2024-04-23T10:00:37.922 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T10:00:37.923 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532 --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} --owner scheduled_leonidus@teuthology --name leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/orig.config.yaml 2024-04-23T10:00:37.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T10:00:38.086 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7669532' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 0a6c3ed699031b80a2b419e7e795368719871394 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5306 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 0a6c3ed699031b80a2b419e7e795368719871394 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBVXvk0wOeJgo4W4qz/0vkgCBzJgq3SlEJ0ExMdq2R5RFNpo7MLyqwYwdI/5t+73SoaKg3N89JYeEki6JUeeaEs= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGJtxDAC1oOVCj5xK2ks4wuHT3ivmQ3faggc0MWbjeb/OvE5tEygihj3W9BUs93wZJpyHD3E+tnZ5lRVknpryhs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_09:49:14 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T10:00:38.086 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa; will attempt to use it 2024-04-23T10:00:38.087 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa/tasks 2024-04-23T10:00:38.087 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T10:00:38.089 INFO:teuthology.task.internal:Checking packages... 2024-04-23T10:00:38.118 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-23T10:00:38.118 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T10:00:38.118 INFO:teuthology.packaging:ref: None 2024-04-23T10:00:38.119 INFO:teuthology.packaging:tag: None 2024-04-23T10:00:38.119 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-23T10:00:38.119 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:00:38.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiescer 2024-04-23T10:00:38.287 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:00:38.288 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T10:00:38.298 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T10:00:38.298 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T10:00:38.320 INFO:teuthology.task.internal:Saving configuration 2024-04-23T10:00:38.338 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T10:00:38.348 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T10:00:38.371 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 09:51:19.760342', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG3OrdcLL9udTlJ3J1WwKG6auLofk2cw89GFHM8rO8BU'} 2024-04-23T10:00:38.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 09:51:19.759076', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCQPl+QPzr+q/SQ5quuslC3Lq1bn07TG2LRdsaqpiCJ'} 2024-04-23T10:00:38.389 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T10:00:38.399 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-23T10:00:38.400 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-23T10:00:38.400 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T10:00:38.487 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc678de20d0>, signals=[15]) 2024-04-23T10:00:38.488 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T10:00:38.495 INFO:teuthology.task.internal:Opening connections... 2024-04-23T10:00:38.495 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:00:38.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:00:38.598 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:00:38.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:00:38.696 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T10:00:38.705 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-23T10:00:38.710 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-23T10:00:38.710 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu" 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04" 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-23T10:00:38.756 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-23T10:00:38.757 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy 2024-04-23T10:00:38.757 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-23T10:00:38.777 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-04-23T10:00:38.782 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-04-23T10:00:38.783 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-04-23T10:00:38.829 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-23T10:00:38.829 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-23T10:00:38.830 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2024-04-23T10:00:38.831 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-23T10:00:38.852 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T10:00:38.865 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T10:00:38.888 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T10:00:38.888 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-04-23T10:00:38.891 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-04-23T10:00:38.898 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T10:00:38.907 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T10:00:38.908 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-04-23T10:00:38.938 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-04-23T10:00:38.959 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T10:00:39.019 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T10:00:39.042 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-23T10:00:39.042 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-23T10:00:39.043 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T10:00:39.043 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T10:00:39.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:00:39.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:00:39.055 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-23T10:00:39.055 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-23T10:00:39.106 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-56-generic 2024-04-23T10:00:39.107 INFO:teuthology.orchestra.run.smithi029.stdout:5.15.0-56-generic 2024-04-23T10:00:39.107 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.15.0-56-generic 2024-04-23T10:00:39.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-04-23T10:00:39.107 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.15.0-56-generic 2024-04-23T10:00:39.107 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get clean 2024-04-23T10:00:39.231 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-23T10:00:39.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-23T10:00:39.430 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T10:00:39.444 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-23T10:00:39.527 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-23T10:00:39.534 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-23T10:00:39.564 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T10:00:39.565 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-23T10:00:39.619 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-23T10:00:39.732 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,608 kB] 2024-04-23T10:00:39.845 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-23T10:00:39.853 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-23T10:00:39.861 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-23T10:00:39.862 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,826 kB] 2024-04-23T10:00:39.916 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-23T10:00:39.917 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [310 kB] 2024-04-23T10:00:39.921 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T10:00:39.922 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-23T10:00:39.934 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-23T10:00:39.943 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-23T10:00:39.947 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-23T10:00:39.956 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-23T10:00:39.957 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-23T10:00:39.958 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-23T10:00:39.958 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-23T10:00:39.973 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-23T10:00:39.979 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,388 kB] 2024-04-23T10:00:40.000 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-23T10:00:40.001 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-23T10:00:40.003 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-23T10:00:40.003 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-23T10:00:40.003 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-23T10:00:40.003 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-23T10:00:40.003 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-23T10:00:40.011 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-23T10:00:40.011 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-23T10:00:40.117 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,608 kB] 2024-04-23T10:00:40.242 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,388 kB] 2024-04-23T10:00:40.410 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-23T10:00:40.422 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-23T10:00:40.423 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-23T10:00:40.423 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-23T10:00:40.425 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,762 kB] 2024-04-23T10:00:40.428 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-23T10:00:40.446 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-23T10:00:40.455 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-23T10:00:40.456 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-23T10:00:40.457 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,762 kB] 2024-04-23T10:00:40.463 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-23T10:00:40.476 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-23T10:00:40.477 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,826 kB] 2024-04-23T10:00:40.507 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-23T10:00:40.516 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T10:00:40.517 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-23T10:00:40.531 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-23T10:00:40.539 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-23T10:00:40.540 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [310 kB] 2024-04-23T10:00:40.548 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T10:00:40.550 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-23T10:00:40.582 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T10:00:40.582 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-23T10:00:40.593 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-23T10:00:40.712 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-23T10:00:40.714 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-23T10:00:40.772 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-23T10:00:41.124 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-23T10:00:41.130 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-23T10:00:41.130 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-23T10:00:41.144 INFO:teuthology.orchestra.run.smithi029.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-23T10:00:41.148 INFO:teuthology.orchestra.run.smithi029.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-23T10:00:41.181 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-23T10:00:41.187 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-23T10:00:41.201 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-23T10:00:41.201 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-23T10:00:41.204 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-23T10:00:41.298 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-23T10:00:41.409 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-23T10:00:41.430 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-23T10:00:41.430 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-23T10:00:41.435 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-23T10:00:41.435 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-23T10:00:41.435 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-23T10:00:41.435 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-23T10:00:41.439 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-23T10:00:41.443 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-23T10:00:41.608 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-23T10:00:41.690 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-23T10:00:41.775 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-23T10:00:41.856 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-23T10:00:41.893 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-23T10:00:46.218 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 13.2 MB in 2s (6,482 kB/s) 2024-04-23T10:00:46.255 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 13.2 MB in 3s (5,189 kB/s) 2024-04-23T10:00:48.491 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-23T10:00:48.504 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-23T10:00:48.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T10:00:48.523 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T10:00:48.570 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-23T10:00:48.579 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-23T10:00:48.752 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-23T10:00:48.752 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-23T10:00:48.783 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-23T10:00:48.785 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-23T10:00:48.907 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:00:48.907 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:00:48.907 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:00:48.908 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:00:48.908 INFO:teuthology.orchestra.run.smithi072.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-23T10:00:48.908 INFO:teuthology.orchestra.run.smithi072.stdout: python2.7-minimal 2024-04-23T10:00:48.908 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:00:48.909 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-04-23T10:00:48.909 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T10:00:48.909 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-23T10:00:48.910 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-23T10:00:48.911 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-04-23T10:00:48.911 INFO:teuthology.orchestra.run.smithi072.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-23T10:00:48.911 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-04-23T10:00:48.911 INFO:teuthology.orchestra.run.smithi072.stdout: thermald 2024-04-23T10:00:48.963 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-04-23T10:00:48.963 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T10:00:48.963 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-23T10:00:48.964 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-23T10:00:48.964 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:00:48.964 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:00:48.964 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:00:48.965 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-04-23T10:00:48.965 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:00:48.965 INFO:teuthology.orchestra.run.smithi029.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-23T10:00:48.965 INFO:teuthology.orchestra.run.smithi029.stdout: python2.7-minimal 2024-04-23T10:00:48.965 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:00:48.966 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-23T10:00:48.966 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-04-23T10:00:48.966 INFO:teuthology.orchestra.run.smithi029.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T10:00:48.966 INFO:teuthology.orchestra.run.smithi029.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-23T10:00:48.967 INFO:teuthology.orchestra.run.smithi029.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-23T10:00:48.968 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-04-23T10:00:48.968 INFO:teuthology.orchestra.run.smithi029.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-23T10:00:48.968 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2024-04-23T10:00:48.968 INFO:teuthology.orchestra.run.smithi029.stdout: thermald 2024-04-23T10:00:49.022 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-04-23T10:00:49.022 INFO:teuthology.orchestra.run.smithi029.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T10:00:49.022 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-23T10:00:49.022 INFO:teuthology.orchestra.run.smithi029.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-23T10:00:49.023 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2024-04-23T10:00:49.024 INFO:teuthology.orchestra.run.smithi029.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-23T10:00:49.096 INFO:teuthology.orchestra.run.smithi029.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T10:00:49.096 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 113 MB of archives. 2024-04-23T10:00:49.097 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-23T10:00:49.097 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-23T10:00:49.145 INFO:teuthology.orchestra.run.smithi072.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T10:00:49.145 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 113 MB of archives. 2024-04-23T10:00:49.145 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-23T10:00:49.146 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-23T10:00:49.770 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-23T10:00:49.953 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-23T10:00:50.914 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-23T10:00:51.333 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-23T10:00:51.644 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-23T10:00:51.644 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-23T10:00:51.644 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-23T10:00:51.860 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-23T10:00:51.895 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-23T10:00:52.395 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 113 MB in 3s (39.6 MB/s) 2024-04-23T10:00:52.609 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-23T10:00:54.371 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-23T10:00:54.371 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-23T10:00:54.371 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-23T10:00:54.725 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-23T10:00:54.873 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-23T10:00:55.263 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 113 MB in 6s (19.2 MB/s) 2024-04-23T10:00:55.458 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-23T10:00:55.922 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-23T10:00:55.927 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T10:00:56.159 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:00:58.548 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-23T10:00:58.554 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T10:00:58.798 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-23T10:00:58.800 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:00:58.819 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T10:00:58.921 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:00:59.537 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-23T10:00:59.558 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T10:00:59.606 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:01.448 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-23T10:01:01.469 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T10:01:01.691 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:02.239 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-23T10:01:02.259 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T10:01:02.314 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:07.804 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T10:01:07.905 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T10:01:08.301 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T10:01:08.413 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T10:01:08.745 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-23T10:01:08.768 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-23T10:01:08.812 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T10:01:10.571 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T10:01:10.682 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T10:01:11.017 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T10:01:11.122 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T10:01:11.445 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-23T10:01:11.467 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-23T10:01:11.503 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T10:01:16.469 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-23T10:01:16.507 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T10:01:16.552 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:18.768 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-23T10:01:18.801 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T10:01:18.846 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:19.448 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T10:01:19.574 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T10:01:19.971 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T10:01:20.128 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:20.255 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-23T10:01:20.384 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:22.174 INFO:teuthology.orchestra.run.smithi029.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-23T10:01:22.174 INFO:teuthology.orchestra.run.smithi029.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-23T10:01:22.174 INFO:teuthology.orchestra.run.smithi029.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-23T10:01:22.174 INFO:teuthology.orchestra.run.smithi029.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-23T10:01:23.219 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:23.313 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T10:01:23.441 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T10:01:23.819 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T10:01:23.935 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:24.062 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-23T10:01:24.196 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:24.664 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:25.513 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-23T10:01:25.513 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-23T10:01:25.513 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-23T10:01:25.513 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-23T10:01:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:26.110 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-23T10:01:26.236 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-23T10:01:26.397 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:26.456 INFO:teuthology.orchestra.run.smithi029.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-23T10:01:26.456 INFO:teuthology.orchestra.run.smithi029.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-23T10:01:27.054 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:28.466 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-23T10:01:28.575 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-23T10:01:28.677 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T10:01:28.744 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-23T10:01:28.744 INFO:teuthology.orchestra.run.smithi072.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-23T10:01:44.151 INFO:teuthology.orchestra.run.smithi029.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-23T10:01:44.151 INFO:teuthology.orchestra.run.smithi029.stdout:Sourcing file `/etc/default/grub' 2024-04-23T10:01:44.175 INFO:teuthology.orchestra.run.smithi029.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T10:01:44.188 INFO:teuthology.orchestra.run.smithi029.stdout:Generating grub configuration file ... 2024-04-23T10:01:44.537 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T10:01:44.572 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T10:01:44.852 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T10:01:44.857 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T10:01:44.944 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T10:01:44.949 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T10:01:45.245 INFO:teuthology.orchestra.run.smithi029.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T10:01:45.245 INFO:teuthology.orchestra.run.smithi029.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T10:01:45.245 INFO:teuthology.orchestra.run.smithi029.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T10:01:45.343 INFO:teuthology.orchestra.run.smithi029.stdout:done 2024-04-23T10:01:45.482 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-23T10:01:45.482 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub' 2024-04-23T10:01:45.506 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T10:01:45.528 INFO:teuthology.orchestra.run.smithi072.stdout:Generating grub configuration file ... 2024-04-23T10:01:45.852 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T10:01:45.903 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T10:01:45.944 DEBUG:teuthology.orchestra.run.smithi029:> dpkg -s linux-image-generic 2024-04-23T10:01:45.969 INFO:teuthology.orchestra.run.smithi029.stdout:Package: linux-image-generic 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Status: install ok installed 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Priority: optional 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Section: kernel 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Installed-Size: 21 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: amd64 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Source: linux-meta 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Version: 5.15.0.105.102 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T10:01:45.970 INFO:teuthology.orchestra.run.smithi029.stdout:Recommends: thermald 2024-04-23T10:01:45.971 INFO:teuthology.orchestra.run.smithi029.stdout:Description: Generic Linux kernel image 2024-04-23T10:01:45.971 INFO:teuthology.orchestra.run.smithi029.stdout: This package will always depend on the latest generic kernel image 2024-04-23T10:01:45.971 INFO:teuthology.orchestra.run.smithi029.stdout: available. 2024-04-23T10:01:45.971 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-23T10:01:45.971 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-23T10:01:45.971 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-23T10:01:45.971 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-23T10:01:45.971 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-04-23T10:01:45.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get clean 2024-04-23T10:01:46.143 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-23T10:01:46.191 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T10:01:46.196 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T10:01:46.281 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T10:01:46.286 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T10:01:46.394 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T10:01:46.487 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T10:01:46.569 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-23T10:01:46.592 INFO:teuthology.orchestra.run.smithi072.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T10:01:46.592 INFO:teuthology.orchestra.run.smithi072.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T10:01:46.592 INFO:teuthology.orchestra.run.smithi072.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T10:01:46.675 INFO:teuthology.orchestra.run.smithi072.stdout:done 2024-04-23T10:01:46.931 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T10:01:47.141 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 119 kB in 1s (145 kB/s) 2024-04-23T10:01:47.171 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-04-23T10:01:47.205 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-04-23T10:01:47.205 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-04-23T10:01:47.205 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-04-23T10:01:47.205 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 21 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.105.102 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-04-23T10:01:47.206 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-04-23T10:01:47.207 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-23T10:01:47.207 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-23T10:01:47.207 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-23T10:01:47.207 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-23T10:01:47.207 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-04-23T10:01:47.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-04-23T10:01:47.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-23T10:01:47.483 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T10:01:47.487 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T10:01:47.508 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T10:01:47.589 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T10:01:48.121 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-23T10:01:48.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T10:01:48.203 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-23T10:01:48.404 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-23T10:01:48.404 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-23T10:01:48.586 INFO:teuthology.orchestra.run.smithi029.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-23T10:01:48.586 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:01:48.586 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:01:48.586 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:01:48.586 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:01:48.587 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:01:48.587 INFO:teuthology.orchestra.run.smithi029.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:01:48.587 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:01:48.631 INFO:teuthology.orchestra.run.smithi029.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T10:01:48.633 DEBUG:teuthology.orchestra.run.smithi029:> dpkg -s linux-image-generic 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Package: linux-image-generic 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Status: install ok installed 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Priority: optional 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Section: kernel 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Installed-Size: 21 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: amd64 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Source: linux-meta 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Version: 5.15.0.105.102 2024-04-23T10:01:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T10:01:48.651 INFO:teuthology.orchestra.run.smithi029.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T10:01:48.651 INFO:teuthology.orchestra.run.smithi029.stdout:Recommends: thermald 2024-04-23T10:01:48.651 INFO:teuthology.orchestra.run.smithi029.stdout:Description: Generic Linux kernel image 2024-04-23T10:01:48.651 INFO:teuthology.orchestra.run.smithi029.stdout: This package will always depend on the latest generic kernel image 2024-04-23T10:01:48.651 INFO:teuthology.orchestra.run.smithi029.stdout: available. 2024-04-23T10:01:48.651 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-23T10:01:48.700 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.lRoapXnJv3 2024-04-23T10:01:48.701 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lRoapXnJv3 2024-04-23T10:01:48.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.lRoapXnJv3 2024-04-23T10:01:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-23T10:01:48.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T10:01:48.892 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.lRoapXnJv3 is 10KB 2024-04-23T10:01:48.905 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.lRoapXnJv3 2024-04-23T10:01:48.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-23T10:01:48.931 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-23T10:01:48.964 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:01:48.964 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-23T10:01:48.964 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-23T10:01:49.059 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-23T10:01:49.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo update-grub 2024-04-23T10:01:49.134 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-23T10:01:49.135 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-23T10:01:49.313 INFO:teuthology.orchestra.run.smithi072.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-23T10:01:49.313 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:01:49.313 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:01:49.313 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:01:49.314 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:01:49.314 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:01:49.314 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:01:49.314 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:01:49.355 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T10:01:49.357 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 21 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.105.102 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T10:01:49.373 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T10:01:49.374 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-04-23T10:01:49.374 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-04-23T10:01:49.374 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-04-23T10:01:49.374 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-04-23T10:01:49.374 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-23T10:01:49.421 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.w8hVSRfm3W 2024-04-23T10:01:49.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub/grub.cfg /tmp/tmp.w8hVSRfm3W 2024-04-23T10:01:49.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.w8hVSRfm3W 2024-04-23T10:01:49.625 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.w8hVSRfm3W is 10KB 2024-04-23T10:01:49.638 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.w8hVSRfm3W 2024-04-23T10:01:49.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-23T10:01:49.697 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:01:49.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-23T10:01:49.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-23T10:01:49.787 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-23T10:01:49.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo update-grub 2024-04-23T10:01:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub' 2024-04-23T10:01:51.432 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T10:01:51.445 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-04-23T10:01:51.675 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T10:01:51.681 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T10:01:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T10:01:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T10:01:51.955 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub' 2024-04-23T10:01:51.960 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T10:01:51.966 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T10:01:51.980 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T10:01:52.006 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-04-23T10:01:52.082 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T10:01:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T10:01:52.083 INFO:teuthology.orchestra.run.smithi029.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T10:01:52.131 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-04-23T10:01:52.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-04-23T10:01:52.214 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T10:01:52.221 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T10:01:52.456 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T10:01:52.461 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T10:01:52.502 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T10:01:52.511 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T10:01:52.621 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T10:01:52.621 INFO:teuthology.orchestra.run.smithi072.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T10:01:52.621 INFO:teuthology.orchestra.run.smithi072.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T10:01:52.667 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-04-23T10:01:52.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-04-23T10:02:22.172 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-23T10:02:22.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-23T10:02:22.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:02:22.673 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-23T10:02:22.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-23T10:02:22.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:02:40.542 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-23T10:02:41.058 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-23T10:02:49.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-23T10:02:49.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:02:50.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-23T10:02:50.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:02:53.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-23T10:03:05.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-23T10:03:05.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:03:23.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-23T10:03:38.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-23T10:03:38.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:03:38.564 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-23T10:03:49.562 DEBUG:teuthology.orchestra.remote:timed out 2024-04-23T10:03:56.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-23T10:03:56.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:03:56.845 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-23T10:03:57.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-23T10:03:57.506 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-23T10:03:57.506 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-23T10:03:57.553 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-105-generic 2024-04-23T10:03:57.553 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-23T10:03:57.553 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T10:03:57.553 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-23T10:03:58.554 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-23T10:03:58.555 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T10:03:58.655 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-04-23T10:03:58.679 DEBUG:teuthology.parallel:result is None 2024-04-23T10:04:01.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-23T10:04:01.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:04:01.872 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-23T10:04:02.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-23T10:04:02.708 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-23T10:04:02.708 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-23T10:04:02.758 INFO:teuthology.orchestra.run.smithi029.stdout:5.15.0-105-generic 2024-04-23T10:04:02.759 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-23T10:04:02.759 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T10:04:02.759 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-23T10:04:03.760 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-23T10:04:03.760 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T10:04:03.865 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-04-23T10:04:03.890 DEBUG:teuthology.parallel:result is None 2024-04-23T10:04:03.890 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T10:04:03.897 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T10:04:03.897 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T10:04:03.902 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T10:04:03.911 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T10:04:03.921 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T10:04:03.933 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T10:04:03.934 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T10:04:03.949 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T10:04:03.977 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T10:04:03.986 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T10:04:03.987 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T10:04:04.005 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T10:04:04.025 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:04:04.032 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:04:04.046 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:04:04.054 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:04:04.056 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T10:04:04.063 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T10:04:04.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T10:04:04.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T10:04:04.114 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T10:04:04.126 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T10:04:04.127 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T10:04:04.142 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T10:04:04.165 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:04:04.194 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:04:04.240 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:04:04.241 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T10:04:04.307 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:04:04.313 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:04:04.365 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:04:04.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T10:04:04.429 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-04-23T10:04:04.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-04-23T10:04:04.525 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T10:04:04.534 INFO:teuthology.task.internal:Starting timer... 2024-04-23T10:04:04.534 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T10:04:04.548 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T10:04:04.560 DEBUG:teuthology.task.selinux:Excluding smithi029: OS 'ubuntu' does not support SELinux 2024-04-23T10:04:04.561 DEBUG:teuthology.task.selinux:Excluding smithi072: OS 'ubuntu' does not support SELinux 2024-04-23T10:04:04.561 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T10:04:04.561 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-23T10:04:04.561 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T10:04:04.561 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T10:04:04.575 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-23T10:04:04.583 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-23T10:04:04.833 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T10:04:04.872 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T10:04:04.873 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi072.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T10:11:29.861 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com')] 2024-04-23T10:11:29.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-23T10:11:29.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:11:29.944 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-23T10:11:30.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-23T10:11:30.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-23T10:11:30.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:11:30.103 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-23T10:11:30.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-23T10:11:30.178 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T10:11:30.187 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T10:11:30.188 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T10:11:30.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:11:30.191 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T10:11:30.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:11:30.219 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-23T10:11:30.219 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Command line: ntpd -gq 2024-04-23T10:11:30.219 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: ---------------------------------------------------- 2024-04-23T10:11:30.220 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: ntp-4 is maintained by Network Time Foundation, 2024-04-23T10:11:30.220 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-23T10:11:30.220 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: corporation. Support and training for ntp-4 are 2024-04-23T10:11:30.220 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: available at https://www.nwtime.org/support 2024-04-23T10:11:30.220 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: ---------------------------------------------------- 2024-04-23T10:11:30.220 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: proto: precision = 0.063 usec (-24) 2024-04-23T10:11:30.220 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: basedate set to 2022-02-04 2024-04-23T10:11:30.221 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: gps base set to 2022-02-06 (week 2196) 2024-04-23T10:11:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T10:11:30.221 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T10:11:30.221 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: restrict ::: KOD does nothing without LIMITED. 2024-04-23T10:11:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-23T10:11:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Listen and drop on 0 v6wildcard [::]:123 2024-04-23T10:11:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-23T10:11:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Listen normally on 2 lo 127.0.0.1:123 2024-04-23T10:11:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Listen normally on 3 ens1f0 172.21.15.29:123 2024-04-23T10:11:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Listen normally on 4 lo [::1]:123 2024-04-23T10:11:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:125a%4]:123 2024-04-23T10:11:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:30 ntpd[17160]: Listening on routing socket on fd #22 for interface updates 2024-04-23T10:11:30.248 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-23T10:11:30.248 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Command line: ntpd -gq 2024-04-23T10:11:30.248 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: ---------------------------------------------------- 2024-04-23T10:11:30.248 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: ntp-4 is maintained by Network Time Foundation, 2024-04-23T10:11:30.248 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-23T10:11:30.248 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: corporation. Support and training for ntp-4 are 2024-04-23T10:11:30.248 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: available at https://www.nwtime.org/support 2024-04-23T10:11:30.248 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: ---------------------------------------------------- 2024-04-23T10:11:30.249 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: proto: precision = 0.067 usec (-24) 2024-04-23T10:11:30.249 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: basedate set to 2022-02-04 2024-04-23T10:11:30.249 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: gps base set to 2022-02-06 (week 2196) 2024-04-23T10:11:30.249 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T10:11:30.249 INFO:teuthology.orchestra.run.smithi072.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T10:11:30.249 INFO:teuthology.orchestra.run.smithi072.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-23T10:11:30.250 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: restrict ::: KOD does nothing without LIMITED. 2024-04-23T10:11:30.251 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Listen and drop on 0 v6wildcard [::]:123 2024-04-23T10:11:30.251 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-23T10:11:30.251 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Listen normally on 2 lo 127.0.0.1:123 2024-04-23T10:11:30.251 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Listen normally on 3 enp3s0f1 172.21.15.72:123 2024-04-23T10:11:30.251 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Listen normally on 4 lo [::1]:123 2024-04-23T10:11:30.251 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:b765%5]:123 2024-04-23T10:11:30.251 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:30 ntpd[17290]: Listening on routing socket on fd #22 for interface updates 2024-04-23T10:11:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:31 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:32.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:32 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:32.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:32 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:32.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:32 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:32.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:32 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:32.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:32 ntpd[17160]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:32.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:32 ntpd[17160]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:32 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:32 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:32 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:32 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:32 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:32 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:33 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:34.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:34 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:34.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:34 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:34.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:34 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:34.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:34 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:34.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:34 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:34.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:34 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:34.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:34 ntpd[17160]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:34.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:34 ntpd[17160]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:34.248 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:34 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:34.248 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:34 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:34 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:34 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:34 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:34.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:34 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:35.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:35.222 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:35 ntpd[17160]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:35 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:36 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:36 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:36 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:36 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:36 ntpd[17160]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:36.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:36 ntpd[17160]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:36 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:36 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:36.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:36 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:36.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:36 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:36.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:36 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:36.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:36 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:37 ntpd[17160]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:37.248 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stdout:23 Apr 10:11:37 ntpd[17290]: ntpd: time slew -0.001026 s 2024-04-23T10:11:37.249 INFO:teuthology.orchestra.run.smithi072.stdout:ntpd: time slew -0.001026s 2024-04-23T10:11:37.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-23T10:11:37.250 INFO:teuthology.orchestra.run.smithi072.stderr:23 Apr 10:11:37 ntpd[17290]: can't open /var/log/ntpstats/loopstats.20240423: Permission denied 2024-04-23T10:11:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T10:11:37.296 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-04-23T10:11:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:11:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:11:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:11:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:11:38.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:38 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:38.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:38 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:38.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:38 ntpd[17160]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:11:38.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:38 ntpd[17160]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:11:38.220 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:38 ntpd[17160]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:11:38.221 INFO:teuthology.orchestra.run.smithi029.stdout:23 Apr 10:11:38 ntpd[17160]: ntpd: time slew -0.000520 s 2024-04-23T10:11:38.221 INFO:teuthology.orchestra.run.smithi029.stdout:ntpd: time slew -0.000520s 2024-04-23T10:11:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:38 ntpd[17160]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:11:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:38 ntpd[17160]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-23T10:11:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:23 Apr 10:11:38 ntpd[17160]: can't open /var/log/ntpstats/loopstats.20240423: Permission denied 2024-04-23T10:11:38.284 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T10:11:38.285 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2024-04-23T10:11:38.285 INFO:teuthology.orchestra.run.smithi029.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:11:38.285 INFO:teuthology.orchestra.run.smithi029.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:11:38.285 INFO:teuthology.orchestra.run.smithi029.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:11:38.285 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:11:38.286 INFO:teuthology.run_tasks:Running task install... 2024-04-23T10:11:38.295 DEBUG:teuthology.task.install:project ceph 2024-04-23T10:11:38.295 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-23T10:11:38.295 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-23T10:11:38.295 INFO:teuthology.task.install:Using flavor: default 2024-04-23T10:11:38.303 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T10:11:38.303 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-23T10:11:38.303 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-key list | grep Ceph 2024-04-23T10:11:38.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-key list | grep Ceph 2024-04-23T10:11:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-23T10:11:38.396 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-23T10:11:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-23T10:11:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph.com (release key) 2024-04-23T10:11:38.398 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-23T10:11:38.398 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-23T10:11:38.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:11:38.425 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-23T10:11:38.425 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph.com (release key) 2024-04-23T10:11:38.426 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-23T10:11:38.426 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-23T10:11:38.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:11:38.614 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-23T10:11:38.614 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:11:38.636 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-23T10:11:38.636 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:11:38.744 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:11:38.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-23T10:11:38.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-23T10:11:38.779 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:11:38.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-23T10:11:38.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-23T10:11:38.931 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T10:11:38.932 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T10:11:38.944 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T10:11:38.963 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T10:11:38.982 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-23T10:11:39.004 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-23T10:11:39.026 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-23T10:11:39.047 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-23T10:11:39.074 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-23T10:11:39.075 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-23T10:11:39.089 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T10:11:39.089 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T10:11:39.110 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-23T10:11:39.147 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-23T10:11:39.162 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T10:11:39.183 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-23T10:11:39.227 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-23T10:11:39.245 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T10:11:39.300 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 29.3 kB in 0s (80.7 kB/s) 2024-04-23T10:11:39.462 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 29.3 kB in 0s (59.7 kB/s) 2024-04-23T10:11:40.282 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-23T10:11:40.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:11:40.352 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-23T10:11:40.477 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-23T10:11:40.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:11:40.533 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-23T10:11:40.534 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-23T10:11:40.550 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-23T10:11:40.716 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:11:40.716 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:11:40.716 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:11:40.716 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:11:40.716 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:11:40.717 INFO:teuthology.orchestra.run.smithi029.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:11:40.717 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:11:40.718 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-04-23T10:11:40.718 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-23T10:11:40.718 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-23T10:11:40.718 INFO:teuthology.orchestra.run.smithi029.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T10:11:40.718 INFO:teuthology.orchestra.run.smithi029.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-23T10:11:40.719 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-23T10:11:40.719 INFO:teuthology.orchestra.run.smithi029.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-23T10:11:40.719 INFO:teuthology.orchestra.run.smithi029.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-23T10:11:40.719 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-23T10:11:40.719 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-23T10:11:40.719 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-23T10:11:40.719 INFO:teuthology.orchestra.run.smithi029.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-23T10:11:40.720 INFO:teuthology.orchestra.run.smithi029.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-23T10:11:40.721 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-04-23T10:11:40.721 INFO:teuthology.orchestra.run.smithi029.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-23T10:11:40.721 INFO:teuthology.orchestra.run.smithi029.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-23T10:11:40.721 INFO:teuthology.orchestra.run.smithi029.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-23T10:11:40.721 INFO:teuthology.orchestra.run.smithi029.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-23T10:11:40.721 INFO:teuthology.orchestra.run.smithi029.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-23T10:11:40.721 INFO:teuthology.orchestra.run.smithi029.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-23T10:11:40.721 INFO:teuthology.orchestra.run.smithi029.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-23T10:11:40.722 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2024-04-23T10:11:40.722 INFO:teuthology.orchestra.run.smithi029.stdout: btrfs-tools 2024-04-23T10:11:40.745 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-23T10:11:40.746 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-23T10:11:40.828 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-04-23T10:11:40.828 INFO:teuthology.orchestra.run.smithi029.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-23T10:11:40.828 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T10:11:40.829 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-23T10:11:40.830 INFO:teuthology.orchestra.run.smithi029.stdout: socat unzip xmlstarlet zip 2024-04-23T10:11:40.898 INFO:teuthology.orchestra.run.smithi029.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-23T10:11:40.898 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 182 MB of archives. 2024-04-23T10:11:40.898 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-23T10:11:40.898 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-23T10:11:40.918 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-23T10:11:40.930 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-23T10:11:40.940 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:11:40.941 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:11:40.941 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:11:40.941 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:11:40.941 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:11:40.941 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:11:40.942 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:11:40.942 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-04-23T10:11:40.942 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-23T10:11:40.942 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-23T10:11:40.943 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T10:11:40.943 INFO:teuthology.orchestra.run.smithi072.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-23T10:11:40.944 INFO:teuthology.orchestra.run.smithi072.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-23T10:11:40.945 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-04-23T10:11:40.946 INFO:teuthology.orchestra.run.smithi072.stdout: btrfs-tools 2024-04-23T10:11:40.974 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-23T10:11:40.977 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-23T10:11:41.002 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-23T10:11:41.005 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-23T10:11:41.019 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-23T10:11:41.050 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-04-23T10:11:41.050 INFO:teuthology.orchestra.run.smithi072.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-23T10:11:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-23T10:11:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-23T10:11:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-23T10:11:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T10:11:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-23T10:11:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-23T10:11:41.051 INFO:teuthology.orchestra.run.smithi072.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-23T10:11:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-23T10:11:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-23T10:11:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-23T10:11:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-23T10:11:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-23T10:11:41.052 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-23T10:11:41.053 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-23T10:11:41.054 INFO:teuthology.orchestra.run.smithi072.stdout: socat unzip xmlstarlet zip 2024-04-23T10:11:41.072 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-23T10:11:41.076 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-23T10:11:41.088 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-23T10:11:41.092 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-23T10:11:41.093 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-23T10:11:41.102 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-23T10:11:41.104 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-23T10:11:41.106 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-23T10:11:41.108 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-23T10:11:41.108 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-23T10:11:41.117 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-23T10:11:41.119 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-23T10:11:41.121 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-23T10:11:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-23T10:11:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 182 MB of archives. 2024-04-23T10:11:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-23T10:11:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-23T10:11:41.137 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-23T10:11:41.137 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-23T10:11:41.139 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-23T10:11:41.139 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-23T10:11:41.139 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-23T10:11:41.139 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-23T10:11:41.140 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-23T10:11:41.143 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-23T10:11:41.157 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-23T10:11:41.157 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-23T10:11:41.158 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-23T10:11:41.160 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-23T10:11:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-23T10:11:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-23T10:11:41.179 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-23T10:11:41.180 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-23T10:11:41.180 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-23T10:11:41.180 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-23T10:11:41.182 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-23T10:11:41.187 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-23T10:11:41.198 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-23T10:11:41.199 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-23T10:11:41.204 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-23T10:11:41.207 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-23T10:11:41.219 INFO:teuthology.orchestra.run.smithi029.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-23T10:11:41.219 INFO:teuthology.orchestra.run.smithi029.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-23T10:11:41.220 INFO:teuthology.orchestra.run.smithi029.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-23T10:11:41.221 INFO:teuthology.orchestra.run.smithi029.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-23T10:11:41.223 INFO:teuthology.orchestra.run.smithi029.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-23T10:11:41.224 INFO:teuthology.orchestra.run.smithi029.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-23T10:11:41.225 INFO:teuthology.orchestra.run.smithi029.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-23T10:11:41.233 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-23T10:11:41.237 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-23T10:11:41.239 INFO:teuthology.orchestra.run.smithi029.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-23T10:11:41.241 INFO:teuthology.orchestra.run.smithi029.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-23T10:11:41.241 INFO:teuthology.orchestra.run.smithi029.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-23T10:11:41.251 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-23T10:11:41.259 INFO:teuthology.orchestra.run.smithi029.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-23T10:11:41.261 INFO:teuthology.orchestra.run.smithi029.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-23T10:11:41.286 INFO:teuthology.orchestra.run.smithi029.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-23T10:11:41.309 INFO:teuthology.orchestra.run.smithi029.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-23T10:11:41.320 INFO:teuthology.orchestra.run.smithi029.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-23T10:11:41.322 INFO:teuthology.orchestra.run.smithi029.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-23T10:11:41.323 INFO:teuthology.orchestra.run.smithi029.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-23T10:11:41.324 INFO:teuthology.orchestra.run.smithi029.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T10:11:41.326 INFO:teuthology.orchestra.run.smithi029.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-23T10:11:41.344 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-23T10:11:41.351 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-23T10:11:41.353 INFO:teuthology.orchestra.run.smithi029.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-23T10:11:41.354 INFO:teuthology.orchestra.run.smithi029.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-23T10:11:41.354 INFO:teuthology.orchestra.run.smithi029.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-23T10:11:41.355 INFO:teuthology.orchestra.run.smithi029.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-23T10:11:41.363 INFO:teuthology.orchestra.run.smithi029.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-23T10:11:41.366 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-23T10:11:41.367 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-23T10:11:41.373 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-23T10:11:41.374 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-23T10:11:41.378 INFO:teuthology.orchestra.run.smithi029.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-23T10:11:41.380 INFO:teuthology.orchestra.run.smithi029.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-23T10:11:41.380 INFO:teuthology.orchestra.run.smithi029.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-23T10:11:41.387 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-23T10:11:41.390 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-23T10:11:41.393 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-23T10:11:41.395 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-23T10:11:41.395 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-23T10:11:41.400 INFO:teuthology.orchestra.run.smithi029.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-23T10:11:41.400 INFO:teuthology.orchestra.run.smithi029.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-23T10:11:41.401 INFO:teuthology.orchestra.run.smithi029.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-23T10:11:41.402 INFO:teuthology.orchestra.run.smithi029.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-23T10:11:41.402 INFO:teuthology.orchestra.run.smithi029.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-23T10:11:41.403 INFO:teuthology.orchestra.run.smithi029.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-23T10:11:41.407 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-23T10:11:41.410 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-23T10:11:41.412 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-23T10:11:41.413 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-23T10:11:41.418 INFO:teuthology.orchestra.run.smithi029.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-23T10:11:41.419 INFO:teuthology.orchestra.run.smithi029.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-23T10:11:41.422 INFO:teuthology.orchestra.run.smithi029.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-23T10:11:41.428 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-23T10:11:41.430 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-23T10:11:41.430 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-23T10:11:41.430 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-23T10:11:41.430 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-23T10:11:41.431 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-23T10:11:41.438 INFO:teuthology.orchestra.run.smithi029.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-23T10:11:41.440 INFO:teuthology.orchestra.run.smithi029.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-23T10:11:41.449 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-23T10:11:41.450 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-23T10:11:41.453 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-23T10:11:41.454 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-23T10:11:41.470 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-23T10:11:41.471 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-23T10:11:41.472 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-23T10:11:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-23T10:11:41.473 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-23T10:11:41.475 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-23T10:11:41.483 INFO:teuthology.orchestra.run.smithi029.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-23T10:11:41.488 INFO:teuthology.orchestra.run.smithi029.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-23T10:11:41.492 INFO:teuthology.orchestra.run.smithi029.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-23T10:11:41.492 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-23T10:11:41.493 INFO:teuthology.orchestra.run.smithi029.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-23T10:11:41.493 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-23T10:11:41.494 INFO:teuthology.orchestra.run.smithi029.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-23T10:11:41.495 INFO:teuthology.orchestra.run.smithi029.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-23T10:11:41.500 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-23T10:11:41.500 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-23T10:11:41.501 INFO:teuthology.orchestra.run.smithi029.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-23T10:11:41.502 INFO:teuthology.orchestra.run.smithi029.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-23T10:11:41.507 INFO:teuthology.orchestra.run.smithi029.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-23T10:11:41.513 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-23T10:11:41.514 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-23T10:11:41.515 INFO:teuthology.orchestra.run.smithi072.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-23T10:11:41.518 INFO:teuthology.orchestra.run.smithi072.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-23T10:11:41.519 INFO:teuthology.orchestra.run.smithi072.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-23T10:11:41.521 INFO:teuthology.orchestra.run.smithi072.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-23T10:11:41.526 INFO:teuthology.orchestra.run.smithi029.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-23T10:11:41.527 INFO:teuthology.orchestra.run.smithi029.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-23T10:11:41.527 INFO:teuthology.orchestra.run.smithi029.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-23T10:11:41.530 INFO:teuthology.orchestra.run.smithi029.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-23T10:11:41.531 INFO:teuthology.orchestra.run.smithi029.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-23T10:11:41.537 INFO:teuthology.orchestra.run.smithi072.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-23T10:11:41.540 INFO:teuthology.orchestra.run.smithi072.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-23T10:11:41.541 INFO:teuthology.orchestra.run.smithi029.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-23T10:11:41.541 INFO:teuthology.orchestra.run.smithi072.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-23T10:11:41.542 INFO:teuthology.orchestra.run.smithi029.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-23T10:11:41.542 INFO:teuthology.orchestra.run.smithi072.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-23T10:11:41.546 INFO:teuthology.orchestra.run.smithi029.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-23T10:11:41.549 INFO:teuthology.orchestra.run.smithi029.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-23T10:11:41.550 INFO:teuthology.orchestra.run.smithi029.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-23T10:11:41.568 INFO:teuthology.orchestra.run.smithi072.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-23T10:11:41.577 INFO:teuthology.orchestra.run.smithi029.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-23T10:11:41.637 INFO:teuthology.orchestra.run.smithi072.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-23T10:11:41.638 INFO:teuthology.orchestra.run.smithi072.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T10:11:41.640 INFO:teuthology.orchestra.run.smithi072.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-23T10:11:41.640 INFO:teuthology.orchestra.run.smithi072.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-23T10:11:41.668 INFO:teuthology.orchestra.run.smithi072.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-23T10:11:41.686 INFO:teuthology.orchestra.run.smithi072.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-23T10:11:41.689 INFO:teuthology.orchestra.run.smithi072.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-23T10:11:41.689 INFO:teuthology.orchestra.run.smithi072.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-23T10:11:41.705 INFO:teuthology.orchestra.run.smithi072.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-23T10:11:41.705 INFO:teuthology.orchestra.run.smithi072.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-23T10:11:41.706 INFO:teuthology.orchestra.run.smithi072.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-23T10:11:41.706 INFO:teuthology.orchestra.run.smithi072.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-23T10:11:41.707 INFO:teuthology.orchestra.run.smithi072.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-23T10:11:41.707 INFO:teuthology.orchestra.run.smithi072.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-23T10:11:41.726 INFO:teuthology.orchestra.run.smithi072.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-23T10:11:41.727 INFO:teuthology.orchestra.run.smithi072.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-23T10:11:41.730 INFO:teuthology.orchestra.run.smithi072.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-23T10:11:41.740 INFO:teuthology.orchestra.run.smithi029.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-23T10:11:41.748 INFO:teuthology.orchestra.run.smithi072.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-23T10:11:41.749 INFO:teuthology.orchestra.run.smithi072.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-23T10:11:41.750 INFO:teuthology.orchestra.run.smithi029.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-23T10:11:41.750 INFO:teuthology.orchestra.run.smithi072.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-23T10:11:41.754 INFO:teuthology.orchestra.run.smithi072.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-23T10:11:41.757 INFO:teuthology.orchestra.run.smithi072.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-23T10:11:41.757 INFO:teuthology.orchestra.run.smithi072.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-23T10:11:41.758 INFO:teuthology.orchestra.run.smithi072.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-23T10:11:41.769 INFO:teuthology.orchestra.run.smithi072.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-23T10:11:41.774 INFO:teuthology.orchestra.run.smithi072.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-23T10:11:41.775 INFO:teuthology.orchestra.run.smithi072.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-23T10:11:41.791 INFO:teuthology.orchestra.run.smithi072.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-23T10:11:41.792 INFO:teuthology.orchestra.run.smithi072.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-23T10:11:41.792 INFO:teuthology.orchestra.run.smithi072.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-23T10:11:41.793 INFO:teuthology.orchestra.run.smithi072.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-23T10:11:41.795 INFO:teuthology.orchestra.run.smithi072.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-23T10:11:41.796 INFO:teuthology.orchestra.run.smithi072.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-23T10:11:41.803 INFO:teuthology.orchestra.run.smithi072.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-23T10:11:41.813 INFO:teuthology.orchestra.run.smithi072.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-23T10:11:41.814 INFO:teuthology.orchestra.run.smithi072.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-23T10:11:41.817 INFO:teuthology.orchestra.run.smithi072.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-23T10:11:41.835 INFO:teuthology.orchestra.run.smithi072.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-23T10:11:42.656 INFO:teuthology.orchestra.run.smithi029.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-23T10:11:42.741 INFO:teuthology.orchestra.run.smithi029.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-23T10:11:42.747 INFO:teuthology.orchestra.run.smithi029.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T10:11:42.751 INFO:teuthology.orchestra.run.smithi029.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-23T10:11:42.808 INFO:teuthology.orchestra.run.smithi029.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-23T10:11:42.906 INFO:teuthology.orchestra.run.smithi072.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-23T10:11:43.032 INFO:teuthology.orchestra.run.smithi029.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-23T10:11:43.955 INFO:teuthology.orchestra.run.smithi029.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-23T10:11:43.955 INFO:teuthology.orchestra.run.smithi029.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-23T10:11:43.973 INFO:teuthology.orchestra.run.smithi029.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-23T10:11:44.007 INFO:teuthology.orchestra.run.smithi072.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-23T10:11:44.016 INFO:teuthology.orchestra.run.smithi029.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-23T10:11:44.027 INFO:teuthology.orchestra.run.smithi029.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-23T10:11:44.029 INFO:teuthology.orchestra.run.smithi029.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-23T10:11:44.090 INFO:teuthology.orchestra.run.smithi029.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-23T10:11:44.276 INFO:teuthology.orchestra.run.smithi072.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-23T10:11:44.403 INFO:teuthology.orchestra.run.smithi029.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-23T10:11:44.404 INFO:teuthology.orchestra.run.smithi029.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-23T10:11:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-23T10:11:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-23T10:11:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-23T10:11:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-23T10:11:44.632 INFO:teuthology.orchestra.run.smithi072.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-23T10:11:46.709 INFO:teuthology.orchestra.run.smithi029.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T10:11:46.712 INFO:teuthology.orchestra.run.smithi029.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-23T10:11:46.717 INFO:teuthology.orchestra.run.smithi029.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-23T10:11:46.718 INFO:teuthology.orchestra.run.smithi029.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-23T10:11:46.718 INFO:teuthology.orchestra.run.smithi029.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-23T10:11:46.719 INFO:teuthology.orchestra.run.smithi029.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-23T10:11:46.774 INFO:teuthology.orchestra.run.smithi072.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-23T10:11:46.788 INFO:teuthology.orchestra.run.smithi072.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-23T10:11:46.960 INFO:teuthology.orchestra.run.smithi072.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-23T10:11:47.090 INFO:teuthology.orchestra.run.smithi029.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-23T10:11:47.812 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 182 MB in 6s (28.7 MB/s) 2024-04-23T10:11:47.955 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-23T10:11:48.057 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-23T10:11:48.062 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-23T10:11:48.103 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-23T10:11:48.540 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-23T10:11:48.567 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-23T10:11:48.618 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T10:11:48.956 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cmd2. 2024-04-23T10:11:48.983 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-23T10:11:49.023 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-23T10:11:49.388 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-23T10:11:49.415 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-23T10:11:49.497 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T10:11:49.872 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-23T10:11:49.898 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-23T10:11:49.947 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T10:11:50.295 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-23T10:11:50.322 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-23T10:11:50.362 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T10:11:50.851 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-23T10:11:50.878 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:11:50.927 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:11:51.239 INFO:teuthology.orchestra.run.smithi072.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-23T10:11:51.392 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-23T10:11:51.420 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:11:51.467 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:11:51.850 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-23T10:11:51.876 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:11:51.881 INFO:teuthology.orchestra.run.smithi072.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-23T10:11:51.916 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:11:51.917 INFO:teuthology.orchestra.run.smithi072.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T10:11:51.944 INFO:teuthology.orchestra.run.smithi072.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-23T10:11:52.145 INFO:teuthology.orchestra.run.smithi072.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-23T10:11:52.288 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-23T10:11:52.315 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-23T10:11:52.355 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T10:11:52.703 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librados2. 2024-04-23T10:11:52.730 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:11:52.770 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:11:52.989 INFO:teuthology.orchestra.run.smithi072.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-23T10:11:53.318 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librbd1. 2024-04-23T10:11:53.345 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:11:53.385 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:11:54.024 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs2. 2024-04-23T10:11:54.050 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:11:54.099 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:11:54.421 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rados. 2024-04-23T10:11:54.448 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:11:54.488 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:11:54.835 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-23T10:11:54.861 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:11:54.901 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:11:55.185 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cephfs. 2024-04-23T10:11:55.209 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:11:55.258 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:11:55.606 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-23T10:11:55.632 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:11:55.672 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:11:55.995 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-prettytable. 2024-04-23T10:11:56.021 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-23T10:11:56.061 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-23T10:11:56.368 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rbd. 2024-04-23T10:11:56.394 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:11:56.434 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:11:56.814 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-23T10:11:56.841 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-23T10:11:56.891 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T10:11:56.903 INFO:teuthology.orchestra.run.smithi072.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-23T10:11:56.904 INFO:teuthology.orchestra.run.smithi072.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-23T10:11:56.988 INFO:teuthology.orchestra.run.smithi072.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-23T10:11:57.204 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-23T10:11:57.220 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-23T10:11:57.254 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T10:11:57.381 INFO:teuthology.orchestra.run.smithi072.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-23T10:11:57.464 INFO:teuthology.orchestra.run.smithi072.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-23T10:11:57.487 INFO:teuthology.orchestra.run.smithi072.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-23T10:11:57.611 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-23T10:11:57.638 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-23T10:11:57.678 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T10:11:57.714 INFO:teuthology.orchestra.run.smithi072.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-23T10:11:58.025 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package lua5.1. 2024-04-23T10:11:58.052 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-23T10:11:58.092 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-23T10:11:58.399 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package lua-any. 2024-04-23T10:11:58.415 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-23T10:11:58.449 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-23T10:11:58.565 INFO:teuthology.orchestra.run.smithi072.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-23T10:11:58.566 INFO:teuthology.orchestra.run.smithi072.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-23T10:11:59.073 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package zip. 2024-04-23T10:11:59.099 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-23T10:11:59.148 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking zip (3.0-12build2) ... 2024-04-23T10:11:59.462 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package unzip. 2024-04-23T10:11:59.488 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-23T10:11:59.529 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-23T10:11:59.937 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package luarocks. 2024-04-23T10:11:59.963 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-23T10:12:00.012 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-23T10:12:00.371 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librgw2. 2024-04-23T10:12:00.398 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:00.437 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:01.209 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rgw. 2024-04-23T10:12:01.235 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:01.285 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:01.641 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-23T10:12:01.667 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-23T10:12:01.707 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T10:12:02.039 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libradosstriper1. 2024-04-23T10:12:02.066 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:02.106 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:02.537 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-common. 2024-04-23T10:12:02.563 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:02.605 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:03.999 INFO:teuthology.orchestra.run.smithi072.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T10:12:04.001 INFO:teuthology.orchestra.run.smithi072.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-23T10:12:04.006 INFO:teuthology.orchestra.run.smithi072.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-23T10:12:04.007 INFO:teuthology.orchestra.run.smithi072.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-23T10:12:04.007 INFO:teuthology.orchestra.run.smithi072.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-23T10:12:04.008 INFO:teuthology.orchestra.run.smithi072.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-23T10:12:04.541 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-base. 2024-04-23T10:12:04.568 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:04.616 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:05.239 INFO:teuthology.orchestra.run.smithi072.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-23T10:12:05.334 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-23T10:12:05.361 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-23T10:12:05.400 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-23T10:12:05.697 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cheroot. 2024-04-23T10:12:05.724 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-23T10:12:05.764 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T10:12:05.849 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 182 MB in 24s (7,509 kB/s) 2024-04-23T10:12:05.995 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-23T10:12:06.084 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-23T10:12:06.087 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-23T10:12:06.089 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-23T10:12:06.114 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-23T10:12:06.127 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-23T10:12:06.154 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-23T10:12:06.423 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-23T10:12:06.450 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-23T10:12:06.452 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-23T10:12:06.479 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-23T10:12:06.490 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T10:12:06.519 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-23T10:12:06.813 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cmd2. 2024-04-23T10:12:06.824 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-23T10:12:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-23T10:12:06.851 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-23T10:12:06.880 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-23T10:12:06.891 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-23T10:12:07.156 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-tempora. 2024-04-23T10:12:07.183 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-23T10:12:07.228 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-23T10:12:07.231 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-23T10:12:07.255 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-23T10:12:07.338 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T10:12:07.528 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-portend. 2024-04-23T10:12:07.555 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-23T10:12:07.595 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-23T10:12:07.693 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-23T10:12:07.717 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-23T10:12:07.762 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T10:12:07.885 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-23T10:12:07.911 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-23T10:12:07.951 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-23T10:12:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-23T10:12:08.119 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-23T10:12:08.159 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T10:12:08.250 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-23T10:12:08.276 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-23T10:12:08.325 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-23T10:12:08.608 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-23T10:12:08.629 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:12:08.639 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-natsort. 2024-04-23T10:12:08.666 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-23T10:12:08.675 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:12:08.706 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-23T10:12:08.997 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-logutils. 2024-04-23T10:12:09.023 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-23T10:12:09.063 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-23T10:12:09.099 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-23T10:12:09.126 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:12:09.166 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:12:09.412 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-23T10:12:09.439 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-23T10:12:09.478 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-23T10:12:09.513 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-23T10:12:09.539 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:12:09.579 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:12:09.775 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-mako. 2024-04-23T10:12:09.802 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-23T10:12:09.842 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T10:12:09.911 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-23T10:12:09.938 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-23T10:12:09.978 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T10:12:10.174 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-23T10:12:10.201 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-23T10:12:10.249 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-23T10:12:10.310 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librados2. 2024-04-23T10:12:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:10.377 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:10.556 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-23T10:12:10.583 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-23T10:12:10.623 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-23T10:12:10.911 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webob. 2024-04-23T10:12:10.938 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-23T10:12:10.978 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-23T10:12:11.098 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librbd1. 2024-04-23T10:12:11.124 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:11.165 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:11.368 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-waitress. 2024-04-23T10:12:11.395 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-23T10:12:11.497 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T10:12:11.688 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs2. 2024-04-23T10:12:11.715 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:11.755 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:11.825 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-tempita. 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-23T10:12:11.892 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T10:12:12.026 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rados. 2024-04-23T10:12:12.041 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:12.197 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-paste. 2024-04-23T10:12:12.224 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-23T10:12:12.264 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T10:12:12.416 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-23T10:12:12.442 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:12.491 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:12.596 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-23T10:12:12.612 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-23T10:12:12.654 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T10:12:12.728 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cephfs. 2024-04-23T10:12:12.744 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:12.788 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:12.952 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-23T10:12:12.980 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-23T10:12:13.027 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-23T10:12:13.325 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webtest. 2024-04-23T10:12:13.352 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-23T10:12:13.391 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-23T10:12:13.607 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-23T10:12:13.634 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:13.706 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pecan. 2024-04-23T10:12:13.734 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-23T10:12:13.781 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T10:12:14.158 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-certifi. 2024-04-23T10:12:14.185 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-23T10:12:14.225 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-23T10:12:14.570 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:14.851 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-prettytable. 2024-04-23T10:12:14.877 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-23T10:12:14.918 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-23T10:12:15.173 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rbd. 2024-04-23T10:12:15.188 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:15.231 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:15.588 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-23T10:12:15.614 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-23T10:12:15.655 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T10:12:16.024 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-idna. 2024-04-23T10:12:16.051 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-23T10:12:16.099 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-23T10:12:16.111 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-23T10:12:16.137 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-23T10:12:16.178 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T10:12:16.429 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-urllib3. 2024-04-23T10:12:16.456 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-23T10:12:16.474 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-23T10:12:16.496 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T10:12:16.501 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-23T10:12:16.541 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T10:12:16.811 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-requests. 2024-04-23T10:12:16.838 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-23T10:12:16.840 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua5.1. 2024-04-23T10:12:16.867 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-23T10:12:16.878 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T10:12:16.907 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-23T10:12:17.185 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-23T10:12:17.212 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-23T10:12:17.222 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-any. 2024-04-23T10:12:17.237 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-23T10:12:17.259 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T10:12:17.281 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-23T10:12:17.535 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package zip. 2024-04-23T10:12:17.551 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-23T10:12:17.565 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-23T10:12:17.581 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:17.594 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking zip (3.0-12build2) ... 2024-04-23T10:12:17.623 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:17.918 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package unzip. 2024-04-23T10:12:17.944 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-23T10:12:18.001 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-23T10:12:18.009 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-23T10:12:18.036 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:18.084 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:18.376 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package luarocks. 2024-04-23T10:12:18.399 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-23T10:12:18.403 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-23T10:12:18.426 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-23T10:12:18.443 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-23T10:12:18.465 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-23T10:12:18.762 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-openssl. 2024-04-23T10:12:18.789 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-23T10:12:18.809 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librgw2. 2024-04-23T10:12:18.831 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-23T10:12:18.835 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:18.877 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:19.219 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr. 2024-04-23T10:12:19.246 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:19.286 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:19.565 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rgw. 2024-04-23T10:12:19.591 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:19.631 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:19.963 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-23T10:12:19.989 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-23T10:12:20.030 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T10:12:20.093 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mon. 2024-04-23T10:12:20.120 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:20.168 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:20.327 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libradosstriper1. 2024-04-23T10:12:20.353 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:20.394 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:20.818 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-common. 2024-04-23T10:12:20.844 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:20.884 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:20.918 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-osd. 2024-04-23T10:12:20.945 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:20.984 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:22.315 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph. 2024-04-23T10:12:22.331 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:22.374 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:22.696 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-fuse. 2024-04-23T10:12:22.723 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:22.729 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-base. 2024-04-23T10:12:22.755 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:22.771 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:22.805 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:23.170 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mds. 2024-04-23T10:12:23.197 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:23.237 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:23.463 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-23T10:12:23.489 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-23T10:12:23.530 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-23T10:12:23.683 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephadm. 2024-04-23T10:12:23.710 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:23.750 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:23.828 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cheroot. 2024-04-23T10:12:23.854 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-23T10:12:23.895 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T10:12:24.090 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-23T10:12:24.117 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-23T10:12:24.165 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-23T10:12:24.209 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-23T10:12:24.235 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-23T10:12:24.276 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-23T10:12:24.503 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-23T10:12:24.530 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T10:12:24.570 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T10:12:24.607 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-23T10:12:24.633 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-23T10:12:24.674 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-23T10:12:24.947 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-23T10:12:24.973 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-23T10:12:25.014 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-23T10:12:25.311 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempora. 2024-04-23T10:12:25.337 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-23T10:12:25.378 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-23T10:12:25.676 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-portend. 2024-04-23T10:12:25.702 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-23T10:12:25.743 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-23T10:12:25.780 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-babel. 2024-04-23T10:12:25.808 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T10:12:25.855 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T10:12:26.024 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-23T10:12:26.051 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-23T10:12:26.091 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-23T10:12:26.195 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jinja2. 2024-04-23T10:12:26.223 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-23T10:12:26.262 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T10:12:26.388 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-23T10:12:26.414 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-23T10:12:26.455 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-23T10:12:26.627 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-23T10:12:26.655 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:26.694 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:26.796 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-natsort. 2024-04-23T10:12:26.822 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-23T10:12:26.862 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-23T10:12:27.075 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-23T10:12:27.103 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-23T10:12:27.151 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-23T10:12:27.170 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-logutils. 2024-04-23T10:12:27.196 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-23T10:12:27.236 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-23T10:12:27.432 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-routes. 2024-04-23T10:12:27.459 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-23T10:12:27.498 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T10:12:27.716 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-23T10:12:27.743 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-23T10:12:27.783 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-23T10:12:27.830 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-23T10:12:27.858 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:27.897 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:28.090 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-mako. 2024-04-23T10:12:28.105 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-23T10:12:28.148 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T10:12:28.481 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-23T10:12:28.507 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-23T10:12:28.547 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-23T10:12:28.844 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-23T10:12:28.871 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-23T10:12:28.911 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-23T10:12:29.209 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webob. 2024-04-23T10:12:29.235 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-23T10:12:29.275 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-23T10:12:29.615 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-waitress. 2024-04-23T10:12:29.617 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-23T10:12:29.641 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-23T10:12:29.645 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-23T10:12:29.686 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T10:12:29.691 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T10:12:29.963 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempita. 2024-04-23T10:12:29.989 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-23T10:12:30.030 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T10:12:30.208 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-joblib. 2024-04-23T10:12:30.236 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-23T10:12:30.274 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T10:12:30.337 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-paste. 2024-04-23T10:12:30.362 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-23T10:12:30.403 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T10:12:30.631 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-23T10:12:30.658 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-23T10:12:30.700 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-23T10:12:30.726 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-23T10:12:30.802 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T10:12:30.802 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-23T10:12:31.099 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-23T10:12:31.116 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn. 2024-04-23T10:12:31.125 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-23T10:12:31.144 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-23T10:12:31.165 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-23T10:12:31.184 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T10:12:31.448 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webtest. 2024-04-23T10:12:31.474 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-23T10:12:31.514 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-23T10:12:31.819 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pecan. 2024-04-23T10:12:31.845 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-23T10:12:31.871 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-23T10:12:31.886 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T10:12:31.899 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:31.946 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:32.246 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-certifi. 2024-04-23T10:12:32.272 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-23T10:12:32.313 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-23T10:12:32.786 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-idna. 2024-04-23T10:12:32.813 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-23T10:12:32.853 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-23T10:12:33.126 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-urllib3. 2024-04-23T10:12:33.153 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-23T10:12:33.193 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T10:12:33.368 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cachetools. 2024-04-23T10:12:33.396 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-23T10:12:33.435 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-23T10:12:33.499 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests. 2024-04-23T10:12:33.526 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-23T10:12:33.565 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T10:12:33.725 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-23T10:12:33.752 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-23T10:12:33.791 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-23T10:12:33.872 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-23T10:12:33.899 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-23T10:12:33.947 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T10:12:34.149 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-23T10:12:34.177 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-23T10:12:34.216 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T10:12:34.229 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-23T10:12:34.256 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:34.296 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:34.529 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rsa. 2024-04-23T10:12:34.557 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-23T10:12:34.596 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-23T10:12:34.823 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-23T10:12:34.850 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:34.890 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:35.080 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-google-auth. 2024-04-23T10:12:35.107 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-23T10:12:35.154 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-23T10:12:35.203 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-23T10:12:35.230 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-23T10:12:35.270 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-23T10:12:35.445 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-23T10:12:35.473 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-23T10:12:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T10:12:35.551 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-openssl. 2024-04-23T10:12:35.567 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-23T10:12:35.601 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-23T10:12:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr. 2024-04-23T10:12:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:36.008 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:36.084 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-websocket. 2024-04-23T10:12:36.112 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-23T10:12:36.151 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-23T10:12:36.414 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mon. 2024-04-23T10:12:36.441 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:36.475 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-23T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:36.502 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-23T10:12:36.541 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T10:12:37.191 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-osd. 2024-04-23T10:12:37.217 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:37.255 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:37.278 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-23T10:12:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:37.336 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:37.668 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-23T10:12:37.696 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-23T10:12:37.734 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T10:12:38.100 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-23T10:12:38.127 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T10:12:38.166 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T10:12:38.438 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package jq. 2024-04-23T10:12:38.455 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T10:12:38.496 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-23T10:12:38.554 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph. 2024-04-23T10:12:38.581 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:38.621 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:38.761 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package socat. 2024-04-23T10:12:38.789 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-23T10:12:38.827 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-23T10:12:38.942 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-fuse. 2024-04-23T10:12:38.968 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:39.009 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:39.166 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package xmlstarlet. 2024-04-23T10:12:39.183 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-23T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mds. 2024-04-23T10:12:39.392 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:39.432 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:39.584 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-test. 2024-04-23T10:12:39.612 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:39.659 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:39.881 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephadm. 2024-04-23T10:12:39.907 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:39.947 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:40.252 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-23T10:12:40.279 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-23T10:12:40.319 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-23T10:12:40.617 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-23T10:12:40.644 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T10:12:40.684 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T10:12:41.611 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-babel. 2024-04-23T10:12:41.638 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T10:12:41.677 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T10:12:41.991 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jinja2. 2024-04-23T10:12:42.018 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-23T10:12:42.059 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T10:12:42.407 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-23T10:12:42.433 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:42.481 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:43.081 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-23T10:12:43.108 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-23T10:12:43.156 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-23T10:12:43.285 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-volume. 2024-04-23T10:12:43.313 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:43.352 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:43.452 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-routes. 2024-04-23T10:12:43.479 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-23T10:12:43.520 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T10:12:43.711 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-23T10:12:43.739 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:43.778 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:43.868 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-23T10:12:43.894 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:43.934 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:44.109 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-colorama. 2024-04-23T10:12:44.137 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-23T10:12:44.184 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-23T10:12:44.438 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-shell. 2024-04-23T10:12:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:44.497 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:44.770 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephfs-top. 2024-04-23T10:12:44.787 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:44.828 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:45.074 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-23T10:12:45.091 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:45.134 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:45.456 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-23T10:12:45.473 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-23T10:12:45.514 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T10:12:45.570 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-23T10:12:45.594 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-23T10:12:45.637 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T10:12:45.882 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-23T10:12:45.910 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-23T10:12:45.949 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-23T10:12:46.112 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-joblib. 2024-04-23T10:12:46.138 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-23T10:12:46.186 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T10:12:46.519 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-23T10:12:46.546 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-23T10:12:46.599 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package nvme-cli. 2024-04-23T10:12:46.627 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-23T10:12:46.665 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-23T10:12:46.665 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T10:12:46.955 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn. 2024-04-23T10:12:46.982 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-23T10:12:47.022 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T10:12:47.101 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package pkg-config. 2024-04-23T10:12:47.129 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-23T10:12:47.176 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T10:12:47.458 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-23T10:12:47.486 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-23T10:12:47.524 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-23T10:12:47.625 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-23T10:12:47.652 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:47.691 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:47.988 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-23T10:12:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-23T10:12:48.063 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-23T10:12:48.378 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastescript. 2024-04-23T10:12:48.407 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-23T10:12:48.453 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-23T10:12:48.769 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pluggy. 2024-04-23T10:12:48.797 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-23T10:12:48.836 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-23T10:12:48.982 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cachetools. 2024-04-23T10:12:49.009 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-23T10:12:49.057 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-23T10:12:49.133 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-psutil. 2024-04-23T10:12:49.161 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-23T10:12:49.199 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-23T10:12:49.345 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-23T10:12:49.372 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-23T10:12:49.412 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-23T10:12:49.548 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-py. 2024-04-23T10:12:49.576 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-23T10:12:49.614 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-23T10:12:49.728 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-23T10:12:49.755 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-23T10:12:49.794 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T10:12:49.955 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pygments. 2024-04-23T10:12:49.984 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-23T10:12:50.022 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T10:12:50.135 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rsa. 2024-04-23T10:12:50.162 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-23T10:12:50.210 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-23T10:12:50.488 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-23T10:12:50.516 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-23T10:12:50.525 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-google-auth. 2024-04-23T10:12:50.552 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-23T10:12:50.554 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-23T10:12:50.591 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-23T10:12:50.877 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-toml. 2024-04-23T10:12:50.890 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-23T10:12:50.905 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-23T10:12:50.906 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-23T10:12:50.940 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T10:12:50.952 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-23T10:12:51.239 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-websocket. 2024-04-23T10:12:51.258 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pytest. 2024-04-23T10:12:51.267 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-23T10:12:51.287 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-23T10:12:51.306 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-23T10:12:51.333 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T10:12:51.620 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-23T10:12:51.647 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-23T10:12:51.696 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T10:12:51.748 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplejson. 2024-04-23T10:12:51.777 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-23T10:12:51.823 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-23T10:12:52.088 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-23T10:12:52.105 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-23T10:12:52.146 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-23T10:12:52.308 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-23T10:12:52.325 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:52.366 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:52.688 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-23T10:12:52.715 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-23T10:12:52.755 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T10:12:52.913 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package radosgw. 2024-04-23T10:12:52.942 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:52.988 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:53.053 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-23T10:12:53.081 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T10:12:53.120 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T10:12:53.626 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package jq. 2024-04-23T10:12:53.643 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T10:12:53.676 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-23T10:12:53.923 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package socat. 2024-04-23T10:12:53.951 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-23T10:12:53.990 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-23T10:12:54.027 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package rbd-fuse. 2024-04-23T10:12:54.044 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:54.087 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:54.289 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package xmlstarlet. 2024-04-23T10:12:54.305 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-23T10:12:54.339 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-23T10:12:54.454 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-23T10:12:54.681 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-test. 2024-04-23T10:12:54.697 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:54.731 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T10:12:54.739 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:54.858 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T10:12:55.121 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-23T10:12:55.458 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-23T10:12:55.879 INFO:teuthology.orchestra.run.smithi029.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-23T10:12:55.954 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:56.500 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user cephadm....done 2024-04-23T10:12:56.652 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T10:12:57.146 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-23T10:12:57.415 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-23T10:12:57.577 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-23T10:12:57.829 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-23T10:12:58.015 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-volume. 2024-04-23T10:12:58.040 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:58.073 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:58.097 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T10:12:58.216 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-23T10:12:58.433 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-23T10:12:58.460 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:58.499 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:58.538 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-colorama. 2024-04-23T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-23T10:12:58.879 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-23T10:12:58.908 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-23T10:12:59.118 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-shell. 2024-04-23T10:12:59.146 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:59.169 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-23T10:12:59.185 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:59.423 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-top. 2024-04-23T10:12:59.431 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-23T10:12:59.451 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:12:59.490 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:59.716 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-23T10:12:59.737 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-23T10:12:59.754 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:12:59.795 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:12:59.961 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-23T10:13:00.101 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-23T10:13:00.128 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-23T10:13:00.167 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T10:13:00.215 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-23T10:13:00.458 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-23T10:13:00.510 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-23T10:13:00.537 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-23T10:13:00.577 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-23T10:13:00.719 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:00.944 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package nvme-cli. 2024-04-23T10:13:00.971 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T10:13:01.010 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T10:13:01.108 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T10:13:01.226 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-23T10:13:01.388 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package pkg-config. 2024-04-23T10:13:01.416 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-23T10:13:01.454 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T10:13:01.495 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T10:13:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-23T10:13:01.728 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-23T10:13:01.744 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-23T10:13:01.786 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-23T10:13:02.210 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-23T10:13:02.238 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-23T10:13:02.276 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-23T10:13:02.288 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-23T10:13:02.359 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T10:13:02.551 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-23T10:13:02.581 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastescript. 2024-04-23T10:13:02.609 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-23T10:13:02.648 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-23T10:13:02.912 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T10:13:02.989 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pluggy. 2024-04-23T10:13:03.017 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-23T10:13:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-23T10:13:03.055 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-23T10:13:03.316 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T10:13:03.361 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-psutil. 2024-04-23T10:13:03.389 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-23T10:13:03.437 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-23T10:13:03.594 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-23T10:13:03.767 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-py. 2024-04-23T10:13:03.795 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-23T10:13:03.922 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up zip (3.0-12build2) ... 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T10:13:04.076 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-23T10:13:04.383 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pygments. 2024-04-23T10:13:04.411 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-23T10:13:04.458 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T10:13:04.721 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T10:13:04.884 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-23T10:13:04.912 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-23T10:13:04.958 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-23T10:13:04.981 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T10:13:05.108 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-23T10:13:05.260 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T10:13:05.263 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-toml. 2024-04-23T10:13:05.291 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-23T10:13:05.338 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-23T10:13:05.562 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-23T10:13:05.628 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pytest. 2024-04-23T10:13:05.656 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-23T10:13:05.695 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T10:13:05.949 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-23T10:13:06.028 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplejson. 2024-04-23T10:13:06.056 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-23T10:13:06.094 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-23T10:13:06.201 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T10:13:06.357 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-23T10:13:06.385 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-23T10:13:06.424 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-23T10:13:06.595 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T10:13:06.891 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-23T10:13:07.100 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package radosgw. 2024-04-23T10:13:07.128 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:13:07.166 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:07.227 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T10:13:07.588 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-23T10:13:07.848 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-23T10:13:07.976 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:08.140 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package rbd-fuse. 2024-04-23T10:13:08.168 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:13:08.214 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:08.279 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-idna (3.3-1) ... 2024-04-23T10:13:08.532 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-23T10:13:08.606 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T10:13:08.792 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T10:13:08.911 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T10:13:09.179 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-23T10:13:09.490 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-23T10:13:09.820 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T10:13:09.915 INFO:teuthology.orchestra.run.smithi072.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-23T10:13:09.983 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:10.081 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:13:10.217 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-23T10:13:10.502 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T10:13:10.504 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user cephadm....done 2024-04-23T10:13:10.631 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-23T10:13:10.654 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T10:13:10.757 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T10:13:10.932 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-23T10:13:11.068 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-23T10:13:11.177 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-23T10:13:11.304 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-23T10:13:11.321 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-23T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-23T10:13:11.566 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:13:11.693 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-23T10:13:11.825 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T10:13:11.946 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-23T10:13:11.995 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-23T10:13:12.247 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-23T10:13:12.249 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T10:13:12.518 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-23T10:13:12.611 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-23T10:13:12.778 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-23T10:13:12.873 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-23T10:13:13.030 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-23T10:13:13.125 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-23T10:13:13.298 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T10:13:13.394 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-23T10:13:13.427 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-23T10:13:13.648 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-23T10:13:13.721 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T10:13:13.848 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T10:13:13.901 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-23T10:13:14.150 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-23T10:13:14.161 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-23T10:13:14.430 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:14.453 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-23T10:13:14.692 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T10:13:14.705 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T10:13:14.819 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T10:13:14.832 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-23T10:13:14.945 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-23T10:13:14.959 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T10:13:15.051 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-23T10:13:15.197 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T10:13:15.297 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T10:13:15.326 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-23T10:13:15.424 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T10:13:15.619 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-23T10:13:15.852 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-23T10:13:16.024 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-23T10:13:16.052 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-23T10:13:16.114 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-23T10:13:16.119 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T10:13:16.241 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-23T10:13:16.246 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-23T10:13:16.501 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:13:16.623 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T10:13:16.636 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-23T10:13:16.965 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T10:13:17.012 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T10:13:17.272 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-23T10:13:17.275 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T10:13:17.552 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-23T10:13:17.583 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up zip (3.0-12build2) ... 2024-04-23T10:13:17.710 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T10:13:17.810 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-23T10:13:18.088 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-23T10:13:18.373 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T10:13:18.390 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T10:13:18.636 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-23T10:13:18.642 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T10:13:18.769 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-23T10:13:18.879 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T10:13:19.006 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-23T10:13:19.166 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-23T10:13:19.308 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T10:13:19.535 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-23T10:13:19.673 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T10:13:19.787 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T10:13:19.791 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:19.919 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:20.047 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-23T10:13:20.158 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T10:13:20.377 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:20.444 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-23T10:13:20.506 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:20.650 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-23T10:13:20.738 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T10:13:20.944 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:21.054 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:21.073 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-23T10:13:21.183 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-23T10:13:21.403 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T10:13:21.404 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T10:13:21.437 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:21.715 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-idna (3.3-1) ... 2024-04-23T10:13:21.869 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:21.979 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:22.025 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T10:13:22.105 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:22.234 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:22.361 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T10:13:23.198 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T10:13:23.434 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:13:23.569 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-23T10:13:23.661 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:23.788 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:23.831 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T10:13:23.915 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:23.933 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-23T10:13:24.041 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T10:13:24.170 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:24.288 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:24.362 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-23T10:13:24.616 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-23T10:13:24.837 INFO:teuthology.orchestra.run.smithi029.stdout:Adding group ceph....done 2024-04-23T10:13:24.860 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:13:24.987 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-23T10:13:25.266 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user ceph....done 2024-04-23T10:13:25.281 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-23T10:13:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:Setting system user ceph properties....done 2024-04-23T10:13:25.453 INFO:teuthology.orchestra.run.smithi029.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-23T10:13:25.526 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-23T10:13:25.594 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-23T10:13:25.787 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-23T10:13:25.901 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-23T10:13:26.022 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-23T10:13:26.393 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:26.536 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T10:13:26.646 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-23T10:13:26.713 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:13:26.714 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:13:26.915 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T10:13:27.042 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T10:13:27.212 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:27.329 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-23T10:13:27.341 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:27.639 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-23T10:13:27.827 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:13:27.827 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:13:27.892 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T10:13:28.010 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-23T10:13:28.138 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T10:13:28.228 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-23T10:13:28.315 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:28.475 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T10:13:28.585 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T10:13:28.688 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-23T10:13:28.981 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-23T10:13:29.173 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:29.250 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-23T10:13:29.377 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-23T10:13:29.438 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T10:13:29.438 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T10:13:29.639 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:13:29.740 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T10:13:29.928 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:30.051 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T10:13:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T10:13:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T10:13:30.361 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T10:13:30.630 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-23T10:13:30.688 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:30.846 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-23T10:13:30.961 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T10:13:30.961 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T10:13:31.098 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-23T10:13:31.369 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T10:13:31.460 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:31.587 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:31.646 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-23T10:13:31.739 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:31.978 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T10:13:31.979 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T10:13:32.008 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-23T10:13:32.279 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T10:13:32.466 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:32.600 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T10:13:32.620 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:32.719 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:32.749 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:32.847 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:32.891 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:32.974 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-23T10:13:33.247 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T10:13:33.298 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:33.357 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T10:13:33.425 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:33.511 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T10:13:33.535 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-23T10:13:33.822 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:33.942 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:34.069 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:34.279 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T10:13:34.279 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T10:13:34.780 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:34.958 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T10:13:35.340 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:35.468 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:35.595 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:35.713 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T10:13:35.716 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T10:13:35.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-23T10:13:35.817 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-23T10:13:36.024 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-23T10:13:36.025 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-23T10:13:36.228 INFO:teuthology.orchestra.run.smithi029.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-23T10:13:36.229 INFO:teuthology.orchestra.run.smithi029.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-23T10:13:36.229 INFO:teuthology.orchestra.run.smithi029.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-23T10:13:36.229 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:13:36.229 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:13:36.229 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:13:36.229 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:13:36.229 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:13:36.230 INFO:teuthology.orchestra.run.smithi029.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:13:36.230 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:13:36.230 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-04-23T10:13:36.230 INFO:teuthology.orchestra.run.smithi029.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-23T10:13:36.230 INFO:teuthology.orchestra.run.smithi029.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-23T10:13:36.231 INFO:teuthology.orchestra.run.smithi029.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-23T10:13:36.231 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-23T10:13:36.231 INFO:teuthology.orchestra.run.smithi029.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T10:13:36.232 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-04-23T10:13:36.233 INFO:teuthology.orchestra.run.smithi029.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-23T10:13:36.233 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-23T10:13:36.233 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-23T10:13:36.275 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-04-23T10:13:36.276 INFO:teuthology.orchestra.run.smithi029.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-23T10:13:36.276 INFO:teuthology.orchestra.run.smithi029.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-23T10:13:36.276 INFO:teuthology.orchestra.run.smithi029.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-23T10:13:36.277 INFO:teuthology.orchestra.run.smithi029.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-23T10:13:36.277 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-23T10:13:36.277 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-23T10:13:36.277 INFO:teuthology.orchestra.run.smithi029.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T10:13:36.278 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2024-04-23T10:13:36.278 INFO:teuthology.orchestra.run.smithi029.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-23T10:13:36.338 INFO:teuthology.orchestra.run.smithi029.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-23T10:13:36.339 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 55.7 MB of archives. 2024-04-23T10:13:36.339 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-23T10:13:36.339 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-23T10:13:36.543 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-23T10:13:36.551 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-23T10:13:36.613 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-23T10:13:36.614 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-23T10:13:36.616 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-23T10:13:36.633 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-23T10:13:36.634 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-23T10:13:36.638 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-23T10:13:36.639 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-23T10:13:36.640 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-23T10:13:36.642 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-23T10:13:36.660 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-23T10:13:36.661 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-23T10:13:36.661 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-23T10:13:36.696 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:37.065 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:37.192 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:37.296 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:37.422 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:37.461 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-23T10:13:37.465 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-23T10:13:37.466 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-23T10:13:37.471 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-23T10:13:37.472 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-23T10:13:37.481 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-23T10:13:37.484 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-23T10:13:37.499 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-23T10:13:37.500 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-23T10:13:37.549 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:37.605 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-23T10:13:37.605 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-23T10:13:37.618 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-23T10:13:37.644 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-23T10:13:37.649 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-23T10:13:37.649 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-23T10:13:37.650 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-23T10:13:37.651 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-23T10:13:37.691 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-23T10:13:37.695 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-23T10:13:38.195 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-23T10:13:38.195 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-23T10:13:38.195 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-23T10:13:38.195 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-23T10:13:38.196 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-23T10:13:38.196 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-23T10:13:38.219 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-23T10:13:38.220 INFO:teuthology.orchestra.run.smithi029.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-23T10:13:38.223 INFO:teuthology.orchestra.run.smithi072.stdout:Adding group ceph....done 2024-04-23T10:13:38.587 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user ceph....done 2024-04-23T10:13:38.647 INFO:teuthology.orchestra.run.smithi029.stdout:Preconfiguring packages ... 2024-04-23T10:13:38.757 INFO:teuthology.orchestra.run.smithi072.stdout:Setting system user ceph properties....done 2024-04-23T10:13:38.771 INFO:teuthology.orchestra.run.smithi072.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-23T10:13:38.829 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 55.7 MB in 2s (28.8 MB/s) 2024-04-23T10:13:38.906 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-23T10:13:39.156 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-23T10:13:39.163 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:13:39.199 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-23T10:13:39.307 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:13:39.662 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:39.873 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:13:39.873 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:13:40.242 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-23T10:13:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:40.460 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:40.920 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:13:40.920 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:13:41.260 INFO:teuthology.orchestra.run.smithi029.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-23T10:13:41.364 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:41.531 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package flex. 2024-04-23T10:13:41.604 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-23T10:13:41.609 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-23T10:13:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-23T10:13:41.717 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-23T10:13:42.177 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:42.227 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T10:13:42.401 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-23T10:13:42.414 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T10:13:42.414 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T10:13:42.892 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:13:42.913 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:43.129 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T10:13:43.129 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T10:13:43.462 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-23T10:13:43.468 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:13:43.566 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:43.676 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:13:43.843 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T10:13:43.843 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T10:13:44.243 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:13:44.321 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:44.425 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:13:44.683 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:44.882 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T10:13:44.914 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T10:13:44.914 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T10:13:45.370 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:45.410 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package bison. 2024-04-23T10:13:45.497 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:45.519 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-23T10:13:45.525 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-23T10:13:45.587 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T10:13:45.684 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:45.836 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:13:46.160 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-23T10:13:46.188 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-23T10:13:46.192 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T10:13:46.243 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T10:13:46.302 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T10:13:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T10:13:46.725 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package dump. 2024-04-23T10:13:46.754 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-23T10:13:46.808 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking dump (0.4b47-3) ... 2024-04-23T10:13:47.142 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package indent. 2024-04-23T10:13:47.170 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:13:47.225 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T10:13:47.580 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-23T10:13:47.609 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-23T10:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T10:13:47.664 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T10:13:48.173 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-23T10:13:48.201 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-23T10:13:48.256 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T10:13:48.408 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T10:13:48.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-23T10:13:48.468 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-23T10:13:48.621 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-23T10:13:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-23T10:13:48.668 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-23T10:13:48.669 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-23T10:13:48.704 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T10:13:48.863 INFO:teuthology.orchestra.run.smithi072.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:13:48.864 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:13:48.865 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-04-23T10:13:48.866 INFO:teuthology.orchestra.run.smithi072.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-23T10:13:48.866 INFO:teuthology.orchestra.run.smithi072.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-23T10:13:48.866 INFO:teuthology.orchestra.run.smithi072.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-23T10:13:48.866 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-23T10:13:48.866 INFO:teuthology.orchestra.run.smithi072.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T10:13:48.866 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-04-23T10:13:48.867 INFO:teuthology.orchestra.run.smithi072.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-23T10:13:48.867 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-23T10:13:48.867 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-23T10:13:48.909 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-04-23T10:13:48.910 INFO:teuthology.orchestra.run.smithi072.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-23T10:13:48.910 INFO:teuthology.orchestra.run.smithi072.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-23T10:13:48.911 INFO:teuthology.orchestra.run.smithi072.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-23T10:13:48.911 INFO:teuthology.orchestra.run.smithi072.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-23T10:13:48.911 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-23T10:13:48.911 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-23T10:13:48.912 INFO:teuthology.orchestra.run.smithi072.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T10:13:48.913 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-04-23T10:13:48.913 INFO:teuthology.orchestra.run.smithi072.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-23T10:13:49.096 INFO:teuthology.orchestra.run.smithi072.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-23T10:13:49.096 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 55.7 MB of archives. 2024-04-23T10:13:49.096 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-23T10:13:49.096 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-23T10:13:49.187 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-23T10:13:49.216 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-23T10:13:49.279 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T10:13:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-23T10:13:49.646 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-23T10:13:49.700 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T10:13:49.728 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-23T10:13:49.745 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-23T10:13:49.958 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-23T10:13:49.959 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-23T10:13:49.960 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-23T10:13:49.985 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-23T10:13:49.987 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-23T10:13:49.991 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-23T10:13:49.994 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-23T10:13:49.995 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-23T10:13:50.118 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjson-perl. 2024-04-23T10:13:50.147 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-23T10:13:50.161 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-23T10:13:50.201 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-23T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-23T10:13:50.470 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-23T10:13:50.475 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-23T10:13:50.558 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-23T10:13:50.625 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-23T10:13:50.654 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-23T10:13:50.708 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T10:13:53.282 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-23T10:13:53.311 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T10:13:53.374 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:13:53.746 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-23T10:13:53.774 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T10:13:53.829 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:13:54.302 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-23T10:13:54.331 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T10:13:54.355 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-23T10:13:54.360 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-23T10:13:54.361 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-23T10:13:54.367 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-23T10:13:54.368 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-23T10:13:54.378 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-23T10:13:54.386 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:13:54.546 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-23T10:13:54.908 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-23T10:13:54.936 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-23T10:13:55.009 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T10:13:55.224 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-23T10:13:55.225 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-23T10:13:55.492 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-23T10:13:55.493 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-23T10:13:55.637 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-23T10:13:55.728 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-23T10:13:55.756 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T10:13:55.811 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T10:13:55.838 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-23T10:13:55.847 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-23T10:13:55.849 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-23T10:13:55.851 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-23T10:13:55.852 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-23T10:13:56.044 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-23T10:13:56.334 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-23T10:13:56.362 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:13:56.417 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:13:56.448 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-23T10:13:56.899 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-23T10:13:56.927 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:13:56.982 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:13:57.414 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-23T10:13:57.443 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:13:57.497 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:13:57.835 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-23T10:13:57.864 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T10:13:57.918 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:13:58.106 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-23T10:13:58.106 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-23T10:13:58.107 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-23T10:13:58.108 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-23T10:13:58.153 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-23T10:13:58.154 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-23T10:13:58.187 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-23T10:13:58.188 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-23T10:13:58.544 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-23T10:13:58.572 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-23T10:13:58.596 INFO:teuthology.orchestra.run.smithi072.stdout:Preconfiguring packages ... 2024-04-23T10:13:58.619 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T10:13:58.750 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 55.7 MB in 9s (6,013 kB/s) 2024-04-23T10:13:59.026 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package modemmanager. 2024-04-23T10:13:59.054 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T10:13:59.070 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-23T10:13:59.076 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:13:59.101 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:13:59.231 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:13:59.815 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package network-manager. 2024-04-23T10:13:59.836 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-23T10:13:59.843 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T10:13:59.891 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-23T10:14:00.737 INFO:teuthology.orchestra.run.smithi072.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-23T10:14:01.057 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package flex. 2024-04-23T10:14:01.159 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-23T10:14:01.165 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-23T10:14:01.191 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ppp. 2024-04-23T10:14:01.203 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-23T10:14:01.220 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-23T10:14:01.497 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T10:14:01.716 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T10:14:01.852 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package pptp-linux. 2024-04-23T10:14:01.880 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-23T10:14:01.890 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-23T10:14:01.918 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-23T10:14:02.175 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-23T10:14:02.203 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-23T10:14:02.250 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-23T10:14:02.338 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:14:02.572 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-23T10:14:02.600 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-23T10:14:02.639 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-client-common (238) ... 2024-04-23T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-23T10:14:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:14:02.955 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-23T10:14:02.972 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:14:03.007 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:14:03.014 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:03.431 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:14:03.563 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:14:03.699 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-common. 2024-04-23T10:14:03.728 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-23T10:14:03.794 INFO:teuthology.orchestra.run.smithi029.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-23T10:14:03.832 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-common (238) ... 2024-04-23T10:14:03.903 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T10:14:04.273 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package bison. 2024-04-23T10:14:04.349 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-14. 2024-04-23T10:14:04.374 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-23T10:14:04.377 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:14:04.380 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-23T10:14:04.425 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T10:14:04.427 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:04.823 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-23T10:14:04.850 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-23T10:14:04.890 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T10:14:05.203 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package dump. 2024-04-23T10:14:05.231 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-23T10:14:05.270 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking dump (0.4b47-3) ... 2024-04-23T10:14:05.646 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package indent. 2024-04-23T10:14:05.673 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:14:05.690 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql. 2024-04-23T10:14:05.712 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T10:14:05.719 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-23T10:14:05.765 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql (14+238) ... 2024-04-23T10:14:05.969 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-23T10:14:05.997 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-23T10:14:06.020 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-client. 2024-04-23T10:14:06.049 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-23T10:14:06.087 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-client (14+238) ... 2024-04-23T10:14:06.321 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T10:14:07.047 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-23T10:14:07.074 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-23T10:14:07.114 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T10:14:07.167 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-23T10:14:07.184 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-23T10:14:07.225 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-23T10:14:07.353 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-23T10:14:07.369 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-23T10:14:07.412 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T10:14:07.548 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package tcl8.6. 2024-04-23T10:14:07.577 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-23T10:14:07.623 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T10:14:07.743 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-23T10:14:07.771 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-23T10:14:07.810 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T10:14:07.930 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package tcl. 2024-04-23T10:14:07.958 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-23T10:14:08.002 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-23T10:14:08.041 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-23T10:14:08.057 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-23T10:14:08.099 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T10:14:08.331 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjson-perl. 2024-04-23T10:14:08.347 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-23T10:14:08.360 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package wpasupplicant. 2024-04-23T10:14:08.389 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-23T10:14:08.389 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-23T10:14:08.435 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T10:14:08.678 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-23T10:14:08.706 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-23T10:14:08.745 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T10:14:08.819 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-23T10:14:08.848 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-23T10:14:08.894 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-23T10:14:09.285 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-23T10:14:09.313 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-23T10:14:09.360 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T10:14:09.671 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-client-common (238) ... 2024-04-23T10:14:09.881 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-23T10:14:09.999 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T10:14:10.128 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:10.255 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T10:14:10.382 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T10:14:10.509 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:11.043 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-23T10:14:11.131 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T10:14:11.137 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-23T10:14:11.163 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T10:14:11.202 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:14:11.467 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-23T10:14:11.483 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T10:14:11.525 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:14:11.529 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T10:14:11.529 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T10:14:11.924 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-23T10:14:11.952 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T10:14:11.992 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:14:12.061 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T10:14:12.190 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T10:14:12.314 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-23T10:14:12.317 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:14:12.342 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-23T10:14:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T10:14:12.444 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-23T10:14:12.570 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-23T10:14:12.697 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T10:14:12.723 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T10:14:12.771 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T10:14:12.834 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T10:14:12.961 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T10:14:13.118 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-23T10:14:13.146 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:14:13.210 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:13.534 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-23T10:14:13.561 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:14:13.600 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:14:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T10:14:13.841 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up dump (0.4b47-3) ... 2024-04-23T10:14:13.923 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-23T10:14:13.937 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-23T10:14:13.939 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:14:13.974 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:14:14.012 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:14:14.139 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T10:14:14.219 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-23T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T10:14:14.266 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-23T10:14:14.278 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:14:14.434 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-23T10:14:14.563 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T10:14:14.653 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-23T10:14:14.724 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T10:14:14.845 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-23T10:14:14.851 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T10:14:14.872 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-23T10:14:14.911 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T10:14:15.030 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T10:14:15.157 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:14:15.260 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package modemmanager. 2024-04-23T10:14:15.284 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-23T10:14:15.288 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T10:14:15.327 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:14:15.453 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-client (14+238) ... 2024-04-23T10:14:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-23T10:14:15.957 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package network-manager. 2024-04-23T10:14:15.985 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T10:14:16.032 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-23T10:14:16.065 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:16.065 INFO:teuthology.orchestra.run.smithi029.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-23T10:14:16.065 INFO:teuthology.orchestra.run.smithi029.stdout:which means they are currently configured by ifupdown: 2024-04-23T10:14:16.065 INFO:teuthology.orchestra.run.smithi029.stdout:- ens1f0 2024-04-23T10:14:16.065 INFO:teuthology.orchestra.run.smithi029.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-23T10:14:16.065 INFO:teuthology.orchestra.run.smithi029.stdout:remove their configuration from /etc/network/interfaces. 2024-04-23T10:14:16.065 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:16.181 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-23T10:14:16.459 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-23T10:14:16.657 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ppp. 2024-04-23T10:14:16.685 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-23T10:14:16.793 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-23T10:14:16.951 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T10:14:17.268 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package pptp-linux. 2024-04-23T10:14:17.284 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-23T10:14:17.311 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:14:17.327 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-23T10:14:17.466 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T10:14:17.591 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-23T10:14:17.607 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-23T10:14:17.618 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-23T10:14:17.650 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-23T10:14:17.745 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-common (238) ... 2024-04-23T10:14:17.947 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-23T10:14:17.974 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-23T10:14:18.013 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client-common (238) ... 2024-04-23T10:14:18.288 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-23T10:14:18.305 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:14:18.339 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:18.949 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-common. 2024-04-23T10:14:18.977 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-23T10:14:18.983 INFO:teuthology.orchestra.run.smithi029.stdout:Adding user postgres to group ssl-cert 2024-04-23T10:14:19.033 INFO:teuthology.orchestra.run.smithi072.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-23T10:14:19.065 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-common (238) ... 2024-04-23T10:14:19.363 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:19.363 INFO:teuthology.orchestra.run.smithi029.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-23T10:14:19.524 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-14. 2024-04-23T10:14:19.551 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:14:19.610 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:19.856 INFO:teuthology.orchestra.run.smithi029.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-23T10:14:19.857 INFO:teuthology.orchestra.run.smithi029.stdout:Removing obsolete dictionary files: 2024-04-23T10:14:20.430 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-23T10:14:20.855 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql. 2024-04-23T10:14:20.907 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-23T10:14:20.948 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql (14+238) ... 2024-04-23T10:14:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-23T10:14:21.195 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client. 2024-04-23T10:14:21.206 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-23T10:14:21.223 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-23T10:14:21.268 INFO:teuthology.orchestra.run.smithi029.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-23T10:14:21.268 INFO:teuthology.orchestra.run.smithi029.stdout:This user must also own the server process. 2024-04-23T10:14:21.268 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:21.268 INFO:teuthology.orchestra.run.smithi029.stdout:The database cluster will be initialized with locale "en_US". 2024-04-23T10:14:21.268 INFO:teuthology.orchestra.run.smithi029.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-23T10:14:21.268 INFO:teuthology.orchestra.run.smithi029.stdout:The default text search configuration will be set to "english". 2024-04-23T10:14:21.269 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:21.269 INFO:teuthology.orchestra.run.smithi029.stdout:Data page checksums are disabled. 2024-04-23T10:14:21.269 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:21.269 INFO:teuthology.orchestra.run.smithi029.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-23T10:14:21.269 INFO:teuthology.orchestra.run.smithi029.stdout:creating subdirectories ... ok 2024-04-23T10:14:21.269 INFO:teuthology.orchestra.run.smithi029.stdout:selecting dynamic shared memory implementation ... posix 2024-04-23T10:14:21.270 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client (14+238) ... 2024-04-23T10:14:21.285 INFO:teuthology.orchestra.run.smithi029.stdout:selecting default max_connections ... 100 2024-04-23T10:14:21.308 INFO:teuthology.orchestra.run.smithi029.stdout:selecting default shared_buffers ... 128MB 2024-04-23T10:14:21.315 INFO:teuthology.orchestra.run.smithi029.stdout:selecting default time zone ... Etc/UTC 2024-04-23T10:14:21.315 INFO:teuthology.orchestra.run.smithi029.stdout:creating configuration files ... ok 2024-04-23T10:14:21.433 INFO:teuthology.orchestra.run.smithi029.stdout:running bootstrap script ... ok 2024-04-23T10:14:21.516 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-23T10:14:21.544 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-23T10:14:21.583 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-23T10:14:22.157 INFO:teuthology.orchestra.run.smithi029.stdout:performing post-bootstrap initialization ... ok 2024-04-23T10:14:22.589 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package tcl8.6. 2024-04-23T10:14:22.618 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-23T10:14:22.664 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T10:14:22.952 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package tcl. 2024-04-23T10:14:22.968 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-23T10:14:23.015 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-23T10:14:23.191 INFO:teuthology.orchestra.run.smithi029.stdout:syncing data to disk ... ok 2024-04-23T10:14:23.334 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package wpasupplicant. 2024-04-23T10:14:23.362 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-23T10:14:23.400 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T10:14:23.571 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-23T10:14:23.768 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-23T10:14:23.797 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-23T10:14:23.843 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-23T10:14:24.200 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-23T10:14:24.229 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-23T10:14:24.275 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T10:14:24.569 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client-common (238) ... 2024-04-23T10:14:24.780 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-23T10:14:24.890 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T10:14:25.019 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:25.146 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T10:14:25.264 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T10:14:25.383 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:25.837 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-23T10:14:25.921 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T10:14:26.335 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T10:14:26.336 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T10:14:26.389 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:14:26.515 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-23T10:14:26.644 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up postgresql (14+238) ... 2024-04-23T10:14:26.771 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:14:26.835 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T10:14:26.897 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:14:26.962 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T10:14:27.090 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:14:27.166 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T10:14:27.166 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T10:14:27.209 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-23T10:14:27.336 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T10:14:27.463 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T10:14:27.591 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T10:14:27.709 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T10:14:27.720 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T10:14:27.821 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-23T10:14:28.184 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T10:14:28.347 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T10:14:28.363 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T10:14:28.489 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up dump (0.4b47-3) ... 2024-04-23T10:14:28.592 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-23T10:14:28.661 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:14:28.788 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T10:14:28.898 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-23T10:14:29.025 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-23T10:14:29.151 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T10:14:29.244 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-23T10:14:29.314 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T10:14:29.433 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T10:14:29.524 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-23T10:14:29.610 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T10:14:29.626 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T10:14:29.739 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:14:29.849 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-23T10:14:30.018 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client (14+238) ... 2024-04-23T10:14:30.145 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-23T10:14:30.257 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T10:14:30.262 DEBUG:teuthology.parallel:result is None 2024-04-23T10:14:30.608 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:30.608 INFO:teuthology.orchestra.run.smithi072.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-23T10:14:30.608 INFO:teuthology.orchestra.run.smithi072.stdout:which means they are currently configured by ifupdown: 2024-04-23T10:14:30.609 INFO:teuthology.orchestra.run.smithi072.stdout:- enp3s0f1 2024-04-23T10:14:30.609 INFO:teuthology.orchestra.run.smithi072.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-23T10:14:30.609 INFO:teuthology.orchestra.run.smithi072.stdout:remove their configuration from /etc/network/interfaces. 2024-04-23T10:14:30.609 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:30.741 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-23T10:14:31.063 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-23T10:14:31.390 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-23T10:14:31.852 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:14:31.987 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T10:14:32.114 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-23T10:14:32.234 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-common (238) ... 2024-04-23T10:14:33.178 INFO:teuthology.orchestra.run.smithi072.stdout:Adding user postgres to group ssl-cert 2024-04-23T10:14:33.415 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi072.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-23T10:14:33.679 INFO:teuthology.orchestra.run.smithi072.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-23T10:14:33.679 INFO:teuthology.orchestra.run.smithi072.stdout:Removing obsolete dictionary files: 2024-04-23T10:14:34.222 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-23T10:14:34.623 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:14:34.938 INFO:teuthology.orchestra.run.smithi072.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-23T10:14:34.949 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout:This user must also own the server process. 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout:The database cluster will be initialized with locale "en_US". 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout:The default text search configuration will be set to "english". 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout:Data page checksums are disabled. 2024-04-23T10:14:35.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-23T10:14:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:creating subdirectories ... ok 2024-04-23T10:14:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:selecting dynamic shared memory implementation ... posix 2024-04-23T10:14:35.028 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default max_connections ... 100 2024-04-23T10:14:35.048 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default shared_buffers ... 128MB 2024-04-23T10:14:35.058 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default time zone ... Etc/UTC 2024-04-23T10:14:35.058 INFO:teuthology.orchestra.run.smithi072.stdout:creating configuration files ... ok 2024-04-23T10:14:35.172 INFO:teuthology.orchestra.run.smithi072.stdout:running bootstrap script ... ok 2024-04-23T10:14:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:performing post-bootstrap initialization ... ok 2024-04-23T10:14:36.616 INFO:teuthology.orchestra.run.smithi072.stdout:syncing data to disk ... ok 2024-04-23T10:14:37.025 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-23T10:14:39.806 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:14:39.916 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-23T10:14:40.043 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql (14+238) ... 2024-04-23T10:14:40.169 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:14:40.296 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:14:40.551 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T10:14:40.551 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T10:14:41.086 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T10:14:41.204 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-23T10:14:41.560 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T10:14:41.714 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T10:14:43.349 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-23T10:14:43.443 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T10:14:43.891 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T10:14:43.896 DEBUG:teuthology.parallel:result is None 2024-04-23T10:14:43.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:14:44.235 DEBUG:teuthology.orchestra.run.smithi029:> dpkg-query -W -f '${Version}' ceph 2024-04-23T10:14:44.256 INFO:teuthology.orchestra.run.smithi029.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:14:44.256 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:14:44.256 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-23T10:14:44.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:14:44.394 DEBUG:teuthology.orchestra.run.smithi072:> dpkg-query -W -f '${Version}' ceph 2024-04-23T10:14:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:14:44.414 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:14:44.414 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-23T10:14:44.415 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T10:14:44.415 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:44.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T10:14:44.430 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:14:44.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T10:14:44.469 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T10:14:44.469 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:44.469 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T10:14:44.485 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T10:14:44.541 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:14:44.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T10:14:44.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T10:14:44.608 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T10:14:44.609 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:44.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T10:14:44.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T10:14:44.676 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:14:44.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T10:14:44.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T10:14:44.744 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T10:14:44.744 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:44.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T10:14:44.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T10:14:44.812 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:14:44.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T10:14:44.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T10:14:44.881 INFO:teuthology.run_tasks:Running task ceph... 2024-04-23T10:14:44.957 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-23T10:14:44.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-04-23T10:14:44.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2024-04-23T10:14:44.972 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-23T10:14:44.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T10:14:45.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T10:14:45.028 INFO:tasks.ceph:Creating extra log directories... 2024-04-23T10:14:45.028 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T10:14:45.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T10:14:45.088 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-23T10:14:45.089 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-23T10:14:45.089 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-23T10:14:45.089 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:45.089 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-23T10:14:45.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-23T10:14:45.205 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:14:45.206 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-23T10:14:45.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-23T10:14:45.290 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-23T10:14:45.290 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-23T10:14:45.290 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7669532', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '0a6c3ed699031b80a2b419e7e795368719871394'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5306, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': '0a6c3ed699031b80a2b419e7e795368719871394', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBVXvk0wOeJgo4W4qz/0vkgCBzJgq3SlEJ0ExMdq2R5RFNpo7MLyqwYwdI/5t+73SoaKg3N89JYeEki6JUeeaEs=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGJtxDAC1oOVCj5xK2ks4wuHT3ivmQ3faggc0MWbjeb/OvE5tEygihj3W9BUs93wZJpyHD3E+tnZ5lRVknpryhs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_09:49:14', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-23T10:14:45.291 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T10:14:45.293 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T10:14:45.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T10:14:45.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T10:14:45.389 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:45.389 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T10:14:45.402 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T10:14:45.402 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-04-23T10:14:45.450 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T10:14:45.450 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:14:45.450 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-04-23T10:14:45.450 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:14:45.450 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-23 10:08:03.882995645 +0000 2024-04-23T10:14:45.450 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-23 10:08:03.878995681 +0000 2024-04-23T10:14:45.450 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-23 10:08:03.878995681 +0000 2024-04-23T10:14:45.450 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-23T10:14:45.450 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T10:14:45.504 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-23T10:14:45.504 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-23T10:14:45.504 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.00027098 s, 1.9 MB/s 2024-04-23T10:14:45.505 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T10:14:45.555 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-04-23T10:14:45.602 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T10:14:45.602 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:14:45.602 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-04-23T10:14:45.602 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:14:45.602 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-23 10:08:04.654988749 +0000 2024-04-23T10:14:45.602 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-23 10:08:04.382991179 +0000 2024-04-23T10:14:45.602 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-23 10:08:04.382991179 +0000 2024-04-23T10:14:45.602 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-23T10:14:45.602 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T10:14:45.657 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-23T10:14:45.657 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-23T10:14:45.657 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000299711 s, 1.7 MB/s 2024-04-23T10:14:45.658 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T10:14:45.707 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-04-23T10:14:45.754 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T10:14:45.754 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:14:45.754 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-04-23T10:14:45.754 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:14:45.754 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-23 10:08:05.130984498 +0000 2024-04-23T10:14:45.754 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-23 10:08:04.866986856 +0000 2024-04-23T10:14:45.755 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-23 10:08:04.866986856 +0000 2024-04-23T10:14:45.755 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-23T10:14:45.755 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T10:14:45.808 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-23T10:14:45.809 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-23T10:14:45.809 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000311104 s, 1.6 MB/s 2024-04-23T10:14:45.810 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T10:14:45.859 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-04-23T10:14:45.905 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T10:14:45.905 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:14:45.905 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-04-23T10:14:45.906 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:14:45.906 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-23 10:08:05.614980175 +0000 2024-04-23T10:14:45.906 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-23 10:08:05.334982676 +0000 2024-04-23T10:14:45.906 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-23 10:08:05.334982676 +0000 2024-04-23T10:14:45.906 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-23T10:14:45.906 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T10:14:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-23T10:14:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-23T10:14:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000301551 s, 1.7 MB/s 2024-04-23T10:14:45.962 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T10:14:46.011 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:14:46.012 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:14:46.012 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T10:14:46.017 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T10:14:46.018 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-04-23T10:14:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T10:14:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:14:46.066 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-04-23T10:14:46.066 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:14:46.066 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-23 10:07:57.340238587 +0000 2024-04-23T10:14:46.066 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-23 10:07:57.072240980 +0000 2024-04-23T10:14:46.066 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-23 10:07:57.072240980 +0000 2024-04-23T10:14:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-23T10:14:46.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T10:14:46.120 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-23T10:14:46.120 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-23T10:14:46.120 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000382347 s, 1.3 MB/s 2024-04-23T10:14:46.121 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T10:14:46.170 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-04-23T10:14:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T10:14:46.217 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:14:46.217 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-04-23T10:14:46.217 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:14:46.217 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-23 10:07:57.836234157 +0000 2024-04-23T10:14:46.217 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-23 10:07:57.584236407 +0000 2024-04-23T10:14:46.218 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-23 10:07:57.584236407 +0000 2024-04-23T10:14:46.218 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-23T10:14:46.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T10:14:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-23T10:14:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-23T10:14:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000427453 s, 1.2 MB/s 2024-04-23T10:14:46.273 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T10:14:46.322 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-04-23T10:14:46.370 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T10:14:46.370 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:14:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-23T10:14:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:14:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-23 10:07:58.312229905 +0000 2024-04-23T10:14:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-23 10:07:58.064232120 +0000 2024-04-23T10:14:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-23 10:07:58.064232120 +0000 2024-04-23T10:14:46.371 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-23T10:14:46.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T10:14:46.424 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-23T10:14:46.424 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-23T10:14:46.424 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000360326 s, 1.4 MB/s 2024-04-23T10:14:46.425 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T10:14:46.475 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-04-23T10:14:46.521 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T10:14:46.521 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:14:46.521 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-04-23T10:14:46.521 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:14:46.521 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-23 10:07:58.532227940 +0000 2024-04-23T10:14:46.521 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-23 10:07:58.528227976 +0000 2024-04-23T10:14:46.522 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-23 10:07:58.528227976 +0000 2024-04-23T10:14:46.522 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-23T10:14:46.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T10:14:46.575 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-23T10:14:46.575 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-23T10:14:46.575 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000389851 s, 1.3 MB/s 2024-04-23T10:14:46.577 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T10:14:46.627 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:14:46.627 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T10:14:46.627 INFO:tasks.ceph:Generating config... 2024-04-23T10:14:46.628 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-23T10:14:46.628 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-23T10:14:46.628 INFO:tasks.ceph:[client] debug client = 20 2024-04-23T10:14:46.629 INFO:tasks.ceph:[client] debug ms = 1 2024-04-23T10:14:46.629 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-23T10:14:46.629 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-23T10:14:46.629 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-23T10:14:46.630 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-23T10:14:46.631 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-23T10:14:46.631 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-23T10:14:46.632 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-23T10:14:46.633 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-23T10:14:46.633 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-23T10:14:46.633 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-23T10:14:46.633 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-23T10:14:46.633 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-23T10:14:46.633 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-23T10:14:46.633 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-23T10:14:46.633 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-23T10:14:46.633 INFO:tasks.ceph:Setting up mon.a... 2024-04-23T10:14:46.634 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-23T10:14:46.668 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-04-23T10:14:46.684 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-23T10:14:46.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T10:14:46.816 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '172.21.15.72'), ('mon.c', '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]')] 2024-04-23T10:14:46.816 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-23T10:14:46.817 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:46.817 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T10:14:46.862 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --add b 172.21.15.72 --addv c '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid 04cdcd58-672f-4635-ab0e-456f05ed3368 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = quincy 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 04cdcd58-672f-4635-ab0e-456f05ed3368 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-04-23T10:14:46.946356+0000 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-04-23T10:14:46.946356+0000 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 17 (quincy) 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-04-23T10:14:46.943 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-23T10:14:46.944 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.b 2024-04-23T10:14:46.944 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2024-04-23T10:14:46.944 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-23T10:14:46.945 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T10:14:46.994 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 04cdcd58-672f-4635-ab0e-456f05ed3368... 2024-04-23T10:14:46.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T10:14:47.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-04-23T10:14:47.068 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-04-23T10:14:47.069 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.070 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]" 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 04cdcd58-672f-4635-ab0e-456f05ed3368 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-04-23T10:14:47.071 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug trim objects = true 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-04-23T10:14:47.072 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 20 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 20 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 10 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: mon client directed command retry = 5 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject delay max = 1 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject delay probability = 0.005 2024-04-23T10:14:47.073 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject delay type = client mds 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject socket failures = 2500 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: osd blocked scrub grace period = 3600 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: osd max markdown count = 1000 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-23T10:14:47.074 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-04-23T10:14:47.075 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-04-23T10:14:47.076 INFO:teuthology.orchestra.run.smithi029.stdout: mon down mkfs grace = 300 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: client_shutdown_timeout = 120 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-04-23T10:14:47.077 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.e] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.f] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds balancer = 20 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout: mds bal fragment size max = 10000 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout: mds bal merge size = 5 2024-04-23T10:14:47.078 INFO:teuthology.orchestra.run.smithi029.stdout: mds bal split bits = 3 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mds bal split size = 100 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mds oft prefetch dirfrags = True 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mds_dir_prefetch = True 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mds_sleep_rank_change = 5000000.0 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: mon client directed command retry = 5 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject delay max = 1 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject delay probability = 0.005 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject delay type = client mds osd 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject socket failures = 2500 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-04-23T10:14:47.079 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2024-04-23T10:14:47.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2024-04-23T10:14:47.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.29,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]" 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 04cdcd58-672f-4635-ab0e-456f05ed3368 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2024-04-23T10:14:47.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug trim objects = true 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2024-04-23T10:14:47.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: mon client directed command retry = 5 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay max = 1 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay probability = 0.005 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay type = client mds 2024-04-23T10:14:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject socket failures = 2500 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: osd blocked scrub grace period = 3600 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: osd max markdown count = 1000 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2024-04-23T10:14:47.087 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T10:14:47.088 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: mon down mkfs grace = 300 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2024-04-23T10:14:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: client_shutdown_timeout = 120 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-04-23T10:14:47.090 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.e] 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.f] 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal fragment size max = 10000 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal merge size = 5 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal split bits = 3 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal split size = 100 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2024-04-23T10:14:47.091 INFO:teuthology.orchestra.run.smithi072.stdout: mds oft prefetch dirfrags = True 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: mds_dir_prefetch = True 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: mds_sleep_rank_change = 5000000.0 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: mon client directed command retry = 5 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay max = 1 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay probability = 0.005 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay type = client mds osd 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject socket failures = 2500 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-04-23T10:14:47.092 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-04-23T10:14:47.092 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-23T10:14:47.093 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-23T10:14:47.173 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-23T10:14:47.173 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:47.173 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-23T10:14:47.178 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:47.179 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-23T10:14:47.225 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:14:47.225 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:47.225 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T10:14:47.225 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T10:14:47.297 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:14:47.297 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:14:47.350 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:14:47.350 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:14:47.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T10:14:47.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T10:14:47.372 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:14:47.373 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:14:47.421 INFO:tasks.ceph:Setting up mon nodes... 2024-04-23T10:14:47.421 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-23T10:14:47.421 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T10:14:47.464 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T10:14:47.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T10:14:47.510 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T10:14:47.520 INFO:tasks.ceph:Setting up mds nodes... 2024-04-23T10:14:47.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-23T10:14:47.559 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-23T10:14:47.562 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-23T10:14:47.617 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-23T10:14:47.703 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-23T10:14:47.705 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-23T10:14:47.765 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-23T10:14:47.851 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-23T10:14:47.854 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-23T10:14:47.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-23T10:14:47.957 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-23T10:14:47.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-23T10:14:47.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-23T10:14:48.054 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-23T10:14:48.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-23T10:14:48.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-23T10:14:48.190 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-23T10:14:48.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-23T10:14:48.249 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-23T10:14:48.249 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T10:14:48.288 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-23T10:14:48.299 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-23T10:14:48.299 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T10:14:48.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-23T10:14:48.353 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:14:48.353 INFO:tasks.ceph:role: osd.0 2024-04-23T10:14:48.353 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:14:48.353 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T10:14:48.410 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:14:48.410 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:14:48.410 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:14:48.410 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:14:48.410 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:14:48.410 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:14:48.410 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:14:48.411 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:14:48.411 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:14:48.411 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:14:48.434 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-23T10:14:48.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-23T10:14:48.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-23T10:14:48.493 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-23T10:14:48.545 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:14:48.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:14:48.546 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-23T10:14:48.599 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:14:48.599 INFO:tasks.ceph:role: osd.1 2024-04-23T10:14:48.599 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:14:48.599 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T10:14:48.654 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:14:48.654 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:14:48.654 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:14:48.654 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:14:48.654 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:14:48.654 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:14:48.654 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:14:48.654 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:14:48.655 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:14:48.655 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:14:48.678 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-23T10:14:48.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-23T10:14:48.679 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-23T10:14:48.736 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-23T10:14:48.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:14:48.790 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:14:48.791 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-23T10:14:48.845 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:14:48.846 INFO:tasks.ceph:role: osd.2 2024-04-23T10:14:48.846 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:14:48.846 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:14:48.902 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:14:48.928 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-23T10:14:48.930 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-23T10:14:48.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-23T10:14:48.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-23T10:14:49.045 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:14:49.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:14:49.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-23T10:14:49.099 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:14:49.099 INFO:tasks.ceph:role: osd.3 2024-04-23T10:14:49.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:14:49.099 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T10:14:49.154 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:14:49.154 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:14:49.154 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:14:49.154 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:14:49.154 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:14:49.154 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:14:49.154 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:14:49.154 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:14:49.155 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:14:49.155 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:14:49.178 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-23T10:14:49.180 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-23T10:14:49.180 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-23T10:14:49.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-23T10:14:49.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:14:49.291 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:14:49.291 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:14:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:49.413+0000 7f4ec08b47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-23T10:14:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:49.413+0000 7f4ec08b47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-23T10:14:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:49.413+0000 7f4ec08b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T10:14:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:49.413+0000 7f4ec08b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T10:14:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:49.413+0000 7f4ec08b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T10:14:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:49.417+0000 7f4ec08b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-23T10:14:52.391 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T10:14:52.406 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:14:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:52.485+0000 7f7616a5c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-23T10:14:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:52.485+0000 7f7616a5c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-23T10:14:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:52.485+0000 7f7616a5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T10:14:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:52.485+0000 7f7616a5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T10:14:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:52.485+0000 7f7616a5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T10:14:52.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:52.485+0000 7f7616a5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-23T10:14:55.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T10:14:55.526 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:14:55.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:55.609+0000 7f17b879b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-23T10:14:55.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:55.609+0000 7f17b879b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-23T10:14:55.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:55.609+0000 7f17b879b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T10:14:55.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:55.609+0000 7f17b879b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T10:14:55.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:55.609+0000 7f17b879b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T10:14:55.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:55.609+0000 7f17b879b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-23T10:14:58.564 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T10:14:58.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:14:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:58.701+0000 7fb1cec1b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-23T10:14:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:58.701+0000 7fb1cec1b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-23T10:14:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:58.701+0000 7fb1cec1b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T10:14:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:58.701+0000 7fb1cec1b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T10:14:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:58.701+0000 7fb1cec1b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T10:14:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:14:58.701+0000 7fb1cec1b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-23T10:15:01.718 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T10:15:01.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-23T10:15:01.789 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:15:01.790 INFO:tasks.ceph:role: osd.4 2024-04-23T10:15:01.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:15:01.790 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:15:01.853 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:15:02.345 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-23T10:15:02.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-23T10:15:02.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-23T10:15:02.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-23T10:15:02.499 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:15:02.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:15:02.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-23T10:15:02.553 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:15:02.553 INFO:tasks.ceph:role: osd.5 2024-04-23T10:15:02.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:15:02.553 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:15:02.616 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:15:03.066 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-23T10:15:03.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-23T10:15:03.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-23T10:15:03.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-23T10:15:03.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:15:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:15:03.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-23T10:15:03.264 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:15:03.264 INFO:tasks.ceph:role: osd.6 2024-04-23T10:15:03.264 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:15:03.264 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T10:15:03.324 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:15:03.324 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:15:03.324 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:15:03.324 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:15:03.324 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:15:03.324 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:15:03.324 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:15:03.325 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:15:03.325 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:15:03.325 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:15:03.777 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-23T10:15:03.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-23T10:15:03.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-23T10:15:03.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-23T10:15:03.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:15:03.926 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:15:03.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-23T10:15:03.981 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:15:03.982 INFO:tasks.ceph:role: osd.7 2024-04-23T10:15:03.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:15:03.982 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T10:15:04.044 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:15:04.044 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:15:04.044 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:15:04.044 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:15:04.044 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:15:04.044 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:15:04.044 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:15:04.044 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:15:04.045 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:15:04.045 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:15:04.538 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-23T10:15:04.540 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-23T10:15:04.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-23T10:15:04.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-23T10:15:04.682 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:15:04.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:15:04.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:15:04.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:04.808+0000 7f68509c07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-23T10:15:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:04.812+0000 7f68509c07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-23T10:15:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:04.812+0000 7f68509c07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T10:15:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:04.812+0000 7f68509c07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T10:15:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:04.812+0000 7f68509c07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:04.816+0000 7f68509c07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-23T10:15:07.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T10:15:07.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:15:07.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:07.892+0000 7ff930b057c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-23T10:15:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:07.892+0000 7ff930b057c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-23T10:15:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:07.892+0000 7ff930b057c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T10:15:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:07.892+0000 7ff930b057c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T10:15:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:07.892+0000 7ff930b057c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T10:15:07.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:07.892+0000 7ff930b057c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-23T10:15:10.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T10:15:10.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:15:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:11.008+0000 7f6df9ea97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-23T10:15:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:11.008+0000 7f6df9ea97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-23T10:15:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:11.008+0000 7f6df9ea97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T10:15:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:11.008+0000 7f6df9ea97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T10:15:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:11.008+0000 7f6df9ea97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T10:15:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:11.012+0000 7f6df9ea97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-23T10:15:13.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-23T10:15:14.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:15:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:14.124+0000 7f0279cd47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-23T10:15:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:14.124+0000 7f0279cd47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-23T10:15:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:14.124+0000 7f0279cd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T10:15:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:14.124+0000 7f0279cd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T10:15:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:14.124+0000 7f0279cd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T10:15:14.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:14.124+0000 7f0279cd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-23T10:15:15.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:15.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:17.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-23T10:15:17.119 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-23T10:15:17.119 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-23T10:15:17.134 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.134 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-23T10:15:17.190 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-23T10:15:17.247 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.247 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-23T10:15:17.302 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.302 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-23T10:15:17.357 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-23T10:15:17.413 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-23T10:15:17.469 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.469 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-23T10:15:17.525 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:17.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-23T10:15:17.539 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:17.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-23T10:15:17.592 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:17.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-23T10:15:17.645 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:17.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-23T10:15:17.700 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:17.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-23T10:15:17.757 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:17.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-23T10:15:17.816 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:17.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-23T10:15:17.869 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:17.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-23T10:15:17.925 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:17.925 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-23T10:15:17.932 INFO:tasks.ceph:Adding keys to all mons... 2024-04-23T10:15:17.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T10:15:17.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T10:15:17.984 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAXiidmrRjsGxAAb/mf2ZJqzTPBpqnWdl8mhQ== 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAXiidmr0GOIRAAdAXREMkERhGV1zWZGGWL6g== 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAXiidm56kaKhAAcRcMxzn8PTTWg3Ke5Tbvww== 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.e] 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAXiidmijLwMhAA6dT7R5NfKDIATUW0ppljyg== 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAZiidmgiMJGRAAUqg8yzGlchWhHCTJ5BMWgg== 2024-04-23T10:15:17.985 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAciidm/2hJHRAATlgZHJHAfF4FiZ51ehbZlQ== 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAfiidm4P2JJBAAwCZQ4AUuRP06fDirNQXvow== 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAiiidmz2MsKhAApeI2e1VAXzOmF7KqO4hTAQ== 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAXiidmlVenHhAAbUcUELDcj8qVTVqu09O/Zw== 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAXiidm/cBTORAAOxi+4XzM/37iipMp8bQ1Vg== 2024-04-23T10:15:17.986 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAYiidm4hl5AxAA+cgmkoIerQIv6sw2Yqqa4Q== 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.f] 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAYiidmaimaCxAAJno/Ie8FvLCReXZN02aZyw== 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAoiidmkANHMBAAHocE6JwFhtBxHsL2HuExPg== 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAriidml3dbNRAAP5ErG09nkKAeaAKCB9Njvw== 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAviidmCu6zABAAsH05HgPz/xBlTNV09xr/UQ== 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAyiidm2f+XBxAAmpOPc9pkkeu8XWXI1Sgnjg== 2024-04-23T10:15:17.987 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-04-23T10:15:17.988 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAYiidmzApgERAAw2wm27jlCEiqHq/BI3TxiA== 2024-04-23T10:15:17.989 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2024-04-23T10:15:17.989 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAXiidmrRjsGxAAb/mf2ZJqzTPBpqnWdl8mhQ== 2024-04-23T10:15:17.989 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-04-23T10:15:17.989 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAXiidmr0GOIRAAdAXREMkERhGV1zWZGGWL6g== 2024-04-23T10:15:17.989 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-04-23T10:15:17.989 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAXiidm56kaKhAAcRcMxzn8PTTWg3Ke5Tbvww== 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.e] 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAXiidmijLwMhAA6dT7R5NfKDIATUW0ppljyg== 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAZiidmgiMJGRAAUqg8yzGlchWhHCTJ5BMWgg== 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAciidm/2hJHRAATlgZHJHAfF4FiZ51ehbZlQ== 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAfiidm4P2JJBAAwCZQ4AUuRP06fDirNQXvow== 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAiiidmz2MsKhAApeI2e1VAXzOmF7KqO4hTAQ== 2024-04-23T10:15:17.990 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAXiidmlVenHhAAbUcUELDcj8qVTVqu09O/Zw== 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAXiidm/cBTORAAOxi+4XzM/37iipMp8bQ1Vg== 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAYiidm4hl5AxAA+cgmkoIerQIv6sw2Yqqa4Q== 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.f] 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAYiidmaimaCxAAJno/Ie8FvLCReXZN02aZyw== 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAoiidmkANHMBAAHocE6JwFhtBxHsL2HuExPg== 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAriidml3dbNRAAP5ErG09nkKAeaAKCB9Njvw== 2024-04-23T10:15:17.991 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2024-04-23T10:15:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAviidmCu6zABAAsH05HgPz/xBlTNV09xr/UQ== 2024-04-23T10:15:17.992 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2024-04-23T10:15:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAyiidm2f+XBxAAmpOPc9pkkeu8XWXI1Sgnjg== 2024-04-23T10:15:17.992 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-04-23T10:15:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAYiidmzApgERAAw2wm27jlCEiqHq/BI3TxiA== 2024-04-23T10:15:17.992 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T10:15:18.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T10:15:18.082 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.306 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.393 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.569 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.612 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T10:15:18.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T10:15:18.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:15:18.960 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:18.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:19.007 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:19.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:19.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:19.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:19.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:19.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:15:19.252 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T10:15:19.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T10:15:19.342 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-23T10:15:19.343 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-23T10:15:19.398 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T10:15:19.493 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-23T10:15:19.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-23T10:15:19.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T10:15:19.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-23T10:15:19.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-23T10:15:19.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T10:15:19.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-23T10:15:19.820 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:15:19.823 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:15:19.866 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-23T10:15:19.866 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-23T10:15:19.866 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-23T10:15:19.871 INFO:tasks.ceph.mon.a:Started 2024-04-23T10:15:19.872 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-23T10:15:19.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-23T10:15:19.911 INFO:tasks.ceph.mon.b:Started 2024-04-23T10:15:19.912 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-23T10:15:19.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-23T10:15:19.914 INFO:tasks.ceph.mon.c:Started 2024-04-23T10:15:19.914 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-23T10:15:19.915 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-23T10:15:19.915 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-23T10:15:19.918 INFO:tasks.ceph.mgr.y:Started 2024-04-23T10:15:19.918 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-23T10:15:19.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-23T10:15:19.921 INFO:tasks.ceph.mgr.x:Started 2024-04-23T10:15:19.921 INFO:tasks.ceph:Setting crush tunables to default 2024-04-23T10:15:19.921 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-04-23T10:15:20.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dd0fd4640 1 Processor -- start 2024-04-23T10:15:20.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dd0fd4640 1 -- start start 2024-04-23T10:15:20.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dd0fd4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7dcc0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dd0fd4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 0x7f7dcc070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dd0fd4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc158fd0 con 0x7f7dcc074d60 2024-04-23T10:15:20.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dd0fd4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7dcc159be0 con 0x7f7dcc070a30 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dd0fd4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc1592b0 con 0x7f7dcc152fb0 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dcad9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7dcc074d60 0x7f7dcc15c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33652/0 (socket says 172.21.15.29:33652) 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dcad9d640 1 -- 172.21.15.29:0/2157089062 learned_addr learned my addr 172.21.15.29:0/2157089062 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 0x7f7dcc070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7dcc0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dc9d9b640 1 -- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 msgr2=0x7f7dcc070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dc9d9b640 1 -- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 msgr2=0x7f7dcc070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 0x7f7dcc070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 0x7f7dcc070190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dca59c640 1 -- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 msgr2=0x7f7dcc0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dca59c640 1 -- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 msgr2=0x7f7dcc0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7dcc0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:15:20.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.040+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7dcc0c9ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7dcc0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 0x7f7dcc070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dc9d9b640 1 -- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 msgr2=0x7f7dcc070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dc9d9b640 1 -- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 msgr2=0x7f7dcc070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 0x7f7dcc070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 0x7f7dcc070190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dca59c640 1 -- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 msgr2=0x7f7dcc0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dca59c640 1 -- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 msgr2=0x7f7dcc0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:15:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7dcc0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:15:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.244+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7dcc0c9ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:15:20.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131259847 0 0) 0x7f7dcc158fd0 con 0x7f7dcc074d60 2024-04-23T10:15:20.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db8003530 con 0x7f7dcc074d60 2024-04-23T10:15:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1335803514 0 0) 0x7f7db8003530 con 0x7f7dcc074d60 2024-04-23T10:15:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 msgr2=0x7f7dcc0c9ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:15:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7dcc0c9ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 msgr2=0x7f7dcc070190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:15:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 --2- 172.21.15.29:0/2157089062 >> v2:172.21.15.72:3300/0 conn(0x7f7dcc070a30 0x7f7dcc070190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc159590 con 0x7f7dcc074d60 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.248+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f7dbc001a00 con 0x7f7dcc074d60 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 >> v1:172.21.15.29:6789/0 conn(0x7f7dcc074d60 legacy=0x7f7dcc15c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dc959a640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db80039c0 0x7f7db8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dc959a640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7db8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dc959a640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db8004d50 0x7f7db80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1592b0 con 0x7f7db80039c0 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7db800ba80 con 0x7f7db8004d50 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7db800bc80 con 0x7f7dcc152fb0 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db80039c0 0x7f7db8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7db8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dcad9d640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db8004d50 0x7f7db80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dca59c640 1 -- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 msgr2=0x7f7db8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dcc152fb0 0x7f7db8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dca59c640 1 -- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db8004d50 msgr2=0x7f7db80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db8004d50 0x7f7db80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.252+0000 7f7dca59c640 1 -- 172.21.15.29:0/2157089062 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db8003530 con 0x7f7db80039c0 2024-04-23T10:15:20.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.256+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db80039c0 0x7f7db8003de0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400e8d0 tx=0x7f7dc401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52495abfd2a5d681 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:20.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.256+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40ab070 con 0x7f7db80039c0 2024-04-23T10:15:20.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.256+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc40a5770 con 0x7f7db80039c0 2024-04-23T10:15:20.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.256+0000 7f7dc959a640 1 -- 172.21.15.29:0/2157089062 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400f040 con 0x7f7db80039c0 2024-04-23T10:15:20.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2157089062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db80039c0 msgr2=0x7f7db8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dd0fd4640 1 --2- 172.21.15.29:0/2157089062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db80039c0 0x7f7db8003de0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400e8d0 tx=0x7f7dc401c870 comp rx=0 tx=0).stop 2024-04-23T10:15:20.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dcad9d640 1 -- 172.21.15.29:0/2157089062 reap_dead start 2024-04-23T10:15:20.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2157089062 shutdown_connections 2024-04-23T10:15:20.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2157089062 >> 172.21.15.29:0/2157089062 conn(0x7f7dcc06b9e0 msgr2=0x7f7dcc06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:20.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2157089062 shutdown_connections 2024-04-23T10:15:20.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2157089062 wait complete. 2024-04-23T10:15:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dd0fd4640 1 Processor -- start 2024-04-23T10:15:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.260+0000 7f7dd0fd4640 1 -- start start 2024-04-23T10:15:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7db80039c0 0x7f7dcc1f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dcc148440 0x7f7dcc14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dcc148880 0x7f7dcc1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc153510 con 0x7f7dcc148440 2024-04-23T10:15:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc153390 con 0x7f7dcc148880 2024-04-23T10:15:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc15cc70 con 0x7f7db80039c0 2024-04-23T10:15:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dcc148440 0x7f7dcc14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dcc148440 0x7f7dcc14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38540/0 (socket says 172.21.15.29:38540) 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dcad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dcc148880 0x7f7dcc1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 -- 172.21.15.29:0/2050859971 learned_addr learned my addr 172.21.15.29:0/2050859971 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dca59c640 1 --2- 172.21.15.29:0/2050859971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7db80039c0 0x7f7dcc1f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 -- 172.21.15.29:0/2050859971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7db80039c0 msgr2=0x7f7dcc1f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2050859971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7db80039c0 0x7f7dcc1f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 -- 172.21.15.29:0/2050859971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dcc148880 msgr2=0x7f7dcc1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2050859971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dcc148880 0x7f7dcc1461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 -- 172.21.15.29:0/2050859971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc1f2c10 con 0x7f7dcc148440 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc9d9b640 1 --2- 172.21.15.29:0/2050859971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dcc148440 0x7f7dcc14b4f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7db40128c0 tx=0x7f7db4012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc2ffd640 1 -- 172.21.15.29:0/2050859971 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4019030 con 0x7f7dcc148440 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc2ffd640 1 -- 172.21.15.29:0/2050859971 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db40109e0 con 0x7f7dcc148440 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc14a070 con 0x7f7dcc148440 2024-04-23T10:15:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc2ffd640 1 -- 172.21.15.29:0/2050859971 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400f040 con 0x7f7dcc148440 2024-04-23T10:15:20.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc14a630 con 0x7f7dcc148440 2024-04-23T10:15:20.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc2ffd640 1 -- 172.21.15.29:0/2050859971 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7db401c030 con 0x7f7dcc148440 2024-04-23T10:15:20.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dc2ffd640 1 -- 172.21.15.29:0/2050859971 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7db40158c0 con 0x7f7dcc148440 2024-04-23T10:15:20.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.264+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc0693c0 con 0x7f7dcc148440 2024-04-23T10:15:20.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.284+0000 7f7dc2ffd640 1 -- 172.21.15.29:0/2050859971 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7dcc1f2c10 con 0x7f7dcc148440 2024-04-23T10:15:20.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.348+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7dcc14d040 con 0x7f7dcc148440 2024-04-23T10:15:20.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.352+0000 7f7dc2ffd640 1 -- 172.21.15.29:0/2050859971 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f7db4015ac0 con 0x7f7dcc148440 2024-04-23T10:15:20.352 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dcc148440 msgr2=0x7f7dcc14b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 --2- 172.21.15.29:0/2050859971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dcc148440 0x7f7dcc14b4f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7db40128c0 tx=0x7f7db4012cc0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 shutdown_connections 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 --2- 172.21.15.29:0/2050859971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dcc148880 0x7f7dcc1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 --2- 172.21.15.29:0/2050859971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dcc148440 0x7f7dcc14b4f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 --2- 172.21.15.29:0/2050859971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7db80039c0 0x7f7dcc1f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 >> 172.21.15.29:0/2050859971 conn(0x7f7dcc06b9e0 msgr2=0x7f7dcc0ca430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 shutdown_connections 2024-04-23T10:15:20.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:20.356+0000 7f7dd0fd4640 1 -- 172.21.15.29:0/2050859971 wait complete. 2024-04-23T10:15:20.373 INFO:tasks.ceph:check_enable_crimson: False 2024-04-23T10:15:20.373 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-23T10:15:20.373 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:20.374 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-23T10:15:20.385 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:20.385 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-23T10:15:20.440 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:20.441 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-23T10:15:20.493 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:20.493 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-23T10:15:20.515 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:20.516+0000 7fd393c49180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:15:20.527 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:20.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-23T10:15:20.527 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:20.527+0000 7f26fdc61180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:15:20.541 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:20.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-23T10:15:20.597 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:20.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-23T10:15:20.648 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-23T10:15:20.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-23T10:15:20.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 6e46ea02-d5dd-4188-8828-1b1b43a81155 0 2024-04-23T10:15:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.859+0000 7feea24f7640 1 Processor -- start 2024-04-23T10:15:20.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.859+0000 7feea24f7640 1 -- start start 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea24f7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea24f7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee9c0c8190 0x7fee9c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea24f7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee9c158e00 con 0x7fee9c0ca110 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea24f7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fee9c0c96a0 con 0x7fee9c0c8190 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea24f7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fee9c158280 con 0x7fee9c0c9d30 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea0a94640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee9c0c8190 0x7fee9c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea0a94640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee9c0c8190 0x7fee9c151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49238/0 (socket says 172.21.15.72:49238) 2024-04-23T10:15:20.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7fee9b7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fee9c0ca110 0x7fee9c0c7a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56518/0 (socket says 172.21.15.72:56518) 2024-04-23T10:15:20.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea0a94640 1 -- 172.21.15.72:0/1053527608 learned_addr learned my addr 172.21.15.72:0/1053527608 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:20.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea0a94640 1 -- 172.21.15.72:0/1053527608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 msgr2=0x7fee9c151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:20.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea0a94640 1 --2- 172.21.15.72:0/1053527608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea0a94640 1 -- 172.21.15.72:0/1053527608 >> v1:172.21.15.72:6789/0 conn(0x7fee9c0ca110 legacy=0x7fee9c0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea0a94640 1 -- 172.21.15.72:0/1053527608 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9c158560 con 0x7fee9c0c8190 2024-04-23T10:15:20.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7fee9bfff640 1 --2- 172.21.15.72:0/1053527608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:15:20.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7feea0a94640 1 --2- 172.21.15.72:0/1053527608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c151fc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009e50 tx=0x7fee8c01f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64f3e348fbcfbde6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:20.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7fee9affd640 1 -- 172.21.15.72:0/1053527608 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0b4070 con 0x7fee9c0c8190 2024-04-23T10:15:20.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7fee9affd640 1 -- 172.21.15.72:0/1053527608 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee8c0af400 con 0x7fee9c0c8190 2024-04-23T10:15:20.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.863+0000 7fee9affd640 1 -- 172.21.15.72:0/1053527608 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0af7d0 con 0x7fee9c0c8190 2024-04-23T10:15:20.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- 172.21.15.72:0/1053527608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 msgr2=0x7fee9c151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 --2- 172.21.15.72:0/1053527608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c151fc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009e50 tx=0x7fee8c01f210 comp rx=0 tx=0).stop 2024-04-23T10:15:20.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- 172.21.15.72:0/1053527608 shutdown_connections 2024-04-23T10:15:20.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 --2- 172.21.15.72:0/1053527608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c151fc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 --2- 172.21.15.72:0/1053527608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- 172.21.15.72:0/1053527608 >> 172.21.15.72:0/1053527608 conn(0x7fee9c06b9e0 msgr2=0x7fee9c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:20.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- 172.21.15.72:0/1053527608 shutdown_connections 2024-04-23T10:15:20.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- 172.21.15.72:0/1053527608 wait complete. 2024-04-23T10:15:20.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 Processor -- start 2024-04-23T10:15:20.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- start start 2024-04-23T10:15:20.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee9c0ca110 0x7fee9c146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c15b510 con 0x7fee9c0ca110 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c158b20 con 0x7fee9c0c8190 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fee9c157e80 con 0x7fee9c0c9d30 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c143dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49246/0 (socket says 172.21.15.72:49246) 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 -- 172.21.15.72:0/371497537 learned_addr learned my addr 172.21.15.72:0/371497537 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9b7fe640 1 --2- 172.21.15.72:0/371497537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:20.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 -- 172.21.15.72:0/371497537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 msgr2=0x7fee9c159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 --2- 172.21.15.72:0/371497537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 -- 172.21.15.72:0/371497537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee9c0ca110 msgr2=0x7fee9c146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 --2- 172.21.15.72:0/371497537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee9c0ca110 0x7fee9c146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 -- 172.21.15.72:0/371497537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9c1f08e0 con 0x7fee9c0c8190 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee9bfff640 1 --2- 172.21.15.72:0/371497537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c143dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee9400ebe0 tx=0x7fee9400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee98ff9640 1 -- 172.21.15.72:0/371497537 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9400cc30 con 0x7fee9c0c8190 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee98ff9640 1 -- 172.21.15.72:0/371497537 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9400cdd0 con 0x7fee9c0c8190 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9c14dbd0 con 0x7fee9c0c8190 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee98ff9640 1 -- 172.21.15.72:0/371497537 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94005bc0 con 0x7fee9c0c8190 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee9c1efe00 con 0x7fee9c0c8190 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee98ff9640 1 -- 172.21.15.72:0/371497537 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee940063c0 con 0x7fee9c0c8190 2024-04-23T10:15:20.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7fee98ff9640 1 -- 172.21.15.72:0/371497537 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fee94013c90 con 0x7fee9c0c8190 2024-04-23T10:15:20.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.867+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee9c0693c0 con 0x7fee9c0c8190 2024-04-23T10:15:20.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.875+0000 7fee98ff9640 1 -- 172.21.15.72:0/371497537 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fee94017020 con 0x7fee9c0c8190 2024-04-23T10:15:20.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.943+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6e46ea02-d5dd-4188-8828-1b1b43a81155", "id": 0} v 0) -- 0x7fee9c0c85a0 con 0x7fee9c0c8190 2024-04-23T10:15:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7fee98ff9640 1 -- 172.21.15.72:0/371497537 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e46ea02-d5dd-4188-8828-1b1b43a81155", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fee94013470 con 0x7fee9c0c8190 2024-04-23T10:15:20.947 INFO:teuthology.orchestra.run.smithi072.stdout:0 2024-04-23T10:15:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 msgr2=0x7fee9c143dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 --2- 172.21.15.72:0/371497537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c143dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee9400ebe0 tx=0x7fee9400c520 comp rx=0 tx=0).stop 2024-04-23T10:15:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 shutdown_connections 2024-04-23T10:15:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 --2- 172.21.15.72:0/371497537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee9c0ca110 0x7fee9c146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 --2- 172.21.15.72:0/371497537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c9d30 0x7fee9c159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 --2- 172.21.15.72:0/371497537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0c8190 0x7fee9c143dc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 >> 172.21.15.72:0/371497537 conn(0x7fee9c06b9e0 msgr2=0x7fee9c14e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 shutdown_connections 2024-04-23T10:15:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:20.947+0000 7feea24f7640 1 -- 172.21.15.72:0/371497537 wait complete. 2024-04-23T10:15:20.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 6bdb22bd-1e3c-425a-b281-9e2278da0520 1 2024-04-23T10:15:21.031 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:21.031+0000 7f26fdc61180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:15:21.068 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:21.068+0000 7fd393c49180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:15:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.083+0000 7f1613f43640 1 Processor -- start 2024-04-23T10:15:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.083+0000 7f1613f43640 1 -- start start 2024-04-23T10:15:21.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1613f43640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9550 0x7f160c155030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1613f43640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f160c0c8530 0x7f160c155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1613f43640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160c15b4d0 con 0x7f160c0c9170 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1613f43640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f160c155ab0 con 0x7f160c0c8530 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1613f43640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f160c0ca7d0 con 0x7f160c0c9550 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1611cdf640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f160c0c9170 0x7f160c0c7e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56532/0 (socket says 172.21.15.72:56532) 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1611cdf640 1 -- 172.21.15.72:0/3150448262 learned_addr learned my addr 172.21.15.72:0/3150448262 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f16114de640 1 --2- 172.21.15.72:0/3150448262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9550 0x7f160c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f16124e0640 1 --2- 172.21.15.72:0/3150448262 >> v2:172.21.15.29:3300/0 conn(0x7f160c0c8530 0x7f160c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1610cdd640 1 -- 172.21.15.72:0/3150448262 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223211210 0 0) 0x7f160c15b4d0 con 0x7f160c0c9170 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1610cdd640 1 -- 172.21.15.72:0/3150448262 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f8003530 con 0x7f160c0c9170 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f16114de640 1 -- 172.21.15.72:0/3150448262 >> v2:172.21.15.29:3300/0 conn(0x7f160c0c8530 msgr2=0x7f160c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f16114de640 1 --2- 172.21.15.72:0/3150448262 >> v2:172.21.15.29:3300/0 conn(0x7f160c0c8530 0x7f160c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f16114de640 1 -- 172.21.15.72:0/3150448262 >> v1:172.21.15.72:6789/0 conn(0x7f160c0c9170 legacy=0x7f160c0c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f16114de640 1 -- 172.21.15.72:0/3150448262 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c15b7b0 con 0x7f160c0c9550 2024-04-23T10:15:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f16114de640 1 --2- 172.21.15.72:0/3150448262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9550 0x7f160c155030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0097c0 tx=0x7f15fc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7e9532e0f055f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1610cdd640 1 -- 172.21.15.72:0/3150448262 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0b0070 con 0x7f160c0c9550 2024-04-23T10:15:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1610cdd640 1 -- 172.21.15.72:0/3150448262 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15fc0ab600 con 0x7f160c0c9550 2024-04-23T10:15:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.087+0000 7f1610cdd640 1 -- 172.21.15.72:0/3150448262 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0ab9d0 con 0x7f160c0c9550 2024-04-23T10:15:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- 172.21.15.72:0/3150448262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9550 msgr2=0x7f160c155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 --2- 172.21.15.72:0/3150448262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9550 0x7f160c155030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0097c0 tx=0x7f15fc01c4a0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- 172.21.15.72:0/3150448262 shutdown_connections 2024-04-23T10:15:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 --2- 172.21.15.72:0/3150448262 >> v2:172.21.15.29:3300/0 conn(0x7f160c0c8530 0x7f160c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 --2- 172.21.15.72:0/3150448262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9550 0x7f160c155030 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- 172.21.15.72:0/3150448262 >> 172.21.15.72:0/3150448262 conn(0x7f160c0c9a90 msgr2=0x7f160c0c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- 172.21.15.72:0/3150448262 shutdown_connections 2024-04-23T10:15:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- 172.21.15.72:0/3150448262 wait complete. 2024-04-23T10:15:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 Processor -- start 2024-04-23T10:15:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- start start 2024-04-23T10:15:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f160c0c8530 0x7f160c1f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9170 0x7f160c14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c0c9550 0x7f160c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f160c06e460 con 0x7f160c0c9550 2024-04-23T10:15:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f160c06e2e0 con 0x7f160c0c8530 2024-04-23T10:15:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f160c168380 con 0x7f160c0c9170 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9170 0x7f160c14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1611cdf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f160c0c8530 0x7f160c1f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9170 0x7f160c14dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34496/0 (socket says 172.21.15.72:34496) 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 -- 172.21.15.72:0/52916049 learned_addr learned my addr 172.21.15.72:0/52916049 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16124e0640 1 --2- 172.21.15.72:0/52916049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c0c9550 0x7f160c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 -- 172.21.15.72:0/52916049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f160c0c8530 msgr2=0x7f160c1f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 --2- 172.21.15.72:0/52916049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f160c0c8530 0x7f160c1f7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 -- 172.21.15.72:0/52916049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c0c9550 msgr2=0x7f160c0736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 --2- 172.21.15.72:0/52916049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c0c9550 0x7f160c0736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 -- 172.21.15.72:0/52916049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c1f8620 con 0x7f160c0c9170 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16114de640 1 --2- 172.21.15.72:0/52916049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9170 0x7f160c14dbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f15fc01a0d0 tx=0x7f15fc019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16027fc640 1 -- 172.21.15.72:0/52916049 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0b0040 con 0x7f160c0c9170 2024-04-23T10:15:21.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16027fc640 1 -- 172.21.15.72:0/52916049 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15fc0bb070 con 0x7f160c0c9170 2024-04-23T10:15:21.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c1f7d80 con 0x7f160c0c9170 2024-04-23T10:15:21.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16027fc640 1 -- 172.21.15.72:0/52916049 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0b6630 con 0x7f160c0c9170 2024-04-23T10:15:21.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c1f8340 con 0x7f160c0c9170 2024-04-23T10:15:21.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16027fc640 1 -- 172.21.15.72:0/52916049 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f15fc0b3070 con 0x7f160c0c9170 2024-04-23T10:15:21.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.091+0000 7f16027fc640 1 -- 172.21.15.72:0/52916049 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f15fc0c0850 con 0x7f160c0c9170 2024-04-23T10:15:21.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.095+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160c0693c0 con 0x7f160c0c9170 2024-04-23T10:15:21.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.103+0000 7f16027fc640 1 -- 172.21.15.72:0/52916049 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f15fc016090 con 0x7f160c0c9170 2024-04-23T10:15:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.171+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6bdb22bd-1e3c-425a-b281-9e2278da0520", "id": 1} v 0) -- 0x7f160c074600 con 0x7f160c0c9170 2024-04-23T10:15:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.175+0000 7f16027fc640 1 -- 172.21.15.72:0/52916049 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6bdb22bd-1e3c-425a-b281-9e2278da0520", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f15fc0c0af0 con 0x7f160c0c9170 2024-04-23T10:15:21.178 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-04-23T10:15:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9170 msgr2=0x7f160c14dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 --2- 172.21.15.72:0/52916049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9170 0x7f160c14dbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f15fc01a0d0 tx=0x7f15fc019240 comp rx=0 tx=0).stop 2024-04-23T10:15:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 shutdown_connections 2024-04-23T10:15:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 --2- 172.21.15.72:0/52916049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c0c9550 0x7f160c0736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 --2- 172.21.15.72:0/52916049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f160c0c9170 0x7f160c14dbf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 --2- 172.21.15.72:0/52916049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f160c0c8530 0x7f160c1f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 >> 172.21.15.72:0/52916049 conn(0x7f160c0c9a90 msgr2=0x7f160c14ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 shutdown_connections 2024-04-23T10:15:21.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.179+0000 7f1613f43640 1 -- 172.21.15.72:0/52916049 wait complete. 2024-04-23T10:15:21.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new cd517f53-aa2f-4faf-a252-f9b7ad473667 2 2024-04-23T10:15:21.241 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:21.239+0000 7f26fdc61180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:15:21.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59fa0ba640 1 Processor -- start 2024-04-23T10:15:21.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59fa0ba640 1 -- start start 2024-04-23T10:15:21.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59fa0ba640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f40cea00 0x7f59f415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59fa0ba640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59f4158ef0 0x7f59f4073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59fa0ba640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f41593a0 con 0x7f59f415d190 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59fa0ba640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f59f415c4e0 con 0x7f59f4158ef0 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59fa0ba640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f59f4159680 con 0x7f59f40cea00 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f37fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f40cea00 0x7f59f415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f3fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59f4158ef0 0x7f59f4073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f37fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f40cea00 0x7f59f415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34500/0 (socket says 172.21.15.72:34500) 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f37fe640 1 -- 172.21.15.72:0/2971974642 learned_addr learned my addr 172.21.15.72:0/2971974642 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f3fff640 1 -- 172.21.15.72:0/2971974642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f40cea00 msgr2=0x7f59f415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f3fff640 1 --2- 172.21.15.72:0/2971974642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f40cea00 0x7f59f415cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f3fff640 1 -- 172.21.15.72:0/2971974642 >> v1:172.21.15.29:6789/0 conn(0x7f59f415d190 legacy=0x7f59f4152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f3fff640 1 -- 172.21.15.72:0/2971974642 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f4159960 con 0x7f59f4158ef0 2024-04-23T10:15:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.311+0000 7f59f37fe640 1 --2- 172.21.15.72:0/2971974642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f40cea00 0x7f59f415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:15:21.315 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:21.312+0000 7fd393c49180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:15:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59f3fff640 1 --2- 172.21.15.72:0/2971974642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f4158ef0 0x7f59f4073bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009d90 tx=0x7f59ec01c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab7b29b517f46a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59f27fc640 1 -- 172.21.15.72:0/2971974642 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0b2070 con 0x7f59f4158ef0 2024-04-23T10:15:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59f27fc640 1 -- 172.21.15.72:0/2971974642 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec0a5980 con 0x7f59f4158ef0 2024-04-23T10:15:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59f27fc640 1 -- 172.21.15.72:0/2971974642 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0a5d50 con 0x7f59f4158ef0 2024-04-23T10:15:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59fa0ba640 1 -- 172.21.15.72:0/2971974642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f4158ef0 msgr2=0x7f59f4073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59fa0ba640 1 --2- 172.21.15.72:0/2971974642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f4158ef0 0x7f59f4073bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009d90 tx=0x7f59ec01c900 comp rx=0 tx=0).stop 2024-04-23T10:15:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59fa0ba640 1 -- 172.21.15.72:0/2971974642 shutdown_connections 2024-04-23T10:15:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59fa0ba640 1 --2- 172.21.15.72:0/2971974642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f4158ef0 0x7f59f4073bc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59fa0ba640 1 --2- 172.21.15.72:0/2971974642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f40cea00 0x7f59f415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59fa0ba640 1 -- 172.21.15.72:0/2971974642 >> 172.21.15.72:0/2971974642 conn(0x7f59f4070f40 msgr2=0x7f59f4071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59fa0ba640 1 -- 172.21.15.72:0/2971974642 shutdown_connections 2024-04-23T10:15:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.315+0000 7f59fa0ba640 1 -- 172.21.15.72:0/2971974642 wait complete. 2024-04-23T10:15:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 Processor -- start 2024-04-23T10:15:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 -- start start 2024-04-23T10:15:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f40cea00 0x7f59f4149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f4158ef0 0x7f59f414d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f415d190 0x7f59f414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4074280 con 0x7f59f415d190 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4074100 con 0x7f59f40cea00 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f59f4074400 con 0x7f59f4158ef0 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f40cea00 0x7f59f4149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f40cea00 0x7f59f4149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49260/0 (socket says 172.21.15.72:49260) 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 -- 172.21.15.72:0/838048190 learned_addr learned my addr 172.21.15.72:0/838048190 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f2ffd640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f4158ef0 0x7f59f414d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f3fff640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f415d190 0x7f59f414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 -- 172.21.15.72:0/838048190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f4158ef0 msgr2=0x7f59f414d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f4158ef0 0x7f59f414d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 -- 172.21.15.72:0/838048190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f415d190 msgr2=0x7f59f414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f415d190 0x7f59f414e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 -- 172.21.15.72:0/838048190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f414be70 con 0x7f59f40cea00 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f3fff640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f415d190 0x7f59f414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59f37fe640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f40cea00 0x7f59f4149e90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f59e400ea00 tx=0x7f59e400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59dbfff640 1 -- 172.21.15.72:0/838048190 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4017070 con 0x7f59f40cea00 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f41f2990 con 0x7f59f40cea00 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59dbfff640 1 -- 172.21.15.72:0/838048190 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e400ca60 con 0x7f59f40cea00 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59dbfff640 1 -- 172.21.15.72:0/838048190 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e400ce10 con 0x7f59f40cea00 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f414b8b0 con 0x7f59f40cea00 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59dbfff640 1 -- 172.21.15.72:0/838048190 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f59e401a070 con 0x7f59f40cea00 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59dbfff640 1 -- 172.21.15.72:0/838048190 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f59e401c870 con 0x7f59f40cea00 2024-04-23T10:15:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.319+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f40693c0 con 0x7f59f40cea00 2024-04-23T10:15:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.323+0000 7f59dbfff640 1 -- 172.21.15.72:0/838048190 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f59e401c450 con 0x7f59f40cea00 2024-04-23T10:15:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.387+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd517f53-aa2f-4faf-a252-f9b7ad473667", "id": 2} v 0) -- 0x7f59f40ce010 con 0x7f59f40cea00 2024-04-23T10:15:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59dbfff640 1 -- 172.21.15.72:0/838048190 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd517f53-aa2f-4faf-a252-f9b7ad473667", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f59e40059a0 con 0x7f59f40cea00 2024-04-23T10:15:21.394 INFO:teuthology.orchestra.run.smithi072.stdout:2 2024-04-23T10:15:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f40cea00 msgr2=0x7f59f4149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f40cea00 0x7f59f4149e90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f59e400ea00 tx=0x7f59e400eec0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 shutdown_connections 2024-04-23T10:15:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f415d190 0x7f59f414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59f4158ef0 0x7f59f414d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 --2- 172.21.15.72:0/838048190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59f40cea00 0x7f59f4149e90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 >> 172.21.15.72:0/838048190 conn(0x7f59f4070f40 msgr2=0x7f59f414f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 shutdown_connections 2024-04-23T10:15:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.395+0000 7f59fa0ba640 1 -- 172.21.15.72:0/838048190 wait complete. 2024-04-23T10:15:21.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea 3 2024-04-23T10:15:21.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e8c59640 1 Processor -- start 2024-04-23T10:15:21.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e8c59640 1 -- start start 2024-04-23T10:15:21.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e8c59640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24e40cea00 0x7f24e415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e8c59640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f24e4158ef0 0x7f24e4073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e8c59640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e41593a0 con 0x7f24e415d190 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e8c59640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f24e415c4e0 con 0x7f24e4158ef0 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e8c59640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f24e4159680 con 0x7f24e40cea00 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e259c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24e40cea00 0x7f24e415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e259c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24e40cea00 0x7f24e415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49272/0 (socket says 172.21.15.72:49272) 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e259c640 1 -- 172.21.15.72:0/3694339109 learned_addr learned my addr 172.21.15.72:0/3694339109 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e2d9d640 1 --2- 172.21.15.72:0/3694339109 >> v2:172.21.15.29:3300/0 conn(0x7f24e4158ef0 0x7f24e4073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e259c640 1 -- 172.21.15.72:0/3694339109 >> v2:172.21.15.29:3300/0 conn(0x7f24e4158ef0 msgr2=0x7f24e4073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e259c640 1 --2- 172.21.15.72:0/3694339109 >> v2:172.21.15.29:3300/0 conn(0x7f24e4158ef0 0x7f24e4073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e259c640 1 -- 172.21.15.72:0/3694339109 >> v1:172.21.15.29:6789/0 conn(0x7f24e415d190 legacy=0x7f24e4152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.559+0000 7f24e259c640 1 -- 172.21.15.72:0/3694339109 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e4159960 con 0x7f24e40cea00 2024-04-23T10:15:21.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e259c640 1 --2- 172.21.15.72:0/3694339109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e40cea00 0x7f24e415cc50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24e40cf910 tx=0x7f24d401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2175c686f0dfa2b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e1d9b640 1 -- 172.21.15.72:0/3694339109 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d40aa650 con 0x7f24e40cea00 2024-04-23T10:15:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e1d9b640 1 -- 172.21.15.72:0/3694339109 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d40af070 con 0x7f24e40cea00 2024-04-23T10:15:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e1d9b640 1 -- 172.21.15.72:0/3694339109 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d40aaa10 con 0x7f24e40cea00 2024-04-23T10:15:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- 172.21.15.72:0/3694339109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e40cea00 msgr2=0x7f24e415cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 --2- 172.21.15.72:0/3694339109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e40cea00 0x7f24e415cc50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24e40cf910 tx=0x7f24d401c4f0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- 172.21.15.72:0/3694339109 shutdown_connections 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 --2- 172.21.15.72:0/3694339109 >> v2:172.21.15.29:3300/0 conn(0x7f24e4158ef0 0x7f24e4073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 --2- 172.21.15.72:0/3694339109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e40cea00 0x7f24e415cc50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- 172.21.15.72:0/3694339109 >> 172.21.15.72:0/3694339109 conn(0x7f24e4070f40 msgr2=0x7f24e4071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- 172.21.15.72:0/3694339109 shutdown_connections 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- 172.21.15.72:0/3694339109 wait complete. 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 Processor -- start 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- start start 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e40cea00 0x7f24e414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24e4158ef0 0x7f24e406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e415d190 0x7f24e40c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f24e4074280 con 0x7f24e40cea00 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f24e4074100 con 0x7f24e415d190 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e8c59640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f24e4074400 con 0x7f24e4158ef0 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e2d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e415d190 0x7f24e40c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24dbfff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24e4158ef0 0x7f24e406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e2d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e415d190 0x7f24e40c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49286/0 (socket says 172.21.15.72:49286) 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24dbfff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24e4158ef0 0x7f24e406c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34512/0 (socket says 172.21.15.72:34512) 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e2d9d640 1 -- 172.21.15.72:0/997333759 learned_addr learned my addr 172.21.15.72:0/997333759 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.563+0000 7f24e259c640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e40cea00 0x7f24e414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24dbfff640 1 -- 172.21.15.72:0/997333759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e415d190 msgr2=0x7f24e40c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24dbfff640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e415d190 0x7f24e40c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24dbfff640 1 -- 172.21.15.72:0/997333759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e40cea00 msgr2=0x7f24e414d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24dbfff640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e40cea00 0x7f24e414d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24dbfff640 1 -- 172.21.15.72:0/997333759 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e4161aa0 con 0x7f24e4158ef0 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24e2d9d640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e415d190 0x7f24e40c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24e259c640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e40cea00 0x7f24e414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24dbfff640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24e4158ef0 0x7f24e406c940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00c3c0 tx=0x7f24cc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24daffd640 1 -- 172.21.15.72:0/997333759 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0052d0 con 0x7f24e4158ef0 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24daffd640 1 -- 172.21.15.72:0/997333759 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc005470 con 0x7f24e4158ef0 2024-04-23T10:15:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e406bb80 con 0x7f24e4158ef0 2024-04-23T10:15:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24daffd640 1 -- 172.21.15.72:0/997333759 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc007260 con 0x7f24e4158ef0 2024-04-23T10:15:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e406c140 con 0x7f24e4158ef0 2024-04-23T10:15:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24daffd640 1 -- 172.21.15.72:0/997333759 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f24cc007400 con 0x7f24e4158ef0 2024-04-23T10:15:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24daffd640 1 -- 172.21.15.72:0/997333759 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f24cc011590 con 0x7f24e4158ef0 2024-04-23T10:15:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e40693c0 con 0x7f24e4158ef0 2024-04-23T10:15:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.567+0000 7f24daffd640 1 -- 172.21.15.72:0/997333759 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f24cc003600 con 0x7f24e4158ef0 2024-04-23T10:15:21.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.631+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea", "id": 3} v 0) -- 0x7f24e414ff70 con 0x7f24e4158ef0 2024-04-23T10:15:21.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.635+0000 7f24daffd640 1 -- 172.21.15.72:0/997333759 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f24cc003ab0 con 0x7f24e4158ef0 2024-04-23T10:15:21.637 INFO:teuthology.orchestra.run.smithi072.stdout:3 2024-04-23T10:15:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24e4158ef0 msgr2=0x7f24e406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24e4158ef0 0x7f24e406c940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00c3c0 tx=0x7f24cc00c880 comp rx=0 tx=0).stop 2024-04-23T10:15:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 shutdown_connections 2024-04-23T10:15:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e415d190 0x7f24e40c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24e4158ef0 0x7f24e406c940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 --2- 172.21.15.72:0/997333759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e40cea00 0x7f24e414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 >> 172.21.15.72:0/997333759 conn(0x7f24e4070f40 msgr2=0x7f24e4071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 shutdown_connections 2024-04-23T10:15:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.639+0000 7f24e8c59640 1 -- 172.21.15.72:0/997333759 wait complete. 2024-04-23T10:15:21.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new acfd70d1-45fe-4746-9f3e-6447853dfaad 4 2024-04-23T10:15:21.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746c9e2640 1 Processor -- start 2024-04-23T10:15:21.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746c9e2640 1 -- start start 2024-04-23T10:15:21.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746c9e2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7468158ef0 0x7f7468152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746c9e2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f74681531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746c9e2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74681593a0 con 0x7f74680cea00 2024-04-23T10:15:21.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746c9e2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f746815c4e0 con 0x7f7468158ef0 2024-04-23T10:15:21.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746c9e2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7468159680 con 0x7f74680cede0 2024-04-23T10:15:21.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f7466d9d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f74681531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746659c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f74680cea00 0x7f746815cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56546/0 (socket says 172.21.15.72:56546) 2024-04-23T10:15:21.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.767+0000 7f746659c640 1 -- 172.21.15.72:0/3751844360 learned_addr learned my addr 172.21.15.72:0/3751844360 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-23T10:15:21.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f745ffff640 1 --2- 172.21.15.72:0/3751844360 >> v2:172.21.15.29:3300/0 conn(0x7f7468158ef0 0x7f7468152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7466d9d640 1 -- 172.21.15.72:0/3751844360 >> v2:172.21.15.29:3300/0 conn(0x7f7468158ef0 msgr2=0x7f7468152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:21.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7466d9d640 1 --2- 172.21.15.72:0/3751844360 >> v2:172.21.15.29:3300/0 conn(0x7f7468158ef0 0x7f7468152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7465d9b640 1 -- 172.21.15.72:0/3751844360 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3751594326 0 0) 0x7f74681593a0 con 0x7f74680cea00 2024-04-23T10:15:21.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7466d9d640 1 -- 172.21.15.72:0/3751844360 >> v1:172.21.15.72:6789/0 conn(0x7f74680cea00 legacy=0x7f746815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7466d9d640 1 -- 172.21.15.72:0/3751844360 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7468159960 con 0x7f74680cede0 2024-04-23T10:15:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7466d9d640 1 --2- 172.21.15.72:0/3751844360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f74681531e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7460009d90 tx=0x7f746001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bfeba74d10d195f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7465d9b640 1 -- 172.21.15.72:0/3751844360 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600b2070 con 0x7f74680cede0 2024-04-23T10:15:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7465d9b640 1 -- 172.21.15.72:0/3751844360 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74600a5a00 con 0x7f74680cede0 2024-04-23T10:15:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.771+0000 7f7465d9b640 1 -- 172.21.15.72:0/3751844360 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600a5dd0 con 0x7f74680cede0 2024-04-23T10:15:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- 172.21.15.72:0/3751844360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 msgr2=0x7f74681531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 --2- 172.21.15.72:0/3751844360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f74681531e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7460009d90 tx=0x7f746001c940 comp rx=0 tx=0).stop 2024-04-23T10:15:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- 172.21.15.72:0/3751844360 shutdown_connections 2024-04-23T10:15:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 --2- 172.21.15.72:0/3751844360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f74681531e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 --2- 172.21.15.72:0/3751844360 >> v2:172.21.15.29:3300/0 conn(0x7f7468158ef0 0x7f7468152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- 172.21.15.72:0/3751844360 >> 172.21.15.72:0/3751844360 conn(0x7f7468070f40 msgr2=0x7f7468071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- 172.21.15.72:0/3751844360 shutdown_connections 2024-04-23T10:15:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- 172.21.15.72:0/3751844360 wait complete. 2024-04-23T10:15:21.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 Processor -- start 2024-04-23T10:15:21.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- start start 2024-04-23T10:15:21.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74680cea00 0x7f746815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f746814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7468158ef0 0x7f746815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f74680743d0 con 0x7f74680cea00 2024-04-23T10:15:21.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f74680c9ac0 con 0x7f7468158ef0 2024-04-23T10:15:21.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7468074550 con 0x7f74680cede0 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f746814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f7466d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7468158ef0 0x7f746815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f746814f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34534/0 (socket says 172.21.15.72:34534) 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 -- 172.21.15.72:0/2569683810 learned_addr learned my addr 172.21.15.72:0/2569683810 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746659c640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74680cea00 0x7f746815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 -- 172.21.15.72:0/2569683810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7468158ef0 msgr2=0x7f746815a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7468158ef0 0x7f746815a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 -- 172.21.15.72:0/2569683810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74680cea00 msgr2=0x7f746815b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74680cea00 0x7f746815b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 -- 172.21.15.72:0/2569683810 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746815b680 con 0x7f74680cede0 2024-04-23T10:15:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f7466d9d640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7468158ef0 0x7f746815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745ffff640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f746814f110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f745000c7f0 tx=0x7f745000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745effd640 1 -- 172.21.15.72:0/2569683810 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450015070 con 0x7f74680cede0 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745effd640 1 -- 172.21.15.72:0/2569683810 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7450004240 con 0x7f74680cede0 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746814e490 con 0x7f74680cede0 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f745effd640 1 -- 172.21.15.72:0/2569683810 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450003620 con 0x7f74680cede0 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.775+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f746814d9b0 con 0x7f74680cede0 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.779+0000 7f745effd640 1 -- 172.21.15.72:0/2569683810 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f74500039d0 con 0x7f74680cede0 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.779+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74680693c0 con 0x7f74680cede0 2024-04-23T10:15:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.779+0000 7f745effd640 1 -- 172.21.15.72:0/2569683810 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7450019960 con 0x7f74680cede0 2024-04-23T10:15:21.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.779+0000 7f745effd640 1 -- 172.21.15.72:0/2569683810 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7450019bb0 con 0x7f74680cede0 2024-04-23T10:15:21.813 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:21.811+0000 7f26fdc61180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:15:21.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.843+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "acfd70d1-45fe-4746-9f3e-6447853dfaad", "id": 4} v 0) -- 0x7f74680714c0 con 0x7f74680cede0 2024-04-23T10:15:21.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.847+0000 7f745effd640 1 -- 172.21.15.72:0/2569683810 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "acfd70d1-45fe-4746-9f3e-6447853dfaad", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f7450019d90 con 0x7f74680cede0 2024-04-23T10:15:21.849 INFO:teuthology.orchestra.run.smithi072.stdout:4 2024-04-23T10:15:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 msgr2=0x7f746814f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f746814f110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f745000c7f0 tx=0x7f745000ccb0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 shutdown_connections 2024-04-23T10:15:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7468158ef0 0x7f746815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74680cede0 0x7f746814f110 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 --2- 172.21.15.72:0/2569683810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74680cea00 0x7f746815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 >> 172.21.15.72:0/2569683810 conn(0x7f7468070f40 msgr2=0x7f74680c5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 shutdown_connections 2024-04-23T10:15:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.851+0000 7f746c9e2640 1 -- 172.21.15.72:0/2569683810 wait complete. 2024-04-23T10:15:21.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new d93f7e73-c8d0-402e-bf90-9e81ef1bf283 5 2024-04-23T10:15:21.870 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:21.871+0000 7f26fdc61180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:15:21.897 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:21.896+0000 7fd393c49180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:15:21.924 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:21.923+0000 7f26fdc61180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:15:21.953 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:21.952+0000 7fd393c49180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:15:21.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d28c4d640 1 Processor -- start 2024-04-23T10:15:21.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d28c4d640 1 -- start start 2024-04-23T10:15:21.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d28c4d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6d24073b40 0x7f6d24073f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d28c4d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d2406dea0 con 0x7f6d240700a0 2024-04-23T10:15:21.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d28c4d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d2406fe10 con 0x7f6d24152a00 2024-04-23T10:15:21.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d28c4d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f6d24069e60 con 0x7f6d24073b40 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d22d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6d24152a00 0x7f6d24152e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56560/0 (socket says 172.21.15.72:56560) 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d22d9d640 1 -- 172.21.15.72:0/3884043051 learned_addr learned my addr 172.21.15.72:0/3884043051 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2259c640 1 --2- 172.21.15.72:0/3884043051 >> v2:172.21.15.29:3300/0 conn(0x7f6d24073b40 0x7f6d24073f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523545426 0 0) 0x7f6d2406fe10 con 0x7f6d24152a00 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d0c003530 con 0x7f6d24152a00 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 <== mon.1 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2157507957 0 0) 0x7f6d0c003530 con 0x7f6d24152a00 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 >> v2:172.21.15.29:3300/0 conn(0x7f6d24073b40 msgr2=0x7f6d24073f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 --2- 172.21.15.72:0/3884043051 >> v2:172.21.15.29:3300/0 conn(0x7f6d24073b40 0x7f6d24073f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 >> v1:172.21.15.29:6789/0 conn(0x7f6d240700a0 legacy=0x7f6d2406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2406a140 con 0x7f6d24152a00 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 <== mon.1 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f6d14001680 con 0x7f6d24152a00 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2259c640 1 --2- 172.21.15.72:0/3884043051 >> v2:172.21.15.29:3300/0 conn(0x7f6d24073b40 0x7f6d24073f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 >> v1:172.21.15.72:6789/0 conn(0x7f6d24152a00 legacy=0x7f6d24152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d0c0039c0 0x7f6d0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c004810 0x7f6d0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d0c0051d0 0x7f6d0c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6d24069e60 con 0x7f6d0c004810 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c00c120 con 0x7f6d0c0039c0 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c00c320 con 0x7f6d0c0051d0 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2259c640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d0c0039c0 0x7f6d0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d22d9d640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d0c0051d0 0x7f6d0c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d21d9b640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c004810 0x7f6d0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2259c640 1 -- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d0c0051d0 msgr2=0x7f6d0c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2259c640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d0c0051d0 0x7f6d0c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2259c640 1 -- 172.21.15.72:0/3884043051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c004810 msgr2=0x7f6d0c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2259c640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c004810 0x7f6d0c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d2259c640 1 -- 172.21.15.72:0/3884043051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c003530 con 0x7f6d0c0039c0 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d22d9d640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d0c0051d0 0x7f6d0c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:15:21.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.987+0000 7f6d22d9d640 1 -- 172.21.15.72:0/3884043051 reap_dead start 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d2259c640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d0c0039c0 0x7f6d0c003de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0073e0 tx=0x7f6d1c01cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b54dfd5d515a0bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0b2070 con 0x7f6d0c0039c0 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c0a5ba0 con 0x7f6d0c0039c0 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d2159a640 1 -- 172.21.15.72:0/3884043051 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c009c80 con 0x7f6d0c0039c0 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 -- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d0c0039c0 msgr2=0x7f6d0c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d0c0039c0 0x7f6d0c003de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0073e0 tx=0x7f6d1c01cec0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 -- 172.21.15.72:0/3884043051 shutdown_connections 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 --2- 172.21.15.72:0/3884043051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d0c0039c0 0x7f6d0c003de0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 -- 172.21.15.72:0/3884043051 >> 172.21.15.72:0/3884043051 conn(0x7f6d24075360 msgr2=0x7f6d2406f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 -- 172.21.15.72:0/3884043051 shutdown_connections 2024-04-23T10:15:21.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 -- 172.21.15.72:0/3884043051 wait complete. 2024-04-23T10:15:21.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 Processor -- start 2024-04-23T10:15:21.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.991+0000 7f6d28c4d640 1 -- start start 2024-04-23T10:15:21.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c0039c0 0x7f6d240c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d241557a0 0x7f6d24150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24155ba0 0x7f6d241511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6d241595a0 con 0x7f6d0c0039c0 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6d241592c0 con 0x7f6d24155ba0 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6d24159880 con 0x7f6d241557a0 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d241557a0 0x7f6d24150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d22d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24155ba0 0x7f6d241511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d241557a0 0x7f6d24150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34554/0 (socket says 172.21.15.72:34554) 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d22d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24155ba0 0x7f6d241511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49312/0 (socket says 172.21.15.72:49312) 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 -- 172.21.15.72:0/1414281911 learned_addr learned my addr 172.21.15.72:0/1414281911 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d2259c640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c0039c0 0x7f6d240c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 -- 172.21.15.72:0/1414281911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24155ba0 msgr2=0x7f6d241511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24155ba0 0x7f6d241511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 -- 172.21.15.72:0/1414281911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c0039c0 msgr2=0x7f6d240c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c0039c0 0x7f6d240c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 -- 172.21.15.72:0/1414281911 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d241501d0 con 0x7f6d241557a0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d2259c640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c0039c0 0x7f6d240c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d21d9b640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d241557a0 0x7f6d24150c70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800e4b0 tx=0x7f6d1800e970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d12ffd640 1 -- 172.21.15.72:0/1414281911 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d180052e0 con 0x7f6d241557a0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d12ffd640 1 -- 172.21.15.72:0/1414281911 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d18018070 con 0x7f6d241557a0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d12ffd640 1 -- 172.21.15.72:0/1414281911 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18005480 con 0x7f6d241557a0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d24153920 con 0x7f6d241557a0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d24150470 con 0x7f6d241557a0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d12ffd640 1 -- 172.21.15.72:0/1414281911 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d18003840 con 0x7f6d241557a0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d24068d70 con 0x7f6d241557a0 2024-04-23T10:15:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.995+0000 7f6d12ffd640 1 -- 172.21.15.72:0/1414281911 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f6d18003b30 con 0x7f6d241557a0 2024-04-23T10:15:21.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:21.999+0000 7f6d12ffd640 1 -- 172.21.15.72:0/1414281911 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6d1801d460 con 0x7f6d241557a0 2024-04-23T10:15:22.006 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:22.007+0000 7f26fdc61180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:15:22.008 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:22.008+0000 7fd393c49180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:15:22.059 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:22.059+0000 7f26fdc61180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:15:22.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.063+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d93f7e73-c8d0-402e-bf90-9e81ef1bf283", "id": 5} v 0) -- 0x7f6d2406d9e0 con 0x7f6d241557a0 2024-04-23T10:15:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d12ffd640 1 -- 172.21.15.72:0/1414281911 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d93f7e73-c8d0-402e-bf90-9e81ef1bf283", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f6d1801d640 con 0x7f6d241557a0 2024-04-23T10:15:22.071 INFO:teuthology.orchestra.run.smithi072.stdout:5 2024-04-23T10:15:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d241557a0 msgr2=0x7f6d24150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d241557a0 0x7f6d24150c70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800e4b0 tx=0x7f6d1800e970 comp rx=0 tx=0).stop 2024-04-23T10:15:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 shutdown_connections 2024-04-23T10:15:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24155ba0 0x7f6d241511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d241557a0 0x7f6d24150c70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 --2- 172.21.15.72:0/1414281911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d0c0039c0 0x7f6d240c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 >> 172.21.15.72:0/1414281911 conn(0x7f6d24075360 msgr2=0x7f6d24157780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 shutdown_connections 2024-04-23T10:15:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.071+0000 7f6d28c4d640 1 -- 172.21.15.72:0/1414281911 wait complete. 2024-04-23T10:15:22.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 330ae5ec-02c0-490e-8031-8a5f432a1dba 6 2024-04-23T10:15:22.089 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:22.092+0000 7fd393c49180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:15:22.139 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:22.139+0000 7f26fdc61180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:15:22.144 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:22.144+0000 7fd393c49180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:15:22.194 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:22.195+0000 7f26fdc61180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:15:22.224 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:22.224+0000 7fd393c49180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:15:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.243+0000 7f1d528dd640 1 Processor -- start 2024-04-23T10:15:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.243+0000 7f1d528dd640 1 -- start start 2024-04-23T10:15:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d528dd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d4c0c9a60 0x7f1d4c0c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d528dd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d4c0c9e40 0x7f1d4c0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d528dd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0caad0 0x7f1d4c0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d528dd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4c0c93c0 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d528dd640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4c0caf60 con 0x7f1d4c0c9e40 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d528dd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c0c4b40 con 0x7f1d4c0caad0 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d50e7a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0caad0 0x7f1d4c0cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d4c0c9e40 0x7f1d4c0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d4c0c9e40 0x7f1d4c0ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49314/0 (socket says 172.21.15.72:49314) 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 -- 172.21.15.72:0/674751262 learned_addr learned my addr 172.21.15.72:0/674751262 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d50e7a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0caad0 0x7f1d4c0cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34566/0 (socket says 172.21.15.72:34566) 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4bfff640 1 --2- 172.21.15.72:0/674751262 >> v2:172.21.15.29:3300/0 conn(0x7f1d4c0c9a60 0x7f1d4c0c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 -- 172.21.15.72:0/674751262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0caad0 msgr2=0x7f1d4c0cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 --2- 172.21.15.72:0/674751262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0caad0 0x7f1d4c0cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 -- 172.21.15.72:0/674751262 >> v2:172.21.15.29:3300/0 conn(0x7f1d4c0c9a60 msgr2=0x7f1d4c0c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 --2- 172.21.15.72:0/674751262 >> v2:172.21.15.29:3300/0 conn(0x7f1d4c0c9a60 0x7f1d4c0c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 -- 172.21.15.72:0/674751262 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c0c4e20 con 0x7f1d4c0c9e40 2024-04-23T10:15:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d50e7a640 1 --2- 172.21.15.72:0/674751262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0caad0 0x7f1d4c0cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:15:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4b7fe640 1 --2- 172.21.15.72:0/674751262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9e40 0x7f1d4c0ca590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c159010 tx=0x7f1d4001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94c7ee5450c28615 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4affd640 1 -- 172.21.15.72:0/674751262 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400b0070 con 0x7f1d4c0c9e40 2024-04-23T10:15:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4affd640 1 -- 172.21.15.72:0/674751262 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d400ab600 con 0x7f1d4c0c9e40 2024-04-23T10:15:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.247+0000 7f1d4affd640 1 -- 172.21.15.72:0/674751262 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400ab9d0 con 0x7f1d4c0c9e40 2024-04-23T10:15:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- 172.21.15.72:0/674751262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9e40 msgr2=0x7f1d4c0ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 --2- 172.21.15.72:0/674751262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9e40 0x7f1d4c0ca590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c159010 tx=0x7f1d4001c460 comp rx=0 tx=0).stop 2024-04-23T10:15:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- 172.21.15.72:0/674751262 shutdown_connections 2024-04-23T10:15:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 --2- 172.21.15.72:0/674751262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0caad0 0x7f1d4c0cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 --2- 172.21.15.72:0/674751262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9e40 0x7f1d4c0ca590 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 --2- 172.21.15.72:0/674751262 >> v2:172.21.15.29:3300/0 conn(0x7f1d4c0c9a60 0x7f1d4c0c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- 172.21.15.72:0/674751262 >> 172.21.15.72:0/674751262 conn(0x7f1d4c06b9e0 msgr2=0x7f1d4c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- 172.21.15.72:0/674751262 shutdown_connections 2024-04-23T10:15:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- 172.21.15.72:0/674751262 wait complete. 2024-04-23T10:15:22.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 Processor -- start 2024-04-23T10:15:22.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- start start 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9a60 0x7f1d4c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0c9e40 0x7f1d4c1f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d4c159bb0 0x7f1d4c1f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c153440 con 0x7f1d4c159bb0 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c0ce2f0 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c1535c0 con 0x7f1d4c0c9e40 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9a60 0x7f1d4c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9a60 0x7f1d4c14c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49328/0 (socket says 172.21.15.72:49328) 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 -- 172.21.15.72:0/410992618 learned_addr learned my addr 172.21.15.72:0/410992618 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4b7fe640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0c9e40 0x7f1d4c1f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d50e7a640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d4c159bb0 0x7f1d4c1f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 -- 172.21.15.72:0/410992618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0c9e40 msgr2=0x7f1d4c1f13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0c9e40 0x7f1d4c1f13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 -- 172.21.15.72:0/410992618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d4c159bb0 msgr2=0x7f1d4c1f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d4c159bb0 0x7f1d4c1f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 -- 172.21.15.72:0/410992618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c0ca900 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d50e7a640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d4c159bb0 0x7f1d4c1f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d4bfff640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9a60 0x7f1d4c14c950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00d800 tx=0x7f1d3c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d48ff9640 1 -- 172.21.15.72:0/410992618 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c018020 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d48ff9640 1 -- 172.21.15.72:0/410992618 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0096c0 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4c1f3e80 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d48ff9640 1 -- 172.21.15.72:0/410992618 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c009ab0 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4c157f10 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d48ff9640 1 -- 172.21.15.72:0/410992618 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1d3c01b020 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d48ff9640 1 -- 172.21.15.72:0/410992618 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f1d3c01db80 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.251+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d4c0693c0 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.255+0000 7f1d48ff9640 1 -- 172.21.15.72:0/410992618 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1d3c022020 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.281 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:22.280+0000 7fd393c49180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:15:22.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.335+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "330ae5ec-02c0-490e-8031-8a5f432a1dba", "id": 6} v 0) -- 0x7f1d4c1461d0 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.339+0000 7f1d48ff9640 1 -- 172.21.15.72:0/410992618 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "330ae5ec-02c0-490e-8031-8a5f432a1dba", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f1d3c01d720 con 0x7f1d4c0c9a60 2024-04-23T10:15:22.341 INFO:teuthology.orchestra.run.smithi072.stdout:6 2024-04-23T10:15:22.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9a60 msgr2=0x7f1d4c14c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9a60 0x7f1d4c14c950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00d800 tx=0x7f1d3c00dcc0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 shutdown_connections 2024-04-23T10:15:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d4c159bb0 0x7f1d4c1f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d4c0c9e40 0x7f1d4c1f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 --2- 172.21.15.72:0/410992618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4c0c9a60 0x7f1d4c14c950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 >> 172.21.15.72:0/410992618 conn(0x7f1d4c06b9e0 msgr2=0x7f1d4c0c6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 shutdown_connections 2024-04-23T10:15:22.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.343+0000 7f1d528dd640 1 -- 172.21.15.72:0/410992618 wait complete. 2024-04-23T10:15:22.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 789febc7-727c-4454-88c9-9b396669f9fe 7 2024-04-23T10:15:22.365 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:22.363+0000 7f26fdc61180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:15:22.428 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:22.427+0000 7f26fdc61180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:15:22.438 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:22.440+0000 7fd393c49180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:15:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.479+0000 7fa73b3a3640 1 Processor -- start 2024-04-23T10:15:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.479+0000 7fa73b3a3640 1 -- start start 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.479+0000 7fa73b3a3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7341533b0 0x7fa734073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.479+0000 7fa73b3a3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7341593a0 con 0x7fa734158ef0 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.479+0000 7fa73b3a3640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa734159680 con 0x7fa7340cea00 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.479+0000 7fa73b3a3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa73415c4e0 con 0x7fa7341533b0 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa739940640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7341533b0 0x7fa734073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73913f640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa7340cea00 0x7fa73415cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56568/0 (socket says 172.21.15.72:56568) 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73913f640 1 -- 172.21.15.72:0/3556222142 learned_addr learned my addr 172.21.15.72:0/3556222142 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa72bfff640 1 -- 172.21.15.72:0/3556222142 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722728698 0 0) 0x7fa734159680 con 0x7fa7340cea00 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa72bfff640 1 -- 172.21.15.72:0/3556222142 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa720003530 con 0x7fa7340cea00 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa739940640 1 -- 172.21.15.72:0/3556222142 >> v1:172.21.15.72:6789/0 conn(0x7fa7340cea00 legacy=0x7fa73415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa739940640 1 -- 172.21.15.72:0/3556222142 >> v1:172.21.15.29:6789/0 conn(0x7fa734158ef0 legacy=0x7fa734152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa739940640 1 -- 172.21.15.72:0/3556222142 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa734159960 con 0x7fa7341533b0 2024-04-23T10:15:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa739940640 1 --2- 172.21.15.72:0/3556222142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7341533b0 0x7fa734073bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009dc0 tx=0x7fa72c01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e954f8b7edd9ceaa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa72bfff640 1 -- 172.21.15.72:0/3556222142 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0b2070 con 0x7fa7341533b0 2024-04-23T10:15:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa72bfff640 1 -- 172.21.15.72:0/3556222142 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c0a5a20 con 0x7fa7341533b0 2024-04-23T10:15:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa72bfff640 1 -- 172.21.15.72:0/3556222142 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0a5df0 con 0x7fa7341533b0 2024-04-23T10:15:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73b3a3640 1 -- 172.21.15.72:0/3556222142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7341533b0 msgr2=0x7fa734073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73b3a3640 1 --2- 172.21.15.72:0/3556222142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7341533b0 0x7fa734073bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009dc0 tx=0x7fa72c01c960 comp rx=0 tx=0).stop 2024-04-23T10:15:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73b3a3640 1 -- 172.21.15.72:0/3556222142 shutdown_connections 2024-04-23T10:15:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73b3a3640 1 --2- 172.21.15.72:0/3556222142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7341533b0 0x7fa734073bc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73b3a3640 1 -- 172.21.15.72:0/3556222142 >> 172.21.15.72:0/3556222142 conn(0x7fa734070f40 msgr2=0x7fa734071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73b3a3640 1 -- 172.21.15.72:0/3556222142 shutdown_connections 2024-04-23T10:15:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.483+0000 7fa73b3a3640 1 -- 172.21.15.72:0/3556222142 wait complete. 2024-04-23T10:15:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 Processor -- start 2024-04-23T10:15:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 -- start start 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7340cea00 0x7fa734149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7341533b0 0x7fa734163a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa734158ef0 0x7fa734163fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa734074510 con 0x7fa7341533b0 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa7340c9ac0 con 0x7fa7340cea00 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa7341670a0 con 0x7fa734158ef0 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73913f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7340cea00 0x7fa734149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa734158ef0 0x7fa734163fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa734158ef0 0x7fa734163fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34594/0 (socket says 172.21.15.72:34594) 2024-04-23T10:15:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73913f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7340cea00 0x7fa734149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49344/0 (socket says 172.21.15.72:49344) 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 -- 172.21.15.72:0/2191987112 learned_addr learned my addr 172.21.15.72:0/2191987112 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73893e640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7341533b0 0x7fa734163a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 -- 172.21.15.72:0/2191987112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7340cea00 msgr2=0x7fa734149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7340cea00 0x7fa734149890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 -- 172.21.15.72:0/2191987112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7341533b0 msgr2=0x7fa734163a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7341533b0 0x7fa734163a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 -- 172.21.15.72:0/2191987112 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73414b450 con 0x7fa734158ef0 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73893e640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7341533b0 0x7fa734163a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa739940640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa734158ef0 0x7fa734163fa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa72c01ce40 tx=0x7fa72c019700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa729ffb640 1 -- 172.21.15.72:0/2191987112 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0b2050 con 0x7fa734158ef0 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa729ffb640 1 -- 172.21.15.72:0/2191987112 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c0be070 con 0x7fa734158ef0 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73414a200 con 0x7fa734158ef0 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa729ffb640 1 -- 172.21.15.72:0/2191987112 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0adab0 con 0x7fa734158ef0 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa734149dd0 con 0x7fa734158ef0 2024-04-23T10:15:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa729ffb640 1 -- 172.21.15.72:0/2191987112 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa72c0adc50 con 0x7fa734158ef0 2024-04-23T10:15:22.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa729ffb640 1 -- 172.21.15.72:0/2191987112 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa72c0c3d20 con 0x7fa734158ef0 2024-04-23T10:15:22.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.487+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7341f4230 con 0x7fa734158ef0 2024-04-23T10:15:22.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.491+0000 7fa729ffb640 1 -- 172.21.15.72:0/2191987112 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa7341f4230 con 0x7fa734158ef0 2024-04-23T10:15:22.502 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:22.504+0000 7fd393c49180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:15:22.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.559+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "789febc7-727c-4454-88c9-9b396669f9fe", "id": 7} v 0) -- 0x7fa7340693c0 con 0x7fa734158ef0 2024-04-23T10:15:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.567+0000 7fa729ffb640 1 -- 172.21.15.72:0/2191987112 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "789febc7-727c-4454-88c9-9b396669f9fe", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa72c016580 con 0x7fa734158ef0 2024-04-23T10:15:22.568 INFO:teuthology.orchestra.run.smithi072.stdout:7 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa734158ef0 msgr2=0x7fa734163fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa734158ef0 0x7fa734163fa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa72c01ce40 tx=0x7fa72c019700 comp rx=0 tx=0).stop 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 shutdown_connections 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa734158ef0 0x7fa734163fa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7341533b0 0x7fa734163a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 --2- 172.21.15.72:0/2191987112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7340cea00 0x7fa734149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 >> 172.21.15.72:0/2191987112 conn(0x7fa734070f40 msgr2=0x7fa7340c5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 shutdown_connections 2024-04-23T10:15:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-23T10:15:22.571+0000 7fa73b3a3640 1 -- 172.21.15.72:0/2191987112 wait complete. 2024-04-23T10:15:22.584 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-23T10:15:22.584 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-23T10:15:22.587 INFO:tasks.ceph.osd.0:Started 2024-04-23T10:15:22.587 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-23T10:15:22.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-23T10:15:22.589 INFO:tasks.ceph.osd.1:Started 2024-04-23T10:15:22.589 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-23T10:15:22.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-23T10:15:22.592 INFO:tasks.ceph.osd.2:Started 2024-04-23T10:15:22.592 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-23T10:15:22.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-23T10:15:22.594 INFO:tasks.ceph.osd.3:Started 2024-04-23T10:15:22.594 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-23T10:15:22.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-23T10:15:22.596 INFO:tasks.ceph.osd.4:Started 2024-04-23T10:15:22.596 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-23T10:15:22.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-23T10:15:22.598 INFO:tasks.ceph.osd.5:Started 2024-04-23T10:15:22.598 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-23T10:15:22.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-23T10:15:22.601 INFO:tasks.ceph.osd.6:Started 2024-04-23T10:15:22.601 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-23T10:15:22.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-23T10:15:22.603 INFO:tasks.ceph.osd.7:Started 2024-04-23T10:15:22.603 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.732+0000 7f4a118dd640 1 Processor -- start 2024-04-23T10:15:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.732+0000 7f4a118dd640 1 -- start start 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.732+0000 7f4a118dd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a0c15bd80 0x7f4a0c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.732+0000 7f4a118dd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a0c0cbcb0 0x7f4a0c0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.732+0000 7f4a118dd640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c06c910 con 0x7f4a0c151bb0 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0c06cbf0 con 0x7f4a0c15bd80 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0c06ced0 con 0x7f4a0c0cbcb0 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a0c15bd80 0x7f4a0c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0affd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4a0c151bb0 0x7f4a0c0c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:53212/0 (socket says 172.21.15.29:53212) 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0affd640 1 -- 172.21.15.29:0/1895925367 learned_addr learned my addr 172.21.15.29:0/1895925367 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0b7fe640 1 --2- 172.21.15.29:0/1895925367 >> v2:172.21.15.72:3300/0 conn(0x7f4a0c0cbcb0 0x7f4a0c0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a09ffb640 1 -- 172.21.15.29:0/1895925367 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425157059 0 0) 0x7f4a0c06c910 con 0x7f4a0c151bb0 2024-04-23T10:15:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0a7fc640 1 -- 172.21.15.29:0/1895925367 >> v2:172.21.15.72:3300/0 conn(0x7f4a0c0cbcb0 msgr2=0x7f4a0c0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:22.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0a7fc640 1 --2- 172.21.15.29:0/1895925367 >> v2:172.21.15.72:3300/0 conn(0x7f4a0c0cbcb0 0x7f4a0c0c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0a7fc640 1 -- 172.21.15.29:0/1895925367 >> v1:172.21.15.72:6789/0 conn(0x7f4a0c151bb0 legacy=0x7f4a0c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0a7fc640 1 -- 172.21.15.29:0/1895925367 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c06d1b0 con 0x7f4a0c15bd80 2024-04-23T10:15:22.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a0a7fc640 1 --2- 172.21.15.29:0/1895925367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c15bd80 0x7f4a0c0cb770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0b4a10 tx=0x7f4a0001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a09e63f17b02e2a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:22.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a09ffb640 1 -- 172.21.15.29:0/1895925367 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000b5070 con 0x7f4a0c15bd80 2024-04-23T10:15:22.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a09ffb640 1 -- 172.21.15.29:0/1895925367 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a000a8970 con 0x7f4a0c15bd80 2024-04-23T10:15:22.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a09ffb640 1 -- 172.21.15.29:0/1895925367 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000a8d40 con 0x7f4a0c15bd80 2024-04-23T10:15:22.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 -- 172.21.15.29:0/1895925367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c15bd80 msgr2=0x7f4a0c0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 --2- 172.21.15.29:0/1895925367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c15bd80 0x7f4a0c0cb770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0b4a10 tx=0x7f4a0001ec70 comp rx=0 tx=0).stop 2024-04-23T10:15:22.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 -- 172.21.15.29:0/1895925367 shutdown_connections 2024-04-23T10:15:22.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 --2- 172.21.15.29:0/1895925367 >> v2:172.21.15.72:3300/0 conn(0x7f4a0c0cbcb0 0x7f4a0c0c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 --2- 172.21.15.29:0/1895925367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c15bd80 0x7f4a0c0cb770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 -- 172.21.15.29:0/1895925367 >> 172.21.15.29:0/1895925367 conn(0x7f4a0c0730f0 msgr2=0x7f4a0c073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:22.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 -- 172.21.15.29:0/1895925367 shutdown_connections 2024-04-23T10:15:22.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.736+0000 7f4a118dd640 1 -- 172.21.15.29:0/1895925367 wait complete. 2024-04-23T10:15:22.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 Processor -- start 2024-04-23T10:15:22.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 -- start start 2024-04-23T10:15:22.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a0c0cbcb0 0x7f4a0c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c151bb0 0x7f4a0c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a0c15bd80 0x7f4a0c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c0c6010 con 0x7f4a0c151bb0 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c151f90 con 0x7f4a0c15bd80 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0c0c6190 con 0x7f4a0c0cbcb0 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c151bb0 0x7f4a0c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c151bb0 0x7f4a0c0b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38562/0 (socket says 172.21.15.29:38562) 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 -- 172.21.15.29:0/2745688795 learned_addr learned my addr 172.21.15.29:0/2745688795 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0affd640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a0c0cbcb0 0x7f4a0c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0b7fe640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a0c15bd80 0x7f4a0c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 -- 172.21.15.29:0/2745688795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a0c0cbcb0 msgr2=0x7f4a0c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a0c0cbcb0 0x7f4a0c14cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 -- 172.21.15.29:0/2745688795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a0c15bd80 msgr2=0x7f4a0c14d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a0c15bd80 0x7f4a0c14d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 -- 172.21.15.29:0/2745688795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c0b52e0 con 0x7f4a0c151bb0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a0a7fc640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c151bb0 0x7f4a0c0b6390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a000b3040 tx=0x7f4a0001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f49f3fff640 1 -- 172.21.15.29:0/2745688795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000bf070 con 0x7f4a0c151bb0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f49f3fff640 1 -- 172.21.15.29:0/2745688795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a000b0720 con 0x7f4a0c151bb0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c15a1c0 con 0x7f4a0c151bb0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f49f3fff640 1 -- 172.21.15.29:0/2745688795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000b5040 con 0x7f4a0c151bb0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c0b4d20 con 0x7f4a0c151bb0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f49f3fff640 1 -- 172.21.15.29:0/2745688795 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a000c2070 con 0x7f4a0c151bb0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f49f3fff640 1 -- 172.21.15.29:0/2745688795 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4a000b9ac0 con 0x7f4a0c151bb0 2024-04-23T10:15:22.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.740+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0c068d70 con 0x7f4a0c151bb0 2024-04-23T10:15:22.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.744+0000 7f49f3fff640 1 -- 172.21.15.29:0/2745688795 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4a0c0b52e0 con 0x7f4a0c151bb0 2024-04-23T10:15:22.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a0c158e00 con 0x7f4a0c151bb0 2024-04-23T10:15:22.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f49f3fff640 1 -- 172.21.15.29:0/2745688795 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4a000187d0 con 0x7f4a0c151bb0 2024-04-23T10:15:22.800 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:22.800 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:22.564029+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:22.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c151bb0 msgr2=0x7f4a0c0b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:22.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f4a118dd640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c151bb0 0x7f4a0c0b6390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a000b3040 tx=0x7f4a0001ba10 comp rx=0 tx=0).stop 2024-04-23T10:15:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 shutdown_connections 2024-04-23T10:15:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f4a118dd640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a0c15bd80 0x7f4a0c14d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f4a118dd640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a0c151bb0 0x7f4a0c0b6390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f4a118dd640 1 --2- 172.21.15.29:0/2745688795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a0c0cbcb0 0x7f4a0c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.800+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 >> 172.21.15.29:0/2745688795 conn(0x7f4a0c0730f0 msgr2=0x7f4a0c0734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.804+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 shutdown_connections 2024-04-23T10:15:22.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:22.804+0000 7f4a118dd640 1 -- 172.21.15.29:0/2745688795 wait complete. 2024-04-23T10:15:22.816 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-23T10:15:22.817 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-23T10:15:23.211 INFO:tasks.ceph.osd.5.smithi072.stderr:2024-04-23T10:15:23.211+0000 7f8a1df657c0 -1 Falling back to public interface 2024-04-23T10:15:23.212 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-04-23T10:15:23.211+0000 7fbde18be7c0 -1 Falling back to public interface 2024-04-23T10:15:23.212 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-04-23T10:15:23.211+0000 7fbde087e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-23T10:15:23.216 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-23T10:15:23.216+0000 7f829ce587c0 -1 Falling back to public interface 2024-04-23T10:15:23.230 INFO:tasks.ceph.osd.4.smithi072.stderr:2024-04-23T10:15:23.231+0000 7f1333f777c0 -1 Falling back to public interface 2024-04-23T10:15:23.231 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-23T10:15:23.232+0000 7fdf6e4ab7c0 -1 Falling back to public interface 2024-04-23T10:15:23.234 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-04-23T10:15:23.235+0000 7f14f2f4a7c0 -1 Falling back to public interface 2024-04-23T10:15:23.236 INFO:tasks.ceph.mgr.x.smithi072.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-23T10:15:23.236 INFO:tasks.ceph.mgr.x.smithi072.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-23T10:15:23.236 INFO:tasks.ceph.mgr.x.smithi072.stderr: from numpy import show_config as show_numpy_config 2024-04-23T10:15:23.246 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-23T10:15:23.248+0000 7fc5312fb7c0 -1 Falling back to public interface 2024-04-23T10:15:23.250 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-23T10:15:23.252+0000 7fa856e497c0 -1 Falling back to public interface 2024-04-23T10:15:23.265 INFO:tasks.ceph.mgr.y.smithi029.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-23T10:15:23.265 INFO:tasks.ceph.mgr.y.smithi029.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-23T10:15:23.265 INFO:tasks.ceph.mgr.y.smithi029.stderr: from numpy import show_config as show_numpy_config 2024-04-23T10:15:23.306 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:23.307+0000 7f26fdc61180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:15:23.343 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:23.344+0000 7fd393c49180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:15:23.459 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:23.459+0000 7f26fdc61180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:15:23.498 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:23.500+0000 7fd393c49180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:15:23.621 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:23.625 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:23.627+0000 7f26fdc61180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:15:23.685 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:23.684+0000 7fd393c49180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:15:23.700 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:23.699+0000 7f26fdc61180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:15:23.729 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56f242640 1 Processor -- start 2024-04-23T10:15:23.729 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56f242640 1 -- start start 2024-04-23T10:15:23.730 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56f242640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff568152030 0x7ff5680cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:23.731 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56f242640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff568072750 0x7ff5680cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:23.731 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56f242640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5681582f0 con 0x7ff568157e60 2024-04-23T10:15:23.731 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56f242640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff568158e70 con 0x7ff568152030 2024-04-23T10:15:23.731 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56f242640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff5681585d0 con 0x7ff568072750 2024-04-23T10:15:23.732 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56d7df640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff568072750 0x7ff5680cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:23.732 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56d7df640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff568072750 0x7ff5680cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:51706/0 (socket says 172.21.15.29:51706) 2024-04-23T10:15:23.732 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56d7df640 1 -- 172.21.15.29:0/498773526 learned_addr learned my addr 172.21.15.29:0/498773526 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:23.732 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56cfde640 1 --2- 172.21.15.29:0/498773526 >> v2:172.21.15.72:3300/0 conn(0x7ff568152030 0x7ff5680cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:23.732 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56d7df640 1 -- 172.21.15.29:0/498773526 >> v2:172.21.15.72:3300/0 conn(0x7ff568152030 msgr2=0x7ff5680cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:23.732 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56d7df640 1 --2- 172.21.15.29:0/498773526 >> v2:172.21.15.72:3300/0 conn(0x7ff568152030 0x7ff5680cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.732 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56d7df640 1 -- 172.21.15.29:0/498773526 >> v1:172.21.15.72:6789/0 conn(0x7ff568157e60 legacy=0x7ff568073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:23.732 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.732+0000 7ff56d7df640 1 -- 172.21.15.29:0/498773526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5681588b0 con 0x7ff568072750 2024-04-23T10:15:23.734 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56d7df640 1 --2- 172.21.15.29:0/498773526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff568072750 0x7ff5680cdb30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff568158ff0 tx=0x7ff56001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a9e2f85c41d2c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:23.734 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff5677fe640 1 -- 172.21.15.29:0/498773526 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5600a57d0 con 0x7ff568072750 2024-04-23T10:15:23.734 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff5677fe640 1 -- 172.21.15.29:0/498773526 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5600a5970 con 0x7ff568072750 2024-04-23T10:15:23.734 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff5677fe640 1 -- 172.21.15.29:0/498773526 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5600a5d40 con 0x7ff568072750 2024-04-23T10:15:23.735 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 -- 172.21.15.29:0/498773526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff568072750 msgr2=0x7ff5680cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:23.735 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 --2- 172.21.15.29:0/498773526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff568072750 0x7ff5680cdb30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff568158ff0 tx=0x7ff56001ca10 comp rx=0 tx=0).stop 2024-04-23T10:15:23.735 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 -- 172.21.15.29:0/498773526 shutdown_connections 2024-04-23T10:15:23.735 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 --2- 172.21.15.29:0/498773526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff568072750 0x7ff5680cdb30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.735 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 --2- 172.21.15.29:0/498773526 >> v2:172.21.15.72:3300/0 conn(0x7ff568152030 0x7ff5680cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.735 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 -- 172.21.15.29:0/498773526 >> 172.21.15.29:0/498773526 conn(0x7ff568067ee0 msgr2=0x7ff56806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:23.735 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 -- 172.21.15.29:0/498773526 shutdown_connections 2024-04-23T10:15:23.735 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 -- 172.21.15.29:0/498773526 wait complete. 2024-04-23T10:15:23.736 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 Processor -- start 2024-04-23T10:15:23.736 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.736+0000 7ff56f242640 1 -- start start 2024-04-23T10:15:23.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff568072750 0x7ff568144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:23.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff568152030 0x7ff56806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:23.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5681f6070 0x7ff5681f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:23.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff568152590 con 0x7ff568072750 2024-04-23T10:15:23.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff568152410 con 0x7ff568152030 2024-04-23T10:15:23.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff568165000 con 0x7ff5681f6070 2024-04-23T10:15:23.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff568072750 0x7ff568144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:23.739 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff568072750 0x7ff568144580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38576/0 (socket says 172.21.15.29:38576) 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 -- 172.21.15.29:0/2025173815 learned_addr learned my addr 172.21.15.29:0/2025173815 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56d7df640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5681f6070 0x7ff5681f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff567fff640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff568152030 0x7ff56806bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 -- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5681f6070 msgr2=0x7ff5681f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5681f6070 0x7ff5681f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 -- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff568152030 msgr2=0x7ff56806bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff568152030 0x7ff56806bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 -- 172.21.15.29:0/2025173815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff568145da0 con 0x7ff568072750 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff567fff640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff568152030 0x7ff56806bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56cfde640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff568072750 0x7ff568144580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00e930 tx=0x7ff55c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff5657fa640 1 -- 172.21.15.29:0/2025173815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c017070 con 0x7ff568072750 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff5657fa640 1 -- 172.21.15.29:0/2025173815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55c00c8e0 con 0x7ff568072750 2024-04-23T10:15:23.740 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff5657fa640 1 -- 172.21.15.29:0/2025173815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00cc90 con 0x7ff568072750 2024-04-23T10:15:23.741 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff568144e50 con 0x7ff568072750 2024-04-23T10:15:23.741 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff568145410 con 0x7ff568072750 2024-04-23T10:15:23.741 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff56804fcf0 con 0x7ff568072750 2024-04-23T10:15:23.741 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff5657fa640 1 -- 172.21.15.29:0/2025173815 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff55c01a070 con 0x7ff568072750 2024-04-23T10:15:23.741 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.740+0000 7ff5657fa640 1 -- 172.21.15.29:0/2025173815 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff55c01cb70 con 0x7ff568072750 2024-04-23T10:15:23.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.744+0000 7ff5657fa640 1 -- 172.21.15.29:0/2025173815 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff55c01c4a0 con 0x7ff568072750 2024-04-23T10:15:23.762 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:23.764+0000 7fd393c49180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:15:23.798 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff568073670 con 0x7ff568072750 2024-04-23T10:15:23.799 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff5657fa640 1 -- 172.21.15.29:0/2025173815 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff55c01c680 con 0x7ff568072750 2024-04-23T10:15:23.799 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-23T10:15:23.799 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:22.564029+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff568072750 msgr2=0x7ff568144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff568072750 0x7ff568144580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00e930 tx=0x7ff55c00edf0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 shutdown_connections 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5681f6070 0x7ff5681f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff568152030 0x7ff56806bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 --2- 172.21.15.29:0/2025173815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff568072750 0x7ff568144580 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 >> 172.21.15.29:0/2025173815 conn(0x7ff568067ee0 msgr2=0x7ff568157570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 shutdown_connections 2024-04-23T10:15:23.800 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:23.800+0000 7ff56f242640 1 -- 172.21.15.29:0/2025173815 wait complete. 2024-04-23T10:15:23.814 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T10:15:23.845 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:23.847+0000 7f26fdc61180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:15:23.911 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:23.912+0000 7fd393c49180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:15:24.463 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:24.463+0000 7f26fdc61180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:15:24.538 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:24.539+0000 7f26fdc61180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:15:24.561 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:24.564+0000 7fd393c49180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:15:24.640 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:24.640+0000 7fd393c49180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:15:24.719 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:24.719+0000 7f26fdc61180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:15:24.793 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:24.791+0000 7f26fdc61180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:15:24.831 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:24.832+0000 7fd393c49180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:15:24.908 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:24.908+0000 7fd393c49180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:15:25.084 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:25.083+0000 7f26fdc61180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:15:25.146 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:25.147+0000 7f26fdc61180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:15:25.215 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:25.216+0000 7fd393c49180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:15:25.281 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-23T10:15:25.280+0000 7fd393c49180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:15:26.190 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:26.191+0000 7f26a50a9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-23T10:15:26.193 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-23T10:15:26.195+0000 7f26a50a9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-23T10:15:26.969 INFO:tasks.ceph.osd.5.smithi072.stderr:2024-04-23T10:15:26.967+0000 7f8a1df657c0 -1 osd.5 0 log_to_monitors true 2024-04-23T10:15:27.064 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-23T10:15:27.064+0000 7fa856e497c0 -1 osd.1 0 log_to_monitors true 2024-04-23T10:15:27.099 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-04-23T10:15:27.099+0000 7fbde18be7c0 -1 osd.7 0 log_to_monitors true 2024-04-23T10:15:27.108 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-23T10:15:27.108+0000 7f829ce587c0 -1 osd.0 0 log_to_monitors true 2024-04-23T10:15:27.114 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-23T10:15:27.116+0000 7fc5312fb7c0 -1 osd.3 0 log_to_monitors true 2024-04-23T10:15:27.114 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-04-23T10:15:27.115+0000 7f14f2f4a7c0 -1 osd.6 0 log_to_monitors true 2024-04-23T10:15:27.129 INFO:tasks.ceph.osd.4.smithi072.stderr:2024-04-23T10:15:27.127+0000 7f1333f777c0 -1 osd.4 0 log_to_monitors true 2024-04-23T10:15:27.142 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-23T10:15:27.144+0000 7fdf6e4ab7c0 -1 osd.2 0 log_to_monitors true 2024-04-23T10:15:29.872 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-23T10:15:29.872+0000 7fa852df2640 -1 osd.1 0 waiting for initial osdmap 2024-04-23T10:15:29.885 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-23T10:15:29.884+0000 7f8298e01640 -1 osd.0 0 waiting for initial osdmap 2024-04-23T10:15:29.895 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-23T10:15:29.896+0000 7fc52d2a4640 -1 osd.3 0 waiting for initial osdmap 2024-04-23T10:15:29.900 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-23T10:15:29.900+0000 7fa84ac26640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:15:29.914 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-23T10:15:29.916+0000 7f8290c35640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:15:29.922 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-23T10:15:29.924+0000 7fc5250d8640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:15:29.968 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-23T10:15:29.968+0000 7fdf6a454640 -1 osd.2 0 waiting for initial osdmap 2024-04-23T10:15:29.998 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-23T10:15:30.000+0000 7fdf62288640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:15:30.360 INFO:tasks.ceph.osd.5.smithi072.stderr:2024-04-23T10:15:30.359+0000 7f8a19f0e640 -1 osd.5 0 waiting for initial osdmap 2024-04-23T10:15:30.390 INFO:tasks.ceph.osd.5.smithi072.stderr:2024-04-23T10:15:30.391+0000 7f8a11d42640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:15:30.489 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-04-23T10:15:30.487+0000 7fbddd867640 -1 osd.7 0 waiting for initial osdmap 2024-04-23T10:15:30.507 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-04-23T10:15:30.507+0000 7f14eeef3640 -1 osd.6 0 waiting for initial osdmap 2024-04-23T10:15:30.524 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-04-23T10:15:30.523+0000 7fbdd569b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:15:30.534 INFO:tasks.ceph.osd.4.smithi072.stderr:2024-04-23T10:15:30.535+0000 7f132ff20640 -1 osd.4 0 waiting for initial osdmap 2024-04-23T10:15:30.538 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-04-23T10:15:30.539+0000 7f14e6d27640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:15:30.562 INFO:tasks.ceph.osd.4.smithi072.stderr:2024-04-23T10:15:30.563+0000 7f1327d54640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:15:30.619 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:30.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5486cd5640 1 Processor -- start 2024-04-23T10:15:30.742 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5486cd5640 1 -- start start 2024-04-23T10:15:30.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5486cd5640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54801599b0 0x7f54800c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:30.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5486cd5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548006d580 con 0x7f548014fa00 2024-04-23T10:15:30.743 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5486cd5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548015c4c0 con 0x7f54800c6160 2024-04-23T10:15:30.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5486cd5640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f54800c7240 con 0x7f54801599b0 2024-04-23T10:15:30.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5484a71640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f548014fa00 0x7f548006ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56534/0 (socket says 172.21.15.29:56534) 2024-04-23T10:15:30.744 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5484a71640 1 -- 172.21.15.29:0/4212857688 learned_addr learned my addr 172.21.15.29:0/4212857688 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:30.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547ffff640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54801599b0 0x7f54800c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:30.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618413729 0 0) 0x7f548006d580 con 0x7f548014fa00 2024-04-23T10:15:30.745 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f546c003530 con 0x7f548014fa00 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 863760062 0 0) 0x7f546c003530 con 0x7f548014fa00 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54801599b0 msgr2=0x7f54800c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54801599b0 0x7f54800c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 >> v1:172.21.15.72:6789/0 conn(0x7f54800c6160 legacy=0x7f5480070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548015c7a0 con 0x7f548014fa00 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f5470001a20 con 0x7f548014fa00 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 >> v1:172.21.15.29:6789/0 conn(0x7f548014fa00 legacy=0x7f548006ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54801599b0 0x7f546c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f546c003f70 0x7f546c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c004d50 0x7f546c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f54800c7240 con 0x7f546c003f70 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f546c00bb60 con 0x7f546c004d50 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f546c00bd60 con 0x7f54801599b0 2024-04-23T10:15:30.746 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547ffff640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f546c003f70 0x7f546c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:30.747 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5484a71640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54801599b0 0x7f546c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:30.747 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f5485272640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c004d50 0x7f546c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:30.747 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547ffff640 1 -- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54801599b0 msgr2=0x7f546c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:30.747 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547ffff640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54801599b0 0x7f546c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.747 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547ffff640 1 -- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c004d50 msgr2=0x7f546c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:30.747 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547ffff640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c004d50 0x7f546c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.747 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.744+0000 7f547ffff640 1 -- 172.21.15.29:0/4212857688 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c003530 con 0x7f546c003f70 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f547ffff640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f546c003f70 0x7f546c004810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5468009ae0 tx=0x7f546801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef68f73feae2488 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54680b2070 con 0x7f546c003f70 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54680a5550 con 0x7f546c003f70 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f547f7fe640 1 -- 172.21.15.29:0/4212857688 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54680096b0 con 0x7f546c003f70 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5486cd5640 1 -- 172.21.15.29:0/4212857688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f546c003f70 msgr2=0x7f546c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5486cd5640 1 --2- 172.21.15.29:0/4212857688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f546c003f70 0x7f546c004810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5468009ae0 tx=0x7f546801ca70 comp rx=0 tx=0).stop 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5485272640 1 -- 172.21.15.29:0/4212857688 reap_dead start 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5486cd5640 1 -- 172.21.15.29:0/4212857688 shutdown_connections 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5486cd5640 1 -- 172.21.15.29:0/4212857688 >> 172.21.15.29:0/4212857688 conn(0x7f54800cc510 msgr2=0x7f54800cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:30.748 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5486cd5640 1 -- 172.21.15.29:0/4212857688 shutdown_connections 2024-04-23T10:15:30.749 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5486cd5640 1 -- 172.21.15.29:0/4212857688 wait complete. 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5486cd5640 1 Processor -- start 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.748+0000 7f5486cd5640 1 -- start start 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c003f70 0x7f54801f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5480157030 0x7f5480157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5480162970 0x7f5480162df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f548014ff60 con 0x7f5480162970 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f548014fde0 con 0x7f546c003f70 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5480164f40 con 0x7f5480157030 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5480162970 0x7f5480162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5480162970 0x7f5480162df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57416/0 (socket says 172.21.15.29:57416) 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 -- 172.21.15.29:0/3609150106 learned_addr learned my addr 172.21.15.29:0/3609150106 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5484a71640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c003f70 0x7f54801f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:30.751 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f547ffff640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5480157030 0x7f5480157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 -- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5480157030 msgr2=0x7f5480157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5480157030 0x7f5480157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 -- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c003f70 msgr2=0x7f54801f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c003f70 0x7f54801f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 -- 172.21.15.29:0/3609150106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548006d580 con 0x7f5480162970 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5484a71640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c003f70 0x7f54801f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5485272640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5480162970 0x7f5480162df0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54800c6930 tx=0x7f547800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f547d7fa640 1 -- 172.21.15.29:0/3609150106 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478019070 con 0x7f5480162970 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f547d7fa640 1 -- 172.21.15.29:0/3609150106 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54780052e0 con 0x7f5480162970 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5480163330 con 0x7f5480162970 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f547d7fa640 1 -- 172.21.15.29:0/3609150106 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478003840 con 0x7f5480162970 2024-04-23T10:15:30.752 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5480161b30 con 0x7f5480162970 2024-04-23T10:15:30.753 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548004fcf0 con 0x7f5480162970 2024-04-23T10:15:30.753 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f547d7fa640 1 -- 172.21.15.29:0/3609150106 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f547801c070 con 0x7f5480162970 2024-04-23T10:15:30.753 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f547d7fa640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f54600682f0 0x7f546006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:30.753 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f547d7fa640 1 -- 172.21.15.29:0/3609150106 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f5478084e70 con 0x7f5480162970 2024-04-23T10:15:30.753 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.752+0000 7f5484a71640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f54600682f0 0x7f546006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:30.753 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.756+0000 7f5484a71640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f54600682f0 0x7f546006a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f548006d750 tx=0x7f5470009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:30.757 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.756+0000 7f547d7fa640 1 -- 172.21.15.29:0/3609150106 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5480163330 con 0x7f5480162970 2024-04-23T10:15:30.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.924+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5480071240 con 0x7f5480162970 2024-04-23T10:15:30.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.924+0000 7f547d7fa640 1 -- 172.21.15.29:0/3609150106 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10837 (secure 0 0 0) 0x7f5478056330 con 0x7f5480162970 2024-04-23T10:15:30.925 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-23T10:15:30.925 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":13,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:30.899992+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f54600682f0 msgr2=0x7f546006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f54600682f0 0x7f546006a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f548006d750 tx=0x7f5470009040 comp rx=0 tx=0).stop 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5480162970 msgr2=0x7f5480162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5480162970 0x7f5480162df0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54800c6930 tx=0x7f547800e8a0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 shutdown_connections 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f54600682f0 0x7f546006a7b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5480162970 0x7f5480162df0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5480157030 0x7f5480157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 --2- 172.21.15.29:0/3609150106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f546c003f70 0x7f54801f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:30.927 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 >> 172.21.15.29:0/3609150106 conn(0x7f54800cc510 msgr2=0x7f548014db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:30.928 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 shutdown_connections 2024-04-23T10:15:30.928 INFO:teuthology.misc.health.smithi029.stderr:2024-04-23T10:15:30.928+0000 7f5486cd5640 1 -- 172.21.15.29:0/3609150106 wait complete. 2024-04-23T10:15:30.941 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-23T10:15:30.941 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-23T10:15:30.941 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-23T10:15:30.941 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-23T10:15:30.943 INFO:tasks.ceph.mds.a:Started 2024-04-23T10:15:30.943 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-23T10:15:30.943 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-23T10:15:30.945 INFO:tasks.ceph.mds.c:Started 2024-04-23T10:15:30.945 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-23T10:15:30.946 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-23T10:15:30.947 INFO:tasks.ceph.mds.e:Started 2024-04-23T10:15:30.948 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-23T10:15:30.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-23T10:15:30.950 INFO:tasks.ceph.mds.b:Started 2024-04-23T10:15:30.951 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-23T10:15:30.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-23T10:15:30.953 INFO:tasks.ceph.mds.d:Started 2024-04-23T10:15:30.953 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-23T10:15:30.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-23T10:15:30.955 INFO:tasks.ceph.mds.f:Started 2024-04-23T10:15:30.955 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-23T10:15:30.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:31.012 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-04-23T10:15:31.013 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-04-23T10:15:31.013 INFO:tasks.ceph.mds.e.smithi029.stdout:starting mds.e at 2024-04-23T10:15:31.034 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2024-04-23T10:15:31.035 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2024-04-23T10:15:31.035 INFO:tasks.ceph.mds.f.smithi072.stdout:starting mds.f at 2024-04-23T10:15:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fded5635640 1 Processor -- start 2024-04-23T10:15:31.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fded5635640 1 -- start start 2024-04-23T10:15:31.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fded5635640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded0159210 0x7fded01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fded5635640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded0159be0 con 0x7fded00cf3c0 2024-04-23T10:15:31.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fded5635640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded00ca140 con 0x7fded01530b0 2024-04-23T10:15:31.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fded5635640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fded00735f0 con 0x7fded0159210 2024-04-23T10:15:31.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fdece7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fded00cf3c0 0x7fded00c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56554/0 (socket says 172.21.15.29:56554) 2024-04-23T10:15:31.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fdece7fc640 1 -- 172.21.15.29:0/1799843406 learned_addr learned my addr 172.21.15.29:0/1799843406 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fdecf7fe640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded0159210 0x7fded01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127588667 0 0) 0x7fded0159be0 con 0x7fded00cf3c0 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.064+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdebc003530 con 0x7fded00cf3c0 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462992596 0 0) 0x7fded00ca140 con 0x7fded01530b0 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fded0159be0 con 0x7fded01530b0 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2017845636 0 0) 0x7fdebc003530 con 0x7fded00cf3c0 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded0159210 msgr2=0x7fded01596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded0159210 0x7fded01596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 >> v1:172.21.15.72:6789/0 conn(0x7fded01530b0 legacy=0x7fded00c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded00738d0 con 0x7fded00cf3c0 2024-04-23T10:15:31.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fdec0001680 con 0x7fded00cf3c0 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 >> v1:172.21.15.29:6789/0 conn(0x7fded00cf3c0 legacy=0x7fded00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdebc003b80 0x7fdebc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc004810 0x7fdebc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded0159210 0x7fdebc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fded00735f0 con 0x7fdebc003b80 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc00ba80 con 0x7fdebc004810 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdebc00bc50 con 0x7fded0159210 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdeceffd640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdebc003b80 0x7fdebc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdece7fc640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc004810 0x7fdebc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecf7fe640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded0159210 0x7fdebc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdeceffd640 1 -- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded0159210 msgr2=0x7fdebc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdeceffd640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded0159210 0x7fdebc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdeceffd640 1 -- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc004810 msgr2=0x7fdebc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdeceffd640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc004810 0x7fdebc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdeceffd640 1 -- 172.21.15.29:0/1799843406 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc003530 con 0x7fdebc003b80 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdeceffd640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdebc003b80 0x7fdebc003f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80018d0 tx=0x7fdeb801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58d5ad9505d5d62 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8001520 con 0x7fdebc003b80 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb80052f0 con 0x7fdebc003b80 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecdffb640 1 -- 172.21.15.29:0/1799843406 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8003840 con 0x7fdebc003b80 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fded5635640 1 -- 172.21.15.29:0/1799843406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdebc003b80 msgr2=0x7fdebc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fded5635640 1 --2- 172.21.15.29:0/1799843406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdebc003b80 0x7fdebc003f80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80018d0 tx=0x7fdeb801c520 comp rx=0 tx=0).stop 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fdecf7fe640 1 -- 172.21.15.29:0/1799843406 reap_dead start 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fded5635640 1 -- 172.21.15.29:0/1799843406 shutdown_connections 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fded5635640 1 -- 172.21.15.29:0/1799843406 >> 172.21.15.29:0/1799843406 conn(0x7fded00ce7b0 msgr2=0x7fded00ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fded5635640 1 -- 172.21.15.29:0/1799843406 shutdown_connections 2024-04-23T10:15:31.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.068+0000 7fded5635640 1 -- 172.21.15.29:0/1799843406 wait complete. 2024-04-23T10:15:31.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 Processor -- start 2024-04-23T10:15:31.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 -- start start 2024-04-23T10:15:31.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc003b80 0x7fded00cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded014deb0 0x7fded014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded014a920 0x7fded014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fded00c62c0 con 0x7fded014a920 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fded0159a30 con 0x7fdebc003b80 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fded00c6440 con 0x7fded014deb0 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded014a920 0x7fded014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdeceffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc003b80 0x7fded00cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded014a920 0x7fded014b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57474/0 (socket says 172.21.15.29:57474) 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 -- 172.21.15.29:0/2914470681 learned_addr learned my addr 172.21.15.29:0/2914470681 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdece7fc640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded014deb0 0x7fded014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 -- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded014deb0 msgr2=0x7fded014a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded014deb0 0x7fded014a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 -- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc003b80 msgr2=0x7fded00cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc003b80 0x7fded00cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 -- 172.21.15.29:0/2914470681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded01f5c70 con 0x7fded014a920 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdeceffd640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc003b80 0x7fded00cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdecf7fe640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded014a920 0x7fded014b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fded0073390 tx=0x7fdec80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdec77fe640 1 -- 172.21.15.29:0/2914470681 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8011e70 con 0x7fded014a920 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdec77fe640 1 -- 172.21.15.29:0/2914470681 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec801b070 con 0x7fded014a920 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdec77fe640 1 -- 172.21.15.29:0/2914470681 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec80039a0 con 0x7fded014a920 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded01f5f10 con 0x7fded014a920 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded014f250 con 0x7fded014a920 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded00693c0 con 0x7fded014a920 2024-04-23T10:15:31.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdec77fe640 1 -- 172.21.15.29:0/2914470681 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fdec8003b40 con 0x7fded014a920 2024-04-23T10:15:31.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdec77fe640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdeb00682f0 0x7fdeb006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdec77fe640 1 -- 172.21.15.29:0/2914470681 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fdec8086970 con 0x7fded014a920 2024-04-23T10:15:31.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.072+0000 7fdeceffd640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdeb00682f0 0x7fdeb006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.076+0000 7fdeceffd640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdeb00682f0 0x7fdeb006a7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80ac000 tx=0x7fdeb80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:31.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.080+0000 7fdec77fe640 1 -- 172.21.15.29:0/2914470681 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdec8056f20 con 0x7fded014a920 2024-04-23T10:15:31.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.236+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fded00714f0 con 0x7fded014a920 2024-04-23T10:15:31.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.236+0000 7fdec77fe640 1 -- 172.21.15.29:0/2914470681 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10837 (secure 0 0 0) 0x7fdec805b220 con 0x7fded014a920 2024-04-23T10:15:31.237 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:31.237 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:30.899992+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdeb00682f0 msgr2=0x7fdeb006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdeb00682f0 0x7fdeb006a7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80ac000 tx=0x7fdeb80a6000 comp rx=0 tx=0).stop 2024-04-23T10:15:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded014a920 msgr2=0x7fded014b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded014a920 0x7fded014b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fded0073390 tx=0x7fdec80115a0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 shutdown_connections 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdeb00682f0 0x7fdeb006a7b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded014a920 0x7fded014b780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fded014deb0 0x7fded014a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 --2- 172.21.15.29:0/2914470681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdebc003b80 0x7fded00cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 >> 172.21.15.29:0/2914470681 conn(0x7fded00ce7b0 msgr2=0x7fded0156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 shutdown_connections 2024-04-23T10:15:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.240+0000 7fded5635640 1 -- 172.21.15.29:0/2914470681 wait complete. 2024-04-23T10:15:31.254 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-23T10:15:31.255 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:15:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.372+0000 7fe441339640 1 Processor -- start 2024-04-23T10:15:31.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.372+0000 7fe441339640 1 -- start start 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe441339640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 0x7fe43c0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe441339640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe43c0ced40 0x7fe43c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe441339640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe43c073b70 con 0x7fe43c074380 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe441339640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe43c0740f0 con 0x7fe43c0ced40 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe441339640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe43c073e10 con 0x7fe43c0ce960 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe43c074380 0x7fe43c152c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56568/0 (socket says 172.21.15.29:56568) 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43b7fe640 1 -- 172.21.15.29:0/1235809859 learned_addr learned my addr 172.21.15.29:0/1235809859 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/1235809859 >> v2:172.21.15.72:3300/0 conn(0x7fe43c0ced40 0x7fe43c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43affd640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 0x7fe43c0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415492792 0 0) 0x7fe43c073b70 con 0x7fe43c074380 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe428003530 con 0x7fe43c074380 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3747530612 0 0) 0x7fe428003530 con 0x7fe43c074380 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 msgr2=0x7fe43c0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 0x7fe43c0c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 >> v2:172.21.15.72:3300/0 conn(0x7fe43c0ced40 msgr2=0x7fe43c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 --2- 172.21.15.29:0/1235809859 >> v2:172.21.15.72:3300/0 conn(0x7fe43c0ced40 0x7fe43c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c0ca8d0 con 0x7fe43c074380 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fe42c001680 con 0x7fe43c074380 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 >> v1:172.21.15.29:6789/0 conn(0x7fe43c074380 legacy=0x7fe43c152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4280039c0 0x7fe428003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe428004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 0x7fe4280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c0740f0 con 0x7fe428004810 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c073e10 con 0x7fe4280039c0 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe42800b9d0 con 0x7fe43c0ce960 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe428004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43affd640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4280039c0 0x7fe428003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43a7fc640 1 -- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 msgr2=0x7fe4280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43b7fe640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 0x7fe4280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 0x7fe4280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43a7fc640 1 -- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4280039c0 msgr2=0x7fe428003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4280039c0 0x7fe428003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43a7fc640 1 -- 172.21.15.29:0/1235809859 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe428003530 con 0x7fe428004810 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43affd640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4280039c0 0x7fe428003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.376+0000 7fe43b7fe640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c0ce960 0x7fe4280051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:31.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe428004c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe424009ab0 tx=0x7fe42401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47424f9787e6d7fc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:31.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4240b2070 con 0x7fe428004810 2024-04-23T10:15:31.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4240a55a0 con 0x7fe428004810 2024-04-23T10:15:31.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe439ffb640 1 -- 172.21.15.29:0/1235809859 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4240096b0 con 0x7fe428004810 2024-04-23T10:15:31.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- 172.21.15.29:0/1235809859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 msgr2=0x7fe428004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 --2- 172.21.15.29:0/1235809859 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe428004c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe424009ab0 tx=0x7fe42401ca90 comp rx=0 tx=0).stop 2024-04-23T10:15:31.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe43b7fe640 1 -- 172.21.15.29:0/1235809859 reap_dead start 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- 172.21.15.29:0/1235809859 shutdown_connections 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- 172.21.15.29:0/1235809859 >> 172.21.15.29:0/1235809859 conn(0x7fe43c070f60 msgr2=0x7fe43c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- 172.21.15.29:0/1235809859 shutdown_connections 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- 172.21.15.29:0/1235809859 wait complete. 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 Processor -- start 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- start start 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe43c157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c14e2a0 0x7fe43c14cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c14d400 0x7fe43c1f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c0ca250 con 0x7fe428004810 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c0cae90 con 0x7fe43c14e2a0 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe441339640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe43c0ca3d0 con 0x7fe43c14d400 2024-04-23T10:15:31.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe43affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe43c157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe43affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe43c157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57490/0 (socket says 172.21.15.29:57490) 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.380+0000 7fe43affd640 1 -- 172.21.15.29:0/2368715434 learned_addr learned my addr 172.21.15.29:0/2368715434 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43b7fe640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c14d400 0x7fe43c1f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c14e2a0 0x7fe43c14cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43affd640 1 -- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c14d400 msgr2=0x7fe43c1f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43affd640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c14d400 0x7fe43c1f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43affd640 1 -- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c14e2a0 msgr2=0x7fe43c14cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43affd640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c14e2a0 0x7fe43c14cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43affd640 1 -- 172.21.15.29:0/2368715434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c14c920 con 0x7fe428004810 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c14e2a0 0x7fe43c14cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43b7fe640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c14d400 0x7fe43c1f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43affd640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe43c157eb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe43400f3b0 tx=0x7fe43400f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:31.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe4337fe640 1 -- 172.21.15.29:0/2368715434 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43401c070 con 0x7fe428004810 2024-04-23T10:15:31.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe4337fe640 1 -- 172.21.15.29:0/2368715434 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe434017600 con 0x7fe428004810 2024-04-23T10:15:31.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43c06d480 con 0x7fe428004810 2024-04-23T10:15:31.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe4337fe640 1 -- 172.21.15.29:0/2368715434 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4340179b0 con 0x7fe428004810 2024-04-23T10:15:31.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43c06c490 con 0x7fe428004810 2024-04-23T10:15:31.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe43c0693c0 con 0x7fe428004810 2024-04-23T10:15:31.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe4337fe640 1 -- 172.21.15.29:0/2368715434 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fe43401f070 con 0x7fe428004810 2024-04-23T10:15:31.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe4337fe640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe41c068320 0x7fe41c06a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:31.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe4337fe640 1 -- 172.21.15.29:0/2368715434 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fe434086990 con 0x7fe428004810 2024-04-23T10:15:31.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe41c068320 0x7fe41c06a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:31.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.384+0000 7fe43a7fc640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe41c068320 0x7fe41c06a7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4240af000 tx=0x7fe4240046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:31.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.388+0000 7fe4337fe640 1 -- 172.21.15.29:0/2368715434 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe434012070 con 0x7fe428004810 2024-04-23T10:15:31.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.580+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe43c1597d0 con 0x7fe428004810 2024-04-23T10:15:31.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.580+0000 7fe4337fe640 1 -- 172.21.15.29:0/2368715434 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7fe434057500 con 0x7fe428004810 2024-04-23T10:15:31.580 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:31.580 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T10:15:31.580 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-04-23T10:15:31.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe41c068320 msgr2=0x7fe41c06a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe41c068320 0x7fe41c06a7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4240af000 tx=0x7fe4240046d0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 msgr2=0x7fe43c157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe43c157eb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe43400f3b0 tx=0x7fe43400f870 comp rx=0 tx=0).stop 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 shutdown_connections 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe41c068320 0x7fe41c06a7e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c14d400 0x7fe43c1f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c14e2a0 0x7fe43c14cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 --2- 172.21.15.29:0/2368715434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe428004810 0x7fe43c157eb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 >> 172.21.15.29:0/2368715434 conn(0x7fe43c070f60 msgr2=0x7fe43c0cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 shutdown_connections 2024-04-23T10:15:31.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:31.584+0000 7fe441339640 1 -- 172.21.15.29:0/2368715434 wait complete. 2024-04-23T10:15:33.597 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:15:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.723+0000 7f7ef93c1640 1 Processor -- start 2024-04-23T10:15:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.723+0000 7f7ef93c1640 1 -- start start 2024-04-23T10:15:33.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef93c1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ef4151bb0 0x7f7ef415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef93c1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40c5900 0x7f7ef40c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef93c1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef406c910 con 0x7f7ef40cb770 2024-04-23T10:15:33.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef93c1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef406cbf0 con 0x7f7ef4151bb0 2024-04-23T10:15:33.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef93c1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef406ced0 con 0x7f7ef40c5900 2024-04-23T10:15:33.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7ef40cb770 0x7f7ef40c6840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56580/0 (socket says 172.21.15.29:56580) 2024-04-23T10:15:33.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef37fe640 1 -- 172.21.15.29:0/806879103 learned_addr learned my addr 172.21.15.29:0/806879103 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef2ffd640 1 --2- 172.21.15.29:0/806879103 >> v2:172.21.15.72:3300/0 conn(0x7f7ef4151bb0 0x7f7ef415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef27fc640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40c5900 0x7f7ef40c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001983409 0 0) 0x7f7ef406c910 con 0x7f7ef40cb770 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7edc003530 con 0x7f7ef40cb770 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2372914274 0 0) 0x7f7edc003530 con 0x7f7ef40cb770 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40c5900 msgr2=0x7f7ef40c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40c5900 0x7f7ef40c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 >> v2:172.21.15.72:3300/0 conn(0x7f7ef4151bb0 msgr2=0x7f7ef415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 --2- 172.21.15.29:0/806879103 >> v2:172.21.15.72:3300/0 conn(0x7f7ef4151bb0 0x7f7ef415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef406d1b0 con 0x7f7ef40cb770 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f7eec001680 con 0x7f7ef40cb770 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef2ffd640 1 --2- 172.21.15.29:0/806879103 >> v2:172.21.15.72:3300/0 conn(0x7f7ef4151bb0 0x7f7ef415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:15:33.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 >> v1:172.21.15.29:6789/0 conn(0x7f7ef40cb770 legacy=0x7f7ef40c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0039c0 0x7f7edc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7edc004810 0x7f7edc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40c5900 0x7f7edc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef406cbf0 con 0x7f7edc004810 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef406ced0 con 0x7f7edc0039c0 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7edc00ba00 con 0x7f7ef40c5900 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef27fc640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7edc004810 0x7f7edc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef2ffd640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0039c0 0x7f7edc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef37fe640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40c5900 0x7f7edc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef27fc640 1 -- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40c5900 msgr2=0x7f7edc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef27fc640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40c5900 0x7f7edc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef27fc640 1 -- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0039c0 msgr2=0x7f7edc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef27fc640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0039c0 0x7f7edc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.727+0000 7f7ef27fc640 1 -- 172.21.15.29:0/806879103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7edc003530 con 0x7f7edc004810 2024-04-23T10:15:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7edc004810 0x7f7edc004c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009ae0 tx=0x7f7ee801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7a0b6c7b23330b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80b2070 con 0x7f7edc004810 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee80a5580 con 0x7f7edc004810 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef1ffb640 1 -- 172.21.15.29:0/806879103 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80096b0 con 0x7f7edc004810 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- 172.21.15.29:0/806879103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7edc004810 msgr2=0x7f7edc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 --2- 172.21.15.29:0/806879103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7edc004810 0x7f7edc004c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009ae0 tx=0x7f7ee801ca70 comp rx=0 tx=0).stop 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef37fe640 1 -- 172.21.15.29:0/806879103 reap_dead start 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- 172.21.15.29:0/806879103 shutdown_connections 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- 172.21.15.29:0/806879103 >> 172.21.15.29:0/806879103 conn(0x7f7ef40730f0 msgr2=0x7f7ef4073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- 172.21.15.29:0/806879103 shutdown_connections 2024-04-23T10:15:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- 172.21.15.29:0/806879103 wait complete. 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 Processor -- start 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- start start 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc004810 0x7f7ef41f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef40c8790 0x7f7ef415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40ca2e0 0x7f7ef41452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40c6f50 con 0x7f7ef40c8790 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4151f90 con 0x7f7edc004810 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef93c1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef40c70d0 con 0x7f7ef40ca2e0 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef40c8790 0x7f7ef415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef40c8790 0x7f7ef415edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57510/0 (socket says 172.21.15.29:57510) 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 -- 172.21.15.29:0/1705760226 learned_addr learned my addr 172.21.15.29:0/1705760226 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef2ffd640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc004810 0x7f7ef41f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef37fe640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40ca2e0 0x7f7ef41452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 -- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40ca2e0 msgr2=0x7f7ef41452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40ca2e0 0x7f7ef41452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 -- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc004810 msgr2=0x7f7ef41f0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc004810 0x7f7ef41f0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef27fc640 1 -- 172.21.15.29:0/1705760226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef41f13c0 con 0x7f7ef40c8790 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.731+0000 7f7ef37fe640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40ca2e0 0x7f7ef41452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7ef27fc640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef40c8790 0x7f7ef415edf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009ae0 tx=0x7f7edc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7edb7fe640 1 -- 172.21.15.29:0/1705760226 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80b2040 con 0x7f7ef40c8790 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7edb7fe640 1 -- 172.21.15.29:0/1705760226 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee8004020 con 0x7f7ef40c8790 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef41f1680 con 0x7f7ef40c8790 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7edb7fe640 1 -- 172.21.15.29:0/1705760226 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80043d0 con 0x7f7ef40c8790 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef41f1c40 con 0x7f7ef40c8790 2024-04-23T10:15:33.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef4068d70 con 0x7f7ef40c8790 2024-04-23T10:15:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7edb7fe640 1 -- 172.21.15.29:0/1705760226 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f7ee80c0060 con 0x7f7ef40c8790 2024-04-23T10:15:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7edb7fe640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7ee00682f0 0x7f7ee006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7edb7fe640 1 -- 172.21.15.29:0/1705760226 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4857+0+0 (secure 0 0 0) 0x7f7ee811ffb0 con 0x7f7ef40c8790 2024-04-23T10:15:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7ef2ffd640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7ee00682f0 0x7f7ee006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:33.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.735+0000 7f7ef2ffd640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7ee00682f0 0x7f7ee006a7b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009fd0 tx=0x7f7ee400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:33.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.739+0000 7f7edb7fe640 1 -- 172.21.15.29:0/1705760226 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ee8016780 con 0x7f7ef40c8790 2024-04-23T10:15:33.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.943+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ef40cad90 con 0x7f7ef40c8790 2024-04-23T10:15:33.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.947+0000 7f7edb7fe640 1 -- 172.21.15.29:0/1705760226 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5500 (secure 0 0 0) 0x7f7ee80f0350 con 0x7f7ef40c8790 2024-04-23T10:15:33.949 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:33.949 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4212,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-23T10:15:33.950 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 3 2024-04-23T10:15:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7ee00682f0 msgr2=0x7f7ee006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7ee00682f0 0x7f7ee006a7b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009fd0 tx=0x7f7ee400b040 comp rx=0 tx=0).stop 2024-04-23T10:15:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef40c8790 msgr2=0x7f7ef415edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef40c8790 0x7f7ef415edf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009ae0 tx=0x7f7edc005840 comp rx=0 tx=0).stop 2024-04-23T10:15:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 shutdown_connections 2024-04-23T10:15:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7ee00682f0 0x7f7ee006a7b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef40ca2e0 0x7f7ef41452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ef40c8790 0x7f7ef415edf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 --2- 172.21.15.29:0/1705760226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc004810 0x7f7ef41f0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:33.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 >> 172.21.15.29:0/1705760226 conn(0x7f7ef40730f0 msgr2=0x7f7ef414cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:33.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 shutdown_connections 2024-04-23T10:15:33.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:33.951+0000 7f7ef93c1640 1 -- 172.21.15.29:0/1705760226 wait complete. 2024-04-23T10:15:33.974 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff2867fc640 1 Processor -- start 2024-04-23T10:15:34.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff2867fc640 1 -- start start 2024-04-23T10:15:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff2867fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff280152e00 0x7ff280153250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff2867fc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2800cd860 con 0x7ff280074fc0 2024-04-23T10:15:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff2867fc640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2800cdb20 con 0x7ff2800753a0 2024-04-23T10:15:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff2867fc640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff2800cd630 con 0x7ff280152e00 2024-04-23T10:15:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff280074fc0 0x7ff28015cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56594/0 (socket says 172.21.15.29:56594) 2024-04-23T10:15:34.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27ffff640 1 -- 172.21.15.29:0/1392810265 learned_addr learned my addr 172.21.15.29:0/1392810265 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:34.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff284d99640 1 --2- 172.21.15.29:0/1392810265 >> v2:172.21.15.72:3300/0 conn(0x7ff280152e00 0x7ff280153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127221513 0 0) 0x7ff2800cd860 con 0x7ff280074fc0 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff268003530 con 0x7ff280074fc0 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 353546567 0 0) 0x7ff268003530 con 0x7ff280074fc0 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 >> v2:172.21.15.72:3300/0 conn(0x7ff280152e00 msgr2=0x7ff280153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 --2- 172.21.15.29:0/1392810265 >> v2:172.21.15.72:3300/0 conn(0x7ff280152e00 0x7ff280153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 >> v1:172.21.15.72:6789/0 conn(0x7ff2800753a0 legacy=0x7ff2800ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2800cde00 con 0x7ff280074fc0 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7ff270001680 con 0x7ff280074fc0 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 >> v1:172.21.15.29:6789/0 conn(0x7ff280074fc0 legacy=0x7ff28015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff268003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff268004810 0x7ff268004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2680051d0 0x7ff26800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff26800c050 con 0x7ff2680039c0 2024-04-23T10:15:34.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff26800c200 con 0x7ff2680051d0 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff26800c400 con 0x7ff268004810 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27ffff640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff268003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff284d99640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2680051d0 0x7ff26800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27f7fe640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff268004810 0x7ff268004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27ffff640 1 -- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff268004810 msgr2=0x7ff268004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27ffff640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff268004810 0x7ff268004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27ffff640 1 -- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2680051d0 msgr2=0x7ff26800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27ffff640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2680051d0 0x7ff26800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff284d99640 1 -- 172.21.15.29:0/1392810265 reap_dead start 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27ffff640 1 -- 172.21.15.29:0/1392810265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff268003530 con 0x7ff2680039c0 2024-04-23T10:15:34.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.091+0000 7ff27f7fe640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff268004810 0x7ff268004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:34.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff27ffff640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff268003de0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff27000c210 tx=0x7ff27001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0f7744a68344fb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270007d40 con 0x7ff2680039c0 2024-04-23T10:15:34.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff270005b00 con 0x7ff2680039c0 2024-04-23T10:15:34.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff27effd640 1 -- 172.21.15.29:0/1392810265 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270007070 con 0x7ff2680039c0 2024-04-23T10:15:34.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 -- 172.21.15.29:0/1392810265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 msgr2=0x7ff268003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff268003de0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff27000c210 tx=0x7ff27001f3b0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 -- 172.21.15.29:0/1392810265 shutdown_connections 2024-04-23T10:15:34.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 --2- 172.21.15.29:0/1392810265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff268003de0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 -- 172.21.15.29:0/1392810265 >> 172.21.15.29:0/1392810265 conn(0x7ff28006b9e0 msgr2=0x7ff28006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:34.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 -- 172.21.15.29:0/1392810265 shutdown_connections 2024-04-23T10:15:34.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 -- 172.21.15.29:0/1392810265 wait complete. 2024-04-23T10:15:34.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 Processor -- start 2024-04-23T10:15:34.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.095+0000 7ff2867fc640 1 -- start start 2024-04-23T10:15:34.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff2801563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff28014f1e0 0x7ff2800729b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2801f4070 0x7ff2801f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff2800ce3c0 con 0x7ff2680039c0 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff28015ca10 con 0x7ff2801f4070 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff28015c6a0 con 0x7ff28014f1e0 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff2801563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff2801563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57520/0 (socket says 172.21.15.29:57520) 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 -- 172.21.15.29:0/566609266 learned_addr learned my addr 172.21.15.29:0/566609266 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27f7fe640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff28014f1e0 0x7ff2800729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff284d99640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2801f4070 0x7ff2801f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 -- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff28014f1e0 msgr2=0x7ff2800729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff28014f1e0 0x7ff2800729b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 -- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2801f4070 msgr2=0x7ff2801f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2801f4070 0x7ff2801f44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 -- 172.21.15.29:0/566609266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2800cb070 con 0x7ff2680039c0 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27ffff640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff2801563b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff27009bb00 tx=0x7ff268005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27cff9640 1 -- 172.21.15.29:0/566609266 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270001680 con 0x7ff2680039c0 2024-04-23T10:15:34.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27cff9640 1 -- 172.21.15.29:0/566609266 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2700b6070 con 0x7ff2680039c0 2024-04-23T10:15:34.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2800757f0 con 0x7ff2680039c0 2024-04-23T10:15:34.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27cff9640 1 -- 172.21.15.29:0/566609266 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270004a10 con 0x7ff2680039c0 2024-04-23T10:15:34.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff280158360 con 0x7ff2680039c0 2024-04-23T10:15:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2800693c0 con 0x7ff2680039c0 2024-04-23T10:15:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27cff9640 1 -- 172.21.15.29:0/566609266 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff2700b8020 con 0x7ff2680039c0 2024-04-23T10:15:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27cff9640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff26c068380 0x7ff26c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27cff9640 1 -- 172.21.15.29:0/566609266 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff270123640 con 0x7ff2680039c0 2024-04-23T10:15:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.099+0000 7ff27f7fe640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff26c068380 0x7ff26c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.103+0000 7ff27f7fe640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff26c068380 0x7ff26c06a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2801f4fc0 tx=0x7ff274009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.107+0000 7ff27cff9640 1 -- 172.21.15.29:0/566609266 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff2700190c0 con 0x7ff2680039c0 2024-04-23T10:15:34.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.271+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2800cc480 con 0x7ff2680039c0 2024-04-23T10:15:34.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.271+0000 7ff27cff9640 1 -- 172.21.15.29:0/566609266 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12812 (secure 0 0 0) 0x7ff2700f3ec0 con 0x7ff2680039c0 2024-04-23T10:15:34.273 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:34.273 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:33.909241+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff26c068380 msgr2=0x7ff26c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff26c068380 0x7ff26c06a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2801f4fc0 tx=0x7ff274009040 comp rx=0 tx=0).stop 2024-04-23T10:15:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 msgr2=0x7ff2801563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff2801563b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff27009bb00 tx=0x7ff268005840 comp rx=0 tx=0).stop 2024-04-23T10:15:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 shutdown_connections 2024-04-23T10:15:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff26c068380 0x7ff26c06a840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2801f4070 0x7ff2801f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff28014f1e0 0x7ff2800729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 --2- 172.21.15.29:0/566609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2680039c0 0x7ff2801563b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 >> 172.21.15.29:0/566609266 conn(0x7ff28006b9e0 msgr2=0x7ff28014d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:34.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 shutdown_connections 2024-04-23T10:15:34.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.275+0000 7ff2867fc640 1 -- 172.21.15.29:0/566609266 wait complete. 2024-04-23T10:15:34.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:15:34.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:15:34.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.423+0000 7f32dc392640 1 Processor -- start 2024-04-23T10:15:34.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.423+0000 7f32dc392640 1 -- start start 2024-04-23T10:15:34.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.423+0000 7f32dc392640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f32d40c7730 0x7f32d415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.423+0000 7f32dc392640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d415b350 con 0x7f32d41518f0 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.423+0000 7f32dc392640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d415b630 con 0x7f32d40c4f00 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.423+0000 7f32dc392640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f32d40c4280 con 0x7f32d40c7730 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.423+0000 7f32d992d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f32d40c7730 0x7f32d415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.423+0000 7f32da12e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f32d41518f0 0x7f32d40c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55862/0 (socket says 172.21.15.29:55862) 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32da12e640 1 -- 172.21.15.29:0/1107823546 learned_addr learned my addr 172.21.15.29:0/1107823546 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32d992d640 1 -- 172.21.15.29:0/1107823546 >> v1:172.21.15.72:6789/0 conn(0x7f32d40c4f00 legacy=0x7f32d40c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32d992d640 1 -- 172.21.15.29:0/1107823546 >> v1:172.21.15.29:6789/0 conn(0x7f32d41518f0 legacy=0x7f32d40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32d992d640 1 -- 172.21.15.29:0/1107823546 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d415b910 con 0x7f32d40c7730 2024-04-23T10:15:34.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32d992d640 1 --2- 172.21.15.29:0/1107823546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d40c7730 0x7f32d415ac10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32c400a960 tx=0x7f32c401d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44d71fadfb97bc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32d912c640 1 -- 172.21.15.29:0/1107823546 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40b3070 con 0x7f32d40c7730 2024-04-23T10:15:34.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32d912c640 1 -- 172.21.15.29:0/1107823546 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c40a6790 con 0x7f32d40c7730 2024-04-23T10:15:34.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32d912c640 1 -- 172.21.15.29:0/1107823546 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c400b040 con 0x7f32d40c7730 2024-04-23T10:15:34.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32dc392640 1 -- 172.21.15.29:0/1107823546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d40c7730 msgr2=0x7f32d415ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32dc392640 1 --2- 172.21.15.29:0/1107823546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d40c7730 0x7f32d415ac10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32c400a960 tx=0x7f32c401d830 comp rx=0 tx=0).stop 2024-04-23T10:15:34.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32dc392640 1 -- 172.21.15.29:0/1107823546 shutdown_connections 2024-04-23T10:15:34.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32dc392640 1 --2- 172.21.15.29:0/1107823546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d40c7730 0x7f32d415ac10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32dc392640 1 -- 172.21.15.29:0/1107823546 >> 172.21.15.29:0/1107823546 conn(0x7f32d406cfb0 msgr2=0x7f32d406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:34.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32dc392640 1 -- 172.21.15.29:0/1107823546 shutdown_connections 2024-04-23T10:15:34.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.427+0000 7f32dc392640 1 -- 172.21.15.29:0/1107823546 wait complete. 2024-04-23T10:15:34.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 Processor -- start 2024-04-23T10:15:34.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 -- start start 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32d40c4f00 0x7f32d4156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32d40c7730 0x7f32d4157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d41518f0 0x7f32d4160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f32d40c6bb0 con 0x7f32d41518f0 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f32d40c6a30 con 0x7f32d40c4f00 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f32d40c7f60 con 0x7f32d40c7730 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d41518f0 0x7f32d4160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d41518f0 0x7f32d4160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48232/0 (socket says 172.21.15.29:48232) 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 -- 172.21.15.29:0/1835069858 learned_addr learned my addr 172.21.15.29:0/1835069858 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da12e640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32d40c4f00 0x7f32d4156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32d992d640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32d40c7730 0x7f32d4157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 -- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32d40c7730 msgr2=0x7f32d4157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32d40c7730 0x7f32d4157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 -- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32d40c4f00 msgr2=0x7f32d4156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32d40c4f00 0x7f32d4156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 -- 172.21.15.29:0/1835069858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d4157fe0 con 0x7f32d41518f0 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32da92f640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d41518f0 0x7f32d4160140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00b9a0 tx=0x7f32cc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32caffd640 1 -- 172.21.15.29:0/1835069858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc019070 con 0x7f32d41518f0 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32caffd640 1 -- 172.21.15.29:0/1835069858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32cc00cba0 con 0x7f32d41518f0 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d4158280 con 0x7f32d41518f0 2024-04-23T10:15:34.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32caffd640 1 -- 172.21.15.29:0/1835069858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc014440 con 0x7f32d41518f0 2024-04-23T10:15:34.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d41f7ac0 con 0x7f32d41518f0 2024-04-23T10:15:34.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.431+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d4068d70 con 0x7f32d41518f0 2024-04-23T10:15:34.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.435+0000 7f32caffd640 1 -- 172.21.15.29:0/1835069858 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32cc01c070 con 0x7f32d41518f0 2024-04-23T10:15:34.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.435+0000 7f32caffd640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f32b8068380 0x7f32b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.435+0000 7f32caffd640 1 -- 172.21.15.29:0/1835069858 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f32cc086280 con 0x7f32d41518f0 2024-04-23T10:15:34.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.435+0000 7f32da12e640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f32b8068380 0x7f32b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.435+0000 7f32da12e640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f32b8068380 0x7f32b806a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000f70 tx=0x7f32d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.439+0000 7f32caffd640 1 -- 172.21.15.29:0/1835069858 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f32cc056b90 con 0x7f32d41518f0 2024-04-23T10:15:34.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.603+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32d4150070 con 0x7f32d41518f0 2024-04-23T10:15:34.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.603+0000 7f32caffd640 1 -- 172.21.15.29:0/1835069858 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f32cc056490 con 0x7f32d41518f0 2024-04-23T10:15:34.605 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f32b8068380 msgr2=0x7f32b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f32b8068380 0x7f32b806a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000f70 tx=0x7f32d0009040 comp rx=0 tx=0).stop 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d41518f0 msgr2=0x7f32d4160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d41518f0 0x7f32d4160140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00b9a0 tx=0x7f32cc00be60 comp rx=0 tx=0).stop 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 shutdown_connections 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f32b8068380 0x7f32b806a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32d41518f0 0x7f32d4160140 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32d40c7730 0x7f32d4157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 --2- 172.21.15.29:0/1835069858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32d40c4f00 0x7f32d4156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 >> 172.21.15.29:0/1835069858 conn(0x7f32d406cfb0 msgr2=0x7f32d406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 shutdown_connections 2024-04-23T10:15:34.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.607+0000 7f32dc392640 1 -- 172.21.15.29:0/1835069858 wait complete. 2024-04-23T10:15:34.624 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-23T10:15:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.739+0000 7f9065131640 1 Processor -- start 2024-04-23T10:15:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.739+0000 7f9065131640 1 -- start start 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f9065131640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f906006f3b0 0x7f90600c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f9065131640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f906015eae0 con 0x7f90600c8950 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f9065131640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f906015edc0 con 0x7f90600c7600 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f9065131640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9060073b70 con 0x7f906006f3b0 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905e59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f90600c8950 0x7f9060154f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55870/0 (socket says 172.21.15.29:55870) 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905e59c640 1 -- 172.21.15.29:0/2211247931 learned_addr learned my addr 172.21.15.29:0/2211247931 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905ed9d640 1 --2- 172.21.15.29:0/2211247931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f906006f3b0 0x7f90600c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905dd9b640 1 -- 172.21.15.29:0/2211247931 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017272416 0 0) 0x7f906015eae0 con 0x7f90600c8950 2024-04-23T10:15:34.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905dd9b640 1 -- 172.21.15.29:0/2211247931 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9048003530 con 0x7f90600c8950 2024-04-23T10:15:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905dd9b640 1 -- 172.21.15.29:0/2211247931 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 540792803 0 0) 0x7f9048003530 con 0x7f90600c8950 2024-04-23T10:15:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905ed9d640 1 -- 172.21.15.29:0/2211247931 >> v1:172.21.15.72:6789/0 conn(0x7f90600c7600 legacy=0x7f9060071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905ed9d640 1 -- 172.21.15.29:0/2211247931 >> v1:172.21.15.29:6789/0 conn(0x7f90600c8950 legacy=0x7f9060154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.743+0000 7f905ed9d640 1 -- 172.21.15.29:0/2211247931 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906015f0a0 con 0x7f906006f3b0 2024-04-23T10:15:34.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 --2- 172.21.15.29:0/2211247931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f906006f3b0 0x7f90600c70c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9050009dc0 tx=0x7f905001c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626c8d5b7fb85c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905dd9b640 1 -- 172.21.15.29:0/2211247931 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500b2070 con 0x7f906006f3b0 2024-04-23T10:15:34.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905dd9b640 1 -- 172.21.15.29:0/2211247931 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90500a5650 con 0x7f906006f3b0 2024-04-23T10:15:34.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905dd9b640 1 -- 172.21.15.29:0/2211247931 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054001680 con 0x7f906006f3b0 2024-04-23T10:15:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- 172.21.15.29:0/2211247931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f906006f3b0 msgr2=0x7f90600c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 --2- 172.21.15.29:0/2211247931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f906006f3b0 0x7f90600c70c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9050009dc0 tx=0x7f905001c7f0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- 172.21.15.29:0/2211247931 shutdown_connections 2024-04-23T10:15:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 --2- 172.21.15.29:0/2211247931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f906006f3b0 0x7f90600c70c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- 172.21.15.29:0/2211247931 >> 172.21.15.29:0/2211247931 conn(0x7f906006cfb0 msgr2=0x7f906006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- 172.21.15.29:0/2211247931 shutdown_connections 2024-04-23T10:15:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- 172.21.15.29:0/2211247931 wait complete. 2024-04-23T10:15:34.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 Processor -- start 2024-04-23T10:15:34.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- start start 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906006f3b0 0x7f90601f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90600c7600 0x7f9060159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f90600c8950 0x7f9060147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9060071960 con 0x7f906006f3b0 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f906015f660 con 0x7f90600c7600 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f9065131640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f906015e780 con 0x7f90600c8950 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906006f3b0 0x7f90601f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906006f3b0 0x7f90601f1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48248/0 (socket says 172.21.15.29:48248) 2024-04-23T10:15:34.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 -- 172.21.15.29:0/2291619206 learned_addr learned my addr 172.21.15.29:0/2291619206 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905f59e640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f90600c8950 0x7f9060147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905e59c640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90600c7600 0x7f9060159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 -- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f90600c8950 msgr2=0x7f9060147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f90600c8950 0x7f9060147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 -- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90600c7600 msgr2=0x7f9060159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90600c7600 0x7f9060159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 -- 172.21.15.29:0/2291619206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906015e1d0 con 0x7f906006f3b0 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.747+0000 7f905ed9d640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906006f3b0 0x7f90601f1470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f905001d090 tx=0x7f9050019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f90477fe640 1 -- 172.21.15.29:0/2291619206 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500b2040 con 0x7f906006f3b0 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f90477fe640 1 -- 172.21.15.29:0/2291619206 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90500bf070 con 0x7f906006f3b0 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90601f0990 con 0x7f906006f3b0 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f90477fe640 1 -- 172.21.15.29:0/2291619206 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050009450 con 0x7f906006f3b0 2024-04-23T10:15:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90601f0f50 con 0x7f906006f3b0 2024-04-23T10:15:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9060068d70 con 0x7f906006f3b0 2024-04-23T10:15:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f90477fe640 1 -- 172.21.15.29:0/2291619206 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9050004460 con 0x7f906006f3b0 2024-04-23T10:15:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f90477fe640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f904c068380 0x7f904c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f90477fe640 1 -- 172.21.15.29:0/2291619206 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f90501224c0 con 0x7f906006f3b0 2024-04-23T10:15:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f905e59c640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f904c068380 0x7f904c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:34.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.751+0000 7f905e59c640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f904c068380 0x7f904c06a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9054000fc0 tx=0x7f90540015e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:34.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.755+0000 7f90477fe640 1 -- 172.21.15.29:0/2291619206 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f90500164a0 con 0x7f906006f3b0 2024-04-23T10:15:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.919+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f90600c7a60 con 0x7f906006f3b0 2024-04-23T10:15:34.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.919+0000 7f90477fe640 1 -- 172.21.15.29:0/2291619206 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f90500f3000 con 0x7f906006f3b0 2024-04-23T10:15:34.921 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:34.921 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-04-23T10:15:34.921 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-23T10:15:34.921 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-04-23T10:15:34.922 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-04-23T10:15:34.922 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:15:34.922 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f904c068380 msgr2=0x7f904c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f904c068380 0x7f904c06a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9054000fc0 tx=0x7f90540015e0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906006f3b0 msgr2=0x7f90601f1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906006f3b0 0x7f90601f1470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f905001d090 tx=0x7f9050019590 comp rx=0 tx=0).stop 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 shutdown_connections 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f904c068380 0x7f904c06a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f90600c8950 0x7f9060147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90600c7600 0x7f9060159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 --2- 172.21.15.29:0/2291619206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f906006f3b0 0x7f90601f1470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 >> 172.21.15.29:0/2291619206 conn(0x7f906006cfb0 msgr2=0x7f9060154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:34.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 shutdown_connections 2024-04-23T10:15:34.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:34.923+0000 7f9065131640 1 -- 172.21.15.29:0/2291619206 wait complete. 2024-04-23T10:15:34.941 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-23T10:15:34.941 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-23T10:15:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f121a1c7640 1 Processor -- start 2024-04-23T10:15:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f121a1c7640 1 -- start start 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f121a1c7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1214152fe0 0x7f12140c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f121a1c7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12140c6fb0 0x7f12140c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f121a1c7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1214159120 con 0x7f12140c60e0 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f121a1c7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f12140c8de0 con 0x7f1214152fe0 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f121a1c7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1214159400 con 0x7f12140c6fb0 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f12137fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1214152fe0 0x7f12140c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f12137fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1214152fe0 0x7f12140c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48262/0 (socket says 172.21.15.29:48262) 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f12137fe640 1 -- 172.21.15.29:0/1443894624 learned_addr learned my addr 172.21.15.29:0/1443894624 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f1212ffd640 1 --2- 172.21.15.29:0/1443894624 >> v2:172.21.15.72:3300/0 conn(0x7f12140c6fb0 0x7f12140c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f12137fe640 1 -- 172.21.15.29:0/1443894624 >> v2:172.21.15.72:3300/0 conn(0x7f12140c6fb0 msgr2=0x7f12140c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f12137fe640 1 --2- 172.21.15.29:0/1443894624 >> v2:172.21.15.72:3300/0 conn(0x7f12140c6fb0 0x7f12140c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f12137fe640 1 -- 172.21.15.29:0/1443894624 >> v1:172.21.15.29:6789/0 conn(0x7f12140c60e0 legacy=0x7f121415c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f12137fe640 1 -- 172.21.15.29:0/1443894624 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12141596e0 con 0x7f1214152fe0 2024-04-23T10:15:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.071+0000 7f1212ffd640 1 --2- 172.21.15.29:0/1443894624 >> v2:172.21.15.72:3300/0 conn(0x7f12140c6fb0 0x7f12140c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f12137fe640 1 --2- 172.21.15.29:0/1443894624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f12140c88a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12140c37d0 tx=0x7f120401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d55e346ee237474 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f12127fc640 1 -- 172.21.15.29:0/1443894624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12040b5070 con 0x7f1214152fe0 2024-04-23T10:15:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f12127fc640 1 -- 172.21.15.29:0/1443894624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12040a8a10 con 0x7f1214152fe0 2024-04-23T10:15:35.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f12127fc640 1 -- 172.21.15.29:0/1443894624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12040a8de0 con 0x7f1214152fe0 2024-04-23T10:15:35.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f121a1c7640 1 -- 172.21.15.29:0/1443894624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 msgr2=0x7f12140c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:35.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f121a1c7640 1 --2- 172.21.15.29:0/1443894624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f12140c88a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12140c37d0 tx=0x7f120401ed10 comp rx=0 tx=0).stop 2024-04-23T10:15:35.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f121a1c7640 1 -- 172.21.15.29:0/1443894624 shutdown_connections 2024-04-23T10:15:35.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f121a1c7640 1 --2- 172.21.15.29:0/1443894624 >> v2:172.21.15.72:3300/0 conn(0x7f12140c6fb0 0x7f12140c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f121a1c7640 1 --2- 172.21.15.29:0/1443894624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f12140c88a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f121a1c7640 1 -- 172.21.15.29:0/1443894624 >> 172.21.15.29:0/1443894624 conn(0x7f12140c8f90 msgr2=0x7f12140c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:35.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f121a1c7640 1 -- 172.21.15.29:0/1443894624 shutdown_connections 2024-04-23T10:15:35.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.075+0000 7f121a1c7640 1 -- 172.21.15.29:0/1443894624 wait complete. 2024-04-23T10:15:35.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 Processor -- start 2024-04-23T10:15:35.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 -- start start 2024-04-23T10:15:35.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12140c60e0 0x7f1214073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12140c6fb0 0x7f1214150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f1214151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f121415c400 con 0x7f1214152fe0 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1214159ca0 con 0x7f12140c6fb0 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f12141533c0 con 0x7f12140c60e0 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f1214151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f1214151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48276/0 (socket says 172.21.15.29:48276) 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 -- 172.21.15.29:0/2730606672 learned_addr learned my addr 172.21.15.29:0/2730606672 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1212ffd640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12140c6fb0 0x7f1214150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f12137fe640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12140c60e0 0x7f1214073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 -- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12140c60e0 msgr2=0x7f1214073db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12140c60e0 0x7f1214073db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 -- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12140c6fb0 msgr2=0x7f1214150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12140c6fb0 0x7f1214150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 -- 172.21.15.29:0/2730606672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1214150b90 con 0x7f1214152fe0 2024-04-23T10:15:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f1213fff640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f1214151ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c730 tx=0x7f120c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f11fbfff640 1 -- 172.21.15.29:0/2730606672 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c016020 con 0x7f1214152fe0 2024-04-23T10:15:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f11fbfff640 1 -- 172.21.15.29:0/2730606672 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c006d60 con 0x7f1214152fe0 2024-04-23T10:15:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f11fbfff640 1 -- 172.21.15.29:0/2730606672 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c003bc0 con 0x7f1214152fe0 2024-04-23T10:15:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1214153760 con 0x7f1214152fe0 2024-04-23T10:15:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1214154000 con 0x7f1214152fe0 2024-04-23T10:15:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.079+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1214068d70 con 0x7f1214152fe0 2024-04-23T10:15:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.083+0000 7f11fbfff640 1 -- 172.21.15.29:0/2730606672 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f120c0050d0 con 0x7f1214152fe0 2024-04-23T10:15:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.083+0000 7f11fbfff640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1200068380 0x7f120006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.083+0000 7f11fbfff640 1 -- 172.21.15.29:0/2730606672 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f120c0862b0 con 0x7f1214152fe0 2024-04-23T10:15:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.083+0000 7f12137fe640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1200068380 0x7f120006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.083+0000 7f12137fe640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1200068380 0x7f120006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12040b2000 tx=0x7f1204008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:35.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.087+0000 7f11fbfff640 1 -- 172.21.15.29:0/2730606672 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f120c020020 con 0x7f1214152fe0 2024-04-23T10:15:35.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.251+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f121406fac0 con 0x7f1214152fe0 2024-04-23T10:15:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.963+0000 7f11fbfff640 1 -- 172.21.15.29:0/2730606672 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f120c056bc0 con 0x7f1214152fe0 2024-04-23T10:15:35.963 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-04-23T10:15:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1200068380 msgr2=0x7f120006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1200068380 0x7f120006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12040b2000 tx=0x7f1204008040 comp rx=0 tx=0).stop 2024-04-23T10:15:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 msgr2=0x7f1214151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f1214151ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c730 tx=0x7f120c00cb30 comp rx=0 tx=0).stop 2024-04-23T10:15:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 shutdown_connections 2024-04-23T10:15:35.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1200068380 0x7f120006a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1214152fe0 0x7f1214151ad0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12140c6fb0 0x7f1214150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 --2- 172.21.15.29:0/2730606672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12140c60e0 0x7f1214073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 >> 172.21.15.29:0/2730606672 conn(0x7f12140c8f90 msgr2=0x7f1214148560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 shutdown_connections 2024-04-23T10:15:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:35.967+0000 7f121a1c7640 1 -- 172.21.15.29:0/2730606672 wait complete. 2024-04-23T10:15:35.996 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-23T10:15:36.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3137147640 1 Processor -- start 2024-04-23T10:15:36.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3137147640 1 -- start start 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3137147640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31300c8950 0x7f3130154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3137147640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f790 0x7f3130155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3137147640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313015eae0 con 0x7f313006f3b0 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3137147640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f3130073b70 con 0x7f31300c8950 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3137147640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f313015edc0 con 0x7f313006f790 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3134ee3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f313006f3b0 0x7f31300c70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55890/0 (socket says 172.21.15.29:55890) 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f312ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31300c8950 0x7f3130154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f3134ee3640 1 -- 172.21.15.29:0/3854900903 learned_addr learned my addr 172.21.15.29:0/3854900903 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:36.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f31356e4640 1 --2- 172.21.15.29:0/3854900903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f790 0x7f3130155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:36.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f312ffff640 1 -- 172.21.15.29:0/3854900903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f790 msgr2=0x7f3130155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:36.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f312ffff640 1 --2- 172.21.15.29:0/3854900903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f790 0x7f3130155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f312ffff640 1 -- 172.21.15.29:0/3854900903 >> v1:172.21.15.29:6789/0 conn(0x7f313006f3b0 legacy=0x7f31300c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:36.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f312ffff640 1 -- 172.21.15.29:0/3854900903 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313015f0a0 con 0x7f31300c8950 2024-04-23T10:15:36.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.131+0000 7f31356e4640 1 --2- 172.21.15.29:0/3854900903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f790 0x7f3130155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f312ffff640 1 --2- 172.21.15.29:0/3854900903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31300c8950 0x7f3130154f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31200097c0 tx=0x7f312001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895c4f94f16a9883 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f312f7fe640 1 -- 172.21.15.29:0/3854900903 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31200b5070 con 0x7f31300c8950 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f312f7fe640 1 -- 172.21.15.29:0/3854900903 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31200a8990 con 0x7f31300c8950 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f312f7fe640 1 -- 172.21.15.29:0/3854900903 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31200a8d60 con 0x7f31300c8950 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 -- 172.21.15.29:0/3854900903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31300c8950 msgr2=0x7f3130154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 --2- 172.21.15.29:0/3854900903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31300c8950 0x7f3130154f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31200097c0 tx=0x7f312001ec90 comp rx=0 tx=0).stop 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 -- 172.21.15.29:0/3854900903 shutdown_connections 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 --2- 172.21.15.29:0/3854900903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f790 0x7f3130155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 --2- 172.21.15.29:0/3854900903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31300c8950 0x7f3130154f10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 -- 172.21.15.29:0/3854900903 >> 172.21.15.29:0/3854900903 conn(0x7f313006cfb0 msgr2=0x7f313006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:36.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 -- 172.21.15.29:0/3854900903 shutdown_connections 2024-04-23T10:15:36.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 -- 172.21.15.29:0/3854900903 wait complete. 2024-04-23T10:15:36.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 Processor -- start 2024-04-23T10:15:36.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.135+0000 7f3137147640 1 -- start start 2024-04-23T10:15:36.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f3b0 0x7f31301f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:36.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f313006f790 0x7f3130146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:36.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31300c8950 0x7f3130150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:36.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3130071960 con 0x7f313006f790 2024-04-23T10:15:36.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f313015f660 con 0x7f31300c8950 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f31300c77d0 con 0x7f313006f3b0 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f313006f790 0x7f3130146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f313006f790 0x7f3130146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48282/0 (socket says 172.21.15.29:48282) 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 -- 172.21.15.29:0/3809583742 learned_addr learned my addr 172.21.15.29:0/3809583742 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3134ee3640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f3b0 0x7f31301f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f31356e4640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31300c8950 0x7f3130150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 -- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f3b0 msgr2=0x7f31301f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f3b0 0x7f31301f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 -- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31300c8950 msgr2=0x7f3130150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31300c8950 0x7f3130150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 -- 172.21.15.29:0/3809583742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31301f24a0 con 0x7f313006f790 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3134ee3640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f3b0 0x7f31301f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312ffff640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f313006f790 0x7f3130146480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31200b3040 tx=0x7f312001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:36.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312d7fa640 1 -- 172.21.15.29:0/3809583742 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31200bf070 con 0x7f313006f790 2024-04-23T10:15:36.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312d7fa640 1 -- 172.21.15.29:0/3809583742 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31200b0860 con 0x7f313006f790 2024-04-23T10:15:36.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31301f2780 con 0x7f313006f790 2024-04-23T10:15:36.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312d7fa640 1 -- 172.21.15.29:0/3809583742 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31200b5040 con 0x7f313006f790 2024-04-23T10:15:36.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31301f2d40 con 0x7f313006f790 2024-04-23T10:15:36.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3130068d70 con 0x7f313006f790 2024-04-23T10:15:36.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312d7fa640 1 -- 172.21.15.29:0/3809583742 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31200c2070 con 0x7f313006f790 2024-04-23T10:15:36.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312d7fa640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f311c068380 0x7f311c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:36.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f312d7fa640 1 -- 172.21.15.29:0/3809583742 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f3120123190 con 0x7f313006f790 2024-04-23T10:15:36.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.139+0000 7f3134ee3640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f311c068380 0x7f311c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:36.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.143+0000 7f3134ee3640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f311c068380 0x7f311c06a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3124007fd0 tx=0x7f3124009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:36.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.147+0000 7f312d7fa640 1 -- 172.21.15.29:0/3809583742 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31200187f0 con 0x7f313006f790 2024-04-23T10:15:36.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.311+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f3130073050 con 0x7f313006f790 2024-04-23T10:15:36.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.975+0000 7f312d7fa640 1 -- 172.21.15.29:0/3809583742 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f31200f38a0 con 0x7f313006f790 2024-04-23T10:15:36.974 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-04-23T10:15:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f311c068380 msgr2=0x7f311c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:36.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f311c068380 0x7f311c06a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3124007fd0 tx=0x7f3124009040 comp rx=0 tx=0).stop 2024-04-23T10:15:36.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f313006f790 msgr2=0x7f3130146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:36.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f313006f790 0x7f3130146480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31200b3040 tx=0x7f312001ba30 comp rx=0 tx=0).stop 2024-04-23T10:15:36.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 shutdown_connections 2024-04-23T10:15:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f311c068380 0x7f311c06a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31300c8950 0x7f3130150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f313006f790 0x7f3130146480 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 --2- 172.21.15.29:0/3809583742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f313006f3b0 0x7f31301f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.979+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 >> 172.21.15.29:0/3809583742 conn(0x7f313006cfb0 msgr2=0x7f313014a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.983+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 shutdown_connections 2024-04-23T10:15:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:36.983+0000 7f3137147640 1 -- 172.21.15.29:0/3809583742 wait complete. 2024-04-23T10:15:37.028 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-23T10:15:37.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef51452640 1 Processor -- start 2024-04-23T10:15:37.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef51452640 1 -- start start 2024-04-23T10:15:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef51452640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef4c0cea00 0x7fef4c15cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef51452640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c1593a0 con 0x7fef4c158ef0 2024-04-23T10:15:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef51452640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c159680 con 0x7fef4c15d190 2024-04-23T10:15:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef51452640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fef4c15c4e0 con 0x7fef4c0cea00 2024-04-23T10:15:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fef4c158ef0 0x7fef4c073bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55896/0 (socket says 172.21.15.29:55896) 2024-04-23T10:15:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4b7fe640 1 -- 172.21.15.29:0/1625269082 learned_addr learned my addr 172.21.15.29:0/1625269082 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4affd640 1 --2- 172.21.15.29:0/1625269082 >> v2:172.21.15.72:3300/0 conn(0x7fef4c0cea00 0x7fef4c15cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182374938 0 0) 0x7fef4c1593a0 con 0x7fef4c158ef0 2024-04-23T10:15:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef38003530 con 0x7fef4c158ef0 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4193887778 0 0) 0x7fef38003530 con 0x7fef4c158ef0 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 >> v2:172.21.15.72:3300/0 conn(0x7fef4c0cea00 msgr2=0x7fef4c15cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 --2- 172.21.15.29:0/1625269082 >> v2:172.21.15.72:3300/0 conn(0x7fef4c0cea00 0x7fef4c15cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 >> v1:172.21.15.72:6789/0 conn(0x7fef4c15d190 legacy=0x7fef4c152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c159960 con 0x7fef4c158ef0 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fef44001a00 con 0x7fef4c158ef0 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 >> v1:172.21.15.29:6789/0 conn(0x7fef4c158ef0 legacy=0x7fef4c073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380039c0 0x7fef38003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef38004810 0x7fef38004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef380051d0 0x7fef3800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c15c4e0 con 0x7fef380051d0 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fef3800c070 con 0x7fef380039c0 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fef3800c270 con 0x7fef38004810 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4b7fe640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef380051d0 0x7fef3800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4affd640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380039c0 0x7fef38003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef43fff640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef38004810 0x7fef38004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4b7fe640 1 -- 172.21.15.29:0/1625269082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef38004810 msgr2=0x7fef38004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4b7fe640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef38004810 0x7fef38004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4b7fe640 1 -- 172.21.15.29:0/1625269082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380039c0 msgr2=0x7fef38003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4b7fe640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380039c0 0x7fef38003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.155+0000 7fef4b7fe640 1 -- 172.21.15.29:0/1625269082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef38003530 con 0x7fef380051d0 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef4b7fe640 1 -- 172.21.15.29:0/1625269082 reap_dead start 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef4b7fe640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef380051d0 0x7fef3800b9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef4400a840 tx=0x7fef4401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c26580f0225e255 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4400a460 con 0x7fef380051d0 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef440ac640 con 0x7fef380051d0 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef4a7fc640 1 -- 172.21.15.29:0/1625269082 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440aca30 con 0x7fef380051d0 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- 172.21.15.29:0/1625269082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef380051d0 msgr2=0x7fef3800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef380051d0 0x7fef3800b9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef4400a840 tx=0x7fef4401d360 comp rx=0 tx=0).stop 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- 172.21.15.29:0/1625269082 shutdown_connections 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 --2- 172.21.15.29:0/1625269082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef380051d0 0x7fef3800b9d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- 172.21.15.29:0/1625269082 >> 172.21.15.29:0/1625269082 conn(0x7fef4c070f40 msgr2=0x7fef4c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:37.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- 172.21.15.29:0/1625269082 shutdown_connections 2024-04-23T10:15:37.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- 172.21.15.29:0/1625269082 wait complete. 2024-04-23T10:15:37.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 Processor -- start 2024-04-23T10:15:37.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- start start 2024-04-23T10:15:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380051d0 0x7fef4c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4c0bbbb0 0x7fef4c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef4c154820 0x7fef4c0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0c9ac0 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c15c730 con 0x7fef380051d0 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef51452640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c0cede0 con 0x7fef4c154820 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.159+0000 7fef43fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4c0bbbb0 0x7fef4c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef43fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4c0bbbb0 0x7fef4c15b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48308/0 (socket says 172.21.15.29:48308) 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef43fff640 1 -- 172.21.15.29:0/196322770 learned_addr learned my addr 172.21.15.29:0/196322770 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef4b7fe640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef4c154820 0x7fef4c0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef4affd640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380051d0 0x7fef4c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef43fff640 1 -- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef4c154820 msgr2=0x7fef4c0b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef43fff640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef4c154820 0x7fef4c0b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef43fff640 1 -- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380051d0 msgr2=0x7fef4c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:37.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef43fff640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380051d0 0x7fef4c154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef43fff640 1 -- 172.21.15.29:0/196322770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c153e40 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef43fff640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4c0bbbb0 0x7fef4c15b570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef3400e410 tx=0x7fef3400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef437fe640 1 -- 172.21.15.29:0/196322770 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34019070 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef437fe640 1 -- 172.21.15.29:0/196322770 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef340052e0 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c0bc220 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef437fe640 1 -- 172.21.15.29:0/196322770 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34003820 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c153b60 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c0693c0 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef437fe640 1 -- 172.21.15.29:0/196322770 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef3401c070 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef437fe640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fef2c0683b0 0x7fef2c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef437fe640 1 -- 172.21.15.29:0/196322770 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fef340866d0 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.163+0000 7fef4affd640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fef2c0683b0 0x7fef2c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:37.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.167+0000 7fef4affd640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fef2c0683b0 0x7fef2c06a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009910 tx=0x7fef3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.167+0000 7fef437fe640 1 -- 172.21.15.29:0/196322770 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef4c0bc220 con 0x7fef4c0bbbb0 2024-04-23T10:15:37.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:37.363+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fef4c0c5d20 con 0x7fef4c0bbbb0 2024-04-23T10:15:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.023+0000 7fef437fe640 1 -- 172.21.15.29:0/196322770 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fef34056780 con 0x7fef4c0bbbb0 2024-04-23T10:15:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fef2c0683b0 msgr2=0x7fef2c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fef2c0683b0 0x7fef2c06a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009910 tx=0x7fef3c008040 comp rx=0 tx=0).stop 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4c0bbbb0 msgr2=0x7fef4c15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4c0bbbb0 0x7fef4c15b570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef3400e410 tx=0x7fef3400e8d0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 shutdown_connections 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fef2c0683b0 0x7fef2c06a870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef4c154820 0x7fef4c0b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4c0bbbb0 0x7fef4c15b570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 --2- 172.21.15.29:0/196322770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef380051d0 0x7fef4c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 >> 172.21.15.29:0/196322770 conn(0x7fef4c070f40 msgr2=0x7fef4c1578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 shutdown_connections 2024-04-23T10:15:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.031+0000 7fef51452640 1 -- 172.21.15.29:0/196322770 wait complete. 2024-04-23T10:15:38.055 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-23T10:15:38.056 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-23T10:15:38.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.183+0000 7fa1a7b03640 1 Processor -- start 2024-04-23T10:15:38.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.183+0000 7fa1a7b03640 1 -- start start 2024-04-23T10:15:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a7b03640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1a0152fe0 0x7fa1a00c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a7b03640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c6fb0 0x7fa1a00c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a7b03640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1a00c60e0 0x7fa1a015c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a7b03640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a00c8de0 con 0x7fa1a0152fe0 2024-04-23T10:15:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a7b03640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a0159120 con 0x7fa1a00c60e0 2024-04-23T10:15:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a7b03640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a0159400 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1a0152fe0 0x7fa1a00c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1a0152fe0 0x7fa1a00c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48336/0 (socket says 172.21.15.29:48336) 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 -- 172.21.15.29:0/1594558211 learned_addr learned my addr 172.21.15.29:0/1594558211 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a509e640 1 --2- 172.21.15.29:0/1594558211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c6fb0 0x7fa1a00c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a60a0640 1 --2- 172.21.15.29:0/1594558211 >> v2:172.21.15.72:3300/0 conn(0x7fa1a00c60e0 0x7fa1a015c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 -- 172.21.15.29:0/1594558211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c6fb0 msgr2=0x7fa1a00c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 --2- 172.21.15.29:0/1594558211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c6fb0 0x7fa1a00c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 -- 172.21.15.29:0/1594558211 >> v2:172.21.15.72:3300/0 conn(0x7fa1a00c60e0 msgr2=0x7fa1a015c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 --2- 172.21.15.29:0/1594558211 >> v2:172.21.15.72:3300/0 conn(0x7fa1a00c60e0 0x7fa1a015c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 -- 172.21.15.29:0/1594558211 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a01596e0 con 0x7fa1a0152fe0 2024-04-23T10:15:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a60a0640 1 --2- 172.21.15.29:0/1594558211 >> v2:172.21.15.72:3300/0 conn(0x7fa1a00c60e0 0x7fa1a015c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a589f640 1 --2- 172.21.15.29:0/1594558211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a0152fe0 0x7fa1a00c88a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0072df0 tx=0x7fa19c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b83fbe6fe0f6a3e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:38.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a489d640 1 -- 172.21.15.29:0/1594558211 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0b5070 con 0x7fa1a0152fe0 2024-04-23T10:15:38.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a489d640 1 -- 172.21.15.29:0/1594558211 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa19c0a89d0 con 0x7fa1a0152fe0 2024-04-23T10:15:38.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.187+0000 7fa1a489d640 1 -- 172.21.15.29:0/1594558211 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0a8da0 con 0x7fa1a0152fe0 2024-04-23T10:15:38.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- 172.21.15.29:0/1594558211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a0152fe0 msgr2=0x7fa1a00c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:38.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/1594558211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a0152fe0 0x7fa1a00c88a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0072df0 tx=0x7fa19c01ed10 comp rx=0 tx=0).stop 2024-04-23T10:15:38.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- 172.21.15.29:0/1594558211 shutdown_connections 2024-04-23T10:15:38.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/1594558211 >> v2:172.21.15.72:3300/0 conn(0x7fa1a00c60e0 0x7fa1a015c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/1594558211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c6fb0 0x7fa1a00c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/1594558211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a0152fe0 0x7fa1a00c88a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- 172.21.15.29:0/1594558211 >> 172.21.15.29:0/1594558211 conn(0x7fa1a00c8f90 msgr2=0x7fa1a00c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- 172.21.15.29:0/1594558211 shutdown_connections 2024-04-23T10:15:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- 172.21.15.29:0/1594558211 wait complete. 2024-04-23T10:15:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 Processor -- start 2024-04-23T10:15:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- start start 2024-04-23T10:15:38.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c60e0 0x7fa1a01f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:38.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a00c6fb0 0x7fa1a01eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1a0152fe0 0x7fa1a0148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a015c400 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0159ca0 con 0x7fa1a0152fe0 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a01533c0 con 0x7fa1a00c60e0 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a00c6fb0 0x7fa1a01eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a00c6fb0 0x7fa1a01eace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48340/0 (socket says 172.21.15.29:48340) 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 -- 172.21.15.29:0/2583243011 learned_addr learned my addr 172.21.15.29:0/2583243011 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a589f640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c60e0 0x7fa1a01f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a60a0640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1a0152fe0 0x7fa1a0148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 -- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c60e0 msgr2=0x7fa1a01f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c60e0 0x7fa1a01f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 -- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1a0152fe0 msgr2=0x7fa1a0148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1a0152fe0 0x7fa1a0148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 -- 172.21.15.29:0/2583243011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a01f1a50 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a509e640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a00c6fb0 0x7fa1a01eace0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa19000d800 tx=0x7fa19000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1967fc640 1 -- 172.21.15.29:0/2583243011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19000b660 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1967fc640 1 -- 172.21.15.29:0/2583243011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa190019070 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a015abf0 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1967fc640 1 -- 172.21.15.29:0/2583243011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19000ba00 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.191+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a015ae70 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.195+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a0068d70 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.195+0000 7fa1967fc640 1 -- 172.21.15.29:0/2583243011 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa19000bba0 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.195+0000 7fa1967fc640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa184068380 0x7fa18406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.195+0000 7fa1967fc640 1 -- 172.21.15.29:0/2583243011 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fa190086ef0 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.195+0000 7fa1a589f640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa184068380 0x7fa18406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:38.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.195+0000 7fa1a589f640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa184068380 0x7fa18406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0b2000 tx=0x7fa19c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.199+0000 7fa1967fc640 1 -- 172.21.15.29:0/2583243011 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1a015abf0 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.371+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fa1a00695c0 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.979+0000 7fa1967fc640 1 -- 172.21.15.29:0/2583243011 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fa190057420 con 0x7fa1a00c6fb0 2024-04-23T10:15:38.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa184068380 msgr2=0x7fa18406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:38.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa184068380 0x7fa18406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0b2000 tx=0x7fa19c008040 comp rx=0 tx=0).stop 2024-04-23T10:15:38.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a00c6fb0 msgr2=0x7fa1a01eace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:38.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a00c6fb0 0x7fa1a01eace0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa19000d800 tx=0x7fa19000dcc0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 shutdown_connections 2024-04-23T10:15:38.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa184068380 0x7fa18406a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1a0152fe0 0x7fa1a0148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1a00c6fb0 0x7fa1a01eace0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 --2- 172.21.15.29:0/2583243011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1a00c60e0 0x7fa1a01f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:38.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 >> 172.21.15.29:0/2583243011 conn(0x7fa1a00c8f90 msgr2=0x7fa1a00720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:38.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 shutdown_connections 2024-04-23T10:15:38.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:38.983+0000 7fa1a7b03640 1 -- 172.21.15.29:0/2583243011 wait complete. 2024-04-23T10:15:39.004 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-23T10:15:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.143+0000 7ff83db15640 1 Processor -- start 2024-04-23T10:15:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.143+0000 7ff83db15640 1 -- start start 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff83db15640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff838153040 0x7ff8380c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff83db15640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff838153420 0x7ff838158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff83db15640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8380ca170 con 0x7ff8380ce840 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff83db15640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff838073a30 con 0x7ff838153420 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff83db15640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff838073ff0 con 0x7ff838153040 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff836ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff838153420 0x7ff838158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff837fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff8380ce840 0x7ff83815c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55900/0 (socket says 172.21.15.29:55900) 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff837fff640 1 -- 172.21.15.29:0/761488600 learned_addr learned my addr 172.21.15.29:0/761488600 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff8377fe640 1 --2- 172.21.15.29:0/761488600 >> v2:172.21.15.72:3300/0 conn(0x7ff838153040 0x7ff8380c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff836ffd640 1 -- 172.21.15.29:0/761488600 >> v2:172.21.15.72:3300/0 conn(0x7ff838153040 msgr2=0x7ff8380c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff836ffd640 1 --2- 172.21.15.29:0/761488600 >> v2:172.21.15.72:3300/0 conn(0x7ff838153040 0x7ff8380c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:39.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff836ffd640 1 -- 172.21.15.29:0/761488600 >> v1:172.21.15.29:6789/0 conn(0x7ff8380ce840 legacy=0x7ff83815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:39.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff836ffd640 1 -- 172.21.15.29:0/761488600 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8380ca450 con 0x7ff838153420 2024-04-23T10:15:39.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff8367fc640 1 -- 172.21.15.29:0/761488600 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971575683 0 0) 0x7ff8380ca170 con 0x7ff8380ce840 2024-04-23T10:15:39.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff836ffd640 1 --2- 172.21.15.29:0/761488600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838153420 0x7ff838158ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8380734e0 tx=0x7ff82801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f406a90d727292d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:39.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff8367fc640 1 -- 172.21.15.29:0/761488600 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8280ab650 con 0x7ff838153420 2024-04-23T10:15:39.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff8367fc640 1 -- 172.21.15.29:0/761488600 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8280b0070 con 0x7ff838153420 2024-04-23T10:15:39.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.147+0000 7ff8367fc640 1 -- 172.21.15.29:0/761488600 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8280aba10 con 0x7ff838153420 2024-04-23T10:15:39.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- 172.21.15.29:0/761488600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838153420 msgr2=0x7ff838158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:39.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 --2- 172.21.15.29:0/761488600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838153420 0x7ff838158ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8380734e0 tx=0x7ff82801c450 comp rx=0 tx=0).stop 2024-04-23T10:15:39.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- 172.21.15.29:0/761488600 shutdown_connections 2024-04-23T10:15:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 --2- 172.21.15.29:0/761488600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838153420 0x7ff838158ea0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 --2- 172.21.15.29:0/761488600 >> v2:172.21.15.72:3300/0 conn(0x7ff838153040 0x7ff8380c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- 172.21.15.29:0/761488600 >> 172.21.15.29:0/761488600 conn(0x7ff838067e40 msgr2=0x7ff838070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- 172.21.15.29:0/761488600 shutdown_connections 2024-04-23T10:15:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- 172.21.15.29:0/761488600 wait complete. 2024-04-23T10:15:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 Processor -- start 2024-04-23T10:15:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- start start 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8380ce840 0x7ff83815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff838153040 0x7ff838146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff838146f40 0x7ff8381f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff838074460 con 0x7ff8380ce840 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff8380c9790 con 0x7ff838153040 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff8380745e0 con 0x7ff838146f40 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8380ce840 0x7ff83815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8380ce840 0x7ff83815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48354/0 (socket says 172.21.15.29:48354) 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 -- 172.21.15.29:0/1372641990 learned_addr learned my addr 172.21.15.29:0/1372641990 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:39.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff837fff640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff838146f40 0x7ff8381f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff836ffd640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff838153040 0x7ff838146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 -- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff838146f40 msgr2=0x7ff8381f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff838146f40 0x7ff8381f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 -- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff838153040 msgr2=0x7ff838146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff838153040 0x7ff838146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 -- 172.21.15.29:0/1372641990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8381473e0 con 0x7ff8380ce840 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff8377fe640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8380ce840 0x7ff83815a9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff82000d830 tx=0x7ff82000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff82ffff640 1 -- 172.21.15.29:0/1372641990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82000b6c0 con 0x7ff8380ce840 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff82ffff640 1 -- 172.21.15.29:0/1372641990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff820019070 con 0x7ff8380ce840 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8381f4fd0 con 0x7ff8380ce840 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff82ffff640 1 -- 172.21.15.29:0/1372641990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82000ba60 con 0x7ff8380ce840 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.151+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8381f5590 con 0x7ff8380ce840 2024-04-23T10:15:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.155+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8380762d0 con 0x7ff8380ce840 2024-04-23T10:15:39.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.155+0000 7ff82ffff640 1 -- 172.21.15.29:0/1372641990 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff82000bc00 con 0x7ff8380ce840 2024-04-23T10:15:39.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.155+0000 7ff82ffff640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff818068380 0x7ff81806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:39.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.155+0000 7ff82ffff640 1 -- 172.21.15.29:0/1372641990 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7ff820086f30 con 0x7ff8380ce840 2024-04-23T10:15:39.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.155+0000 7ff836ffd640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff818068380 0x7ff81806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:39.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.155+0000 7ff836ffd640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff818068380 0x7ff81806a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8280af000 tx=0x7ff8280a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.159+0000 7ff82ffff640 1 -- 172.21.15.29:0/1372641990 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff8200573c0 con 0x7ff8380ce840 2024-04-23T10:15:39.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:39.327+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff838070fc0 con 0x7ff8380ce840 2024-04-23T10:15:41.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.043+0000 7ff82ffff640 1 -- 172.21.15.29:0/1372641990 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7ff820056cc0 con 0x7ff8380ce840 2024-04-23T10:15:41.044 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' created 2024-04-23T10:15:41.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff818068380 msgr2=0x7ff81806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff818068380 0x7ff81806a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8280af000 tx=0x7ff8280a7000 comp rx=0 tx=0).stop 2024-04-23T10:15:41.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8380ce840 msgr2=0x7ff83815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8380ce840 0x7ff83815a9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff82000d830 tx=0x7ff82000dcf0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 shutdown_connections 2024-04-23T10:15:41.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff818068380 0x7ff81806a840 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8280af000 tx=0x7ff8280a7000 comp rx=0 tx=0).stop 2024-04-23T10:15:41.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff838146f40 0x7ff8381f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff838153040 0x7ff838146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 --2- 172.21.15.29:0/1372641990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8380ce840 0x7ff83815a9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 >> 172.21.15.29:0/1372641990 conn(0x7ff838067e40 msgr2=0x7ff8380cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:41.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 shutdown_connections 2024-04-23T10:15:41.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.047+0000 7ff83db15640 1 -- 172.21.15.29:0/1372641990 wait complete. 2024-04-23T10:15:41.077 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-23T10:15:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.207+0000 7f5dc3a36640 1 Processor -- start 2024-04-23T10:15:41.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.207+0000 7f5dc3a36640 1 -- start start 2024-04-23T10:15:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.207+0000 7f5dc3a36640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 0x7f5dbc157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.207+0000 7f5dc3a36640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5dbc072570 0x7f5dbc072990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dbc158390 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5dbc158670 con 0x7f5dbc072570 2024-04-23T10:15:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5dbc158950 con 0x7f5dbc152010 2024-04-23T10:15:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc0fd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5dbc072570 0x7f5dbc072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc1fd3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5dbc0ca0d0 0x7f5dbc0738b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55908/0 (socket says 172.21.15.29:55908) 2024-04-23T10:15:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc1fd3640 1 -- 172.21.15.29:0/2814884155 learned_addr learned my addr 172.21.15.29:0/2814884155 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc17d2640 1 --2- 172.21.15.29:0/2814884155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 0x7f5dbc157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc0fd1640 1 -- 172.21.15.29:0/2814884155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 msgr2=0x7f5dbc157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc0fd1640 1 --2- 172.21.15.29:0/2814884155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 0x7f5dbc157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc0fd1640 1 -- 172.21.15.29:0/2814884155 >> v1:172.21.15.29:6789/0 conn(0x7f5dbc0ca0d0 legacy=0x7f5dbc0738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc0fd1640 1 -- 172.21.15.29:0/2814884155 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dbc158c30 con 0x7f5dbc072570 2024-04-23T10:15:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc0fd1640 1 --2- 172.21.15.29:0/2814884155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc072570 0x7f5dbc072990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0097c0 tx=0x7f5dac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d67432c373b4b4e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5db3fff640 1 -- 172.21.15.29:0/2814884155 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0b1070 con 0x7f5dbc072570 2024-04-23T10:15:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5db3fff640 1 -- 172.21.15.29:0/2814884155 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dac0ac600 con 0x7f5dbc072570 2024-04-23T10:15:41.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5db3fff640 1 -- 172.21.15.29:0/2814884155 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0ac9d0 con 0x7f5dbc072570 2024-04-23T10:15:41.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 -- 172.21.15.29:0/2814884155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc072570 msgr2=0x7f5dbc072990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/2814884155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc072570 0x7f5dbc072990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0097c0 tx=0x7f5dac01c4a0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 -- 172.21.15.29:0/2814884155 shutdown_connections 2024-04-23T10:15:41.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/2814884155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc072570 0x7f5dbc072990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/2814884155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 0x7f5dbc157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 -- 172.21.15.29:0/2814884155 >> 172.21.15.29:0/2814884155 conn(0x7f5dbc0683f0 msgr2=0x7f5dbc06fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:41.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 -- 172.21.15.29:0/2814884155 shutdown_connections 2024-04-23T10:15:41.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.211+0000 7f5dc3a36640 1 -- 172.21.15.29:0/2814884155 wait complete. 2024-04-23T10:15:41.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 Processor -- start 2024-04-23T10:15:41.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 -- start start 2024-04-23T10:15:41.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc072570 0x7f5dbc148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc0ca0d0 0x7f5dbc149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 0x7f5dbc1441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc075570 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc0ca8f0 con 0x7f5dbc072570 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5dbc0756f0 con 0x7f5dbc152010 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc0ca0d0 0x7f5dbc149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc0ca0d0 0x7f5dbc149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48368/0 (socket says 172.21.15.29:48368) 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 -- 172.21.15.29:0/1173361487 learned_addr learned my addr 172.21.15.29:0/1173361487 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc1fd3640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 0x7f5dbc1441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc17d2640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc072570 0x7f5dbc148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 -- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 msgr2=0x7f5dbc1441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 0x7f5dbc1441d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 -- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc072570 msgr2=0x7f5dbc148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc072570 0x7f5dbc148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 -- 172.21.15.29:0/1173361487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dbc143a40 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc0fd1640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc0ca0d0 0x7f5dbc149780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5dac01a0d0 tx=0x7f5dac01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5db1ffb640 1 -- 172.21.15.29:0/1173361487 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0bc070 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5db1ffb640 1 -- 172.21.15.29:0/1173361487 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dac0b7410 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dbc1491a0 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5db1ffb640 1 -- 172.21.15.29:0/1173361487 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0b1040 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dbc15bd60 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.215+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dbc0693c0 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.219+0000 7f5db1ffb640 1 -- 172.21.15.29:0/1173361487 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5dac0bf070 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.219+0000 7f5db1ffb640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5da00683b0 0x7f5da006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.219+0000 7f5db1ffb640 1 -- 172.21.15.29:0/1173361487 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f5dac120270 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.219+0000 7f5dc17d2640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5da00683b0 0x7f5da006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.219+0000 7f5dc17d2640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5da00683b0 0x7f5da006a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009e90 tx=0x7f5db800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:41.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.223+0000 7f5db1ffb640 1 -- 172.21.15.29:0/1173361487 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5dac016090 con 0x7f5dbc0ca0d0 2024-04-23T10:15:41.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:41.387+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f5dbc0cc8a0 con 0x7f5dbc0ca0d0 2024-04-23T10:15:42.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.047+0000 7f5db1ffb640 1 -- 172.21.15.29:0/1173361487 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f5dac0f0510 con 0x7f5dbc0ca0d0 2024-04-23T10:15:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:set pool 4 allow_ec_overwrites to true 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.047+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5da00683b0 msgr2=0x7f5da006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.047+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5da00683b0 0x7f5da006a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009e90 tx=0x7f5db800b040 comp rx=0 tx=0).stop 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.047+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc0ca0d0 msgr2=0x7f5dbc149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.047+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc0ca0d0 0x7f5dbc149780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5dac01a0d0 tx=0x7f5dac01ace0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.051+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 shutdown_connections 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.051+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5da00683b0 0x7f5da006a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.051+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc152010 0x7f5dbc1441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.051+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dbc0ca0d0 0x7f5dbc149780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.051+0000 7f5dc3a36640 1 --2- 172.21.15.29:0/1173361487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc072570 0x7f5dbc148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.051+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 >> 172.21.15.29:0/1173361487 conn(0x7f5dbc0683f0 msgr2=0x7f5dbc0cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.051+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 shutdown_connections 2024-04-23T10:15:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.051+0000 7f5dc3a36640 1 -- 172.21.15.29:0/1173361487 wait complete. 2024-04-23T10:15:42.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-23T10:15:42.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8063ad5640 1 Processor -- start 2024-04-23T10:15:42.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8063ad5640 1 -- start start 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8063ad5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f805c06f790 0x7f805c0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8063ad5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f805c071160 0x7f805c073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8063ad5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f805c072590 con 0x7f805c06f3b0 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8063ad5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f805c072fe0 con 0x7f805c071160 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8063ad5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f805c158df0 con 0x7f805c06f790 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8061871640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f805c06f3b0 0x7f805c157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55914/0 (socket says 172.21.15.29:55914) 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8062072640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f805c071160 0x7f805c073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8061871640 1 -- 172.21.15.29:0/2819593060 learned_addr learned my addr 172.21.15.29:0/2819593060 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8061070640 1 --2- 172.21.15.29:0/2819593060 >> v2:172.21.15.72:3300/0 conn(0x7f805c06f790 0x7f805c0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8062072640 1 -- 172.21.15.29:0/2819593060 >> v2:172.21.15.72:3300/0 conn(0x7f805c06f790 msgr2=0x7f805c0c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8062072640 1 --2- 172.21.15.29:0/2819593060 >> v2:172.21.15.72:3300/0 conn(0x7f805c06f790 0x7f805c0c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8062072640 1 -- 172.21.15.29:0/2819593060 >> v1:172.21.15.29:6789/0 conn(0x7f805c06f3b0 legacy=0x7f805c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f806086f640 1 -- 172.21.15.29:0/2819593060 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867207205 0 0) 0x7f805c072590 con 0x7f805c06f3b0 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.219+0000 7f8062072640 1 -- 172.21.15.29:0/2819593060 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805c158830 con 0x7f805c071160 2024-04-23T10:15:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8062072640 1 --2- 172.21.15.29:0/2819593060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c071160 0x7f805c073470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f805c06e420 tx=0x7f804401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be38efc61f2d856 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f806086f640 1 -- 172.21.15.29:0/2819593060 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80440ab650 con 0x7f805c071160 2024-04-23T10:15:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f806086f640 1 -- 172.21.15.29:0/2819593060 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80440b0070 con 0x7f805c071160 2024-04-23T10:15:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f806086f640 1 -- 172.21.15.29:0/2819593060 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80440aba10 con 0x7f805c071160 2024-04-23T10:15:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- 172.21.15.29:0/2819593060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c071160 msgr2=0x7f805c073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 --2- 172.21.15.29:0/2819593060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c071160 0x7f805c073470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f805c06e420 tx=0x7f804401c450 comp rx=0 tx=0).stop 2024-04-23T10:15:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- 172.21.15.29:0/2819593060 shutdown_connections 2024-04-23T10:15:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 --2- 172.21.15.29:0/2819593060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c071160 0x7f805c073470 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 --2- 172.21.15.29:0/2819593060 >> v2:172.21.15.72:3300/0 conn(0x7f805c06f790 0x7f805c0c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- 172.21.15.29:0/2819593060 >> 172.21.15.29:0/2819593060 conn(0x7f805c06cfb0 msgr2=0x7f805c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- 172.21.15.29:0/2819593060 shutdown_connections 2024-04-23T10:15:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- 172.21.15.29:0/2819593060 wait complete. 2024-04-23T10:15:42.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 Processor -- start 2024-04-23T10:15:42.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- start start 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f805c06f3b0 0x7f805c1f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c06f790 0x7f805c0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f805c071160 0x7f805c153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f805c152330 con 0x7f805c06f790 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f805c158500 con 0x7f805c06f3b0 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8063ad5640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f805c1524b0 con 0x7f805c071160 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8061070640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c06f790 0x7f805c0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.223+0000 7f8061070640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c06f790 0x7f805c0ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48386/0 (socket says 172.21.15.29:48386) 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061070640 1 -- 172.21.15.29:0/453583197 learned_addr learned my addr 172.21.15.29:0/453583197 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061871640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f805c06f3b0 0x7f805c1f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8062072640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f805c071160 0x7f805c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061070640 1 -- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f805c071160 msgr2=0x7f805c153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061070640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f805c071160 0x7f805c153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061070640 1 -- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f805c06f3b0 msgr2=0x7f805c1f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061070640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f805c06f3b0 0x7f805c1f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061070640 1 -- 172.21.15.29:0/453583197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805c152860 con 0x7f805c06f790 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8062072640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f805c071160 0x7f805c153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061070640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c06f790 0x7f805c0ca800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f804c00d830 tx=0x7f804c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f805a7fc640 1 -- 172.21.15.29:0/453583197 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c00b6c0 con 0x7f805c06f790 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f805a7fc640 1 -- 172.21.15.29:0/453583197 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c019070 con 0x7f805c06f790 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f805a7fc640 1 -- 172.21.15.29:0/453583197 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c00ba60 con 0x7f805c06f790 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805c1551c0 con 0x7f805c06f790 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f805c152b00 con 0x7f805c06f790 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805c068d70 con 0x7f805c06f790 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f805a7fc640 1 -- 172.21.15.29:0/453583197 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f804c01e460 con 0x7f805c06f790 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f805a7fc640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f803c068380 0x7f803c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f805a7fc640 1 -- 172.21.15.29:0/453583197 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f804c087440 con 0x7f805c06f790 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061871640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f803c068380 0x7f803c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.227+0000 7f8061871640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f803c068380 0x7f803c06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80540012f0 tx=0x7f8054009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.231+0000 7f805a7fc640 1 -- 172.21.15.29:0/453583197 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f804c057640 con 0x7f805c06f790 2024-04-23T10:15:42.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:42.435+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f805c1556e0 con 0x7f805c06f790 2024-04-23T10:15:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.079+0000 7f805a7fc640 1 -- 172.21.15.29:0/453583197 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f804c056f40 con 0x7f805c06f790 2024-04-23T10:15:43.078 INFO:teuthology.orchestra.run.smithi029.stderr:added data pool 4 to fsmap 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f803c068380 msgr2=0x7f803c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f803c068380 0x7f803c06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80540012f0 tx=0x7f8054009040 comp rx=0 tx=0).stop 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c06f790 msgr2=0x7f805c0ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c06f790 0x7f805c0ca800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f804c00d830 tx=0x7f804c00dcf0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 shutdown_connections 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f803c068380 0x7f803c06a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f805c071160 0x7f805c153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f805c06f790 0x7f805c0ca800 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f804c00d830 tx=0x7f804c00dcf0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 --2- 172.21.15.29:0/453583197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f805c06f3b0 0x7f805c1f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 >> 172.21.15.29:0/453583197 conn(0x7f805c06cfb0 msgr2=0x7f805c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 shutdown_connections 2024-04-23T10:15:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.083+0000 7f8063ad5640 1 -- 172.21.15.29:0/453583197 wait complete. 2024-04-23T10:15:43.103 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:15:43.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f121dd21640 1 Processor -- start 2024-04-23T10:15:43.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f121dd21640 1 -- start start 2024-04-23T10:15:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f121dd21640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f121806f3b0 0x7f12180c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f121dd21640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1218072590 con 0x7f121806f790 2024-04-23T10:15:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f121dd21640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1218158830 con 0x7f1218071160 2024-04-23T10:15:43.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f121dd21640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1218072fe0 con 0x7f121806f3b0 2024-04-23T10:15:43.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f12177fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f121806f3b0 0x7f12180c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f1216ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f121806f790 0x7f1218157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55930/0 (socket says 172.21.15.29:55930) 2024-04-23T10:15:43.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f1216ffd640 1 -- 172.21.15.29:0/2281023488 learned_addr learned my addr 172.21.15.29:0/2281023488 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:43.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f12177fe640 1 -- 172.21.15.29:0/2281023488 >> v1:172.21.15.72:6789/0 conn(0x7f1218071160 legacy=0x7f1218151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:43.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f12177fe640 1 -- 172.21.15.29:0/2281023488 >> v1:172.21.15.29:6789/0 conn(0x7f121806f790 legacy=0x7f1218157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f12177fe640 1 -- 172.21.15.29:0/2281023488 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218158b10 con 0x7f121806f3b0 2024-04-23T10:15:43.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f12167fc640 1 -- 172.21.15.29:0/2281023488 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990693008 0 0) 0x7f1218072590 con 0x7f121806f790 2024-04-23T10:15:43.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.235+0000 7f12177fe640 1 --2- 172.21.15.29:0/2281023488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f3b0 0x7f12180c4d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f12080097c0 tx=0x7f120801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdceb78a45ed17d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f12167fc640 1 -- 172.21.15.29:0/2281023488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12080b0070 con 0x7f121806f3b0 2024-04-23T10:15:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f12167fc640 1 -- 172.21.15.29:0/2281023488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12080ab600 con 0x7f121806f3b0 2024-04-23T10:15:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f12167fc640 1 -- 172.21.15.29:0/2281023488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12080ab9d0 con 0x7f121806f3b0 2024-04-23T10:15:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- 172.21.15.29:0/2281023488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f3b0 msgr2=0x7f12180c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 --2- 172.21.15.29:0/2281023488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f3b0 0x7f12180c4d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f12080097c0 tx=0x7f120801c460 comp rx=0 tx=0).stop 2024-04-23T10:15:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- 172.21.15.29:0/2281023488 shutdown_connections 2024-04-23T10:15:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 --2- 172.21.15.29:0/2281023488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f3b0 0x7f12180c4d70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- 172.21.15.29:0/2281023488 >> 172.21.15.29:0/2281023488 conn(0x7f121806cfb0 msgr2=0x7f121806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:43.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- 172.21.15.29:0/2281023488 shutdown_connections 2024-04-23T10:15:43.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- 172.21.15.29:0/2281023488 wait complete. 2024-04-23T10:15:43.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 Processor -- start 2024-04-23T10:15:43.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- start start 2024-04-23T10:15:43.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121806f3b0 0x7f12180cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f790 0x7f12181f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1218071160 0x7f12181f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1218165fa0 con 0x7f121806f790 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1218158500 con 0x7f121806f3b0 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1218166120 con 0x7f1218071160 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f790 0x7f12181f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f790 0x7f12181f3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48396/0 (socket says 172.21.15.29:48396) 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 -- 172.21.15.29:0/2830088264 learned_addr learned my addr 172.21.15.29:0/2830088264 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f12177fe640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121806f3b0 0x7f12180cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1217fff640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1218071160 0x7f12181f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 -- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1218071160 msgr2=0x7f12181f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1218071160 0x7f12181f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 -- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121806f3b0 msgr2=0x7f12180cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121806f3b0 0x7f12180cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 -- 172.21.15.29:0/2830088264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218155540 con 0x7f121806f790 2024-04-23T10:15:43.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f1216ffd640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f790 0x7f12181f3720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c580 tx=0x7f120c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f11fffff640 1 -- 172.21.15.29:0/2830088264 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c017070 con 0x7f121806f790 2024-04-23T10:15:43.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f11fffff640 1 -- 172.21.15.29:0/2830088264 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c005d10 con 0x7f121806f790 2024-04-23T10:15:43.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f11fffff640 1 -- 172.21.15.29:0/2830088264 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c007330 con 0x7f121806f790 2024-04-23T10:15:43.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12181468f0 con 0x7f121806f790 2024-04-23T10:15:43.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.239+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1218146eb0 con 0x7f121806f790 2024-04-23T10:15:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.243+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12181f3400 con 0x7f121806f790 2024-04-23T10:15:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.243+0000 7f11fffff640 1 -- 172.21.15.29:0/2830088264 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f120c01a070 con 0x7f121806f790 2024-04-23T10:15:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.243+0000 7f11fffff640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12040683b0 0x7f120406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.243+0000 7f11fffff640 1 -- 172.21.15.29:0/2830088264 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f120c086100 con 0x7f121806f790 2024-04-23T10:15:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.243+0000 7f12177fe640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12040683b0 0x7f120406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.243+0000 7f12177fe640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12040683b0 0x7f120406a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12080ad000 tx=0x7f12080a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.247+0000 7f11fffff640 1 -- 172.21.15.29:0/2830088264 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12181f3400 con 0x7f121806f790 2024-04-23T10:15:43.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1218068d70 con 0x7f121806f790 2024-04-23T10:15:43.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f11fffff640 1 -- 172.21.15.29:0/2830088264 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6813 (secure 0 0 0) 0x7f120c056390 con 0x7f121806f790 2024-04-23T10:15:43.447 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:43.447 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4212,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:15:43.068608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-23T10:15:43.447 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-23T10:15:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12040683b0 msgr2=0x7f120406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12040683b0 0x7f120406a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12080ad000 tx=0x7f12080a6000 comp rx=0 tx=0).stop 2024-04-23T10:15:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f790 msgr2=0x7f12181f3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f790 0x7f12181f3720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c580 tx=0x7f120c00ca40 comp rx=0 tx=0).stop 2024-04-23T10:15:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 shutdown_connections 2024-04-23T10:15:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12040683b0 0x7f120406a870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1218071160 0x7f12181f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f121806f790 0x7f12181f3720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 --2- 172.21.15.29:0/2830088264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121806f3b0 0x7f12180cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 >> 172.21.15.29:0/2830088264 conn(0x7f121806cfb0 msgr2=0x7f121806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:43.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 shutdown_connections 2024-04-23T10:15:43.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.447+0000 7f121dd21640 1 -- 172.21.15.29:0/2830088264 wait complete. 2024-04-23T10:15:43.466 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:43.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc8e51640 1 Processor -- start 2024-04-23T10:15:43.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc8e51640 1 -- start start 2024-04-23T10:15:43.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc8e51640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bc406f3b0 0x7f6bc40c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc8e51640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc406f790 0x7f6bc4073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc8e51640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc4072590 con 0x7f6bc4071160 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc8e51640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc4072fe0 con 0x7f6bc406f3b0 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc8e51640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc4158df0 con 0x7f6bc406f790 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc2d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6bc4071160 0x7f6bc4157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55936/0 (socket says 172.21.15.29:55936) 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc2d9d640 1 -- 172.21.15.29:0/1607990584 learned_addr learned my addr 172.21.15.29:0/1607990584 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bbbfff640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc406f790 0x7f6bc4073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc259c640 1 --2- 172.21.15.29:0/1607990584 >> v2:172.21.15.72:3300/0 conn(0x7f6bc406f3b0 0x7f6bc40c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570757470 0 0) 0x7f6bc4072590 con 0x7f6bc4071160 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.595+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ba4003530 con 0x7f6bc4071160 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3291667769 0 0) 0x7f6ba4003530 con 0x7f6bc4071160 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc406f790 msgr2=0x7f6bc4073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc406f790 0x7f6bc4073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 >> v2:172.21.15.72:3300/0 conn(0x7f6bc406f3b0 msgr2=0x7f6bc40c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 --2- 172.21.15.29:0/1607990584 >> v2:172.21.15.72:3300/0 conn(0x7f6bc406f3b0 0x7f6bc40c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc4158830 con 0x7f6bc4071160 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f6bbc001a00 con 0x7f6bc4071160 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 >> v1:172.21.15.29:6789/0 conn(0x7f6bc4071160 legacy=0x7f6bc4157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ba40039c0 0x7f6ba4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc406f790 0x7f6ba4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba4004d50 0x7f6ba40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4072fe0 con 0x7f6ba40039c0 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4158df0 con 0x7f6ba4004d50 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba400b9d0 con 0x7f6bc406f790 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc259c640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ba40039c0 0x7f6ba4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bbbfff640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc406f790 0x7f6ba4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc2d9d640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba4004d50 0x7f6ba40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc259c640 1 -- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc406f790 msgr2=0x7f6ba4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:43.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc259c640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc406f790 0x7f6ba4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc259c640 1 -- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba4004d50 msgr2=0x7f6ba40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:43.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc259c640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba4004d50 0x7f6ba40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc259c640 1 -- 172.21.15.29:0/1607990584 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba4003530 con 0x7f6ba40039c0 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc259c640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ba40039c0 0x7f6ba4003de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009b10 tx=0x7f6bb401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475ce8c8abfb3341 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40b2070 con 0x7f6ba40039c0 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb40a5650 con 0x7f6ba40039c0 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc1d9b640 1 -- 172.21.15.29:0/1607990584 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40096b0 con 0x7f6ba40039c0 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc8e51640 1 -- 172.21.15.29:0/1607990584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ba40039c0 msgr2=0x7f6ba4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc8e51640 1 --2- 172.21.15.29:0/1607990584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ba40039c0 0x7f6ba4003de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009b10 tx=0x7f6bb401ca80 comp rx=0 tx=0).stop 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc2d9d640 1 -- 172.21.15.29:0/1607990584 reap_dead start 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc8e51640 1 -- 172.21.15.29:0/1607990584 shutdown_connections 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc8e51640 1 -- 172.21.15.29:0/1607990584 >> 172.21.15.29:0/1607990584 conn(0x7f6bc406cfb0 msgr2=0x7f6bc406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc8e51640 1 -- 172.21.15.29:0/1607990584 shutdown_connections 2024-04-23T10:15:43.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.599+0000 7f6bc8e51640 1 -- 172.21.15.29:0/1607990584 wait complete. 2024-04-23T10:15:43.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 Processor -- start 2024-04-23T10:15:43.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 -- start start 2024-04-23T10:15:43.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba40039c0 0x7f6bc41502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc4152760 0x7f6bc40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc40cd000 0x7f6bc41f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4158500 con 0x7f6bc4152760 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4072c70 con 0x7f6ba40039c0 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc4152330 con 0x7f6bc40cd000 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc4152760 0x7f6bc40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc4152760 0x7f6bc40ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48412/0 (socket says 172.21.15.29:48412) 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 -- 172.21.15.29:0/2143706446 learned_addr learned my addr 172.21.15.29:0/2143706446 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc259c640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba40039c0 0x7f6bc41502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc2d9d640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc40cd000 0x7f6bc41f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 -- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc40cd000 msgr2=0x7f6bc41f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc40cd000 0x7f6bc41f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 -- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba40039c0 msgr2=0x7f6bc41502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba40039c0 0x7f6bc41502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 -- 172.21.15.29:0/2143706446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc40cd550 con 0x7f6bc4152760 2024-04-23T10:15:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbbfff640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc4152760 0x7f6bc40ccac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6bac011590 tx=0x7f6bac011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbaffd640 1 -- 172.21.15.29:0/2143706446 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac004220 con 0x7f6bc4152760 2024-04-23T10:15:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbaffd640 1 -- 172.21.15.29:0/2143706446 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac0043c0 con 0x7f6bc4152760 2024-04-23T10:15:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc40cbca0 con 0x7f6bc4152760 2024-04-23T10:15:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bbaffd640 1 -- 172.21.15.29:0/2143706446 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac015870 con 0x7f6bc4152760 2024-04-23T10:15:43.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc40cc260 con 0x7f6bc4152760 2024-04-23T10:15:43.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.603+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc4068d70 con 0x7f6bc4152760 2024-04-23T10:15:43.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.607+0000 7f6bbaffd640 1 -- 172.21.15.29:0/2143706446 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6bac015a10 con 0x7f6bc4152760 2024-04-23T10:15:43.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.607+0000 7f6bbaffd640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6ba8068380 0x7f6ba806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.607+0000 7f6bbaffd640 1 -- 172.21.15.29:0/2143706446 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6bac087340 con 0x7f6bc4152760 2024-04-23T10:15:43.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.607+0000 7f6bc259c640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6ba8068380 0x7f6ba806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.607+0000 7f6bc259c640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6ba8068380 0x7f6ba806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40af000 tx=0x7f6bb40046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.611+0000 7f6bbaffd640 1 -- 172.21.15.29:0/2143706446 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6bac019030 con 0x7f6bc4152760 2024-04-23T10:15:43.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.775+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bc414e4b0 con 0x7f6bc4152760 2024-04-23T10:15:43.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bbaffd640 1 -- 172.21.15.29:0/2143706446 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f6bac057530 con 0x7f6bc4152760 2024-04-23T10:15:43.778 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:43.778 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:43.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6ba8068380 msgr2=0x7f6ba806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6ba8068380 0x7f6ba806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40af000 tx=0x7f6bb40046d0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc4152760 msgr2=0x7f6bc40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc4152760 0x7f6bc40ccac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6bac011590 tx=0x7f6bac011a50 comp rx=0 tx=0).stop 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 shutdown_connections 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6ba8068380 0x7f6ba806a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bc40cd000 0x7f6bc41f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bc4152760 0x7f6bc40ccac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 --2- 172.21.15.29:0/2143706446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba40039c0 0x7f6bc41502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 >> 172.21.15.29:0/2143706446 conn(0x7f6bc406cfb0 msgr2=0x7f6bc4150cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 shutdown_connections 2024-04-23T10:15:43.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.779+0000 7f6bc8e51640 1 -- 172.21.15.29:0/2143706446 wait complete. 2024-04-23T10:15:43.798 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:43.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.915+0000 7f017ad2f640 1 Processor -- start 2024-04-23T10:15:43.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.915+0000 7f017ad2f640 1 -- start start 2024-04-23T10:15:43.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f017ad2f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0174067fb0 0x7f017406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f017ad2f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 0x7f017406e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f017ad2f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0174159380 con 0x7f0174153040 2024-04-23T10:15:43.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f017ad2f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0174159660 con 0x7f0174067fb0 2024-04-23T10:15:43.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f017ad2f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0174159940 con 0x7f0174158ed0 2024-04-23T10:15:43.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f0178acb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0174153040 0x7f017415cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55942/0 (socket says 172.21.15.29:55942) 2024-04-23T10:15:43.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f0173fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0174067fb0 0x7f017406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f0178acb640 1 -- 172.21.15.29:0/1077616224 learned_addr learned my addr 172.21.15.29:0/1077616224 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:43.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f01792cc640 1 --2- 172.21.15.29:0/1077616224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 0x7f017406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f0173fff640 1 -- 172.21.15.29:0/1077616224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 msgr2=0x7f017406e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:43.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f0173fff640 1 --2- 172.21.15.29:0/1077616224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 0x7f017406e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f0173fff640 1 -- 172.21.15.29:0/1077616224 >> v1:172.21.15.29:6789/0 conn(0x7f0174153040 legacy=0x7f017415cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f01737fe640 1 -- 172.21.15.29:0/1077616224 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353297665 0 0) 0x7f0174159380 con 0x7f0174153040 2024-04-23T10:15:43.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f0173fff640 1 -- 172.21.15.29:0/1077616224 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0174159c20 con 0x7f0174067fb0 2024-04-23T10:15:43.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.919+0000 7f0173fff640 1 --2- 172.21.15.29:0/1077616224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174067fb0 0x7f017406de00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0164009dc0 tx=0x7f016401f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775136e40c924c8a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f01737fe640 1 -- 172.21.15.29:0/1077616224 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01640b4070 con 0x7f0174067fb0 2024-04-23T10:15:43.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f01737fe640 1 -- 172.21.15.29:0/1077616224 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01640af600 con 0x7f0174067fb0 2024-04-23T10:15:43.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f01737fe640 1 -- 172.21.15.29:0/1077616224 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01640af9d0 con 0x7f0174067fb0 2024-04-23T10:15:43.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- 172.21.15.29:0/1077616224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174067fb0 msgr2=0x7f017406de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 --2- 172.21.15.29:0/1077616224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174067fb0 0x7f017406de00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0164009dc0 tx=0x7f016401f140 comp rx=0 tx=0).stop 2024-04-23T10:15:43.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- 172.21.15.29:0/1077616224 shutdown_connections 2024-04-23T10:15:43.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 --2- 172.21.15.29:0/1077616224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 0x7f017406e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 --2- 172.21.15.29:0/1077616224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174067fb0 0x7f017406de00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- 172.21.15.29:0/1077616224 >> 172.21.15.29:0/1077616224 conn(0x7f01740c9e20 msgr2=0x7f01740ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:43.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- 172.21.15.29:0/1077616224 shutdown_connections 2024-04-23T10:15:43.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- 172.21.15.29:0/1077616224 wait complete. 2024-04-23T10:15:43.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 Processor -- start 2024-04-23T10:15:43.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- start start 2024-04-23T10:15:43.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0174067fb0 0x7f01741ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153040 0x7f0174158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 0x7f01741f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f017415d390 con 0x7f0174153040 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f017415d210 con 0x7f0174067fb0 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0174074480 con 0x7f0174158ed0 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153040 0x7f0174158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153040 0x7f0174158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48434/0 (socket says 172.21.15.29:48434) 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 -- 172.21.15.29:0/725134795 learned_addr learned my addr 172.21.15.29:0/725134795 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f01792cc640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 0x7f01741f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0178acb640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0174067fb0 0x7f01741ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 -- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 msgr2=0x7f01741f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 0x7f01741f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 -- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0174067fb0 msgr2=0x7f01741ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0174067fb0 0x7f01741ef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:43.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 -- 172.21.15.29:0/725134795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01741528b0 con 0x7f0174153040 2024-04-23T10:15:43.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0178acb640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0174067fb0 0x7f01741ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:43.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f0173fff640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153040 0x7f0174158120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f016401d7f0 tx=0x7f016401bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f01717fa640 1 -- 172.21.15.29:0/725134795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01640b4040 con 0x7f0174153040 2024-04-23T10:15:43.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f01717fa640 1 -- 172.21.15.29:0/725134795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01640039a0 con 0x7f0174153040 2024-04-23T10:15:43.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f01717fa640 1 -- 172.21.15.29:0/725134795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164003d50 con 0x7f0174153040 2024-04-23T10:15:43.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0174140790 con 0x7f0174153040 2024-04-23T10:15:43.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.923+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017415a420 con 0x7f0174153040 2024-04-23T10:15:43.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.927+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0174068d70 con 0x7f0174153040 2024-04-23T10:15:43.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.927+0000 7f01717fa640 1 -- 172.21.15.29:0/725134795 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01640c4060 con 0x7f0174153040 2024-04-23T10:15:43.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.927+0000 7f01717fa640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0154068380 0x7f015406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:43.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.927+0000 7f01717fa640 1 -- 172.21.15.29:0/725134795 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0164124be0 con 0x7f0174153040 2024-04-23T10:15:43.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.927+0000 7f0178acb640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0154068380 0x7f015406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:43.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.927+0000 7f0178acb640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0154068380 0x7f015406a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f015c000f70 tx=0x7f015c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:43.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:43.931+0000 7f01717fa640 1 -- 172.21.15.29:0/725134795 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01741528b0 con 0x7f0174153040 2024-04-23T10:15:44.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.091+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0174071f60 con 0x7f0174153040 2024-04-23T10:15:44.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f01717fa640 1 -- 172.21.15.29:0/725134795 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f0164018ca0 con 0x7f0174153040 2024-04-23T10:15:44.095 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:44.095 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:44.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0154068380 msgr2=0x7f015406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0154068380 0x7f015406a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f015c000f70 tx=0x7f015c009040 comp rx=0 tx=0).stop 2024-04-23T10:15:44.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153040 msgr2=0x7f0174158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153040 0x7f0174158120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f016401d7f0 tx=0x7f016401bee0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 shutdown_connections 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0154068380 0x7f015406a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0174158ed0 0x7f01741f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153040 0x7f0174158120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 --2- 172.21.15.29:0/725134795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0174067fb0 0x7f01741ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 >> 172.21.15.29:0/725134795 conn(0x7f01740c9e20 msgr2=0x7f017414fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 shutdown_connections 2024-04-23T10:15:44.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.095+0000 7f017ad2f640 1 -- 172.21.15.29:0/725134795 wait complete. 2024-04-23T10:15:44.126 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:15:44.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef744e640 1 Processor -- start 2024-04-23T10:15:44.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef744e640 1 -- start start 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef744e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faef006f3b0 0x7faef00c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef744e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faef00c7600 0x7faef0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef744e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef015eae0 con 0x7faef00c8950 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef744e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7faef0073b70 con 0x7faef006f3b0 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef744e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faef015edc0 con 0x7faef00c7600 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef51ea640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faef006f3b0 0x7faef00c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef49e9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faef00c8950 0x7faef0154f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55954/0 (socket says 172.21.15.29:55954) 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef49e9640 1 -- 172.21.15.29:0/3635562496 learned_addr learned my addr 172.21.15.29:0/3635562496 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef59eb640 1 --2- 172.21.15.29:0/3635562496 >> v2:172.21.15.72:3300/0 conn(0x7faef00c7600 0x7faef0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faee3fff640 1 -- 172.21.15.29:0/3635562496 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834039570 0 0) 0x7faef015eae0 con 0x7faef00c8950 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faee3fff640 1 -- 172.21.15.29:0/3635562496 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faedc003530 con 0x7faef00c8950 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef51ea640 1 -- 172.21.15.29:0/3635562496 >> v2:172.21.15.72:3300/0 conn(0x7faef00c7600 msgr2=0x7faef0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:44.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef51ea640 1 --2- 172.21.15.29:0/3635562496 >> v2:172.21.15.72:3300/0 conn(0x7faef00c7600 0x7faef0071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef51ea640 1 -- 172.21.15.29:0/3635562496 >> v1:172.21.15.29:6789/0 conn(0x7faef00c8950 legacy=0x7faef0154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef51ea640 1 -- 172.21.15.29:0/3635562496 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef015f0a0 con 0x7faef006f3b0 2024-04-23T10:15:44.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.251+0000 7faef59eb640 1 --2- 172.21.15.29:0/3635562496 >> v2:172.21.15.72:3300/0 conn(0x7faef00c7600 0x7faef0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:44.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef51ea640 1 --2- 172.21.15.29:0/3635562496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef006f3b0 0x7faef00c70c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faef0073140 tx=0x7faeec01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab24673b198863a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:44.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faee3fff640 1 -- 172.21.15.29:0/3635562496 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec0b5070 con 0x7faef006f3b0 2024-04-23T10:15:44.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faee3fff640 1 -- 172.21.15.29:0/3635562496 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec0a8970 con 0x7faef006f3b0 2024-04-23T10:15:44.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faee3fff640 1 -- 172.21.15.29:0/3635562496 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec0a8d40 con 0x7faef006f3b0 2024-04-23T10:15:44.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- 172.21.15.29:0/3635562496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef006f3b0 msgr2=0x7faef00c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 --2- 172.21.15.29:0/3635562496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef006f3b0 0x7faef00c70c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faef0073140 tx=0x7faeec01ec70 comp rx=0 tx=0).stop 2024-04-23T10:15:44.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- 172.21.15.29:0/3635562496 shutdown_connections 2024-04-23T10:15:44.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 --2- 172.21.15.29:0/3635562496 >> v2:172.21.15.72:3300/0 conn(0x7faef00c7600 0x7faef0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 --2- 172.21.15.29:0/3635562496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef006f3b0 0x7faef00c70c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- 172.21.15.29:0/3635562496 >> 172.21.15.29:0/3635562496 conn(0x7faef006cfb0 msgr2=0x7faef006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:44.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- 172.21.15.29:0/3635562496 shutdown_connections 2024-04-23T10:15:44.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- 172.21.15.29:0/3635562496 wait complete. 2024-04-23T10:15:44.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 Processor -- start 2024-04-23T10:15:44.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- start start 2024-04-23T10:15:44.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef006f3b0 0x7faef01464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faef00c7600 0x7faef0158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef00c8950 0x7faef0140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7faef0071960 con 0x7faef00c8950 2024-04-23T10:15:44.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faef015f660 con 0x7faef006f3b0 2024-04-23T10:15:44.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef744e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7faef015e780 con 0x7faef00c7600 2024-04-23T10:15:44.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef00c8950 0x7faef0140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef00c8950 0x7faef0140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48454/0 (socket says 172.21.15.29:48454) 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 -- 172.21.15.29:0/2277565424 learned_addr learned my addr 172.21.15.29:0/2277565424 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 -- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faef00c7600 msgr2=0x7faef0158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faef00c7600 0x7faef0158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 -- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef006f3b0 msgr2=0x7faef01464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef006f3b0 0x7faef01464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 -- 172.21.15.29:0/2277565424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef014ff50 con 0x7faef00c8950 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.255+0000 7faef59eb640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef00c8950 0x7faef0140df0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faee800e840 tx=0x7faee800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faee1ffb640 1 -- 172.21.15.29:0/2277565424 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee8017070 con 0x7faef00c8950 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faee1ffb640 1 -- 172.21.15.29:0/2277565424 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee800c6d0 con 0x7faef00c8950 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef015e340 con 0x7faef00c8950 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faee1ffb640 1 -- 172.21.15.29:0/2277565424 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee800f040 con 0x7faef00c8950 2024-04-23T10:15:44.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef015d600 con 0x7faef00c8950 2024-04-23T10:15:44.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef0068d70 con 0x7faef00c8950 2024-04-23T10:15:44.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faee1ffb640 1 -- 172.21.15.29:0/2277565424 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faee801a070 con 0x7faef00c8950 2024-04-23T10:15:44.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faee1ffb640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faed4068380 0x7faed406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faee1ffb640 1 -- 172.21.15.29:0/2277565424 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faee8086880 con 0x7faef00c8950 2024-04-23T10:15:44.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faef51ea640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faed4068380 0x7faed406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.259+0000 7faef51ea640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faed4068380 0x7faed406a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faeec0b2000 tx=0x7faeec004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:44.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.263+0000 7faee1ffb640 1 -- 172.21.15.29:0/2277565424 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faee8056b90 con 0x7faef00c8950 2024-04-23T10:15:44.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.459+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faef00c7a60 con 0x7faef00c8950 2024-04-23T10:15:44.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faee1ffb640 1 -- 172.21.15.29:0/2277565424 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6813 (secure 0 0 0) 0x7faee8056490 con 0x7faef00c8950 2024-04-23T10:15:44.462 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:44.463 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4212,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:15:43.068608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-23T10:15:44.463 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-23T10:15:44.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faed4068380 msgr2=0x7faed406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faed4068380 0x7faed406a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faeec0b2000 tx=0x7faeec004740 comp rx=0 tx=0).stop 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef00c8950 msgr2=0x7faef0140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef00c8950 0x7faef0140df0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faee800e840 tx=0x7faee800ed00 comp rx=0 tx=0).stop 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 shutdown_connections 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faed4068380 0x7faed406a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faef00c8950 0x7faef0140df0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faef00c7600 0x7faef0158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 --2- 172.21.15.29:0/2277565424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef006f3b0 0x7faef01464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 >> 172.21.15.29:0/2277565424 conn(0x7faef006cfb0 msgr2=0x7faef00c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 shutdown_connections 2024-04-23T10:15:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.463+0000 7faef744e640 1 -- 172.21.15.29:0/2277565424 wait complete. 2024-04-23T10:15:44.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:44.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.599+0000 7face3b30640 1 Processor -- start 2024-04-23T10:15:44.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.599+0000 7face3b30640 1 -- start start 2024-04-23T10:15:44.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face3b30640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facdc06f150 0x7facdc06f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face3b30640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc0c3fe0 con 0x7facdc153190 2024-04-23T10:15:44.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face3b30640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc0c42c0 con 0x7facdc0ccc50 2024-04-23T10:15:44.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face3b30640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7facdc159f20 con 0x7facdc06f150 2024-04-23T10:15:44.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face10cb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facdc06f150 0x7facdc06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face18cc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7facdc153190 0x7facdc159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34594/0 (socket says 172.21.15.29:34594) 2024-04-23T10:15:44.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face18cc640 1 -- 172.21.15.29:0/3930058224 learned_addr learned my addr 172.21.15.29:0/3930058224 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:44.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face10cb640 1 -- 172.21.15.29:0/3930058224 >> v1:172.21.15.72:6789/0 conn(0x7facdc0ccc50 legacy=0x7facdc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face10cb640 1 -- 172.21.15.29:0/3930058224 >> v1:172.21.15.29:6789/0 conn(0x7facdc153190 legacy=0x7facdc159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face08ca640 1 -- 172.21.15.29:0/3930058224 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2728688125 0 0) 0x7facdc0c3fe0 con 0x7facdc153190 2024-04-23T10:15:44.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.603+0000 7face10cb640 1 -- 172.21.15.29:0/3930058224 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc0c45a0 con 0x7facdc06f150 2024-04-23T10:15:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 --2- 172.21.15.29:0/3930058224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc06f150 0x7facdc06f580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097c0 tx=0x7faccc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672b6b398a6d1d31 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face08ca640 1 -- 172.21.15.29:0/3930058224 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0b5070 con 0x7facdc06f150 2024-04-23T10:15:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face08ca640 1 -- 172.21.15.29:0/3930058224 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc0a8990 con 0x7facdc06f150 2024-04-23T10:15:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face08ca640 1 -- 172.21.15.29:0/3930058224 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0a8d60 con 0x7facdc06f150 2024-04-23T10:15:44.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- 172.21.15.29:0/3930058224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc06f150 msgr2=0x7facdc06f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 --2- 172.21.15.29:0/3930058224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc06f150 0x7facdc06f580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097c0 tx=0x7faccc01ec90 comp rx=0 tx=0).stop 2024-04-23T10:15:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- 172.21.15.29:0/3930058224 shutdown_connections 2024-04-23T10:15:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 --2- 172.21.15.29:0/3930058224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc06f150 0x7facdc06f580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- 172.21.15.29:0/3930058224 >> 172.21.15.29:0/3930058224 conn(0x7facdc06cfb0 msgr2=0x7facdc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- 172.21.15.29:0/3930058224 shutdown_connections 2024-04-23T10:15:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- 172.21.15.29:0/3930058224 wait complete. 2024-04-23T10:15:44.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 Processor -- start 2024-04-23T10:15:44.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- start start 2024-04-23T10:15:44.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facdc06f150 0x7facdc1f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc0ccc50 0x7facdc072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc153190 0x7facdc071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7facdc153570 con 0x7facdc0ccc50 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7facdc159380 con 0x7facdc153190 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7facdc0c4880 con 0x7facdc06f150 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc0ccc50 0x7facdc072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc0ccc50 0x7facdc072430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40460/0 (socket says 172.21.15.29:40460) 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 -- 172.21.15.29:0/3367981884 learned_addr learned my addr 172.21.15.29:0/3367981884 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face18cc640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facdc06f150 0x7facdc1f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face20cd640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc153190 0x7facdc071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 -- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facdc06f150 msgr2=0x7facdc1f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facdc06f150 0x7facdc1f09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 -- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc153190 msgr2=0x7facdc071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc153190 0x7facdc071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 -- 172.21.15.29:0/3367981884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc14e6d0 con 0x7facdc0ccc50 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face18cc640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facdc06f150 0x7facdc1f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face20cd640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc153190 0x7facdc071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face10cb640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc0ccc50 0x7facdc072430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097c0 tx=0x7faccc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7facd27fc640 1 -- 172.21.15.29:0/3367981884 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0c0070 con 0x7facdc0ccc50 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7facd27fc640 1 -- 172.21.15.29:0/3367981884 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc004230 con 0x7facdc0ccc50 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.607+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facdc14ca10 con 0x7facdc0ccc50 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.611+0000 7facd27fc640 1 -- 172.21.15.29:0/3367981884 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0b5040 con 0x7facdc0ccc50 2024-04-23T10:15:44.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.611+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facdc14cf90 con 0x7facdc0ccc50 2024-04-23T10:15:44.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.611+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facdc068d70 con 0x7facdc0ccc50 2024-04-23T10:15:44.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.611+0000 7facd27fc640 1 -- 172.21.15.29:0/3367981884 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faccc0c3070 con 0x7facdc0ccc50 2024-04-23T10:15:44.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.611+0000 7facd27fc640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7facc0068380 0x7facc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:44.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.611+0000 7facd27fc640 1 -- 172.21.15.29:0/3367981884 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faccc1235d0 con 0x7facdc0ccc50 2024-04-23T10:15:44.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.611+0000 7face18cc640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7facc0068380 0x7facc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:44.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.611+0000 7face18cc640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7facc0068380 0x7facc006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facd8000f70 tx=0x7facd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:44.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.615+0000 7facd27fc640 1 -- 172.21.15.29:0/3367981884 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faccc0187f0 con 0x7facdc0ccc50 2024-04-23T10:15:44.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.779+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facdc0c35e0 con 0x7facdc0ccc50 2024-04-23T10:15:44.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.779+0000 7facd27fc640 1 -- 172.21.15.29:0/3367981884 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7faccc0f3850 con 0x7facdc0ccc50 2024-04-23T10:15:44.780 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:44.780 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7facc0068380 msgr2=0x7facc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7facc0068380 0x7facc006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facd8000f70 tx=0x7facd8009040 comp rx=0 tx=0).stop 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc0ccc50 msgr2=0x7facdc072430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc0ccc50 0x7facdc072430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097c0 tx=0x7faccc01ba30 comp rx=0 tx=0).stop 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 shutdown_connections 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7facc0068380 0x7facc006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc153190 0x7facdc071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facdc0ccc50 0x7facdc072430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 --2- 172.21.15.29:0/3367981884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facdc06f150 0x7facdc1f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 >> 172.21.15.29:0/3367981884 conn(0x7facdc06cfb0 msgr2=0x7facdc159810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 shutdown_connections 2024-04-23T10:15:44.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:44.783+0000 7face3b30640 1 -- 172.21.15.29:0/3367981884 wait complete. 2024-04-23T10:15:45.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:45.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:45.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T10:15:37.368844+0000', 'modified': '2024-04-23T10:15:43.068608+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.72:6838/4284551087', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 4284551087}, {'type': 'v1', 'addr': '172.21.15.72:6838', 'nonce': 4284551087}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-04-23T10:15:45.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-23T10:15:45.403 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-23T10:15:45.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc271306640 1 Processor -- start 2024-04-23T10:15:45.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc271306640 1 -- start start 2024-04-23T10:15:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc271306640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc271306640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc26c0c7600 0x7fc26c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc271306640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26c15eae0 con 0x7fc26c0c8950 2024-04-23T10:15:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc271306640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc26c073b70 con 0x7fc26c0c7600 2024-04-23T10:15:45.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc271306640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c15edc0 con 0x7fc26c06f3b0 2024-04-23T10:15:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc26b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc26c0c7600 0x7fc26c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc26b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc26c0c7600 0x7fc26c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40472/0 (socket says 172.21.15.29:40472) 2024-04-23T10:15:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc26b7fe640 1 -- 172.21.15.29:0/294805151 learned_addr learned my addr 172.21.15.29:0/294805151 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc26affd640 1 --2- 172.21.15.29:0/294805151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc26b7fe640 1 -- 172.21.15.29:0/294805151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 msgr2=0x7fc26c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/294805151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c0c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc26b7fe640 1 -- 172.21.15.29:0/294805151 >> v1:172.21.15.72:6789/0 conn(0x7fc26c0c8950 legacy=0x7fc26c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:45.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.587+0000 7fc26b7fe640 1 -- 172.21.15.29:0/294805151 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c15f0a0 con 0x7fc26c0c7600 2024-04-23T10:15:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/294805151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c071e80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc264009e50 tx=0x7fc26401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402925571a01988f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc269ffb640 1 -- 172.21.15.29:0/294805151 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640b4070 con 0x7fc26c0c7600 2024-04-23T10:15:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc269ffb640 1 -- 172.21.15.29:0/294805151 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640af400 con 0x7fc26c0c7600 2024-04-23T10:15:45.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc269ffb640 1 -- 172.21.15.29:0/294805151 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640af7d0 con 0x7fc26c0c7600 2024-04-23T10:15:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 -- 172.21.15.29:0/294805151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 msgr2=0x7fc26c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 --2- 172.21.15.29:0/294805151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c071e80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc264009e50 tx=0x7fc26401f1e0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 -- 172.21.15.29:0/294805151 shutdown_connections 2024-04-23T10:15:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 --2- 172.21.15.29:0/294805151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c071e80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 --2- 172.21.15.29:0/294805151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 -- 172.21.15.29:0/294805151 >> 172.21.15.29:0/294805151 conn(0x7fc26c06cfb0 msgr2=0x7fc26c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 -- 172.21.15.29:0/294805151 shutdown_connections 2024-04-23T10:15:45.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 -- 172.21.15.29:0/294805151 wait complete. 2024-04-23T10:15:45.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.591+0000 7fc271306640 1 Processor -- start 2024-04-23T10:15:45.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 -- start start 2024-04-23T10:15:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c0c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26c0c8950 0x7fc26c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c071960 con 0x7fc26c0c7600 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c15f660 con 0x7fc26c0c8950 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c15e780 con 0x7fc26c06f3b0 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c0c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c0c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40474/0 (socket says 172.21.15.29:40474) 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 -- 172.21.15.29:0/1657923071 learned_addr learned my addr 172.21.15.29:0/1657923071 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26affd640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26c0c8950 0x7fc26c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 -- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 msgr2=0x7fc26c148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 -- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26c0c8950 msgr2=0x7fc26c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26c0c8950 0x7fc26c0c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 -- 172.21.15.29:0/1657923071 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c15bf20 con 0x7fc26c0c7600 2024-04-23T10:15:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26affd640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26c0c8950 0x7fc26c0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c0c56f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc26000b440 tx=0x7fc26000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc2537fe640 1 -- 172.21.15.29:0/1657923071 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260015020 con 0x7fc26c0c7600 2024-04-23T10:15:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc2537fe640 1 -- 172.21.15.29:0/1657923071 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc260011890 con 0x7fc26c0c7600 2024-04-23T10:15:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 -- 172.21.15.29:0/1657923071 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26c15c200 con 0x7fc26c0c7600 2024-04-23T10:15:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc2537fe640 1 -- 172.21.15.29:0/1657923071 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260011c80 con 0x7fc26c0c7600 2024-04-23T10:15:45.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc271306640 1 -- 172.21.15.29:0/1657923071 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26c0c51d0 con 0x7fc26c0c7600 2024-04-23T10:15:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc2537fe640 1 -- 172.21.15.29:0/1657923071 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc260018020 con 0x7fc26c0c7600 2024-04-23T10:15:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.595+0000 7fc2537fe640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc258068380 0x7fc25806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc2537fe640 1 -- 172.21.15.29:0/1657923071 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc260086af0 con 0x7fc26c0c7600 2024-04-23T10:15:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc258068380 0x7fc25806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 Processor -- start 2024-04-23T10:15:45.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- start start 2024-04-23T10:15:45.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc258068380 0x7fc25806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc25c006fd0 tx=0x7fc25c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:45.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154fe190 0x55b0154fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b015539080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0155399a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b015347420 con 0x55b0154fe190 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b0152e1bf0 con 0x55b0154feab0 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b0153433e0 con 0x55b0155395c0 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154fe190 0x55b0154fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154fe190 0x55b0154fe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40488/0 (socket says 172.21.15.29:40488) 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 -- 172.21.15.29:0/6329543 learned_addr learned my addr 172.21.15.29:0/6329543 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0155399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b015539080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 -- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 msgr2=0x55b0155399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0155399a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 -- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 msgr2=0x55b015539080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:45.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b015539080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 -- 172.21.15.29:0/6329543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0153ef450 con 0x55b0154fe190 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0155399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b015539080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc26affd640 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154fe190 0x55b0154fe570 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00db00 tx=0x7fc25c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6823b36a5fde43 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc250ff9640 1 -- 172.21.15.29:0/6329543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c019050 con 0x55b0154fe190 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc250ff9640 1 -- 172.21.15.29:0/6329543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25c023070 con 0x55b0154fe190 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc250ff9640 1 -- 172.21.15.29:0/6329543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c012cb0 con 0x55b0154fe190 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- 172.21.15.29:0/6329543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154fe190 msgr2=0x55b0154fe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154fe190 0x55b0154fe570 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00db00 tx=0x7fc25c010000 comp rx=0 tx=0).stop 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- 172.21.15.29:0/6329543 shutdown_connections 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0155399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b015539080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 --2- 172.21.15.29:0/6329543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154fe190 0x55b0154fe570 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- 172.21.15.29:0/6329543 >> 172.21.15.29:0/6329543 conn(0x55b015535e40 msgr2=0x55b015538260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- 172.21.15.29:0/6329543 shutdown_connections 2024-04-23T10:15:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- 172.21.15.29:0/6329543 wait complete. 2024-04-23T10:15:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 -- start start 2024-04-23T10:15:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.599+0000 7fc274488000 1 Processor -- start 2024-04-23T10:15:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154fe190 0x55b0154fabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0154fb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0154fb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b0152e7ec0 con 0x55b0154feab0 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b0153c8120 con 0x55b0154fe190 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b015352350 con 0x55b0155395c0 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 10 client.0 _ll_register_callbacks cb 0x55b0153244d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0154fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0154fb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40490/0 (socket says 172.21.15.29:40490) 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 -- 172.21.15.29:0/1336286727 learned_addr learned my addr 172.21.15.29:0/1336286727 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26affd640 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154fe190 0x55b0154fabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0154fb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 -- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 msgr2=0x55b0154fb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0154fb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 -- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154fe190 msgr2=0x55b0154fabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154fe190 0x55b0154fabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 -- 172.21.15.29:0/1336286727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01538cf80 con 0x55b0154feab0 2024-04-23T10:15:45.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0154fb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0154fb110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc26005edb0 tx=0x7fc260056e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab0fac9877f60d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc249ffb640 1 -- 172.21.15.29:0/1336286727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260083060 con 0x55b0154feab0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc249ffb640 1 -- 172.21.15.29:0/1336286727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc260055d50 con 0x55b0154feab0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 -- 172.21.15.29:0/1336286727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc25c023070 con 0x55b0154feab0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc249ffb640 1 -- 172.21.15.29:0/1336286727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc260073050 con 0x55b0154feab0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 10 client.4395 fetch_fsmap learned FSMap version 6 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 -- 172.21.15.29:0/1336286727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55b015320f00 con 0x55b0154feab0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc249ffb640 1 -- 172.21.15.29:0/1336286727 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25c023070 con 0x55b0154feab0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc249ffb640 1 -- 172.21.15.29:0/1336286727 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fc260052450 con 0x55b0154feab0 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 10 client.4395 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 20 client.4395 populate_metadata read hostname 'smithi029' 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b01554dd90 0x55b015550180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:45.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 4 client.4395 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:15:45.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc274488000 1 -- 172.21.15.29:0/1336286727 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0152e0bc0 con 0x55b01554dd90 2024-04-23T10:15:45.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26affd640 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b01554dd90 0x55b015550180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:45.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc26affd640 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b01554dd90 0x55b015550180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60259f148b49244b server_cookie=9dbbdcd4ba5141e9 in_seq=0 out_seq=0 2024-04-23T10:15:45.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:45.603+0000 7fc249ffb640 10 client.4395 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:15:48.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc249ffb640 1 -- 172.21.15.29:0/1336286727 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b0152e0bc0 con 0x55b01554dd90 2024-04-23T10:15:48.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc249ffb640 10 client.4395 handle_command_reply: tid=0 2024-04-23T10:15:48.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 client.4395 shutdown 2024-04-23T10:15:48.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 -- 172.21.15.29:0/1336286727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 msgr2=0x55b0154fb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0154fb110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc26005edb0 tx=0x7fc260056e00 comp rx=0 tx=0).stop 2024-04-23T10:15:48.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 -- 172.21.15.29:0/1336286727 shutdown_connections 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b01554dd90 0x55b015550180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0155395c0 0x55b0154fb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0154fb110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 --2- 172.21.15.29:0/1336286727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154fe190 0x55b0154fabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc249ffb640 0 client.4395 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 -- 172.21.15.29:0/1336286727 >> 172.21.15.29:0/1336286727 conn(0x55b015535e40 msgr2=0x55b0155371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 -- 172.21.15.29:0/1336286727 shutdown_connections 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 1 -- 172.21.15.29:0/1336286727 wait complete. 2024-04-23T10:15:48.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.083+0000 7fc274488000 20 client.4395 trim_cache size 0 max 16384 2024-04-23T10:15:48.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc274488000 1 Processor -- start 2024-04-23T10:15:48.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc274488000 1 -- start start 2024-04-23T10:15:48.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc274488000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0154f7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc274488000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b0154f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc274488000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0155395c0 0x55b0155aa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc274488000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c1fdff0 con 0x55b0155395c0 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc274488000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c1fd350 con 0x55b0154feab0 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc274488000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c1fd9a0 con 0x55b0154fe190 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0155395c0 0x55b0155aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0155395c0 0x55b0155aa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40492/0 (socket says 172.21.15.29:40492) 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 -- 172.21.15.29:0/2933783668 learned_addr learned my addr 172.21.15.29:0/2933783668 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b0154f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26affd640 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0154f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 -- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 msgr2=0x55b0154f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0154f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 -- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 msgr2=0x55b0154f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:48.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b0154f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 -- 172.21.15.29:0/2933783668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0152cde80 con 0x55b0155395c0 2024-04-23T10:15:48.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26affd640 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0154f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:48.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0155395c0 0x55b0155aa510 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc2640b2040 tx=0x7fc264004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4156744c20b92fb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:48.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc24bfff640 1 -- 172.21.15.29:0/2933783668 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640b4040 con 0x55b0155395c0 2024-04-23T10:15:48.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc24bfff640 1 -- 172.21.15.29:0/2933783668 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640ba650 con 0x55b0155395c0 2024-04-23T10:15:48.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.123+0000 7fc24bfff640 1 -- 172.21.15.29:0/2933783668 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640baa20 con 0x55b0155395c0 2024-04-23T10:15:48.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 -- 172.21.15.29:0/2933783668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0155395c0 msgr2=0x55b0155aa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0155395c0 0x55b0155aa510 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc2640b2040 tx=0x7fc264004ac0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 -- 172.21.15.29:0/2933783668 shutdown_connections 2024-04-23T10:15:48.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0155395c0 0x55b0155aa510 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0154feab0 0x55b0154f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 --2- 172.21.15.29:0/2933783668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0154f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 -- 172.21.15.29:0/2933783668 >> 172.21.15.29:0/2933783668 conn(0x55b015535e40 msgr2=0x55b015533e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:48.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 -- 172.21.15.29:0/2933783668 shutdown_connections 2024-04-23T10:15:48.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 -- 172.21.15.29:0/2933783668 wait complete. 2024-04-23T10:15:48.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 -- start start 2024-04-23T10:15:48.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.127+0000 7fc274488000 1 Processor -- start 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0155a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0155a8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0155395c0 0x55b0155a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b015346730 con 0x55b0154feab0 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b0153139e0 con 0x55b0155395c0 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b01534ba50 con 0x55b0154fe190 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 10 client.0 _ll_register_callbacks cb 0x7fc26005d0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0155a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0155a8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40502/0 (socket says 172.21.15.29:40502) 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 -- 172.21.15.29:0/2429216075 learned_addr learned my addr 172.21.15.29:0/2429216075 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26affd640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0155a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0155395c0 0x55b0155a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 -- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 msgr2=0x55b0155a80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0155a80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 -- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0155395c0 msgr2=0x55b0155a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0155395c0 0x55b0155a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 -- 172.21.15.29:0/2429216075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01530fb30 con 0x55b0154feab0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26b7fe640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0155395c0 0x55b0155a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26a7fc640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0155a8610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc260004740 tx=0x7fc26001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5591928a3a45a20 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc249ffb640 1 -- 172.21.15.29:0/2429216075 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2600529a0 con 0x55b0154feab0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc249ffb640 1 -- 172.21.15.29:0/2429216075 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc26007e3c0 con 0x55b0154feab0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 -- 172.21.15.29:0/2429216075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2640ba650 con 0x55b0154feab0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc249ffb640 1 -- 172.21.15.29:0/2429216075 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc260066050 con 0x55b0154feab0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 10 client.4401 fetch_fsmap learned FSMap version 6 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 -- 172.21.15.29:0/2429216075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55b0153c85b0 con 0x55b0154feab0 2024-04-23T10:15:48.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc249ffb640 1 -- 172.21.15.29:0/2429216075 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640ba650 con 0x55b0154feab0 2024-04-23T10:15:48.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc249ffb640 1 -- 172.21.15.29:0/2429216075 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fc260069020 con 0x55b0154feab0 2024-04-23T10:15:48.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 10 client.4401 fetch_fsmap finished waiting for FSMap version 6 2024-04-23T10:15:48.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 10 client.4401 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:15:48.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 20 client.4401 populate_metadata read hostname 'smithi029' 2024-04-23T10:15:48.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 0x55b0155a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 4 client.4401 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:15:48.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc274488000 1 -- 172.21.15.29:0/2429216075 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "status"}) -- 0x55b015354e40 con 0x55b0155b5220 2024-04-23T10:15:48.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26affd640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 0x55b0155a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc249ffb640 10 client.4401 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26affd640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 0x55b0155a99e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28de7d6eaa807aa9 server_cookie=329266bc08e49d84 in_seq=0 out_seq=0 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26affd640 1 -- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 msgr2=0x55b0155a99e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26affd640 1 -- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 msgr2=0x55b0155a99e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26affd640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 0x55b0155a99e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26affd640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 0x55b0155a99e0 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.131+0000 7fc26affd640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 0x55b0155a99e0 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc26affd640 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 0x55b0155a99e0 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28de7d6eaa807aa9 server_cookie=329266bc08e49d84 in_seq=0 out_seq=1 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc249ffb640 10 client.4401 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc249ffb640 1 -- 172.21.15.29:0/2429216075 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55b015354e40 con 0x55b0155b5220 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc249ffb640 10 client.4401 handle_command_reply: tid=0 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 client.4401 shutdown 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 -- 172.21.15.29:0/2429216075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 msgr2=0x55b0155a8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0155a8610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc260004740 tx=0x7fc26001c000 comp rx=0 tx=0).stop 2024-04-23T10:15:48.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 -- 172.21.15.29:0/2429216075 shutdown_connections 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b0155b5220 0x55b0155a99e0 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0155395c0 0x55b0155a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0154feab0 0x55b0155a8610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc249ffb640 0 client.4401 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 --2- 172.21.15.29:0/2429216075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0154fe190 0x55b0155a80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 -- 172.21.15.29:0/2429216075 >> 172.21.15.29:0/2429216075 conn(0x55b015535e40 msgr2=0x55b0154f6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 -- 172.21.15.29:0/2429216075 shutdown_connections 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 1 -- 172.21.15.29:0/2429216075 wait complete. 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc274488000 20 client.4401 trim_cache size 0 max 16384 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:15:48.137 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4288, 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 10.10515713, 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 5, 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 24, 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 17.096603344999998 2024-04-23T10:15:48.138 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:15:48.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 -- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc258068380 msgr2=0x7fc25806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc258068380 0x7fc25806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc25c006fd0 tx=0x7fc25c008040 comp rx=0 tx=0).stop 2024-04-23T10:15:48.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 -- 172.21.15.29:0/1657923071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 msgr2=0x7fc26c0c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c0c56f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc26000b440 tx=0x7fc26000b900 comp rx=0 tx=0).stop 2024-04-23T10:15:48.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 -- 172.21.15.29:0/1657923071 shutdown_connections 2024-04-23T10:15:48.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc258068380 0x7fc25806a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26c0c8950 0x7fc26c0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc26c0c7600 0x7fc26c0c56f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 --2- 172.21.15.29:0/1657923071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc26c06f3b0 0x7fc26c148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 -- 172.21.15.29:0/1657923071 >> 172.21.15.29:0/1657923071 conn(0x7fc26c06cfb0 msgr2=0x7fc26c153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:48.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 -- 172.21.15.29:0/1657923071 shutdown_connections 2024-04-23T10:15:48.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.135+0000 7fc271306640 1 -- 172.21.15.29:0/1657923071 wait complete. 2024-04-23T10:15:48.156 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T10:15:48.156 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:48.156 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-23T10:15:48.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e2c024640 1 Processor -- start 2024-04-23T10:15:48.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e2c024640 1 -- start start 2024-04-23T10:15:48.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e2c024640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 0x7f7e2406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e2c024640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e24073350 con 0x7f7e24067f70 2024-04-23T10:15:48.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e2c024640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e240735f0 con 0x7f7e241552c0 2024-04-23T10:15:48.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e2c024640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2406d990 con 0x7f7e24072bd0 2024-04-23T10:15:48.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e295bf640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7e24067f70 0x7f7e24163a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34604/0 (socket says 172.21.15.29:34604) 2024-04-23T10:15:48.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e295bf640 1 -- 172.21.15.29:0/2484550236 learned_addr learned my addr 172.21.15.29:0/2484550236 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:48.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e2a5c1640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 0x7f7e2406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3446963162 0 0) 0x7f7e24073350 con 0x7f7e24067f70 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e10003530 con 0x7f7e24067f70 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1884434184 0 0) 0x7f7e10003530 con 0x7f7e24067f70 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 msgr2=0x7f7e2406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 0x7f7e2406d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 >> v1:172.21.15.72:6789/0 conn(0x7f7e241552c0 legacy=0x7f7e240cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2415b320 con 0x7f7e24067f70 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f7e14001680 con 0x7f7e24067f70 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 >> v1:172.21.15.29:6789/0 conn(0x7f7e24067f70 legacy=0x7f7e24163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e100039f0 0x7f7e10003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 0x7f7e10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10004d50 0x7f7e100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1000bb10 con 0x7f7e100039f0 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1000bc90 con 0x7f7e10004d50 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1000be90 con 0x7f7e24072bd0 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e29dc0640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e100039f0 0x7f7e10003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e2a5c1640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10004d50 0x7f7e100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e295bf640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 0x7f7e10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e29dc0640 1 -- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 msgr2=0x7f7e10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e29dc0640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 0x7f7e10004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e29dc0640 1 -- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10004d50 msgr2=0x7f7e100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e29dc0640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10004d50 0x7f7e100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e29dc0640 1 -- 172.21.15.29:0/2484550236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e10003530 con 0x7f7e100039f0 2024-04-23T10:15:48.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.279+0000 7f7e295bf640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e24072bd0 0x7f7e10004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:48.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e29dc0640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e100039f0 0x7f7e10003e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7e20001750 tx=0x7f7e2001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b39b3c245d59e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:48.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e200013a0 con 0x7f7e100039f0 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e200052f0 con 0x7f7e100039f0 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e28dbe640 1 -- 172.21.15.29:0/2484550236 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20003840 con 0x7f7e100039f0 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2c024640 1 -- 172.21.15.29:0/2484550236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e100039f0 msgr2=0x7f7e10003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2c024640 1 --2- 172.21.15.29:0/2484550236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e100039f0 0x7f7e10003e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7e20001750 tx=0x7f7e2001c3e0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2a5c1640 1 -- 172.21.15.29:0/2484550236 reap_dead start 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2c024640 1 -- 172.21.15.29:0/2484550236 shutdown_connections 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2c024640 1 -- 172.21.15.29:0/2484550236 >> 172.21.15.29:0/2484550236 conn(0x7f7e2406f830 msgr2=0x7f7e2406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2c024640 1 -- 172.21.15.29:0/2484550236 shutdown_connections 2024-04-23T10:15:48.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2c024640 1 -- 172.21.15.29:0/2484550236 wait complete. 2024-04-23T10:15:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2c024640 1 Processor -- start 2024-04-23T10:15:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.283+0000 7f7e2c024640 1 -- start start 2024-04-23T10:15:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e100039f0 0x7f7e2415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e241e59c0 0x7f7e241e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2414efc0 0x7f7e241e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2406ef30 con 0x7f7e241e59c0 2024-04-23T10:15:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2415b8e0 con 0x7f7e2414efc0 2024-04-23T10:15:48.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2406f0b0 con 0x7f7e100039f0 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e241e59c0 0x7f7e241e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e241e59c0 0x7f7e241e49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40520/0 (socket says 172.21.15.29:40520) 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 -- 172.21.15.29:0/2204333177 learned_addr learned my addr 172.21.15.29:0/2204333177 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2a5c1640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2414efc0 0x7f7e241e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e29dc0640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e100039f0 0x7f7e2415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 -- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e100039f0 msgr2=0x7f7e2415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e100039f0 0x7f7e2415a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 -- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2414efc0 msgr2=0x7f7e241e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2414efc0 0x7f7e241e4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 -- 172.21.15.29:0/2204333177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e241e5f70 con 0x7f7e241e59c0 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2a5c1640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2414efc0 0x7f7e241e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e29dc0640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e100039f0 0x7f7e2415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e295bf640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e241e59c0 0x7f7e241e49d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e14010c00 tx=0x7f7e1400e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:48.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e1a7fc640 1 -- 172.21.15.29:0/2204333177 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1401b070 con 0x7f7e241e59c0 2024-04-23T10:15:48.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e1a7fc640 1 -- 172.21.15.29:0/2204333177 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e14011040 con 0x7f7e241e59c0 2024-04-23T10:15:48.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e1a7fc640 1 -- 172.21.15.29:0/2204333177 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e140145c0 con 0x7f7e241e59c0 2024-04-23T10:15:48.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e241f4740 con 0x7f7e241e59c0 2024-04-23T10:15:48.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e241f4ce0 con 0x7f7e241e59c0 2024-04-23T10:15:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e240693c0 con 0x7f7e241e59c0 2024-04-23T10:15:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e1a7fc640 1 -- 172.21.15.29:0/2204333177 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e14014760 con 0x7f7e241e59c0 2024-04-23T10:15:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e1a7fc640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e080683b0 0x7f7e0806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.287+0000 7f7e1a7fc640 1 -- 172.21.15.29:0/2204333177 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e14089820 con 0x7f7e241e59c0 2024-04-23T10:15:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.291+0000 7f7e29dc0640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e080683b0 0x7f7e0806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:48.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.291+0000 7f7e29dc0640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e080683b0 0x7f7e0806a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e100057f0 tx=0x7f7e200011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:48.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.295+0000 7f7e1a7fc640 1 -- 172.21.15.29:0/2204333177 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7e14059aa0 con 0x7f7e241e59c0 2024-04-23T10:15:48.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7e24158b30 con 0x7f7e241e59c0 2024-04-23T10:15:48.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e1a7fc640 1 -- 172.21.15.29:0/2204333177 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f7e140593a0 con 0x7f7e241e59c0 2024-04-23T10:15:48.492 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-23T10:15:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e080683b0 msgr2=0x7f7e0806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e080683b0 0x7f7e0806a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e100057f0 tx=0x7f7e200011a0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e241e59c0 msgr2=0x7f7e241e49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e241e59c0 0x7f7e241e49d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e14010c00 tx=0x7f7e1400e4d0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 shutdown_connections 2024-04-23T10:15:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e080683b0 0x7f7e0806a870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2414efc0 0x7f7e241e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e241e59c0 0x7f7e241e49d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 --2- 172.21.15.29:0/2204333177 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e100039f0 0x7f7e2415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:48.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.491+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 >> 172.21.15.29:0/2204333177 conn(0x7f7e2406f830 msgr2=0x7f7e241500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:48.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.495+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 shutdown_connections 2024-04-23T10:15:48.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48.495+0000 7f7e2c024640 1 -- 172.21.15.29:0/2204333177 wait complete. 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T10:15:48.509 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-23T10:15:48.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:48.509 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:15:48.516 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42475sec preferred_lft 42475sec 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ea:d3:cc:a1 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:15:48.517 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-23T10:15:48.518 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:15:48.518 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T10:15:48.518 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:15:48.518 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:15:48.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-04-23T10:15:48.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-04-23T10:15:48.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-04-23T10:15:48.519 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T10:15:48.519 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:15:48.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:15:48.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:15:48.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:48.634 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T10:15:48.685 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-04-23T10:15:48.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:48.687 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-04-23T10:15:48.756 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-04-23T10:15:48.756 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T10:15:48.756 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-23T10:15:48.756 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-23T10:15:48.756 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-23T10:15:48.756 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T10:15:48.757 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:15:48.757 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:15:48.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-23T10:15:48.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-23T10:15:48.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-23T10:15:48.757 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:15:48.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:15:48.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:15:48.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:48.880 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-23T10:15:48.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:48.886 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-04-23T10:15:48.934 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:15:48.934 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:15:48.934 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:15:48.934 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-23T10:15:48.935 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:15:49.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:15:49.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:15:49.053 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-23T10:15:49.054 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:15:49.054 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:15:49.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-23T10:15:49.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T10:15:49.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-23T10:15:49.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-23T10:15:49.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-23T10:15:49.054 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:15:49.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:15:49.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:15:49.151 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:15:49.152 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:15:49.152 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-04-23T10:15:49.152 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T10:15:49.152 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:15:49.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:15:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:15:49.254 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-23T10:15:49.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:15:49.254 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:49.301 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-23T10:15:49.302 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:15:49.302 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:49.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-23T10:15:49.407 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:15:49.455 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-23T10:15:49.455 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-23T10:15:49.455 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-23T10:15:49.455 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-23T10:15:49.455 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-23T10:15:49.455 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/run/lock 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/fs/nfsd 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-23T10:15:49.456 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/run/rpc_pipefs 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:15:49.457 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:15:49.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:49.458 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-23T10:15:49.506 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-23T10:15:49.507 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-23T10:15:49.551 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-23T10:15:49.565 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/run/lock 2024-04-23T10:15:49.615 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/fs/nfsd 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/run/rpc_pipefs 2024-04-23T10:15:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:15:49.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:49.617 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-23T10:15:49.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:2024-04-23T10:15:49.635+0000 7f9e14941580 -1 init, newargv = 0x55c8618dd110 newargc=15 2024-04-23T10:15:49.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[33475]: starting ceph client 2024-04-23T10:15:49.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[33475]: starting fuse 2024-04-23T10:15:50.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-23T10:15:50.761 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/run/lock 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-23T10:15:50.812 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/fs/nfsd 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/run/rpc_pipefs 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-23T10:15:50.813 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-23T10:15:50.814 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:15:50.814 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:15:50.814 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:15:50.814 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:15:50.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-23T10:15:50.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:15:50.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:15:50.814 INFO:teuthology.orchestra.run.smithi029.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:50.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:50.815 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-23T10:15:50.863 INFO:teuthology.orchestra.run.smithi029.stdout:45 2024-04-23T10:15:50.863 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-23T10:15:50.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo stdin-killer -- python3 -c ' 2024-04-23T10:15:50.863 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-04-23T10:15:50.863 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-04-23T10:15:50.864 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.admin")) 2024-04-23T10:15:50.865 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-04-23T10:15:50.991 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.admin.33475.asok 2024-04-23T10:15:50.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:15:51.004 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33475.asok 2024-04-23T10:15:51.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:51.004 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33475.asok status 2024-04-23T10:15:51.163 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "admin", 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "33475", 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:15:51.164 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4416, 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4416 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3490719061 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:15:51.165 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3490719061 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4416 192.168.0.1:0/3490719061", 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/3490719061", 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 5, 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 24, 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-04-23T10:15:51.166 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-04-23T10:15:51.167 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-04-23T10:15:51.167 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:15:51.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:51.178 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-04-23T10:15:51.178 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:51.184 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-04-23T10:15:51.184 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:51.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:51.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:51.240 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-23T10:15:51.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T10:15:51.369 INFO:teuthology.orchestra.run.smithi029.stdout:# file: . 2024-04-23T10:15:51.369 INFO:teuthology.orchestra.run.smithi029.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-23T10:15:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:51.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:15:51.377 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:51.377 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:15:51.384 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:51.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac2c5a640 1 Processor -- start 2024-04-23T10:15:51.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac2c5a640 1 -- start start 2024-04-23T10:15:51.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac2c5a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8abc0c6c30 0x7f8abc158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac2c5a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8abc0cafc0 con 0x7f8abc15d070 2024-04-23T10:15:51.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac2c5a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8abc15d480 con 0x7f8abc074d60 2024-04-23T10:15:51.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac2c5a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8abc15cbe0 con 0x7f8abc0c6c30 2024-04-23T10:15:51.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac11f7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8abc15d070 0x7f8abc152d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34616/0 (socket says 172.21.15.29:34616) 2024-04-23T10:15:51.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac11f7640 1 -- 172.21.15.29:0/280942342 learned_addr learned my addr 172.21.15.29:0/280942342 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:51.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abbfff640 1 --2- 172.21.15.29:0/280942342 >> v2:172.21.15.72:3300/0 conn(0x7f8abc0c6c30 0x7f8abc158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941317008 0 0) 0x7f8abc0cafc0 con 0x7f8abc15d070 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aac003530 con 0x7f8abc15d070 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2970215205 0 0) 0x7f8aac003530 con 0x7f8abc15d070 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 >> v2:172.21.15.72:3300/0 conn(0x7f8abc0c6c30 msgr2=0x7f8abc158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 --2- 172.21.15.29:0/280942342 >> v2:172.21.15.72:3300/0 conn(0x7f8abc0c6c30 0x7f8abc158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 >> v1:172.21.15.72:6789/0 conn(0x7f8abc074d60 legacy=0x7f8abc0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc0c7160 con 0x7f8abc15d070 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f8ab4001a20 con 0x7f8abc15d070 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 >> v1:172.21.15.29:6789/0 conn(0x7f8abc15d070 legacy=0x7f8abc152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0039c0 0x7f8aac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac0051d0 0x7f8aac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc15cbe0 con 0x7f8aac0051d0 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac00c080 con 0x7f8aac004810 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac00c280 con 0x7f8aac0039c0 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac11f7640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac0051d0 0x7f8aac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8ac09f6640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0039c0 0x7f8aac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.555+0000 7f8abbfff640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac11f7640 1 -- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0039c0 msgr2=0x7f8aac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:51.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac11f7640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0039c0 0x7f8aac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac11f7640 1 -- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac004810 msgr2=0x7f8aac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:51.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac11f7640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac11f7640 1 -- 172.21.15.29:0/280942342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac003530 con 0x7f8aac0051d0 2024-04-23T10:15:51.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8abbfff640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac004810 0x7f8aac004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:51.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac09f6640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0039c0 0x7f8aac003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac11f7640 1 -- 172.21.15.29:0/280942342 reap_dead start 2024-04-23T10:15:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac11f7640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac0051d0 0x7f8aac00b9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400a850 tx=0x7f8ab401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f92fdf5d878d4c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400a4a0 con 0x7f8aac0051d0 2024-04-23T10:15:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab40ad650 con 0x7f8aac0051d0 2024-04-23T10:15:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8abb7fe640 1 -- 172.21.15.29:0/280942342 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40ada40 con 0x7f8aac0051d0 2024-04-23T10:15:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/280942342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac0051d0 msgr2=0x7f8aac00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac2c5a640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac0051d0 0x7f8aac00b9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400a850 tx=0x7f8ab401d360 comp rx=0 tx=0).stop 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/280942342 shutdown_connections 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac2c5a640 1 --2- 172.21.15.29:0/280942342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac0051d0 0x7f8aac00b9d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.559+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/280942342 >> 172.21.15.29:0/280942342 conn(0x7f8abc06b9e0 msgr2=0x7f8abc06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/280942342 shutdown_connections 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/280942342 wait complete. 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 Processor -- start 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- start start 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0051d0 0x7f8abc0cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8abc14d2b0 0x7f8abc0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc1f1d10 0x7f8abc148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc0c7780 con 0x7f8abc1f1d10 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc0c7600 con 0x7f8abc14d2b0 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8abc0c79e0 con 0x7f8aac0051d0 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc1f1d10 0x7f8abc148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc1f1d10 0x7f8abc148310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40534/0 (socket says 172.21.15.29:40534) 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 -- 172.21.15.29:0/2339751927 learned_addr learned my addr 172.21.15.29:0/2339751927 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8abbfff640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8abc14d2b0 0x7f8abc0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac09f6640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0051d0 0x7f8abc0cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 -- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0051d0 msgr2=0x7f8abc0cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0051d0 0x7f8abc0cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 -- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8abc14d2b0 msgr2=0x7f8abc0cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8abc14d2b0 0x7f8abc0cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 -- 172.21.15.29:0/2339751927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc0ce300 con 0x7f8abc1f1d10 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8abbfff640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8abc14d2b0 0x7f8abc0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac11f7640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc1f1d10 0x7f8abc148310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ab401d190 tx=0x7f8aac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ab97fa640 1 -- 172.21.15.29:0/2339751927 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4004d70 con 0x7f8abc1f1d10 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ab97fa640 1 -- 172.21.15.29:0/2339751927 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab40b4070 con 0x7f8abc1f1d10 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8abc0cc9c0 con 0x7f8abc1f1d10 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ab97fa640 1 -- 172.21.15.29:0/2339751927 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4001a40 con 0x7f8abc1f1d10 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8abc0ccc60 con 0x7f8abc1f1d10 2024-04-23T10:15:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.563+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8abc0693c0 con 0x7f8abc1f1d10 2024-04-23T10:15:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.567+0000 7f8ab97fa640 1 -- 172.21.15.29:0/2339751927 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ab40ad650 con 0x7f8abc1f1d10 2024-04-23T10:15:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.567+0000 7f8ab97fa640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8aa0068380 0x7f8aa006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.567+0000 7f8ab97fa640 1 -- 172.21.15.29:0/2339751927 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8ab41210e0 con 0x7f8abc1f1d10 2024-04-23T10:15:51.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.567+0000 7f8ac09f6640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8aa0068380 0x7f8aa006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.567+0000 7f8ac09f6640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8aa0068380 0x7f8aa006a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0000c10 tx=0x7f8ab0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:51.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.571+0000 7f8ab97fa640 1 -- 172.21.15.29:0/2339751927 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ab4017070 con 0x7f8abc1f1d10 2024-04-23T10:15:51.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.735+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8abc1588f0 con 0x7f8abc1f1d10 2024-04-23T10:15:51.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.739+0000 7f8ab97fa640 1 -- 172.21.15.29:0/2339751927 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f8ab40f12d0 con 0x7f8abc1f1d10 2024-04-23T10:15:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:51.741 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:51.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8aa0068380 msgr2=0x7f8aa006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8aa0068380 0x7f8aa006a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0000c10 tx=0x7f8ab0009040 comp rx=0 tx=0).stop 2024-04-23T10:15:51.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc1f1d10 msgr2=0x7f8abc148310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc1f1d10 0x7f8abc148310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ab401d190 tx=0x7f8aac005840 comp rx=0 tx=0).stop 2024-04-23T10:15:51.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 shutdown_connections 2024-04-23T10:15:51.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8aa0068380 0x7f8aa006a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8abc1f1d10 0x7f8abc148310 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8abc14d2b0 0x7f8abc0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 --2- 172.21.15.29:0/2339751927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0051d0 0x7f8abc0cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 >> 172.21.15.29:0/2339751927 conn(0x7f8abc06b9e0 msgr2=0x7f8abc1590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:51.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 shutdown_connections 2024-04-23T10:15:51.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.743+0000 7f8ac2c5a640 1 -- 172.21.15.29:0/2339751927 wait complete. 2024-04-23T10:15:51.761 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:15:51.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:15:51.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ef42640 1 Processor -- start 2024-04-23T10:15:51.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ef42640 1 -- start start 2024-04-23T10:15:51.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ef42640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc0815bc20 0x7fbc08071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ef42640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc08155620 con 0x7fbc08073f80 2024-04-23T10:15:51.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ef42640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0815e9c0 con 0x7fbc08155240 2024-04-23T10:15:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ef42640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbc0815e790 con 0x7fbc0815bc20 2024-04-23T10:15:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc07fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbc08073f80 0x7fbc08070d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34622/0 (socket says 172.21.15.29:34622) 2024-04-23T10:15:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc07fff640 1 -- 172.21.15.29:0/1766832581 learned_addr learned my addr 172.21.15.29:0/1766832581 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:51.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0d4df640 1 --2- 172.21.15.29:0/1766832581 >> v2:172.21.15.72:3300/0 conn(0x7fbc0815bc20 0x7fbc08071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 138087256 0 0) 0x7fbc08155620 con 0x7fbc08073f80 2024-04-23T10:15:51.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbf0003530 con 0x7fbc08073f80 2024-04-23T10:15:51.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 476430436 0 0) 0x7fbbf0003530 con 0x7fbc08073f80 2024-04-23T10:15:51.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 >> v2:172.21.15.72:3300/0 conn(0x7fbc0815bc20 msgr2=0x7fbc08071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:51.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 --2- 172.21.15.29:0/1766832581 >> v2:172.21.15.72:3300/0 conn(0x7fbc0815bc20 0x7fbc08071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 >> v1:172.21.15.72:6789/0 conn(0x7fbc08155240 legacy=0x7fbc08073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0815eca0 con 0x7fbc08073f80 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fbbf8001680 con 0x7fbc08073f80 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 >> v1:172.21.15.29:6789/0 conn(0x7fbc08073f80 legacy=0x7fbc08070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbbf0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbf0004810 0x7fbbf0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbf00051d0 0x7fbbf000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf000c040 con 0x7fbbf00039c0 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf000c1f0 con 0x7fbbf0004810 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf000c3f0 con 0x7fbbf00051d0 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ccde640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbbf0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc07fff640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbf0004810 0x7fbbf0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0d4df640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbf00051d0 0x7fbbf000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ccde640 1 -- 172.21.15.29:0/1766832581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbf00051d0 msgr2=0x7fbbf000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ccde640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbf00051d0 0x7fbbf000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ccde640 1 -- 172.21.15.29:0/1766832581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbf0004810 msgr2=0x7fbbf0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ccde640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbf0004810 0x7fbbf0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0ccde640 1 -- 172.21.15.29:0/1766832581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf0003530 con 0x7fbbf00039c0 2024-04-23T10:15:51.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.883+0000 7fbc0d4df640 1 -- 172.21.15.29:0/1766832581 reap_dead start 2024-04-23T10:15:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ccde640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbbf0003de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc001780 tx=0x7fbbfc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff12d8806041351 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0013a0 con 0x7fbbf00039c0 2024-04-23T10:15:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc0052f0 con 0x7fbbf00039c0 2024-04-23T10:15:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc077fe640 1 -- 172.21.15.29:0/1766832581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc003840 con 0x7fbbf00039c0 2024-04-23T10:15:51.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 -- 172.21.15.29:0/1766832581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 msgr2=0x7fbbf0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbbf0003de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc001780 tx=0x7fbbfc01c400 comp rx=0 tx=0).stop 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 -- 172.21.15.29:0/1766832581 shutdown_connections 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 --2- 172.21.15.29:0/1766832581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbbf0003de0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 -- 172.21.15.29:0/1766832581 >> 172.21.15.29:0/1766832581 conn(0x7fbc0806f230 msgr2=0x7fbc0806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 -- 172.21.15.29:0/1766832581 shutdown_connections 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 -- 172.21.15.29:0/1766832581 wait complete. 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 Processor -- start 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.887+0000 7fbc0ef42640 1 -- start start 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbc0815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc081f4750 0x7fbc0815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc08146010 0x7fbc080cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0815c030 con 0x7fbbf00039c0 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbc08070230 con 0x7fbc081f4750 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbc08073c80 con 0x7fbc08146010 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbc0815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbc0815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40556/0 (socket says 172.21.15.29:40556) 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 -- 172.21.15.29:0/161348875 learned_addr learned my addr 172.21.15.29:0/161348875 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc07fff640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc081f4750 0x7fbc0815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0d4df640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc08146010 0x7fbc080cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 -- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc08146010 msgr2=0x7fbc080cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc08146010 0x7fbc080cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 -- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc081f4750 msgr2=0x7fbc0815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc081f4750 0x7fbc0815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 -- 172.21.15.29:0/161348875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc081f73a0 con 0x7fbbf00039c0 2024-04-23T10:15:51.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc07fff640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc081f4750 0x7fbc0815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:51.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ccde640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbc0815ca60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc005040 tx=0x7fbbf0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:51.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc057fa640 1 -- 172.21.15.29:0/161348875 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0b8020 con 0x7fbbf00039c0 2024-04-23T10:15:51.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc057fa640 1 -- 172.21.15.29:0/161348875 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc0054a0 con 0x7fbbf00039c0 2024-04-23T10:15:51.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc081f7100 con 0x7fbbf00039c0 2024-04-23T10:15:51.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc057fa640 1 -- 172.21.15.29:0/161348875 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc007a40 con 0x7fbbf00039c0 2024-04-23T10:15:51.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc081f3c70 con 0x7fbbf00039c0 2024-04-23T10:15:51.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc080693c0 con 0x7fbbf00039c0 2024-04-23T10:15:51.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc057fa640 1 -- 172.21.15.29:0/161348875 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbbfc0bb020 con 0x7fbbf00039c0 2024-04-23T10:15:51.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc057fa640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbbf4068380 0x7fbbf406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:51.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc057fa640 1 -- 172.21.15.29:0/161348875 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbbfc120b90 con 0x7fbbf00039c0 2024-04-23T10:15:51.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.891+0000 7fbc07fff640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbbf4068380 0x7fbbf406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:51.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.895+0000 7fbc07fff640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbbf4068380 0x7fbbf406a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc0815bb20 tx=0x7fbbf8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:51.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:51.899+0000 7fbc057fa640 1 -- 172.21.15.29:0/161348875 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbbfc0c2030 con 0x7fbbf00039c0 2024-04-23T10:15:52.053 INFO:tasks.ceph.mds.f.smithi072.stderr:2024-04-23T10:15:52.050+0000 7fe6e021a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-23T10:15:52.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbc08158b50 con 0x7fbbf00039c0 2024-04-23T10:15:52.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc057fa640 1 -- 172.21.15.29:0/161348875 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fbbfc016110 con 0x7fbbf00039c0 2024-04-23T10:15:52.063 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:15:52.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbbf4068380 msgr2=0x7fbbf406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbbf4068380 0x7fbbf406a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc0815bb20 tx=0x7fbbf8009040 comp rx=0 tx=0).stop 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 msgr2=0x7fbc0815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbc0815ca60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc005040 tx=0x7fbbf0005840 comp rx=0 tx=0).stop 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 shutdown_connections 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbbf4068380 0x7fbbf406a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc08146010 0x7fbc080cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc081f4750 0x7fbc0815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 --2- 172.21.15.29:0/161348875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbf00039c0 0x7fbc0815ca60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 >> 172.21.15.29:0/161348875 conn(0x7fbc0806f230 msgr2=0x7fbc0815a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 shutdown_connections 2024-04-23T10:15:52.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.063+0000 7fbc0ef42640 1 -- 172.21.15.29:0/161348875 wait complete. 2024-04-23T10:15:52.082 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:15:52.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.207+0000 7fa7f6c43640 1 Processor -- start 2024-04-23T10:15:52.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.207+0000 7fa7f6c43640 1 -- start start 2024-04-23T10:15:52.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7f6c43640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa7f00ced60 0x7fa7f0154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7f6c43640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7f0074330 0x7fa7f0155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7f6c43640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f00740c0 con 0x7fa7f00ce980 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7f6c43640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f00c9c20 con 0x7fa7f00ced60 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7f6c43640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f015b5e0 con 0x7fa7f0074330 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7effff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa7f00ced60 0x7fa7f0154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7f49df640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa7f00ce980 0x7fa7f015ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34626/0 (socket says 172.21.15.29:34626) 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7f49df640 1 -- 172.21.15.29:0/2338969543 learned_addr learned my addr 172.21.15.29:0/2338969543 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7f51e0640 1 --2- 172.21.15.29:0/2338969543 >> v2:172.21.15.72:3300/0 conn(0x7fa7f0074330 0x7fa7f0155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7effff640 1 -- 172.21.15.29:0/2338969543 >> v2:172.21.15.72:3300/0 conn(0x7fa7f0074330 msgr2=0x7fa7f0155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7effff640 1 --2- 172.21.15.29:0/2338969543 >> v2:172.21.15.72:3300/0 conn(0x7fa7f0074330 0x7fa7f0155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7effff640 1 -- 172.21.15.29:0/2338969543 >> v1:172.21.15.29:6789/0 conn(0x7fa7f00ce980 legacy=0x7fa7f015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7effff640 1 -- 172.21.15.29:0/2338969543 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f015b2b0 con 0x7fa7f00ced60 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7effff640 1 --2- 172.21.15.29:0/2338969543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f00ced60 0x7fa7f0154ee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00c8bf0 tx=0x7fa7d801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecb4d822f7206b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7ef7fe640 1 -- 172.21.15.29:0/2338969543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80b5070 con 0x7fa7f00ced60 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7ef7fe640 1 -- 172.21.15.29:0/2338969543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d80a8970 con 0x7fa7f00ced60 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.211+0000 7fa7ef7fe640 1 -- 172.21.15.29:0/2338969543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80a8d40 con 0x7fa7f00ced60 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- 172.21.15.29:0/2338969543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f00ced60 msgr2=0x7fa7f0154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/2338969543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f00ced60 0x7fa7f0154ee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00c8bf0 tx=0x7fa7d801ec70 comp rx=0 tx=0).stop 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- 172.21.15.29:0/2338969543 shutdown_connections 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/2338969543 >> v2:172.21.15.72:3300/0 conn(0x7fa7f0074330 0x7fa7f0155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/2338969543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f00ced60 0x7fa7f0154ee0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- 172.21.15.29:0/2338969543 >> 172.21.15.29:0/2338969543 conn(0x7fa7f0070f60 msgr2=0x7fa7f0071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- 172.21.15.29:0/2338969543 shutdown_connections 2024-04-23T10:15:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- 172.21.15.29:0/2338969543 wait complete. 2024-04-23T10:15:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 Processor -- start 2024-04-23T10:15:52.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- start start 2024-04-23T10:15:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f0074330 0x7fa7f01f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f00ce980 0x7fa7f015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f00ced60 0x7fa7f015e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0073de0 con 0x7fa7f0074330 2024-04-23T10:15:52.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0073b00 con 0x7fa7f00ced60 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f00ca910 con 0x7fa7f00ce980 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f0074330 0x7fa7f01f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f0074330 0x7fa7f01f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40570/0 (socket says 172.21.15.29:40570) 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 -- 172.21.15.29:0/3827111712 learned_addr learned my addr 172.21.15.29:0/3827111712 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 -- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f00ce980 msgr2=0x7fa7f015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f00ce980 0x7fa7f015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 -- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f00ced60 msgr2=0x7fa7f015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f00ced60 0x7fa7f015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 -- 172.21.15.29:0/3827111712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f01f1270 con 0x7fa7f0074330 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f49df640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f0074330 0x7fa7f01f4db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c420 tx=0x7fa7e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7ed7fa640 1 -- 172.21.15.29:0/3827111712 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0017070 con 0x7fa7f0074330 2024-04-23T10:15:52.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7ed7fa640 1 -- 172.21.15.29:0/3827111712 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e0005cf0 con 0x7fa7f0074330 2024-04-23T10:15:52.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f01f1550 con 0x7fa7f0074330 2024-04-23T10:15:52.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7ed7fa640 1 -- 172.21.15.29:0/3827111712 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00072f0 con 0x7fa7f0074330 2024-04-23T10:15:52.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.215+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f01f1b10 con 0x7fa7f0074330 2024-04-23T10:15:52.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.219+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f01f1d50 con 0x7fa7f0074330 2024-04-23T10:15:52.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.219+0000 7fa7ed7fa640 1 -- 172.21.15.29:0/3827111712 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7e001a070 con 0x7fa7f0074330 2024-04-23T10:15:52.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.219+0000 7fa7ed7fa640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa7d00683b0 0x7fa7d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.219+0000 7fa7ed7fa640 1 -- 172.21.15.29:0/3827111712 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa7e0086000 con 0x7fa7f0074330 2024-04-23T10:15:52.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.219+0000 7fa7effff640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa7d00683b0 0x7fa7d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.219+0000 7fa7effff640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa7d00683b0 0x7fa7d006a870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80b2000 tx=0x7fa7d8004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.223+0000 7fa7ed7fa640 1 -- 172.21.15.29:0/3827111712 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7f01f1d50 con 0x7fa7f0074330 2024-04-23T10:15:52.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.387+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa7f00693c0 con 0x7fa7f0074330 2024-04-23T10:15:52.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7ed7fa640 1 -- 172.21.15.29:0/3827111712 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fa7e0056310 con 0x7fa7f0074330 2024-04-23T10:15:52.390 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:15:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa7d00683b0 msgr2=0x7fa7d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa7d00683b0 0x7fa7d006a870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80b2000 tx=0x7fa7d8004740 comp rx=0 tx=0).stop 2024-04-23T10:15:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f0074330 msgr2=0x7fa7f01f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f0074330 0x7fa7f01f4db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c420 tx=0x7fa7e000c8e0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 shutdown_connections 2024-04-23T10:15:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa7d00683b0 0x7fa7d006a870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f00ced60 0x7fa7f015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f00ce980 0x7fa7f015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 --2- 172.21.15.29:0/3827111712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7f0074330 0x7fa7f01f4db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 >> 172.21.15.29:0/3827111712 conn(0x7fa7f0070f60 msgr2=0x7fa7f0071340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 shutdown_connections 2024-04-23T10:15:52.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.391+0000 7fa7f6c43640 1 -- 172.21.15.29:0/3827111712 wait complete. 2024-04-23T10:15:52.408 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:15:52.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.523+0000 7f4e3f45e640 1 Processor -- start 2024-04-23T10:15:52.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.523+0000 7f4e3f45e640 1 -- start start 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.523+0000 7f4e3f45e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 0x7f4e3815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4e380c5900 0x7f4e380c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e3806c910 con 0x7f4e380cb770 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4e3806cbf0 con 0x7f4e380c5900 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3806ced0 con 0x7f4e38151bb0 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3c9f9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4e380c5900 0x7f4e380c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3c9f9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4e380c5900 0x7f4e380c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40572/0 (socket says 172.21.15.29:40572) 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3c9f9640 1 -- 172.21.15.29:0/1132680837 learned_addr learned my addr 172.21.15.29:0/1132680837 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:52.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3d1fa640 1 --2- 172.21.15.29:0/1132680837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 0x7f4e3815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3c9f9640 1 -- 172.21.15.29:0/1132680837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 msgr2=0x7f4e3815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3c9f9640 1 --2- 172.21.15.29:0/1132680837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 0x7f4e3815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3c9f9640 1 -- 172.21.15.29:0/1132680837 >> v1:172.21.15.72:6789/0 conn(0x7f4e380cb770 legacy=0x7f4e380c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3c9f9640 1 -- 172.21.15.29:0/1132680837 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3806d1b0 con 0x7f4e380c5900 2024-04-23T10:15:52.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3c9f9640 1 --2- 172.21.15.29:0/1132680837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e380c5d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009870 tx=0x7f4e2801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3968627702901995 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e2ffff640 1 -- 172.21.15.29:0/1132680837 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e280b5070 con 0x7f4e380c5900 2024-04-23T10:15:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e2ffff640 1 -- 172.21.15.29:0/1132680837 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e280a8a50 con 0x7f4e380c5900 2024-04-23T10:15:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e2ffff640 1 -- 172.21.15.29:0/1132680837 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e280a8e20 con 0x7f4e380c5900 2024-04-23T10:15:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 -- 172.21.15.29:0/1132680837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 msgr2=0x7f4e380c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/1132680837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e380c5d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009870 tx=0x7f4e2801ed50 comp rx=0 tx=0).stop 2024-04-23T10:15:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 -- 172.21.15.29:0/1132680837 shutdown_connections 2024-04-23T10:15:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/1132680837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e380c5d20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/1132680837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 0x7f4e3815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 -- 172.21.15.29:0/1132680837 >> 172.21.15.29:0/1132680837 conn(0x7f4e380730f0 msgr2=0x7f4e38073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:52.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 -- 172.21.15.29:0/1132680837 shutdown_connections 2024-04-23T10:15:52.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.527+0000 7f4e3f45e640 1 -- 172.21.15.29:0/1132680837 wait complete. 2024-04-23T10:15:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 Processor -- start 2024-04-23T10:15:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 -- start start 2024-04-23T10:15:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e38159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380cb770 0x7f4e3814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 0x7f4e3814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4e380c6f50 con 0x7f4e380c5900 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4e38151f90 con 0x7f4e380cb770 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4e380c70d0 con 0x7f4e38151bb0 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e38159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e38159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40580/0 (socket says 172.21.15.29:40580) 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 -- 172.21.15.29:0/3583769863 learned_addr learned my addr 172.21.15.29:0/3583769863 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 -- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 msgr2=0x7f4e3814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3c9f9640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380cb770 0x7f4e3814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d9fb640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 0x7f4e3814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 0x7f4e3814b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 -- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380cb770 msgr2=0x7f4e3814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380cb770 0x7f4e3814b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 -- 172.21.15.29:0/3583769863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e38159560 con 0x7f4e380c5900 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3c9f9640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380cb770 0x7f4e3814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3d1fa640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e38159020 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e34007e70 tx=0x7f4e3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e2dffb640 1 -- 172.21.15.29:0/3583769863 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e34014620 con 0x7f4e380c5900 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e2dffb640 1 -- 172.21.15.29:0/3583769863 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e34019070 con 0x7f4e380c5900 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e2dffb640 1 -- 172.21.15.29:0/3583769863 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e34014a00 con 0x7f4e380c5900 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3815abc0 con 0x7f4e380c5900 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3814a580 con 0x7f4e380c5900 2024-04-23T10:15:52.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e3814a370 con 0x7f4e380c5900 2024-04-23T10:15:52.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.531+0000 7f4e2dffb640 1 -- 172.21.15.29:0/3583769863 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e34014ba0 con 0x7f4e380c5900 2024-04-23T10:15:52.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.535+0000 7f4e2dffb640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e1c0683b0 0x7f4e1c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.535+0000 7f4e2dffb640 1 -- 172.21.15.29:0/3583769863 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4e340876a0 con 0x7f4e380c5900 2024-04-23T10:15:52.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.535+0000 7f4e3c9f9640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e1c0683b0 0x7f4e1c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.535+0000 7f4e3c9f9640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e1c0683b0 0x7f4e1c06a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e280b2000 tx=0x7f4e280aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.539+0000 7f4e2dffb640 1 -- 172.21.15.29:0/3583769863 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e34011260 con 0x7f4e380c5900 2024-04-23T10:15:52.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.699+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4e38068d70 con 0x7f4e380c5900 2024-04-23T10:15:52.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.699+0000 7f4e2dffb640 1 -- 172.21.15.29:0/3583769863 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f4e340577f0 con 0x7f4e380c5900 2024-04-23T10:15:52.700 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:15:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e1c0683b0 msgr2=0x7f4e1c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e1c0683b0 0x7f4e1c06a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e280b2000 tx=0x7f4e280aa070 comp rx=0 tx=0).stop 2024-04-23T10:15:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 msgr2=0x7f4e38159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e38159020 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e34007e70 tx=0x7f4e3400e4b0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 shutdown_connections 2024-04-23T10:15:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e1c0683b0 0x7f4e1c06a870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e38151bb0 0x7f4e3814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e380cb770 0x7f4e3814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 --2- 172.21.15.29:0/3583769863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e380c5900 0x7f4e38159020 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 >> 172.21.15.29:0/3583769863 conn(0x7f4e380730f0 msgr2=0x7f4e380cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 shutdown_connections 2024-04-23T10:15:52.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.703+0000 7f4e3f45e640 1 -- 172.21.15.29:0/3583769863 wait complete. 2024-04-23T10:15:52.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:15:52.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10c5edf640 1 Processor -- start 2024-04-23T10:15:52.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10c5edf640 1 -- start start 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10c5edf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f10c0153190 0x7f10c0159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10c5edf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 0x7f10c006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10c5edf640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c00c3fe0 con 0x7f10c006f150 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10c5edf640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f10c0159380 con 0x7f10c0153190 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10c5edf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f10c00c42c0 con 0x7f10c00cd360 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10bf7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f10c0153190 0x7f10c0159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10beffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f10c006f150 0x7f10c00ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34636/0 (socket says 172.21.15.29:34636) 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10beffd640 1 -- 172.21.15.29:0/3557954738 learned_addr learned my addr 172.21.15.29:0/3557954738 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:52.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10bf7fe640 1 -- 172.21.15.29:0/3557954738 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 msgr2=0x7f10c006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10bf7fe640 1 --2- 172.21.15.29:0/3557954738 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 0x7f10c006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10bf7fe640 1 -- 172.21.15.29:0/3557954738 >> v1:172.21.15.29:6789/0 conn(0x7f10c006f150 legacy=0x7f10c00ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10bf7fe640 1 -- 172.21.15.29:0/3557954738 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c00c45a0 con 0x7f10c0153190 2024-04-23T10:15:52.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.835+0000 7f10bf7fe640 1 --2- 172.21.15.29:0/3557954738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0153190 0x7f10c0159810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009d90 tx=0x7f10b001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64baf0b4c76b6f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10be7fc640 1 -- 172.21.15.29:0/3557954738 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00b4070 con 0x7f10c0153190 2024-04-23T10:15:52.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10be7fc640 1 -- 172.21.15.29:0/3557954738 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b00af600 con 0x7f10c0153190 2024-04-23T10:15:52.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10be7fc640 1 -- 172.21.15.29:0/3557954738 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00af9d0 con 0x7f10c0153190 2024-04-23T10:15:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- 172.21.15.29:0/3557954738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0153190 msgr2=0x7f10c0159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 --2- 172.21.15.29:0/3557954738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0153190 0x7f10c0159810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009d90 tx=0x7f10b001f150 comp rx=0 tx=0).stop 2024-04-23T10:15:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- 172.21.15.29:0/3557954738 shutdown_connections 2024-04-23T10:15:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 --2- 172.21.15.29:0/3557954738 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 0x7f10c006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 --2- 172.21.15.29:0/3557954738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0153190 0x7f10c0159810 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- 172.21.15.29:0/3557954738 >> 172.21.15.29:0/3557954738 conn(0x7f10c006cfb0 msgr2=0x7f10c006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- 172.21.15.29:0/3557954738 shutdown_connections 2024-04-23T10:15:52.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- 172.21.15.29:0/3557954738 wait complete. 2024-04-23T10:15:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 Processor -- start 2024-04-23T10:15:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- start start 2024-04-23T10:15:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c006f150 0x7f10c00726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 0x7f10c00cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0153190 0x7f10c01e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f10c00c4880 con 0x7f10c006f150 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f10c0153570 con 0x7f10c0153190 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f10c00c9070 con 0x7f10c00cd360 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c006f150 0x7f10c00726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c006f150 0x7f10c00726e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40598/0 (socket says 172.21.15.29:40598) 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 -- 172.21.15.29:0/1349055885 learned_addr learned my addr 172.21.15.29:0/1349055885 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10beffd640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 0x7f10c00cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 -- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 msgr2=0x7f10c00cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 0x7f10c00cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 -- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0153190 msgr2=0x7f10c01e3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0153190 0x7f10c01e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 -- 172.21.15.29:0/1349055885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c0153e90 con 0x7f10c006f150 2024-04-23T10:15:52.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10bf7fe640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c006f150 0x7f10c00726e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10b00b2040 tx=0x7f10b001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10b7fff640 1 -- 172.21.15.29:0/1349055885 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00b4040 con 0x7f10c006f150 2024-04-23T10:15:52.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10b7fff640 1 -- 172.21.15.29:0/1349055885 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b00c2070 con 0x7f10c006f150 2024-04-23T10:15:52.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c01f4b40 con 0x7f10c006f150 2024-04-23T10:15:52.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10b7fff640 1 -- 172.21.15.29:0/1349055885 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00ba680 con 0x7f10c006f150 2024-04-23T10:15:52.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.839+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c01f5100 con 0x7f10c006f150 2024-04-23T10:15:52.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.843+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c0068d70 con 0x7f10c006f150 2024-04-23T10:15:52.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.843+0000 7f10b7fff640 1 -- 172.21.15.29:0/1349055885 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10b00ba820 con 0x7f10c006f150 2024-04-23T10:15:52.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.843+0000 7f10b7fff640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10a00683b0 0x7f10a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:52.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.843+0000 7f10b7fff640 1 -- 172.21.15.29:0/1349055885 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f10b0125fe0 con 0x7f10c006f150 2024-04-23T10:15:52.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.843+0000 7f10beffd640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10a00683b0 0x7f10a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:52.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.843+0000 7f10beffd640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10a00683b0 0x7f10a006a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10c015d5b0 tx=0x7f10a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:52.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:52.847+0000 7f10b7fff640 1 -- 172.21.15.29:0/1349055885 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10b0018cb0 con 0x7f10c006f150 2024-04-23T10:15:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f10c006e220 con 0x7f10c006f150 2024-04-23T10:15:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10b7fff640 1 -- 172.21.15.29:0/1349055885 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f10b00f6240 con 0x7f10c006f150 2024-04-23T10:15:53.011 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:15:53.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10a00683b0 msgr2=0x7f10a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10a00683b0 0x7f10a006a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10c015d5b0 tx=0x7f10a8009040 comp rx=0 tx=0).stop 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c006f150 msgr2=0x7f10c00726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c006f150 0x7f10c00726e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10b00b2040 tx=0x7f10b001bef0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 shutdown_connections 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10a00683b0 0x7f10a006a870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0153190 0x7f10c01e3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c00cd360 0x7f10c00cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 --2- 172.21.15.29:0/1349055885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c006f150 0x7f10c00726e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 >> 172.21.15.29:0/1349055885 conn(0x7f10c006cfb0 msgr2=0x7f10c0156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 shutdown_connections 2024-04-23T10:15:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.011+0000 7f10c5edf640 1 -- 172.21.15.29:0/1349055885 wait complete. 2024-04-23T10:15:53.030 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:15:53.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f52574b4640 1 Processor -- start 2024-04-23T10:15:53.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f52574b4640 1 -- start start 2024-04-23T10:15:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f52574b4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5250153190 0x7f5250159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f52574b4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52500c3fe0 con 0x7f525006f150 2024-04-23T10:15:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f52574b4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52500c42c0 con 0x7f52500cd360 2024-04-23T10:15:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f52574b4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5250159380 con 0x7f5250153190 2024-04-23T10:15:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f5255250640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5250153190 0x7f5250159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f5254a4f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f525006f150 0x7f52500ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34646/0 (socket says 172.21.15.29:34646) 2024-04-23T10:15:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f5254a4f640 1 -- 172.21.15.29:0/1953352027 learned_addr learned my addr 172.21.15.29:0/1953352027 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f5255250640 1 -- 172.21.15.29:0/1953352027 >> v1:172.21.15.72:6789/0 conn(0x7f52500cd360 legacy=0x7f5250163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f5255250640 1 -- 172.21.15.29:0/1953352027 >> v1:172.21.15.29:6789/0 conn(0x7f525006f150 legacy=0x7f52500ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f524ffff640 1 -- 172.21.15.29:0/1953352027 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841834833 0 0) 0x7f52500c3fe0 con 0x7f525006f150 2024-04-23T10:15:53.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.147+0000 7f5255250640 1 -- 172.21.15.29:0/1953352027 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52500c45a0 con 0x7f5250153190 2024-04-23T10:15:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f5255250640 1 --2- 172.21.15.29:0/1953352027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f5250159810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52400097c0 tx=0x7f524001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2d6227e85cad65 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f524ffff640 1 -- 172.21.15.29:0/1953352027 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52400b5070 con 0x7f5250153190 2024-04-23T10:15:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f524ffff640 1 -- 172.21.15.29:0/1953352027 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52400a8990 con 0x7f5250153190 2024-04-23T10:15:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f524ffff640 1 -- 172.21.15.29:0/1953352027 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52400a8d60 con 0x7f5250153190 2024-04-23T10:15:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- 172.21.15.29:0/1953352027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 msgr2=0x7f5250159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 --2- 172.21.15.29:0/1953352027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f5250159810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52400097c0 tx=0x7f524001ec90 comp rx=0 tx=0).stop 2024-04-23T10:15:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- 172.21.15.29:0/1953352027 shutdown_connections 2024-04-23T10:15:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 --2- 172.21.15.29:0/1953352027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f5250159810 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- 172.21.15.29:0/1953352027 >> 172.21.15.29:0/1953352027 conn(0x7f525006cfb0 msgr2=0x7f525006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- 172.21.15.29:0/1953352027 shutdown_connections 2024-04-23T10:15:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- 172.21.15.29:0/1953352027 wait complete. 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 Processor -- start 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- start start 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f525006f150 0x7f52501ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52500cd360 0x7f52501eca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f525014a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f52500c4880 con 0x7f5250153190 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5250153570 con 0x7f52500cd360 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f52574b4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f52500c9070 con 0x7f525006f150 2024-04-23T10:15:53.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.151+0000 7f5255a51640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f525014a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255250640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f525006f150 0x7f52501ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5254a4f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52500cd360 0x7f52501eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255a51640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f525014a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40612/0 (socket says 172.21.15.29:40612) 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255250640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f525006f150 0x7f52501ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:56744/0 (socket says 172.21.15.29:56744) 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255a51640 1 -- 172.21.15.29:0/2503113442 learned_addr learned my addr 172.21.15.29:0/2503113442 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255a51640 1 -- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f525006f150 msgr2=0x7f52501ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255a51640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f525006f150 0x7f52501ef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255a51640 1 -- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52500cd360 msgr2=0x7f52501eca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255a51640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52500cd360 0x7f52501eca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255a51640 1 -- 172.21.15.29:0/2503113442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52501eeb70 con 0x7f5250153190 2024-04-23T10:15:53.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255a51640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f525014a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f524800c430 tx=0x7f524800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f524dffb640 1 -- 172.21.15.29:0/2503113442 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248005220 con 0x7f5250153190 2024-04-23T10:15:53.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f524dffb640 1 -- 172.21.15.29:0/2503113442 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52480053c0 con 0x7f5250153190 2024-04-23T10:15:53.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f524dffb640 1 -- 172.21.15.29:0/2503113442 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248007270 con 0x7f5250153190 2024-04-23T10:15:53.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52501f2b80 con 0x7f5250153190 2024-04-23T10:15:53.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52501f2e60 con 0x7f5250153190 2024-04-23T10:15:53.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5250068d70 con 0x7f5250153190 2024-04-23T10:15:53.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f524dffb640 1 -- 172.21.15.29:0/2503113442 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5248019020 con 0x7f5250153190 2024-04-23T10:15:53.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f524dffb640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f523c068380 0x7f523c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f524dffb640 1 -- 172.21.15.29:0/2503113442 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5248085f60 con 0x7f5250153190 2024-04-23T10:15:53.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.155+0000 7f5255250640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f523c068380 0x7f523c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.159+0000 7f5255250640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f523c068380 0x7f523c06a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f52400b2000 tx=0x7f52400aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.159+0000 7f524dffb640 1 -- 172.21.15.29:0/2503113442 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5248055b90 con 0x7f5250153190 2024-04-23T10:15:53.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.335+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5250073b70 con 0x7f5250153190 2024-04-23T10:15:53.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.335+0000 7f524dffb640 1 -- 172.21.15.29:0/2503113442 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f5248059e90 con 0x7f5250153190 2024-04-23T10:15:53.337 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-23T10:15:53.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f523c068380 msgr2=0x7f523c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f523c068380 0x7f523c06a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f52400b2000 tx=0x7f52400aa070 comp rx=0 tx=0).stop 2024-04-23T10:15:53.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 msgr2=0x7f525014a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f525014a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f524800c430 tx=0x7f524800c8f0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 shutdown_connections 2024-04-23T10:15:53.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f523c068380 0x7f523c06a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5250153190 0x7f525014a8c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52500cd360 0x7f52501eca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 --2- 172.21.15.29:0/2503113442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f525006f150 0x7f52501ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 >> 172.21.15.29:0/2503113442 conn(0x7f525006cfb0 msgr2=0x7f52500cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:53.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 shutdown_connections 2024-04-23T10:15:53.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.339+0000 7f52574b4640 1 -- 172.21.15.29:0/2503113442 wait complete. 2024-04-23T10:15:53.355 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:15:53.355 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:15:53.361 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:53.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe919fde640 1 Processor -- start 2024-04-23T10:15:53.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe919fde640 1 -- start start 2024-04-23T10:15:53.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe919fde640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe914159840 0x7fe914072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe919fde640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe914071400 con 0x7fe9140c3470 2024-04-23T10:15:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe919fde640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9140c7890 con 0x7fe9140c70c0 2024-04-23T10:15:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe919fde640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe914160030 con 0x7fe914159840 2024-04-23T10:15:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe913fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe9140c3470 0x7fe91406f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34654/0 (socket says 172.21.15.29:34654) 2024-04-23T10:15:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe913fff640 1 -- 172.21.15.29:0/1324419207 learned_addr learned my addr 172.21.15.29:0/1324419207 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9137fe640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe914159840 0x7fe914072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483155271 0 0) 0x7fe914071400 con 0x7fe9140c3470 2024-04-23T10:15:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8fc003530 con 0x7fe9140c3470 2024-04-23T10:15:53.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2750424196 0 0) 0x7fe8fc003530 con 0x7fe9140c3470 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe914159840 msgr2=0x7fe914072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe914159840 0x7fe914072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 >> v1:172.21.15.72:6789/0 conn(0x7fe9140c70c0 legacy=0x7fe914162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9141604c0 con 0x7fe9140c3470 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fe90c001680 con 0x7fe9140c3470 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 >> v1:172.21.15.29:6789/0 conn(0x7fe9140c3470 legacy=0x7fe91406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8fc0039f0 0x7fe8fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe914159840 0x7fe8fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8fc004d50 0x7fe8fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe914160030 con 0x7fe8fc004d50 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00bb00 con 0x7fe8fc0039f0 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc00bd00 con 0x7fe914159840 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe913fff640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8fc004d50 0x7fe8fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe9137fe640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8fc0039f0 0x7fe8fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe912ffd640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe914159840 0x7fe8fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe913fff640 1 -- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe914159840 msgr2=0x7fe8fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe913fff640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe914159840 0x7fe8fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe913fff640 1 -- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8fc0039f0 msgr2=0x7fe8fc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:53.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe913fff640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8fc0039f0 0x7fe8fc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.527+0000 7fe913fff640 1 -- 172.21.15.29:0/1324419207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc003530 con 0x7fe8fc004d50 2024-04-23T10:15:53.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8fc004d50 0x7fe8fc0051d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c210 tx=0x7fe90c01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154122d179a59c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c007d40 con 0x7fe8fc004d50 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90c005b00 con 0x7fe8fc004d50 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe9127fc640 1 -- 172.21.15.29:0/1324419207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c007070 con 0x7fe8fc004d50 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- 172.21.15.29:0/1324419207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8fc004d50 msgr2=0x7fe8fc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 --2- 172.21.15.29:0/1324419207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8fc004d50 0x7fe8fc0051d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c210 tx=0x7fe90c01f3f0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 -- 172.21.15.29:0/1324419207 reap_dead start 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- 172.21.15.29:0/1324419207 shutdown_connections 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- 172.21.15.29:0/1324419207 >> 172.21.15.29:0/1324419207 conn(0x7fe91406cfb0 msgr2=0x7fe91406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- 172.21.15.29:0/1324419207 shutdown_connections 2024-04-23T10:15:53.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- 172.21.15.29:0/1324419207 wait complete. 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 Processor -- start 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- start start 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe91414e2b0 0x7fe9140c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe91414e690 0x7fe91414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe91414d9f0 0x7fe91414b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe91415f9e0 con 0x7fe91414d9f0 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe91415f700 con 0x7fe91414e2b0 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe919fde640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe91415fcc0 con 0x7fe91414e690 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe91414d9f0 0x7fe91414b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe91414d9f0 0x7fe91414b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40632/0 (socket says 172.21.15.29:40632) 2024-04-23T10:15:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 -- 172.21.15.29:0/1725838592 learned_addr learned my addr 172.21.15.29:0/1725838592 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe9137fe640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe91414e2b0 0x7fe9140c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 -- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe91414e690 msgr2=0x7fe91414d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe91414e690 0x7fe91414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 -- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe91414e2b0 msgr2=0x7fe9140c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.531+0000 7fe913fff640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe91414e2b0 0x7fe9140c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe913fff640 1 -- 172.21.15.29:0/1725838592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91414c6b0 con 0x7fe91414d9f0 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe913fff640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe91414d9f0 0x7fe91414b7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe90c01f220 tx=0x7fe8fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe8fbfff640 1 -- 172.21.15.29:0/1725838592 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0b5070 con 0x7fe91414d9f0 2024-04-23T10:15:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe8fbfff640 1 -- 172.21.15.29:0/1725838592 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90c004ab0 con 0x7fe91414d9f0 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91414eea0 con 0x7fe91414d9f0 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe8fbfff640 1 -- 172.21.15.29:0/1725838592 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c004e60 con 0x7fe91414d9f0 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141eb5a0 con 0x7fe91414d9f0 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe914068d70 con 0x7fe91414d9f0 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe8fbfff640 1 -- 172.21.15.29:0/1725838592 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe90c0b8020 con 0x7fe91414d9f0 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe8fbfff640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe900068380 0x7fe90006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe8fbfff640 1 -- 172.21.15.29:0/1725838592 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe90c123bd0 con 0x7fe91414d9f0 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe9137fe640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe900068380 0x7fe90006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.535+0000 7fe9137fe640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe900068380 0x7fe90006a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe904009a30 tx=0x7fe904008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.539+0000 7fe8fbfff640 1 -- 172.21.15.29:0/1725838592 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe90c019100 con 0x7fe91414d9f0 2024-04-23T10:15:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.699+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe91406d880 con 0x7fe91414d9f0 2024-04-23T10:15:53.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.699+0000 7fe8fbfff640 1 -- 172.21.15.29:0/1725838592 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7fe90c0f3e80 con 0x7fe91414d9f0 2024-04-23T10:15:53.702 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:53.702 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:53.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe900068380 msgr2=0x7fe90006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe900068380 0x7fe90006a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe904009a30 tx=0x7fe904008040 comp rx=0 tx=0).stop 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe91414d9f0 msgr2=0x7fe91414b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe91414d9f0 0x7fe91414b7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe90c01f220 tx=0x7fe8fc005840 comp rx=0 tx=0).stop 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 shutdown_connections 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe900068380 0x7fe90006a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe91414d9f0 0x7fe91414b7b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe91414e690 0x7fe91414d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 --2- 172.21.15.29:0/1725838592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe91414e2b0 0x7fe9140c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 >> 172.21.15.29:0/1725838592 conn(0x7fe91406cfb0 msgr2=0x7fe9140c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:53.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 shutdown_connections 2024-04-23T10:15:53.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.703+0000 7fe919fde640 1 -- 172.21.15.29:0/1725838592 wait complete. 2024-04-23T10:15:53.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:15:53.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:15:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa659003640 1 Processor -- start 2024-04-23T10:15:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa659003640 1 -- start start 2024-04-23T10:15:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa659003640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa65415bc60 0x7fa6540c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa659003640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa654157db0 con 0x7fa6540c99f0 2024-04-23T10:15:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa659003640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa654158070 con 0x7fa654152030 2024-04-23T10:15:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa659003640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa654158350 con 0x7fa65415bc60 2024-04-23T10:15:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa65259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa6540c99f0 0x7fa65415b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34666/0 (socket says 172.21.15.29:34666) 2024-04-23T10:15:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa65259c640 1 -- 172.21.15.29:0/2500672019 learned_addr learned my addr 172.21.15.29:0/2500672019 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa65359e640 1 --2- 172.21.15.29:0/2500672019 >> v2:172.21.15.29:3300/0 conn(0x7fa65415bc60 0x7fa6540c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa651d9b640 1 -- 172.21.15.29:0/2500672019 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9813656 0 0) 0x7fa654157db0 con 0x7fa6540c99f0 2024-04-23T10:15:53.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa651d9b640 1 -- 172.21.15.29:0/2500672019 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa640005740 con 0x7fa6540c99f0 2024-04-23T10:15:53.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa65359e640 1 -- 172.21.15.29:0/2500672019 >> v1:172.21.15.72:6789/0 conn(0x7fa654152030 legacy=0x7fa6540cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa65359e640 1 -- 172.21.15.29:0/2500672019 >> v1:172.21.15.29:6789/0 conn(0x7fa6540c99f0 legacy=0x7fa65415b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.847+0000 7fa65359e640 1 -- 172.21.15.29:0/2500672019 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa654158630 con 0x7fa65415bc60 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa65359e640 1 --2- 172.21.15.29:0/2500672019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa65415bc60 0x7fa6540c8660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097c0 tx=0x7fa64401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bc6ed0952f0e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa651d9b640 1 -- 172.21.15.29:0/2500672019 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6440b0070 con 0x7fa65415bc60 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa651d9b640 1 -- 172.21.15.29:0/2500672019 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6440ab600 con 0x7fa65415bc60 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa651d9b640 1 -- 172.21.15.29:0/2500672019 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6440ab9d0 con 0x7fa65415bc60 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- 172.21.15.29:0/2500672019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa65415bc60 msgr2=0x7fa6540c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 --2- 172.21.15.29:0/2500672019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa65415bc60 0x7fa6540c8660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097c0 tx=0x7fa64401c4a0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- 172.21.15.29:0/2500672019 shutdown_connections 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 --2- 172.21.15.29:0/2500672019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa65415bc60 0x7fa6540c8660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- 172.21.15.29:0/2500672019 >> 172.21.15.29:0/2500672019 conn(0x7fa65406b9e0 msgr2=0x7fa65406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- 172.21.15.29:0/2500672019 shutdown_connections 2024-04-23T10:15:53.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- 172.21.15.29:0/2500672019 wait complete. 2024-04-23T10:15:53.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 Processor -- start 2024-04-23T10:15:53.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- start start 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6540c99f0 0x7fa654146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa654152030 0x7fa6541574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65415bc60 0x7fa6541f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa6540756f0 con 0x7fa654152030 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa654075570 con 0x7fa6540c99f0 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa659003640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa654075870 con 0x7fa65415bc60 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa65259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa654152030 0x7fa6541574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa65259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa654152030 0x7fa6541574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40646/0 (socket says 172.21.15.29:40646) 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.851+0000 7fa65259c640 1 -- 172.21.15.29:0/367234878 learned_addr learned my addr 172.21.15.29:0/367234878 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:53.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa65359e640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65415bc60 0x7fa6541f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa652d9d640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6540c99f0 0x7fa654146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa65259c640 1 -- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65415bc60 msgr2=0x7fa6541f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa65259c640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65415bc60 0x7fa6541f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa65259c640 1 -- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6540c99f0 msgr2=0x7fa654146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa65259c640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6540c99f0 0x7fa654146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa65259c640 1 -- 172.21.15.29:0/367234878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa654147f30 con 0x7fa654152030 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa65259c640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa654152030 0x7fa6541574c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c500 tx=0x7fa63c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa64b7fe640 1 -- 172.21.15.29:0/367234878 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c017070 con 0x7fa654152030 2024-04-23T10:15:53.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa64b7fe640 1 -- 172.21.15.29:0/367234878 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63c005cf0 con 0x7fa654152030 2024-04-23T10:15:53.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa64b7fe640 1 -- 172.21.15.29:0/367234878 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c0072f0 con 0x7fa654152030 2024-04-23T10:15:53.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa654145c80 con 0x7fa654152030 2024-04-23T10:15:53.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa654147970 con 0x7fa654152030 2024-04-23T10:15:53.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6540693c0 con 0x7fa654152030 2024-04-23T10:15:53.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa64b7fe640 1 -- 172.21.15.29:0/367234878 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa63c01a070 con 0x7fa654152030 2024-04-23T10:15:53.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa64b7fe640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa634068380 0x7fa63406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:53.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa64b7fe640 1 -- 172.21.15.29:0/367234878 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa63c085fc0 con 0x7fa654152030 2024-04-23T10:15:53.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa652d9d640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa634068380 0x7fa63406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:53.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.855+0000 7fa652d9d640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa634068380 0x7fa63406a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa64c001d50 tx=0x7fa64c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:53.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:53.859+0000 7fa64b7fe640 1 -- 172.21.15.29:0/367234878 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa63c055be0 con 0x7fa654152030 2024-04-23T10:15:54.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.019+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa6540c6950 con 0x7fa654152030 2024-04-23T10:15:54.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa64b7fe640 1 -- 172.21.15.29:0/367234878 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fa63c059ee0 con 0x7fa654152030 2024-04-23T10:15:54.022 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:15:54.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa634068380 msgr2=0x7fa63406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa634068380 0x7fa63406a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa64c001d50 tx=0x7fa64c009040 comp rx=0 tx=0).stop 2024-04-23T10:15:54.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa654152030 msgr2=0x7fa6541574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa654152030 0x7fa6541574c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c500 tx=0x7fa63c00c9c0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 shutdown_connections 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa634068380 0x7fa63406a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa65415bc60 0x7fa6541f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa654152030 0x7fa6541574c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 --2- 172.21.15.29:0/367234878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6540c99f0 0x7fa654146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 >> 172.21.15.29:0/367234878 conn(0x7fa65406b9e0 msgr2=0x7fa6540730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 shutdown_connections 2024-04-23T10:15:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.023+0000 7fa659003640 1 -- 172.21.15.29:0/367234878 wait complete. 2024-04-23T10:15:54.040 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:15:54.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b3493640 1 Processor -- start 2024-04-23T10:15:54.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b3493640 1 -- start start 2024-04-23T10:15:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b3493640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55ac144620 0x7f55ac15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b3493640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f55ac0753a0 0x7f55ac072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b3493640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ac15e720 con 0x7f55ac074fc0 2024-04-23T10:15:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b3493640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f55ac072280 con 0x7f55ac0753a0 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b3493640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f55ac0cb020 con 0x7f55ac144620 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b1a30640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f55ac0753a0 0x7f55ac072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b122f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f55ac074fc0 0x7f55ac143f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34668/0 (socket says 172.21.15.29:34668) 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b122f640 1 -- 172.21.15.29:0/605413080 learned_addr learned my addr 172.21.15.29:0/605413080 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b1a30640 1 --2- 172.21.15.29:0/605413080 >> v2:172.21.15.29:3300/0 conn(0x7f55ac0753a0 0x7f55ac072710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40652/0 (socket says 172.21.15.29:40652) 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b1a30640 1 -- 172.21.15.29:0/605413080 >> v2:172.21.15.72:3300/0 conn(0x7f55ac144620 msgr2=0x7f55ac15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b1a30640 1 --2- 172.21.15.29:0/605413080 >> v2:172.21.15.72:3300/0 conn(0x7f55ac144620 0x7f55ac15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b1a30640 1 -- 172.21.15.29:0/605413080 >> v1:172.21.15.29:6789/0 conn(0x7f55ac074fc0 legacy=0x7f55ac143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55a3fff640 1 -- 172.21.15.29:0/605413080 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859130613 0 0) 0x7f55ac15e720 con 0x7f55ac074fc0 2024-04-23T10:15:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.159+0000 7f55b1a30640 1 -- 172.21.15.29:0/605413080 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac15e9e0 con 0x7f55ac0753a0 2024-04-23T10:15:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 --2- 172.21.15.29:0/605413080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac0753a0 0x7f55ac072710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55ac06ee10 tx=0x7f55a401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffe38c37689278a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55a3fff640 1 -- 172.21.15.29:0/605413080 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40b2070 con 0x7f55ac0753a0 2024-04-23T10:15:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55a3fff640 1 -- 172.21.15.29:0/605413080 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a40a57f0 con 0x7f55ac0753a0 2024-04-23T10:15:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55a3fff640 1 -- 172.21.15.29:0/605413080 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40a5bc0 con 0x7f55ac0753a0 2024-04-23T10:15:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- 172.21.15.29:0/605413080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac0753a0 msgr2=0x7f55ac072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 --2- 172.21.15.29:0/605413080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac0753a0 0x7f55ac072710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55ac06ee10 tx=0x7f55a401c930 comp rx=0 tx=0).stop 2024-04-23T10:15:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- 172.21.15.29:0/605413080 shutdown_connections 2024-04-23T10:15:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 --2- 172.21.15.29:0/605413080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac0753a0 0x7f55ac072710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 --2- 172.21.15.29:0/605413080 >> v2:172.21.15.72:3300/0 conn(0x7f55ac144620 0x7f55ac15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- 172.21.15.29:0/605413080 >> 172.21.15.29:0/605413080 conn(0x7f55ac06fde0 msgr2=0x7f55ac0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- 172.21.15.29:0/605413080 shutdown_connections 2024-04-23T10:15:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- 172.21.15.29:0/605413080 wait complete. 2024-04-23T10:15:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 Processor -- start 2024-04-23T10:15:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- start start 2024-04-23T10:15:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55ac074fc0 0x7f55ac157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55ac0753a0 0x7f55ac139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac144620 0x7f55ac155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac073060 con 0x7f55ac144620 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac15f560 con 0x7f55ac074fc0 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b3493640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f55ac1682d0 con 0x7f55ac0753a0 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac144620 0x7f55ac155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac144620 0x7f55ac155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40666/0 (socket says 172.21.15.29:40666) 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 -- 172.21.15.29:0/1709424730 learned_addr learned my addr 172.21.15.29:0/1709424730 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b122f640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55ac074fc0 0x7f55ac157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b0a2e640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55ac0753a0 0x7f55ac139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 -- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55ac0753a0 msgr2=0x7f55ac139610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55ac0753a0 0x7f55ac139610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 -- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55ac074fc0 msgr2=0x7f55ac157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55ac074fc0 0x7f55ac157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 -- 172.21.15.29:0/1709424730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac13c8a0 con 0x7f55ac144620 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b122f640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55ac074fc0 0x7f55ac157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.163+0000 7f55b1a30640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac144620 0x7f55ac155aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f55a4019540 tx=0x7f55a40196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55a1ffb640 1 -- 172.21.15.29:0/1709424730 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40b2050 con 0x7f55ac144620 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55a1ffb640 1 -- 172.21.15.29:0/1709424730 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a40be070 con 0x7f55ac144620 2024-04-23T10:15:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac13cb80 con 0x7f55ac144620 2024-04-23T10:15:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55a1ffb640 1 -- 172.21.15.29:0/1709424730 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40ada90 con 0x7f55ac144620 2024-04-23T10:15:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac13d420 con 0x7f55ac144620 2024-04-23T10:15:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac068d70 con 0x7f55ac144620 2024-04-23T10:15:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55a1ffb640 1 -- 172.21.15.29:0/1709424730 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55a40adc30 con 0x7f55ac144620 2024-04-23T10:15:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55a1ffb640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55900683b0 0x7f559006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55a1ffb640 1 -- 172.21.15.29:0/1709424730 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f55a41222e0 con 0x7f55ac144620 2024-04-23T10:15:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55b122f640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55900683b0 0x7f559006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.167+0000 7f55b122f640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55900683b0 0x7f559006a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f559c000f70 tx=0x7f559c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.171+0000 7f55a1ffb640 1 -- 172.21.15.29:0/1709424730 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f55a40c7020 con 0x7f55ac144620 2024-04-23T10:15:54.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.335+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f55ac0727b0 con 0x7f55ac144620 2024-04-23T10:15:54.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.335+0000 7f55a1ffb640 1 -- 172.21.15.29:0/1709424730 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f55a4016520 con 0x7f55ac144620 2024-04-23T10:15:54.337 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:15:54.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55900683b0 msgr2=0x7f559006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55900683b0 0x7f559006a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f559c000f70 tx=0x7f559c009040 comp rx=0 tx=0).stop 2024-04-23T10:15:54.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac144620 msgr2=0x7f55ac155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac144620 0x7f55ac155aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f55a4019540 tx=0x7f55a40196d0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 shutdown_connections 2024-04-23T10:15:54.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55900683b0 0x7f559006a870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55ac144620 0x7f55ac155aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55ac0753a0 0x7f55ac139610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 --2- 172.21.15.29:0/1709424730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55ac074fc0 0x7f55ac157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 >> 172.21.15.29:0/1709424730 conn(0x7f55ac06fde0 msgr2=0x7f55ac15a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 shutdown_connections 2024-04-23T10:15:54.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.339+0000 7f55b3493640 1 -- 172.21.15.29:0/1709424730 wait complete. 2024-04-23T10:15:54.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:15:54.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c63dd640 1 Processor -- start 2024-04-23T10:15:54.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c63dd640 1 -- start start 2024-04-23T10:15:54.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c63dd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 0x7ff9c00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c63dd640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c00cb040 con 0x7ff9c00c8060 2024-04-23T10:15:54.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c63dd640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c015b290 con 0x7ff9c0155010 2024-04-23T10:15:54.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c63dd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c015b570 con 0x7ff9c01553f0 2024-04-23T10:15:54.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c497a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff9c00c8060 0x7ff9c015e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34982/0 (socket says 172.21.15.29:34982) 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c497a640 1 -- 172.21.15.29:0/3191698237 learned_addr learned my addr 172.21.15.29:0/3191698237 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9bf7fe640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 0x7ff9c00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137872159 0 0) 0x7ff9c00cb040 con 0x7ff9c00c8060 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9a8003530 con 0x7ff9c00c8060 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 398951597 0 0) 0x7ff9a8003530 con 0x7ff9c00c8060 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 msgr2=0x7ff9c00caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 0x7ff9c00caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 >> v1:172.21.15.72:6789/0 conn(0x7ff9c0155010 legacy=0x7ff9c0074d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c015b850 con 0x7ff9c00c8060 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7ff9b8001a00 con 0x7ff9c00c8060 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 >> v1:172.21.15.29:6789/0 conn(0x7ff9c00c8060 legacy=0x7ff9c015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a80039f0 0x7ff9a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 0x7ff9a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a8004d50 0x7ff9a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c015b570 con 0x7ff9a8004d50 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a800bab0 con 0x7ff9a80039f0 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a800bcb0 con 0x7ff9c01553f0 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c497a640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a8004d50 0x7ff9a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9bffff640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a80039f0 0x7ff9a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9bf7fe640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 0x7ff9a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c497a640 1 -- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 msgr2=0x7ff9a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:54.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c497a640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 0x7ff9a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c497a640 1 -- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a80039f0 msgr2=0x7ff9a8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:54.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c497a640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a80039f0 0x7ff9a8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9c497a640 1 -- 172.21.15.29:0/3191698237 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a8003530 con 0x7ff9a8004d50 2024-04-23T10:15:54.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.479+0000 7ff9bf7fe640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c01553f0 0x7ff9a8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:54.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9c497a640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a8004d50 0x7ff9a80051d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8002240 tx=0x7ff9b801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3392f9b19e42ba02 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800a4a0 con 0x7ff9a8004d50 2024-04-23T10:15:54.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b80ad650 con 0x7ff9a8004d50 2024-04-23T10:15:54.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9beffd640 1 -- 172.21.15.29:0/3191698237 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80ada40 con 0x7ff9a8004d50 2024-04-23T10:15:54.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9c63dd640 1 -- 172.21.15.29:0/3191698237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a8004d50 msgr2=0x7ff9a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9c63dd640 1 --2- 172.21.15.29:0/3191698237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a8004d50 0x7ff9a80051d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8002240 tx=0x7ff9b801d340 comp rx=0 tx=0).stop 2024-04-23T10:15:54.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9c497a640 1 -- 172.21.15.29:0/3191698237 reap_dead start 2024-04-23T10:15:54.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9c63dd640 1 -- 172.21.15.29:0/3191698237 shutdown_connections 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9c63dd640 1 -- 172.21.15.29:0/3191698237 >> 172.21.15.29:0/3191698237 conn(0x7ff9c006b9e0 msgr2=0x7ff9c006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9c63dd640 1 -- 172.21.15.29:0/3191698237 shutdown_connections 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.483+0000 7ff9c63dd640 1 -- 172.21.15.29:0/3191698237 wait complete. 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 Processor -- start 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 -- start start 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9c015c960 0x7ff9c01f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c015cd40 0x7ff9c01505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c0150b30 0x7ff9c015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00755f0 con 0x7ff9c015c960 2024-04-23T10:15:54.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c0075470 con 0x7ff9c0150b30 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c015ee80 con 0x7ff9c015cd40 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9c015c960 0x7ff9c01f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9c015c960 0x7ff9c01f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58882/0 (socket says 172.21.15.29:58882) 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 -- 172.21.15.29:0/2981292253 learned_addr learned my addr 172.21.15.29:0/2981292253 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bf7fe640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c015cd40 0x7ff9c01505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c497a640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c0150b30 0x7ff9c015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 -- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c015cd40 msgr2=0x7ff9c01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c015cd40 0x7ff9c01505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 -- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c0150b30 msgr2=0x7ff9c015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c0150b30 0x7ff9c015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 -- 172.21.15.29:0/2981292253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c01514b0 con 0x7ff9c015c960 2024-04-23T10:15:54.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c497a640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c0150b30 0x7ff9c015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:54.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bffff640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9c015c960 0x7ff9c01f4860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000e5b0 tx=0x7ff9b000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bcff9640 1 -- 172.21.15.29:0/2981292253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00052e0 con 0x7ff9c015c960 2024-04-23T10:15:54.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bcff9640 1 -- 172.21.15.29:0/2981292253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b0018070 con 0x7ff9c015c960 2024-04-23T10:15:54.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c0151720 con 0x7ff9c015c960 2024-04-23T10:15:54.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bcff9640 1 -- 172.21.15.29:0/2981292253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0003820 con 0x7ff9c015c960 2024-04-23T10:15:54.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c015daf0 con 0x7ff9c015c960 2024-04-23T10:15:54.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c00693c0 con 0x7ff9c015c960 2024-04-23T10:15:54.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.487+0000 7ff9bcff9640 1 -- 172.21.15.29:0/2981292253 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff9b00039c0 con 0x7ff9c015c960 2024-04-23T10:15:54.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.491+0000 7ff9bcff9640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff9ac068380 0x7ff9ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.491+0000 7ff9bcff9640 1 -- 172.21.15.29:0/2981292253 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff9b0086a50 con 0x7ff9c015c960 2024-04-23T10:15:54.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.491+0000 7ff9bf7fe640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff9ac068380 0x7ff9ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.491+0000 7ff9bf7fe640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff9ac068380 0x7ff9ac06a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00cd0e0 tx=0x7ff9b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.495+0000 7ff9bcff9640 1 -- 172.21.15.29:0/2981292253 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9b000ce60 con 0x7ff9c015c960 2024-04-23T10:15:54.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.659+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff9c0154580 con 0x7ff9c015c960 2024-04-23T10:15:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.659+0000 7ff9bcff9640 1 -- 172.21.15.29:0/2981292253 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7ff9b0005480 con 0x7ff9c015c960 2024-04-23T10:15:54.660 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff9ac068380 msgr2=0x7ff9ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff9ac068380 0x7ff9ac06a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00cd0e0 tx=0x7ff9b4008040 comp rx=0 tx=0).stop 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9c015c960 msgr2=0x7ff9c01f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9c015c960 0x7ff9c01f4860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000e5b0 tx=0x7ff9b000ea70 comp rx=0 tx=0).stop 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 shutdown_connections 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff9ac068380 0x7ff9ac06a840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c0150b30 0x7ff9c015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9c015cd40 0x7ff9c01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 --2- 172.21.15.29:0/2981292253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9c015c960 0x7ff9c01f4860 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 >> 172.21.15.29:0/2981292253 conn(0x7ff9c006b9e0 msgr2=0x7ff9c00cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 shutdown_connections 2024-04-23T10:15:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.663+0000 7ff9c63dd640 1 -- 172.21.15.29:0/2981292253 wait complete. 2024-04-23T10:15:54.679 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:15:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc47483640 1 Processor -- start 2024-04-23T10:15:54.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc47483640 1 -- start start 2024-04-23T10:15:54.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc47483640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc400c5a40 0x7efc400c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc47483640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc400cb9d0 con 0x7efc400ccf30 2024-04-23T10:15:54.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc47483640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc40155840 con 0x7efc40155460 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc47483640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efc400cc380 con 0x7efc400c5a40 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc44a1e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efc400ccf30 0x7efc400d0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34988/0 (socket says 172.21.15.29:34988) 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc44a1e640 1 -- 172.21.15.29:0/664614544 learned_addr learned my addr 172.21.15.29:0/664614544 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc45a20640 1 --2- 172.21.15.29:0/664614544 >> v2:172.21.15.72:3300/0 conn(0x7efc400c5a40 0x7efc400c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401415691 0 0) 0x7efc400cb9d0 con 0x7efc400ccf30 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc2c003530 con 0x7efc400ccf30 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2036750986 0 0) 0x7efc2c003530 con 0x7efc400ccf30 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 >> v2:172.21.15.72:3300/0 conn(0x7efc400c5a40 msgr2=0x7efc400c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 --2- 172.21.15.29:0/664614544 >> v2:172.21.15.72:3300/0 conn(0x7efc400c5a40 0x7efc400c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 >> v1:172.21.15.72:6789/0 conn(0x7efc40155460 legacy=0x7efc4015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc400cbc70 con 0x7efc400ccf30 2024-04-23T10:15:54.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7efc30001680 con 0x7efc400ccf30 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 >> v1:172.21.15.29:6789/0 conn(0x7efc400ccf30 legacy=0x7efc400d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0039c0 0x7efc2c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c004810 0x7efc2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c0051d0 0x7efc2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efc400cc380 con 0x7efc2c004810 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c00c070 con 0x7efc2c0051d0 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c00c270 con 0x7efc2c0039c0 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc44a1e640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c004810 0x7efc2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc45a20640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c0051d0 0x7efc2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc4521f640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0039c0 0x7efc2c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc44a1e640 1 -- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0039c0 msgr2=0x7efc2c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc44a1e640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0039c0 0x7efc2c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc44a1e640 1 -- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c0051d0 msgr2=0x7efc2c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc44a1e640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c0051d0 0x7efc2c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc45a20640 1 -- 172.21.15.29:0/664614544 reap_dead start 2024-04-23T10:15:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc44a1e640 1 -- 172.21.15.29:0/664614544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c003530 con 0x7efc2c004810 2024-04-23T10:15:54.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.799+0000 7efc4521f640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0039c0 0x7efc2c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:54.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc44a1e640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c004810 0x7efc2c004c90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c210 tx=0x7efc3001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cd1cafacfbd81c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30007d20 con 0x7efc2c004810 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc30005ae0 con 0x7efc2c004810 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc37fff640 1 -- 172.21.15.29:0/664614544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30007070 con 0x7efc2c004810 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- 172.21.15.29:0/664614544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c004810 msgr2=0x7efc2c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c004810 0x7efc2c004c90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c210 tx=0x7efc3001f370 comp rx=0 tx=0).stop 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- 172.21.15.29:0/664614544 shutdown_connections 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 --2- 172.21.15.29:0/664614544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc2c004810 0x7efc2c004c90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- 172.21.15.29:0/664614544 >> 172.21.15.29:0/664614544 conn(0x7efc40074d60 msgr2=0x7efc40075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- 172.21.15.29:0/664614544 shutdown_connections 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- 172.21.15.29:0/664614544 wait complete. 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 Processor -- start 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- start start 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c004810 0x7efc4015d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc40156590 0x7efc401f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc400ca990 0x7efc401f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efc4015ead0 con 0x7efc40156590 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efc400cbf50 con 0x7efc400ca990 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc47483640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efc400c5f30 con 0x7efc2c004810 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc44a1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc40156590 0x7efc401f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc44a1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc40156590 0x7efc401f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58908/0 (socket says 172.21.15.29:58908) 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.803+0000 7efc44a1e640 1 -- 172.21.15.29:0/197755904 learned_addr learned my addr 172.21.15.29:0/197755904 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc44a1e640 1 -- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c004810 msgr2=0x7efc4015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc4521f640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c004810 0x7efc4015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc44a1e640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c004810 0x7efc4015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc44a1e640 1 -- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc400ca990 msgr2=0x7efc401f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc44a1e640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc400ca990 0x7efc401f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc44a1e640 1 -- 172.21.15.29:0/197755904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc40156af0 con 0x7efc40156590 2024-04-23T10:15:54.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc44a1e640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc40156590 0x7efc401f4810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc3001f1a0 tx=0x7efc2c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc35ffb640 1 -- 172.21.15.29:0/197755904 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30007d20 con 0x7efc40156590 2024-04-23T10:15:54.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc35ffb640 1 -- 172.21.15.29:0/197755904 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc300047f0 con 0x7efc40156590 2024-04-23T10:15:54.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc40156dd0 con 0x7efc40156590 2024-04-23T10:15:54.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc35ffb640 1 -- 172.21.15.29:0/197755904 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30004ba0 con 0x7efc40156590 2024-04-23T10:15:54.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc400b63c0 con 0x7efc40156590 2024-04-23T10:15:54.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc400693c0 con 0x7efc40156590 2024-04-23T10:15:54.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc35ffb640 1 -- 172.21.15.29:0/197755904 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc30007070 con 0x7efc40156590 2024-04-23T10:15:54.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc35ffb640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc24068380 0x7efc2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:54.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc35ffb640 1 -- 172.21.15.29:0/197755904 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efc30123f90 con 0x7efc40156590 2024-04-23T10:15:54.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc4521f640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc24068380 0x7efc2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:54.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.807+0000 7efc4521f640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc24068380 0x7efc2406a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc3c007fd0 tx=0x7efc3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:54.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.811+0000 7efc35ffb640 1 -- 172.21.15.29:0/197755904 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc30019080 con 0x7efc40156590 2024-04-23T10:15:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.971+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7efc400cc500 con 0x7efc40156590 2024-04-23T10:15:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.971+0000 7efc35ffb640 1 -- 172.21.15.29:0/197755904 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7efc300f4180 con 0x7efc40156590 2024-04-23T10:15:54.972 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:15:54.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc24068380 msgr2=0x7efc2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc24068380 0x7efc2406a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc3c007fd0 tx=0x7efc3c009040 comp rx=0 tx=0).stop 2024-04-23T10:15:54.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc40156590 msgr2=0x7efc401f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:54.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc40156590 0x7efc401f4810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc3001f1a0 tx=0x7efc2c005840 comp rx=0 tx=0).stop 2024-04-23T10:15:54.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 shutdown_connections 2024-04-23T10:15:54.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc24068380 0x7efc2406a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc400ca990 0x7efc401f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc40156590 0x7efc401f4810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 --2- 172.21.15.29:0/197755904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c004810 0x7efc4015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:54.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 >> 172.21.15.29:0/197755904 conn(0x7efc40074d60 msgr2=0x7efc40154480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:54.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 shutdown_connections 2024-04-23T10:15:54.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:54.975+0000 7efc47483640 1 -- 172.21.15.29:0/197755904 wait complete. 2024-04-23T10:15:54.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:15:55.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7fbd7640 1 Processor -- start 2024-04-23T10:15:55.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7fbd7640 1 -- start start 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7fbd7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b780c7730 0x7f1b7815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7fbd7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815b350 con 0x7f1b781518f0 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7fbd7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7815b630 con 0x7f1b780c4f00 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7fbd7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1b780c4280 con 0x7f1b780c7730 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7d973640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1b781518f0 0x7f1b780c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34992/0 (socket says 172.21.15.29:34992) 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7d973640 1 -- 172.21.15.29:0/1894339148 learned_addr learned my addr 172.21.15.29:0/1894339148 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7d172640 1 --2- 172.21.15.29:0/1894339148 >> v2:172.21.15.72:3300/0 conn(0x7f1b780c7730 0x7f1b7815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197765188 0 0) 0x7f1b7815b350 con 0x7f1b781518f0 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b64003530 con 0x7f1b781518f0 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2410947092 0 0) 0x7f1b64003530 con 0x7f1b781518f0 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 >> v2:172.21.15.72:3300/0 conn(0x7f1b780c7730 msgr2=0x7f1b7815ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7c971640 1 --2- 172.21.15.29:0/1894339148 >> v2:172.21.15.72:3300/0 conn(0x7f1b780c7730 0x7f1b7815ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 >> v1:172.21.15.72:6789/0 conn(0x7f1b780c4f00 legacy=0x7f1b780c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7815b910 con 0x7f1b781518f0 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.103+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f1b74001a00 con 0x7f1b781518f0 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 >> v1:172.21.15.29:6789/0 conn(0x7f1b781518f0 legacy=0x7f1b780c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b640039c0 0x7f1b64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b64004810 0x7f1b64004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b640051d0 0x7f1b6400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1b780c4280 con 0x7f1b64004810 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6400c070 con 0x7f1b640051d0 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7d172640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b64004810 0x7f1b64004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6400c270 con 0x7f1b640039c0 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7e174640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b640051d0 0x7f1b6400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7d973640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b640039c0 0x7f1b64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7d172640 1 -- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b640039c0 msgr2=0x7f1b64003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7d172640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b640039c0 0x7f1b64003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7d172640 1 -- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b640051d0 msgr2=0x7f1b6400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7d172640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b640051d0 0x7f1b6400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7d172640 1 -- 172.21.15.29:0/1894339148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b64003530 con 0x7f1b64004810 2024-04-23T10:15:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7e174640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b640051d0 0x7f1b6400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:55.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7e174640 1 -- 172.21.15.29:0/1894339148 reap_dead start 2024-04-23T10:15:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7d172640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b64004810 0x7f1b64004c90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800aae0 tx=0x7f1b6801dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eacef02bc4dbc1d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680b2070 con 0x7f1b64004810 2024-04-23T10:15:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b680ad600 con 0x7f1b64004810 2024-04-23T10:15:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7c971640 1 -- 172.21.15.29:0/1894339148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800b040 con 0x7f1b64004810 2024-04-23T10:15:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/1894339148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b64004810 msgr2=0x7f1b64004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7fbd7640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b64004810 0x7f1b64004c90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800aae0 tx=0x7f1b6801dfc0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/1894339148 shutdown_connections 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7fbd7640 1 --2- 172.21.15.29:0/1894339148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b64004810 0x7f1b64004c90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/1894339148 >> 172.21.15.29:0/1894339148 conn(0x7f1b7806cfb0 msgr2=0x7f1b7806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/1894339148 shutdown_connections 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.107+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/1894339148 wait complete. 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 Processor -- start 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 -- start start 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b64004810 0x7f1b780727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b7815a530 0x7f1b781f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b78158800 0x7f1b781f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1b78151cd0 con 0x7f1b7815a530 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1b780c49e0 con 0x7f1b64004810 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1b78151e50 con 0x7f1b78158800 2024-04-23T10:15:55.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b7815a530 0x7f1b781f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b7815a530 0x7f1b781f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58916/0 (socket says 172.21.15.29:58916) 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 -- 172.21.15.29:0/3731409181 learned_addr learned my addr 172.21.15.29:0/3731409181 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d973640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b64004810 0x7f1b780727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7e174640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b78158800 0x7f1b781f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 -- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b78158800 msgr2=0x7f1b781f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b78158800 0x7f1b781f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 -- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b64004810 msgr2=0x7f1b780727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b64004810 0x7f1b780727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 -- 172.21.15.29:0/3731409181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b781f2130 con 0x7f1b7815a530 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7e174640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b78158800 0x7f1b781f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d973640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b64004810 0x7f1b780727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:55.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d172640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b7815a530 0x7f1b781f2910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b680b0040 tx=0x7f1b6801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b6e7fc640 1 -- 172.21.15.29:0/3731409181 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680bb020 con 0x7f1b7815a530 2024-04-23T10:15:55.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b6e7fc640 1 -- 172.21.15.29:0/3731409181 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b680b3040 con 0x7f1b7815a530 2024-04-23T10:15:55.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b78159830 con 0x7f1b7815a530 2024-04-23T10:15:55.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b6e7fc640 1 -- 172.21.15.29:0/3731409181 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680b2070 con 0x7f1b7815a530 2024-04-23T10:15:55.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b78159df0 con 0x7f1b7815a530 2024-04-23T10:15:55.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b78068d70 con 0x7f1b7815a530 2024-04-23T10:15:55.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b6e7fc640 1 -- 172.21.15.29:0/3731409181 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1b680be020 con 0x7f1b7815a530 2024-04-23T10:15:55.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b6e7fc640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1b5c0683b0 0x7f1b5c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b6e7fc640 1 -- 172.21.15.29:0/3731409181 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1b68121620 con 0x7f1b7815a530 2024-04-23T10:15:55.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.111+0000 7f1b7d973640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1b5c0683b0 0x7f1b5c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.115+0000 7f1b7d973640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1b5c0683b0 0x7f1b5c06a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b74001590 tx=0x7f1b74001880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.119+0000 7f1b6e7fc640 1 -- 172.21.15.29:0/3731409181 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b680c5070 con 0x7f1b7815a530 2024-04-23T10:15:55.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.287+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b780c8dc0 con 0x7f1b7815a530 2024-04-23T10:15:55.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.287+0000 7f1b6e7fc640 1 -- 172.21.15.29:0/3731409181 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f1b68017cd0 con 0x7f1b7815a530 2024-04-23T10:15:55.289 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-23T10:15:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1b5c0683b0 msgr2=0x7f1b5c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1b5c0683b0 0x7f1b5c06a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b74001590 tx=0x7f1b74001880 comp rx=0 tx=0).stop 2024-04-23T10:15:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b7815a530 msgr2=0x7f1b781f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b7815a530 0x7f1b781f2910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b680b0040 tx=0x7f1b6801ad60 comp rx=0 tx=0).stop 2024-04-23T10:15:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 shutdown_connections 2024-04-23T10:15:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1b5c0683b0 0x7f1b5c06a870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b78158800 0x7f1b781f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b7815a530 0x7f1b781f2910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 --2- 172.21.15.29:0/3731409181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b64004810 0x7f1b780727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 >> 172.21.15.29:0/3731409181 conn(0x7f1b7806cfb0 msgr2=0x7f1b78150820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:55.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 shutdown_connections 2024-04-23T10:15:55.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.291+0000 7f1b7fbd7640 1 -- 172.21.15.29:0/3731409181 wait complete. 2024-04-23T10:15:55.307 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-04-23T10:15:55.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:55.308 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:15:55.336 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[33475]: fuse finished with error 0 and tester_r 0 2024-04-23T10:15:55.337 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:15:55.428 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:15:55.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:15:55.428 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-23T10:15:55.462 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:55.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ece273640 1 Processor -- start 2024-04-23T10:15:55.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ece273640 1 -- start start 2024-04-23T10:15:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ece273640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ec8153190 0x7f2ec8159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ece273640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ec806f150 0x7f2ec806f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ece273640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec80ccc50 0x7f2ec80cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ece273640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec8159380 con 0x7f2ec8153190 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ece273640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec80cd5c0 con 0x7f2ec806f150 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ece273640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec80c3fe0 con 0x7f2ec80ccc50 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ec8153190 0x7f2ec8159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ec8153190 0x7f2ec8159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58926/0 (socket says 172.21.15.29:58926) 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 -- 172.21.15.29:0/1697198405 learned_addr learned my addr 172.21.15.29:0/1697198405 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ebffff640 1 --2- 172.21.15.29:0/1697198405 >> v2:172.21.15.72:3300/0 conn(0x7f2ec806f150 0x7f2ec806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ecc810640 1 --2- 172.21.15.29:0/1697198405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec80ccc50 0x7f2ec80cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 -- 172.21.15.29:0/1697198405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec80ccc50 msgr2=0x7f2ec80cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 --2- 172.21.15.29:0/1697198405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec80ccc50 0x7f2ec80cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 -- 172.21.15.29:0/1697198405 >> v2:172.21.15.72:3300/0 conn(0x7f2ec806f150 msgr2=0x7f2ec806f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 --2- 172.21.15.29:0/1697198405 >> v2:172.21.15.72:3300/0 conn(0x7f2ec806f150 0x7f2ec806f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 -- 172.21.15.29:0/1697198405 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec80c42c0 con 0x7f2ec8153190 2024-04-23T10:15:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ebffff640 1 --2- 172.21.15.29:0/1697198405 >> v2:172.21.15.72:3300/0 conn(0x7f2ec806f150 0x7f2ec806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec7fff640 1 --2- 172.21.15.29:0/1697198405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec8153190 0x7f2ec8159810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80c8fc0 tx=0x7f2eb001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693d0df8a9cde786 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec77fe640 1 -- 172.21.15.29:0/1697198405 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00b5070 con 0x7f2ec8153190 2024-04-23T10:15:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec77fe640 1 -- 172.21.15.29:0/1697198405 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb00a89d0 con 0x7f2ec8153190 2024-04-23T10:15:55.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.631+0000 7f2ec77fe640 1 -- 172.21.15.29:0/1697198405 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00a8da0 con 0x7f2ec8153190 2024-04-23T10:15:55.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- 172.21.15.29:0/1697198405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec8153190 msgr2=0x7f2ec8159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 --2- 172.21.15.29:0/1697198405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec8153190 0x7f2ec8159810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80c8fc0 tx=0x7f2eb001ed10 comp rx=0 tx=0).stop 2024-04-23T10:15:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- 172.21.15.29:0/1697198405 shutdown_connections 2024-04-23T10:15:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 --2- 172.21.15.29:0/1697198405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec80ccc50 0x7f2ec80cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 --2- 172.21.15.29:0/1697198405 >> v2:172.21.15.72:3300/0 conn(0x7f2ec806f150 0x7f2ec806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 --2- 172.21.15.29:0/1697198405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec8153190 0x7f2ec8159810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- 172.21.15.29:0/1697198405 >> 172.21.15.29:0/1697198405 conn(0x7f2ec806cfb0 msgr2=0x7f2ec806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- 172.21.15.29:0/1697198405 shutdown_connections 2024-04-23T10:15:55.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- 172.21.15.29:0/1697198405 wait complete. 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 Processor -- start 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- start start 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec806f150 0x7f2ec8155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec80ccc50 0x7f2ec81f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ec8153190 0x7f2ec81f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec8153570 con 0x7f2ec80ccc50 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec8159010 con 0x7f2ec8153190 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec80c4880 con 0x7f2ec806f150 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec80ccc50 0x7f2ec81f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec80ccc50 0x7f2ec81f0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58942/0 (socket says 172.21.15.29:58942) 2024-04-23T10:15:55.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 -- 172.21.15.29:0/2277292558 learned_addr learned my addr 172.21.15.29:0/2277292558 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ec7fff640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec806f150 0x7f2ec8155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ecc810640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ec8153190 0x7f2ec81f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 -- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec806f150 msgr2=0x7f2ec8155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec806f150 0x7f2ec8155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 -- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ec8153190 msgr2=0x7f2ec81f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ec8153190 0x7f2ec81f0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 -- 172.21.15.29:0/2277292558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec80c70c0 con 0x7f2ec80ccc50 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ebffff640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec80ccc50 0x7f2ec81f0500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c7c0 tx=0x7f2eb800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ec57fa640 1 -- 172.21.15.29:0/2277292558 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8015070 con 0x7f2ec80ccc50 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ec57fa640 1 -- 172.21.15.29:0/2277292558 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb8007a30 con 0x7f2ec80ccc50 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec8154540 con 0x7f2ec80ccc50 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ec57fa640 1 -- 172.21.15.29:0/2277292558 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8007e00 con 0x7f2ec80ccc50 2024-04-23T10:15:55.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.635+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec8154ae0 con 0x7f2ec80ccc50 2024-04-23T10:15:55.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.639+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec8068d70 con 0x7f2ec80ccc50 2024-04-23T10:15:55.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.639+0000 7f2ec57fa640 1 -- 172.21.15.29:0/2277292558 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2eb8018070 con 0x7f2ec80ccc50 2024-04-23T10:15:55.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.639+0000 7f2ec57fa640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2ea8068380 0x7f2ea806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.639+0000 7f2ec57fa640 1 -- 172.21.15.29:0/2277292558 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2eb8086ba0 con 0x7f2ec80ccc50 2024-04-23T10:15:55.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.639+0000 7f2ec7fff640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2ea8068380 0x7f2ea806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.639+0000 7f2ec7fff640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2ea8068380 0x7f2ea806a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00b2000 tx=0x7f2eb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.643+0000 7f2ec57fa640 1 -- 172.21.15.29:0/2277292558 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2eb8056e20 con 0x7f2ec80ccc50 2024-04-23T10:15:55.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.807+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ec8156920 con 0x7f2ec80ccc50 2024-04-23T10:15:55.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.807+0000 7f2ec57fa640 1 -- 172.21.15.29:0/2277292558 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f2eb8086020 con 0x7f2ec80ccc50 2024-04-23T10:15:55.809 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:55.809 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2ea8068380 msgr2=0x7f2ea806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2ea8068380 0x7f2ea806a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00b2000 tx=0x7f2eb0008040 comp rx=0 tx=0).stop 2024-04-23T10:15:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec80ccc50 msgr2=0x7f2ec81f0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec80ccc50 0x7f2ec81f0500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c7c0 tx=0x7f2eb800cc80 comp rx=0 tx=0).stop 2024-04-23T10:15:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 shutdown_connections 2024-04-23T10:15:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2ea8068380 0x7f2ea806a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ec8153190 0x7f2ec81f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec80ccc50 0x7f2ec81f0500 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 --2- 172.21.15.29:0/2277292558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ec806f150 0x7f2ec8155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 >> 172.21.15.29:0/2277292558 conn(0x7f2ec806cfb0 msgr2=0x7f2ec81586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:55.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 shutdown_connections 2024-04-23T10:15:55.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.811+0000 7f2ece273640 1 -- 172.21.15.29:0/2277292558 wait complete. 2024-04-23T10:15:55.828 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:15:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.943+0000 7fc55e2a0640 1 Processor -- start 2024-04-23T10:15:55.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.943+0000 7fc55e2a0640 1 -- start start 2024-04-23T10:15:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc55e2a0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55815bd80 0x7fc5580cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc55e2a0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5580cbcb0 0x7fc5580c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc55e2a0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55806c910 con 0x7fc558151bb0 2024-04-23T10:15:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc55e2a0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc55806cbf0 con 0x7fc5580cbcb0 2024-04-23T10:15:55.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc55e2a0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc55806ced0 con 0x7fc55815bd80 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc557fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc558151bb0 0x7fc5580c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34996/0 (socket says 172.21.15.29:34996) 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc557fff640 1 -- 172.21.15.29:0/4248610075 learned_addr learned my addr 172.21.15.29:0/4248610075 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc55c83d640 1 --2- 172.21.15.29:0/4248610075 >> v2:172.21.15.72:3300/0 conn(0x7fc5580cbcb0 0x7fc5580c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc5577fe640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55815bd80 0x7fc5580cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922200186 0 0) 0x7fc55806c910 con 0x7fc558151bb0 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc540003530 con 0x7fc558151bb0 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 400888420 0 0) 0x7fc540003530 con 0x7fc558151bb0 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55815bd80 msgr2=0x7fc5580cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55815bd80 0x7fc5580cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 >> v2:172.21.15.72:3300/0 conn(0x7fc5580cbcb0 msgr2=0x7fc5580c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 --2- 172.21.15.29:0/4248610075 >> v2:172.21.15.72:3300/0 conn(0x7fc5580cbcb0 0x7fc5580c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55806d1b0 con 0x7fc558151bb0 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fc548001680 con 0x7fc558151bb0 2024-04-23T10:15:55.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 >> v1:172.21.15.29:6789/0 conn(0x7fc558151bb0 legacy=0x7fc5580c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5400039c0 0x7fc540003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc540004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55815bd80 0x7fc5400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc55806cbf0 con 0x7fc540004810 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc55806ced0 con 0x7fc5400039c0 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc54000ba00 con 0x7fc55815bd80 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc5577fe640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc540004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc557fff640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5400039c0 0x7fc540003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc55c83d640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55815bd80 0x7fc5400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc5577fe640 1 -- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55815bd80 msgr2=0x7fc5400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc5577fe640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55815bd80 0x7fc5400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc5577fe640 1 -- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5400039c0 msgr2=0x7fc540003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc5577fe640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5400039c0 0x7fc540003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.947+0000 7fc5577fe640 1 -- 172.21.15.29:0/4248610075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540003530 con 0x7fc540004810 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc5577fe640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc540004c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009ae0 tx=0x7fc54c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9758805f09481f3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0b2070 con 0x7fc540004810 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c0a5580 con 0x7fc540004810 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc556ffd640 1 -- 172.21.15.29:0/4248610075 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0096b0 con 0x7fc540004810 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- 172.21.15.29:0/4248610075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 msgr2=0x7fc540004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 --2- 172.21.15.29:0/4248610075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc540004c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009ae0 tx=0x7fc54c01ca70 comp rx=0 tx=0).stop 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55c83d640 1 -- 172.21.15.29:0/4248610075 reap_dead start 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- 172.21.15.29:0/4248610075 shutdown_connections 2024-04-23T10:15:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- 172.21.15.29:0/4248610075 >> 172.21.15.29:0/4248610075 conn(0x7fc5580730f0 msgr2=0x7fc558073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- 172.21.15.29:0/4248610075 shutdown_connections 2024-04-23T10:15:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- 172.21.15.29:0/4248610075 wait complete. 2024-04-23T10:15:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 Processor -- start 2024-04-23T10:15:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- start start 2024-04-23T10:15:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc55814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5580b53e0 0x7fc5581f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5581e7f60 0x7fc5580b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc5580c6010 con 0x7fc540004810 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc558151f90 con 0x7fc5581e7f60 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc5580c6190 con 0x7fc5580b53e0 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc55814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc55814b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58960/0 (socket says 172.21.15.29:58960) 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 -- 172.21.15.29:0/2866081765 learned_addr learned my addr 172.21.15.29:0/2866081765 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55c83d640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5581e7f60 0x7fc5580b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc5577fe640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5580b53e0 0x7fc5581f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 -- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5580b53e0 msgr2=0x7fc5581f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5580b53e0 0x7fc5581f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 -- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5581e7f60 msgr2=0x7fc5580b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5581e7f60 0x7fc5580b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 -- 172.21.15.29:0/2866081765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55814b8b0 con 0x7fc540004810 2024-04-23T10:15:55.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc5577fe640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5580b53e0 0x7fc5581f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc557fff640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc55814b370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc54800e7a0 tx=0x7fc54800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc554ff9640 1 -- 172.21.15.29:0/2866081765 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54800c8d0 con 0x7fc540004810 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc554ff9640 1 -- 172.21.15.29:0/2866081765 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548018070 con 0x7fc540004810 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.951+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc558158f10 con 0x7fc540004810 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.955+0000 7fc554ff9640 1 -- 172.21.15.29:0/2866081765 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54800cc90 con 0x7fc540004810 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.955+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5581594d0 con 0x7fc540004810 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.955+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc558068d70 con 0x7fc540004810 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.955+0000 7fc554ff9640 1 -- 172.21.15.29:0/2866081765 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc548013420 con 0x7fc540004810 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.955+0000 7fc554ff9640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc5440683b0 0x7fc54406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.955+0000 7fc554ff9640 1 -- 172.21.15.29:0/2866081765 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc548086940 con 0x7fc540004810 2024-04-23T10:15:55.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.955+0000 7fc5577fe640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc5440683b0 0x7fc54406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:55.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.955+0000 7fc5577fe640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc5440683b0 0x7fc54406a870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0af000 tx=0x7fc54c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:55.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:55.959+0000 7fc554ff9640 1 -- 172.21.15.29:0/2866081765 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc548056b30 con 0x7fc540004810 2024-04-23T10:15:56.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.123+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5580c74c0 con 0x7fc540004810 2024-04-23T10:15:56.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.123+0000 7fc554ff9640 1 -- 172.21.15.29:0/2866081765 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7fc548056430 con 0x7fc540004810 2024-04-23T10:15:56.125 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:15:56.126 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc5440683b0 msgr2=0x7fc54406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc5440683b0 0x7fc54406a870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0af000 tx=0x7fc54c0046d0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 msgr2=0x7fc55814b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc55814b370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc54800e7a0 tx=0x7fc54800ec60 comp rx=0 tx=0).stop 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 shutdown_connections 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc5440683b0 0x7fc54406a870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5581e7f60 0x7fc5580b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5580b53e0 0x7fc5581f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 --2- 172.21.15.29:0/2866081765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc540004810 0x7fc55814b370 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 >> 172.21.15.29:0/2866081765 conn(0x7fc5580730f0 msgr2=0x7fc5580c5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 shutdown_connections 2024-04-23T10:15:56.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.127+0000 7fc55e2a0640 1 -- 172.21.15.29:0/2866081765 wait complete. 2024-04-23T10:15:56.145 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-23T10:15:56.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.271+0000 7f0dfae82640 1 Processor -- start 2024-04-23T10:15:56.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.271+0000 7f0dfae82640 1 -- start start 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0dfae82640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 0x7f0df4155030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0dfae82640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0df40c8530 0x7f0df4155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0dfae82640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df415b4d0 con 0x7f0df40c9170 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0dfae82640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0df4155ab0 con 0x7f0df40c8530 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0dfae82640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0df40ca7d0 con 0x7f0df40c9550 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df941f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0df40c8530 0x7f0df4155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df941f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0df40c8530 0x7f0df4155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58976/0 (socket says 172.21.15.29:58976) 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df941f640 1 -- 172.21.15.29:0/2851400858 learned_addr learned my addr 172.21.15.29:0/2851400858 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df3fff640 1 --2- 172.21.15.29:0/2851400858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 0x7f0df4155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:56.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df941f640 1 -- 172.21.15.29:0/2851400858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 msgr2=0x7f0df4155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:56.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df941f640 1 --2- 172.21.15.29:0/2851400858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 0x7f0df4155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df941f640 1 -- 172.21.15.29:0/2851400858 >> v1:172.21.15.72:6789/0 conn(0x7f0df40c9170 legacy=0x7f0df40c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:56.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df941f640 1 -- 172.21.15.29:0/2851400858 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df415b7b0 con 0x7f0df40c8530 2024-04-23T10:15:56.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df941f640 1 --2- 172.21.15.29:0/2851400858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df4155570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009e50 tx=0x7f0dec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e6b4f6cd4d2b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:56.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df37fe640 1 -- 172.21.15.29:0/2851400858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0a5700 con 0x7f0df40c8530 2024-04-23T10:15:56.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df37fe640 1 -- 172.21.15.29:0/2851400858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dec0a58a0 con 0x7f0df40c8530 2024-04-23T10:15:56.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.275+0000 7f0df37fe640 1 -- 172.21.15.29:0/2851400858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0a5c70 con 0x7f0df40c8530 2024-04-23T10:15:56.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- 172.21.15.29:0/2851400858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 msgr2=0x7f0df4155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:56.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 --2- 172.21.15.29:0/2851400858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df4155570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009e50 tx=0x7f0dec01ca30 comp rx=0 tx=0).stop 2024-04-23T10:15:56.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- 172.21.15.29:0/2851400858 shutdown_connections 2024-04-23T10:15:56.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 --2- 172.21.15.29:0/2851400858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df4155570 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 --2- 172.21.15.29:0/2851400858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 0x7f0df4155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- 172.21.15.29:0/2851400858 >> 172.21.15.29:0/2851400858 conn(0x7f0df40c9a90 msgr2=0x7f0df40c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:56.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- 172.21.15.29:0/2851400858 shutdown_connections 2024-04-23T10:15:56.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- 172.21.15.29:0/2851400858 wait complete. 2024-04-23T10:15:56.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 Processor -- start 2024-04-23T10:15:56.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- start start 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df40c2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df40c9170 0x7f0df41f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 0x7f0df4073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0df406e460 con 0x7f0df40c8530 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0df406e2e0 con 0x7f0df40c9170 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0df4168380 con 0x7f0df40c9550 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df40c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df40c2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58988/0 (socket says 172.21.15.29:58988) 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 -- 172.21.15.29:0/1036487830 learned_addr learned my addr 172.21.15.29:0/1036487830 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df3fff640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df40c9170 0x7f0df41f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:56.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df941f640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 0x7f0df4073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 -- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 msgr2=0x7f0df4073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 0x7f0df4073010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 -- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df40c9170 msgr2=0x7f0df41f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df40c9170 0x7f0df41f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 -- 172.21.15.29:0/1036487830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df4074240 con 0x7f0df40c8530 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df3fff640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df40c9170 0x7f0df41f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df8c1e640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df40c2210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0de800c420 tx=0x7f0de800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df17fa640 1 -- 172.21.15.29:0/1036487830 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de80052d0 con 0x7f0df40c8530 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df17fa640 1 -- 172.21.15.29:0/1036487830 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de8005470 con 0x7f0df40c8530 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df41f7e10 con 0x7f0df40c8530 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0df17fa640 1 -- 172.21.15.29:0/1036487830 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8007260 con 0x7f0df40c8530 2024-04-23T10:15:56.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.279+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df40cc900 con 0x7f0df40c8530 2024-04-23T10:15:56.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.283+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df40693c0 con 0x7f0df40c8530 2024-04-23T10:15:56.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.283+0000 7f0df17fa640 1 -- 172.21.15.29:0/1036487830 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0de8007400 con 0x7f0df40c8530 2024-04-23T10:15:56.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.283+0000 7f0df17fa640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0dd8068380 0x7f0dd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:56.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.283+0000 7f0df17fa640 1 -- 172.21.15.29:0/1036487830 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0de8086220 con 0x7f0df40c8530 2024-04-23T10:15:56.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.283+0000 7f0df3fff640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0dd8068380 0x7f0dd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:56.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.283+0000 7f0df3fff640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0dd8068380 0x7f0dd806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0df40ca290 tx=0x7f0de0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:56.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.287+0000 7f0df17fa640 1 -- 172.21.15.29:0/1036487830 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0de80564a0 con 0x7f0df40c8530 2024-04-23T10:15:56.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:56.483+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0df4075e60 con 0x7f0df40c8530 2024-04-23T10:15:57.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.279+0000 7f0df17fa640 1 -- 172.21.15.29:0/1036487830 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f0de8055da0 con 0x7f0df40c8530 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0dd8068380 msgr2=0x7f0dd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0dd8068380 0x7f0dd806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0df40ca290 tx=0x7f0de0008040 comp rx=0 tx=0).stop 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 msgr2=0x7f0df40c2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df40c2210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0de800c420 tx=0x7f0de800c8e0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 shutdown_connections 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0dd8068380 0x7f0dd806a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0df40c9550 0x7f0df4073010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df40c9170 0x7f0df41f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 --2- 172.21.15.29:0/1036487830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40c8530 0x7f0df40c2210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 >> 172.21.15.29:0/1036487830 conn(0x7f0df40c9a90 msgr2=0x7f0df40c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:57.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 shutdown_connections 2024-04-23T10:15:57.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.283+0000 7f0dfae82640 1 -- 172.21.15.29:0/1036487830 wait complete. 2024-04-23T10:15:57.304 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-23T10:15:57.305 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-23T10:15:57.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.431+0000 7f1971da1640 1 Processor -- start 2024-04-23T10:15:57.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.431+0000 7f1971da1640 1 -- start start 2024-04-23T10:15:57.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.431+0000 7f1971da1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f196c153190 0x7f196c159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:57.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.431+0000 7f1971da1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c06f150 0x7f196c06f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:57.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.431+0000 7f1971da1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f196c0c3fe0 con 0x7f196c0ccc50 2024-04-23T10:15:57.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.431+0000 7f1971da1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f196c159380 con 0x7f196c153190 2024-04-23T10:15:57.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.431+0000 7f1971da1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f196c0c42c0 con 0x7f196c06f150 2024-04-23T10:15:57.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f196c153190 0x7f196c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:57.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f196c153190 0x7f196c159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58998/0 (socket says 172.21.15.29:58998) 2024-04-23T10:15:57.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196b7fe640 1 -- 172.21.15.29:0/2666646656 learned_addr learned my addr 172.21.15.29:0/2666646656 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:57.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196affd640 1 --2- 172.21.15.29:0/2666646656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c06f150 0x7f196c06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:57.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196b7fe640 1 -- 172.21.15.29:0/2666646656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c06f150 msgr2=0x7f196c06f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:57.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196b7fe640 1 --2- 172.21.15.29:0/2666646656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c06f150 0x7f196c06f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196b7fe640 1 -- 172.21.15.29:0/2666646656 >> v1:172.21.15.72:6789/0 conn(0x7f196c0ccc50 legacy=0x7f196c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:57.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196b7fe640 1 -- 172.21.15.29:0/2666646656 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c0c45a0 con 0x7f196c153190 2024-04-23T10:15:57.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196b7fe640 1 --2- 172.21.15.29:0/2666646656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c153190 0x7f196c159810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1960009870 tx=0x7f196001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad344e7bd54ae2c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:57.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196a7fc640 1 -- 172.21.15.29:0/2666646656 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19600b5070 con 0x7f196c153190 2024-04-23T10:15:57.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196a7fc640 1 -- 172.21.15.29:0/2666646656 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19600a8a50 con 0x7f196c153190 2024-04-23T10:15:57.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f196a7fc640 1 -- 172.21.15.29:0/2666646656 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19600a8e20 con 0x7f196c153190 2024-04-23T10:15:57.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f1971da1640 1 -- 172.21.15.29:0/2666646656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c153190 msgr2=0x7f196c159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:57.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f1971da1640 1 --2- 172.21.15.29:0/2666646656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c153190 0x7f196c159810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1960009870 tx=0x7f196001ed50 comp rx=0 tx=0).stop 2024-04-23T10:15:57.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f1971da1640 1 -- 172.21.15.29:0/2666646656 shutdown_connections 2024-04-23T10:15:57.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f1971da1640 1 --2- 172.21.15.29:0/2666646656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c06f150 0x7f196c06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f1971da1640 1 --2- 172.21.15.29:0/2666646656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c153190 0x7f196c159810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f1971da1640 1 -- 172.21.15.29:0/2666646656 >> 172.21.15.29:0/2666646656 conn(0x7f196c06cfb0 msgr2=0x7f196c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:57.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f1971da1640 1 -- 172.21.15.29:0/2666646656 shutdown_connections 2024-04-23T10:15:57.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.435+0000 7f1971da1640 1 -- 172.21.15.29:0/2666646656 wait complete. 2024-04-23T10:15:57.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 Processor -- start 2024-04-23T10:15:57.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 -- start start 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c06f150 0x7f196c1f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c0ccc50 0x7f196c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c153190 0x7f196c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f196c0c4880 con 0x7f196c0ccc50 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f196c153570 con 0x7f196c06f150 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f196c0c9070 con 0x7f196c153190 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c0ccc50 0x7f196c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c0ccc50 0x7f196c151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59010/0 (socket says 172.21.15.29:59010) 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 -- 172.21.15.29:0/2953926881 learned_addr learned my addr 172.21.15.29:0/2953926881 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196b7fe640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c06f150 0x7f196c1f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:57.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 -- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c153190 msgr2=0x7f196c15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196bfff640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c153190 0x7f196c15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c153190 0x7f196c15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 -- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c06f150 msgr2=0x7f196c1f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c06f150 0x7f196c1f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 -- 172.21.15.29:0/2953926881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c0cc9c0 con 0x7f196c0ccc50 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196b7fe640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c06f150 0x7f196c1f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f196affd640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c0ccc50 0x7f196c151450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f195c00d830 tx=0x7f195c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1953fff640 1 -- 172.21.15.29:0/2953926881 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c00b6c0 con 0x7f196c0ccc50 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1953fff640 1 -- 172.21.15.29:0/2953926881 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c019070 con 0x7f196c0ccc50 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196c1f1160 con 0x7f196c0ccc50 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1953fff640 1 -- 172.21.15.29:0/2953926881 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c00ba60 con 0x7f196c0ccc50 2024-04-23T10:15:57.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f196c150df0 con 0x7f196c0ccc50 2024-04-23T10:15:57.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f196c068d70 con 0x7f196c0ccc50 2024-04-23T10:15:57.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.439+0000 7f1953fff640 1 -- 172.21.15.29:0/2953926881 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f195c01e460 con 0x7f196c0ccc50 2024-04-23T10:15:57.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.443+0000 7f1953fff640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1958068380 0x7f195806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:57.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.443+0000 7f1953fff640 1 -- 172.21.15.29:0/2953926881 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f195c087450 con 0x7f196c0ccc50 2024-04-23T10:15:57.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.443+0000 7f196b7fe640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1958068380 0x7f195806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:57.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.443+0000 7f196b7fe640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1958068380 0x7f195806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19600b2000 tx=0x7f19600aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:57.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.447+0000 7f1953fff640 1 -- 172.21.15.29:0/2953926881 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f196c1f1160 con 0x7f196c0ccc50 2024-04-23T10:15:57.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:57.643+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f196c1f4c50 con 0x7f196c0ccc50 2024-04-23T10:15:58.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.279+0000 7f1953fff640 1 -- 172.21.15.29:0/2953926881 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f195c057640 con 0x7f196c0ccc50 2024-04-23T10:15:58.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1958068380 msgr2=0x7f195806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:58.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1958068380 0x7f195806a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19600b2000 tx=0x7f19600aa070 comp rx=0 tx=0).stop 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c0ccc50 msgr2=0x7f196c151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c0ccc50 0x7f196c151450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f195c00d830 tx=0x7f195c00dcf0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 shutdown_connections 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1958068380 0x7f195806a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f196c153190 0x7f196c15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f196c0ccc50 0x7f196c151450 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 --2- 172.21.15.29:0/2953926881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f196c06f150 0x7f196c1f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 >> 172.21.15.29:0/2953926881 conn(0x7f196c06cfb0 msgr2=0x7f196c159810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 shutdown_connections 2024-04-23T10:15:58.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.283+0000 7f1971da1640 1 -- 172.21.15.29:0/2953926881 wait complete. 2024-04-23T10:15:58.308 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-23T10:15:58.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.435+0000 7fd604b25640 1 Processor -- start 2024-04-23T10:15:58.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd604b25640 1 -- start start 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd604b25640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd60006f150 0x7fd60006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd604b25640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6000ccc50 0x7fd6000cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd604b25640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6000cd5a0 con 0x7fd600153190 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd604b25640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd600159f20 con 0x7fd6000ccc50 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd604b25640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd600159380 con 0x7fd60006f150 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd5fed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6000ccc50 0x7fd6000cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd5fed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6000ccc50 0x7fd6000cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59014/0 (socket says 172.21.15.29:59014) 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd5fed9d640 1 -- 172.21.15.29:0/3196164754 learned_addr learned my addr 172.21.15.29:0/3196164754 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd5fdd9b640 1 --2- 172.21.15.29:0/3196164754 >> v2:172.21.15.72:3300/0 conn(0x7fd60006f150 0x7fd60006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd5fed9d640 1 -- 172.21.15.29:0/3196164754 >> v2:172.21.15.72:3300/0 conn(0x7fd60006f150 msgr2=0x7fd60006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd5fed9d640 1 --2- 172.21.15.29:0/3196164754 >> v2:172.21.15.72:3300/0 conn(0x7fd60006f150 0x7fd60006f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd5fed9d640 1 -- 172.21.15.29:0/3196164754 >> v1:172.21.15.72:6789/0 conn(0x7fd600153190 legacy=0x7fd600159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:58.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.439+0000 7fd5fed9d640 1 -- 172.21.15.29:0/3196164754 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6000c3fe0 con 0x7fd6000ccc50 2024-04-23T10:15:58.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd5fed9d640 1 --2- 172.21.15.29:0/3196164754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6000ccc50 0x7fd6000cd060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd600159500 tx=0x7fd5f801f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6988b06d74324a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:58.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd5fd59a640 1 -- 172.21.15.29:0/3196164754 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80b4070 con 0x7fd6000ccc50 2024-04-23T10:15:58.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd5fd59a640 1 -- 172.21.15.29:0/3196164754 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f80af400 con 0x7fd6000ccc50 2024-04-23T10:15:58.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd5fd59a640 1 -- 172.21.15.29:0/3196164754 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80af7d0 con 0x7fd6000ccc50 2024-04-23T10:15:58.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 -- 172.21.15.29:0/3196164754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6000ccc50 msgr2=0x7fd6000cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:58.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 --2- 172.21.15.29:0/3196164754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6000ccc50 0x7fd6000cd060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd600159500 tx=0x7fd5f801f1a0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 -- 172.21.15.29:0/3196164754 shutdown_connections 2024-04-23T10:15:58.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 --2- 172.21.15.29:0/3196164754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6000ccc50 0x7fd6000cd060 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 --2- 172.21.15.29:0/3196164754 >> v2:172.21.15.72:3300/0 conn(0x7fd60006f150 0x7fd60006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 -- 172.21.15.29:0/3196164754 >> 172.21.15.29:0/3196164754 conn(0x7fd60006cfb0 msgr2=0x7fd60006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:58.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 -- 172.21.15.29:0/3196164754 shutdown_connections 2024-04-23T10:15:58.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 -- 172.21.15.29:0/3196164754 wait complete. 2024-04-23T10:15:58.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 Processor -- start 2024-04-23T10:15:58.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.443+0000 7fd604b25640 1 -- start start 2024-04-23T10:15:58.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd60006f150 0x7fd6001466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:58.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6000ccc50 0x7fd6001578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:58.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd600153190 0x7fd600157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:58.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd600159010 con 0x7fd60006f150 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd6000c45a0 con 0x7fd600153190 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd600153570 con 0x7fd6000ccc50 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd60006f150 0x7fd6001466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd60006f150 0x7fd6001466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59022/0 (socket says 172.21.15.29:59022) 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 -- 172.21.15.29:0/3151997372 learned_addr learned my addr 172.21.15.29:0/3151997372 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fed9d640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd600153190 0x7fd600157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fdd9b640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6000ccc50 0x7fd6001578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 -- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6000ccc50 msgr2=0x7fd6001578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6000ccc50 0x7fd6001578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 -- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd600153190 msgr2=0x7fd600157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd600153190 0x7fd600157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 -- 172.21.15.29:0/3151997372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd600146c20 con 0x7fd60006f150 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fed9d640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd600153190 0x7fd600157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fe59c640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd60006f150 0x7fd6001466e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c450 tx=0x7fd5f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:58.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5eeffd640 1 -- 172.21.15.29:0/3151997372 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0012830 con 0x7fd60006f150 2024-04-23T10:15:58.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5eeffd640 1 -- 172.21.15.29:0/3151997372 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0017070 con 0x7fd60006f150 2024-04-23T10:15:58.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd600158450 con 0x7fd60006f150 2024-04-23T10:15:58.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5eeffd640 1 -- 172.21.15.29:0/3151997372 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0012c30 con 0x7fd60006f150 2024-04-23T10:15:58.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd600158710 con 0x7fd60006f150 2024-04-23T10:15:58.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd600068d70 con 0x7fd60006f150 2024-04-23T10:15:58.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5eeffd640 1 -- 172.21.15.29:0/3151997372 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd5f001c460 con 0x7fd60006f150 2024-04-23T10:15:58.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5eeffd640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd5e0068380 0x7fd5e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:58.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5eeffd640 1 -- 172.21.15.29:0/3151997372 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd5f0086b80 con 0x7fd60006f150 2024-04-23T10:15:58.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.447+0000 7fd5fdd9b640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd5e0068380 0x7fd5e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:58.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.451+0000 7fd5fdd9b640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd5e0068380 0x7fd5e006a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40096f0 tx=0x7fd5f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:58.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.455+0000 7fd5eeffd640 1 -- 172.21.15.29:0/3151997372 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd5f0056d60 con 0x7fd60006f150 2024-04-23T10:15:58.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:58.651+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd60014eed0 con 0x7fd60006f150 2024-04-23T10:15:59.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.295+0000 7fd5eeffd640 1 -- 172.21.15.29:0/3151997372 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fd5f0056660 con 0x7fd60006f150 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd5e0068380 msgr2=0x7fd5e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd5e0068380 0x7fd5e006a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40096f0 tx=0x7fd5f4008040 comp rx=0 tx=0).stop 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd60006f150 msgr2=0x7fd6001466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd60006f150 0x7fd6001466e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000c450 tx=0x7fd5f000c910 comp rx=0 tx=0).stop 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 shutdown_connections 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd5e0068380 0x7fd5e006a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd600153190 0x7fd600157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6000ccc50 0x7fd6001578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 --2- 172.21.15.29:0/3151997372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd60006f150 0x7fd6001466e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 >> 172.21.15.29:0/3151997372 conn(0x7fd60006cfb0 msgr2=0x7fd6001e5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 shutdown_connections 2024-04-23T10:15:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.299+0000 7fd604b25640 1 -- 172.21.15.29:0/3151997372 wait complete. 2024-04-23T10:15:59.320 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-23T10:15:59.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff97a40640 1 Processor -- start 2024-04-23T10:15:59.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff97a40640 1 -- start start 2024-04-23T10:15:59.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff97a40640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff90073a50 0x7eff9013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff97a40640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff9013ed80 0x7eff9013bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff97a40640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff900ccc00 con 0x7eff90073e30 2024-04-23T10:15:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff97a40640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7eff900cda60 con 0x7eff90073a50 2024-04-23T10:15:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff97a40640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7eff900ccee0 con 0x7eff9013ed80 2024-04-23T10:15:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff94fdb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7eff90073e30 0x7eff9013e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35012/0 (socket says 172.21.15.29:35012) 2024-04-23T10:15:59.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff94fdb640 1 -- 172.21.15.29:0/824420293 learned_addr learned my addr 172.21.15.29:0/824420293 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff95fdd640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff9013ed80 0x7eff9013bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff957dc640 1 --2- 172.21.15.29:0/824420293 >> v2:172.21.15.72:3300/0 conn(0x7eff90073a50 0x7eff9013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024640447 0 0) 0x7eff900ccc00 con 0x7eff90073e30 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff7c003530 con 0x7eff90073e30 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2896193365 0 0) 0x7eff7c003530 con 0x7eff90073e30 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff9013ed80 msgr2=0x7eff9013bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff9013ed80 0x7eff9013bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 >> v2:172.21.15.72:3300/0 conn(0x7eff90073a50 msgr2=0x7eff9013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 --2- 172.21.15.29:0/824420293 >> v2:172.21.15.72:3300/0 conn(0x7eff90073a50 0x7eff9013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff900cd1c0 con 0x7eff90073e30 2024-04-23T10:15:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7eff80001680 con 0x7eff90073e30 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 >> v1:172.21.15.29:6789/0 conn(0x7eff90073e30 legacy=0x7eff9013e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff7c0039c0 0x7eff7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff9013ed80 0x7eff7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff7c004d50 0x7eff7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7eff900cda60 con 0x7eff7c0039c0 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff900ccee0 con 0x7eff7c004d50 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7eff7c00b9d0 con 0x7eff9013ed80 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff957dc640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff7c0039c0 0x7eff7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff94fdb640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff9013ed80 0x7eff7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff95fdd640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff7c004d50 0x7eff7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff957dc640 1 -- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff9013ed80 msgr2=0x7eff7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff957dc640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff9013ed80 0x7eff7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff957dc640 1 -- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff7c004d50 msgr2=0x7eff7c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff957dc640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff7c004d50 0x7eff7c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff957dc640 1 -- 172.21.15.29:0/824420293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c003530 con 0x7eff7c0039c0 2024-04-23T10:15:59.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.455+0000 7eff95fdd640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff7c004d50 0x7eff7c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff957dc640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff7c0039c0 0x7eff7c003de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009fc0 tx=0x7eff8c01cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3e3db90f9744e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0b2070 con 0x7eff7c0039c0 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8c0a5b90 con 0x7eff7c0039c0 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff87fff640 1 -- 172.21.15.29:0/824420293 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c009c10 con 0x7eff7c0039c0 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff97a40640 1 -- 172.21.15.29:0/824420293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff7c0039c0 msgr2=0x7eff7c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff97a40640 1 --2- 172.21.15.29:0/824420293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff7c0039c0 0x7eff7c003de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009fc0 tx=0x7eff8c01cc90 comp rx=0 tx=0).stop 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff95fdd640 1 -- 172.21.15.29:0/824420293 reap_dead start 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff97a40640 1 -- 172.21.15.29:0/824420293 shutdown_connections 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff97a40640 1 -- 172.21.15.29:0/824420293 >> 172.21.15.29:0/824420293 conn(0x7eff90074d60 msgr2=0x7eff90075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff97a40640 1 -- 172.21.15.29:0/824420293 shutdown_connections 2024-04-23T10:15:59.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff97a40640 1 -- 172.21.15.29:0/824420293 wait complete. 2024-04-23T10:15:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff97a40640 1 Processor -- start 2024-04-23T10:15:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.459+0000 7eff97a40640 1 -- start start 2024-04-23T10:15:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff7c0039c0 0x7eff90138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff90135060 0x7eff900c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff901f1fe0 0x7eff901f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7eff900c6f30 con 0x7eff901f1fe0 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff900c6db0 con 0x7eff90135060 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7eff900c70b0 con 0x7eff7c0039c0 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff901f1fe0 0x7eff901f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff901f1fe0 0x7eff901f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59032/0 (socket says 172.21.15.29:59032) 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 -- 172.21.15.29:0/1155161931 learned_addr learned my addr 172.21.15.29:0/1155161931 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff957dc640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff7c0039c0 0x7eff90138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff94fdb640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff90135060 0x7eff900c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 -- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff7c0039c0 msgr2=0x7eff90138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff7c0039c0 0x7eff90138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 -- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff90135060 msgr2=0x7eff900c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff90135060 0x7eff900c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 -- 172.21.15.29:0/1155161931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff90133490 con 0x7eff901f1fe0 2024-04-23T10:15:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff95fdd640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff901f1fe0 0x7eff901f2460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff900c5ea0 tx=0x7eff88010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff85ffb640 1 -- 172.21.15.29:0/1155161931 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8800f040 con 0x7eff901f1fe0 2024-04-23T10:15:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff85ffb640 1 -- 172.21.15.29:0/1155161931 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff88004020 con 0x7eff901f1fe0 2024-04-23T10:15:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff901f1840 con 0x7eff901f1fe0 2024-04-23T10:15:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff85ffb640 1 -- 172.21.15.29:0/1155161931 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff880043f0 con 0x7eff901f1fe0 2024-04-23T10:15:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff900c9060 con 0x7eff901f1fe0 2024-04-23T10:15:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff90068d70 con 0x7eff901f1fe0 2024-04-23T10:15:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff85ffb640 1 -- 172.21.15.29:0/1155161931 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff8801e030 con 0x7eff901f1fe0 2024-04-23T10:15:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff85ffb640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff74068380 0x7eff7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff85ffb640 1 -- 172.21.15.29:0/1155161931 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7eff88086080 con 0x7eff901f1fe0 2024-04-23T10:15:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.463+0000 7eff957dc640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff74068380 0x7eff7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.467+0000 7eff957dc640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff74068380 0x7eff7406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0af000 tx=0x7eff8c0a7040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:59.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.467+0000 7eff85ffb640 1 -- 172.21.15.29:0/1155161931 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff88025060 con 0x7eff901f1fe0 2024-04-23T10:15:59.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:15:59.667+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7eff90142220 con 0x7eff901f1fe0 2024-04-23T10:16:00.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.303+0000 7eff85ffb640 1 -- 172.21.15.29:0/1155161931 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7eff901f1840 con 0x7eff901f1fe0 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff74068380 msgr2=0x7eff7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff74068380 0x7eff7406a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0af000 tx=0x7eff8c0a7040 comp rx=0 tx=0).stop 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff901f1fe0 msgr2=0x7eff901f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff901f1fe0 0x7eff901f2460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff900c5ea0 tx=0x7eff88010c20 comp rx=0 tx=0).stop 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 shutdown_connections 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff74068380 0x7eff7406a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff901f1fe0 0x7eff901f2460 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff90135060 0x7eff900c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 --2- 172.21.15.29:0/1155161931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff7c0039c0 0x7eff90138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 >> 172.21.15.29:0/1155161931 conn(0x7eff90074d60 msgr2=0x7eff9006ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 shutdown_connections 2024-04-23T10:16:00.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.307+0000 7eff97a40640 1 -- 172.21.15.29:0/1155161931 wait complete. 2024-04-23T10:16:00.326 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-23T10:16:00.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.447+0000 7f28b63ae640 1 Processor -- start 2024-04-23T10:16:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.447+0000 7f28b63ae640 1 -- start start 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28b63ae640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28b0153070 0x7f28b015cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28b63ae640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b0153450 0x7f28b0070100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28b63ae640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b0159510 con 0x7f28b006fa60 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28b63ae640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f28b01597f0 con 0x7f28b0153070 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28b63ae640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f28b0159ad0 con 0x7f28b0153450 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28affff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28b0153070 0x7f28b015cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28affff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28b0153070 0x7f28b015cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59042/0 (socket says 172.21.15.29:59042) 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28affff640 1 -- 172.21.15.29:0/1433878387 learned_addr learned my addr 172.21.15.29:0/1433878387 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28a7fff640 1 --2- 172.21.15.29:0/1433878387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b0153450 0x7f28b0070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28affff640 1 -- 172.21.15.29:0/1433878387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b0153450 msgr2=0x7f28b0070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28affff640 1 --2- 172.21.15.29:0/1433878387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b0153450 0x7f28b0070100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28affff640 1 -- 172.21.15.29:0/1433878387 >> v1:172.21.15.72:6789/0 conn(0x7f28b006fa60 legacy=0x7f28b00c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28affff640 1 -- 172.21.15.29:0/1433878387 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b015c5f0 con 0x7f28b0153070 2024-04-23T10:16:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28affff640 1 --2- 172.21.15.29:0/1433878387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b015cdf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009870 tx=0x7f28a001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d470ca012008a0d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28af7fe640 1 -- 172.21.15.29:0/1433878387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a00b5070 con 0x7f28b0153070 2024-04-23T10:16:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28af7fe640 1 -- 172.21.15.29:0/1433878387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a00a8a50 con 0x7f28b0153070 2024-04-23T10:16:00.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.451+0000 7f28af7fe640 1 -- 172.21.15.29:0/1433878387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a00a8e20 con 0x7f28b0153070 2024-04-23T10:16:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- 172.21.15.29:0/1433878387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 msgr2=0x7f28b015cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 --2- 172.21.15.29:0/1433878387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b015cdf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009870 tx=0x7f28a001ed50 comp rx=0 tx=0).stop 2024-04-23T10:16:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- 172.21.15.29:0/1433878387 shutdown_connections 2024-04-23T10:16:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 --2- 172.21.15.29:0/1433878387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b0153450 0x7f28b0070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 --2- 172.21.15.29:0/1433878387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b015cdf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- 172.21.15.29:0/1433878387 >> 172.21.15.29:0/1433878387 conn(0x7f28b006b9e0 msgr2=0x7f28b006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- 172.21.15.29:0/1433878387 shutdown_connections 2024-04-23T10:16:00.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- 172.21.15.29:0/1433878387 wait complete. 2024-04-23T10:16:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 Processor -- start 2024-04-23T10:16:00.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- start start 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b006fa60 0x7f28b00cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b01f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28b0153450 0x7f28b0073e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0070640 con 0x7f28b0153070 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f28b015d330 con 0x7f28b0153450 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f28b0159db0 con 0x7f28b006fa60 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b01f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b01f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59052/0 (socket says 172.21.15.29:59052) 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 -- 172.21.15.29:0/2333066821 learned_addr learned my addr 172.21.15.29:0/2333066821 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b494b640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28b0153450 0x7f28b0073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28affff640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b006fa60 0x7f28b00cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 -- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b006fa60 msgr2=0x7f28b00cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b006fa60 0x7f28b00cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 -- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28b0153450 msgr2=0x7f28b0073e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28b0153450 0x7f28b0073e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 -- 172.21.15.29:0/2333066821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b0073600 con 0x7f28b0153070 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28affff640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b006fa60 0x7f28b00cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28a7fff640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b01f0b70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f289800d5f0 tx=0x7f289800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28ad7fa640 1 -- 172.21.15.29:0/2333066821 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28980125f0 con 0x7f28b0153070 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28ad7fa640 1 -- 172.21.15.29:0/2333066821 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2898019070 con 0x7f28b0153070 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b01f4c20 con 0x7f28b0153070 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28ad7fa640 1 -- 172.21.15.29:0/2333066821 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28980129d0 con 0x7f28b0153070 2024-04-23T10:16:00.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.455+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b014d050 con 0x7f28b0153070 2024-04-23T10:16:00.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.459+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b00693c0 con 0x7f28b0153070 2024-04-23T10:16:00.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.459+0000 7f28ad7fa640 1 -- 172.21.15.29:0/2333066821 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2898012b70 con 0x7f28b0153070 2024-04-23T10:16:00.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.459+0000 7f28ad7fa640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2890068380 0x7f289006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.459+0000 7f28ad7fa640 1 -- 172.21.15.29:0/2333066821 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2898087c60 con 0x7f28b0153070 2024-04-23T10:16:00.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.459+0000 7f28affff640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2890068380 0x7f289006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.459+0000 7f28affff640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2890068380 0x7f289006a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28a00b2000 tx=0x7f28a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:00.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.463+0000 7f28ad7fa640 1 -- 172.21.15.29:0/2333066821 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2898057ec0 con 0x7f28b0153070 2024-04-23T10:16:00.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.683+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28b00c53a0 con 0x7f28b0153070 2024-04-23T10:16:00.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28ad7fa640 1 -- 172.21.15.29:0/2333066821 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6832 (secure 0 0 0) 0x7f28980577c0 con 0x7f28b0153070 2024-04-23T10:16:00.686 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:00.686 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4212,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:15:59.672753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4288,"mds_1":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-23T10:16:00.686 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 11 2024-04-23T10:16:00.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2890068380 msgr2=0x7f289006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2890068380 0x7f289006a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28a00b2000 tx=0x7f28a0008040 comp rx=0 tx=0).stop 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 msgr2=0x7f28b01f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b01f0b70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f289800d5f0 tx=0x7f289800dab0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 shutdown_connections 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2890068380 0x7f289006a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28b0153450 0x7f28b0073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28b0153070 0x7f28b01f0b70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 --2- 172.21.15.29:0/2333066821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28b006fa60 0x7f28b00cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 >> 172.21.15.29:0/2333066821 conn(0x7f28b006b9e0 msgr2=0x7f28b006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 shutdown_connections 2024-04-23T10:16:00.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.687+0000 7f28b63ae640 1 -- 172.21.15.29:0/2333066821 wait complete. 2024-04-23T10:16:00.704 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:00.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f57758fb640 1 Processor -- start 2024-04-23T10:16:00.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f57758fb640 1 -- start start 2024-04-23T10:16:00.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f57758fb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5770159840 0x7f5770072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f57758fb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f57700c3470 0x7f577006f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f57758fb640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5770071400 con 0x7f57700c70c0 2024-04-23T10:16:00.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f57758fb640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5770160030 con 0x7f5770159840 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f57758fb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f57701604c0 con 0x7f57700c3470 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f576effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5770159840 0x7f5770072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f576e7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f57700c70c0 0x7f5770162b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35026/0 (socket says 172.21.15.29:35026) 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f576e7fc640 1 -- 172.21.15.29:0/2546004115 learned_addr learned my addr 172.21.15.29:0/2546004115 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f576f7fe640 1 --2- 172.21.15.29:0/2546004115 >> v2:172.21.15.72:3300/0 conn(0x7f57700c3470 0x7f577006f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f576effd640 1 -- 172.21.15.29:0/2546004115 >> v2:172.21.15.72:3300/0 conn(0x7f57700c3470 msgr2=0x7f577006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f576effd640 1 --2- 172.21.15.29:0/2546004115 >> v2:172.21.15.72:3300/0 conn(0x7f57700c3470 0x7f577006f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f576effd640 1 -- 172.21.15.29:0/2546004115 >> v1:172.21.15.29:6789/0 conn(0x7f57700c70c0 legacy=0x7f5770162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.823+0000 7f576effd640 1 -- 172.21.15.29:0/2546004115 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57700c7890 con 0x7f5770159840 2024-04-23T10:16:00.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576effd640 1 --2- 172.21.15.29:0/2546004115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770072550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f577006c860 tx=0x7f576001c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63f5dae9b442812 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:00.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576dffb640 1 -- 172.21.15.29:0/2546004115 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57600b0070 con 0x7f5770159840 2024-04-23T10:16:00.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576dffb640 1 -- 172.21.15.29:0/2546004115 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57600ab600 con 0x7f5770159840 2024-04-23T10:16:00.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576dffb640 1 -- 172.21.15.29:0/2546004115 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57600ab9d0 con 0x7f5770159840 2024-04-23T10:16:00.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- 172.21.15.29:0/2546004115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 msgr2=0x7f5770072550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 --2- 172.21.15.29:0/2546004115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770072550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f577006c860 tx=0x7f576001c280 comp rx=0 tx=0).stop 2024-04-23T10:16:00.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- 172.21.15.29:0/2546004115 shutdown_connections 2024-04-23T10:16:00.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 --2- 172.21.15.29:0/2546004115 >> v2:172.21.15.72:3300/0 conn(0x7f57700c3470 0x7f577006f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 --2- 172.21.15.29:0/2546004115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770072550 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- 172.21.15.29:0/2546004115 >> 172.21.15.29:0/2546004115 conn(0x7f577006cfb0 msgr2=0x7f577006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:00.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- 172.21.15.29:0/2546004115 shutdown_connections 2024-04-23T10:16:00.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- 172.21.15.29:0/2546004115 wait complete. 2024-04-23T10:16:00.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 Processor -- start 2024-04-23T10:16:00.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- start start 2024-04-23T10:16:00.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57700c3470 0x7f577014d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57700c70c0 0x7f577014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f577015f9e0 con 0x7f5770159840 2024-04-23T10:16:00.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f577015f700 con 0x7f57700c3470 2024-04-23T10:16:00.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f57758fb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f577015fcc0 con 0x7f57700c70c0 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59058/0 (socket says 172.21.15.29:59058) 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576f7fe640 1 -- 172.21.15.29:0/2556070490 learned_addr learned my addr 172.21.15.29:0/2556070490 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576effd640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57700c3470 0x7f577014d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.827+0000 7f576e7fc640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57700c70c0 0x7f577014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f576f7fe640 1 -- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57700c70c0 msgr2=0x7f577014df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f576f7fe640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57700c70c0 0x7f577014df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f576f7fe640 1 -- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57700c3470 msgr2=0x7f577014d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f576f7fe640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57700c3470 0x7f577014d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f576f7fe640 1 -- 172.21.15.29:0/2556070490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57701f5580 con 0x7f5770159840 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f576f7fe640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770152a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5768007e40 tx=0x7f576800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f5757fff640 1 -- 172.21.15.29:0/2556070490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768014620 con 0x7f5770159840 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f5757fff640 1 -- 172.21.15.29:0/2556070490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5768019070 con 0x7f5770159840 2024-04-23T10:16:00.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57701f6400 con 0x7f5770159840 2024-04-23T10:16:00.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f5757fff640 1 -- 172.21.15.29:0/2556070490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768014a20 con 0x7f5770159840 2024-04-23T10:16:00.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57701f5ad0 con 0x7f5770159840 2024-04-23T10:16:00.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5770068d70 con 0x7f5770159840 2024-04-23T10:16:00.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f5757fff640 1 -- 172.21.15.29:0/2556070490 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5768014bc0 con 0x7f5770159840 2024-04-23T10:16:00.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f5757fff640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f575c068380 0x7f575c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:00.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f5757fff640 1 -- 172.21.15.29:0/2556070490 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5768087600 con 0x7f5770159840 2024-04-23T10:16:00.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f576effd640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f575c068380 0x7f575c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:00.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.831+0000 7f576effd640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f575c068380 0x7f575c06a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57600ad000 tx=0x7f57600a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:00.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.835+0000 7f5757fff640 1 -- 172.21.15.29:0/2556070490 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57680577f0 con 0x7f5770159840 2024-04-23T10:16:01.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:00.999+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f577014d720 con 0x7f5770159840 2024-04-23T10:16:01.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f5757fff640 1 -- 172.21.15.29:0/2556070490 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f57680570f0 con 0x7f5770159840 2024-04-23T10:16:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:01.003 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f575c068380 msgr2=0x7f575c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f575c068380 0x7f575c06a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57600ad000 tx=0x7f57600a6000 comp rx=0 tx=0).stop 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 msgr2=0x7f5770152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770152a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5768007e40 tx=0x7f576800e4b0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 shutdown_connections 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f575c068380 0x7f575c06a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5770159840 0x7f5770152a00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57700c70c0 0x7f577014df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 --2- 172.21.15.29:0/2556070490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57700c3470 0x7f577014d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 >> 172.21.15.29:0/2556070490 conn(0x7f577006cfb0 msgr2=0x7f57700c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:01.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 shutdown_connections 2024-04-23T10:16:01.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.003+0000 7f57758fb640 1 -- 172.21.15.29:0/2556070490 wait complete. 2024-04-23T10:16:01.022 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-23T10:16:01.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:16:01.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb23df640 1 Processor -- start 2024-04-23T10:16:01.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb23df640 1 -- start start 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb23df640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac15bd80 0x7fafac0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb23df640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fafac0cbcb0 0x7fafac0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb23df640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafac06c910 con 0x7fafac151bb0 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb23df640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fafac06cbf0 con 0x7fafac0cbcb0 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb23df640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fafac06ced0 con 0x7fafac15bd80 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb097c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fafac0cbcb0 0x7fafac0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb097c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fafac0cbcb0 0x7fafac0c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59066/0 (socket says 172.21.15.29:59066) 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb097c640 1 -- 172.21.15.29:0/2820200714 learned_addr learned my addr 172.21.15.29:0/2820200714 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:01.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafab7fe640 1 --2- 172.21.15.29:0/2820200714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac15bd80 0x7fafac0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb097c640 1 -- 172.21.15.29:0/2820200714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac15bd80 msgr2=0x7fafac0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb097c640 1 --2- 172.21.15.29:0/2820200714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac15bd80 0x7fafac0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.143+0000 7fafb097c640 1 -- 172.21.15.29:0/2820200714 >> v1:172.21.15.72:6789/0 conn(0x7fafac151bb0 legacy=0x7fafac0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb097c640 1 -- 172.21.15.29:0/2820200714 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac06d1b0 con 0x7fafac0cbcb0 2024-04-23T10:16:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafab7fe640 1 --2- 172.21.15.29:0/2820200714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac15bd80 0x7fafac0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:01.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb097c640 1 --2- 172.21.15.29:0/2820200714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac0cbcb0 0x7fafac0c6840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009870 tx=0x7fafa401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e03801ad79f438 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafaaffd640 1 -- 172.21.15.29:0/2820200714 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40b5070 con 0x7fafac0cbcb0 2024-04-23T10:16:01.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafaaffd640 1 -- 172.21.15.29:0/2820200714 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa40a89d0 con 0x7fafac0cbcb0 2024-04-23T10:16:01.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafaaffd640 1 -- 172.21.15.29:0/2820200714 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40a8da0 con 0x7fafac0cbcb0 2024-04-23T10:16:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 -- 172.21.15.29:0/2820200714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac0cbcb0 msgr2=0x7fafac0c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 --2- 172.21.15.29:0/2820200714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac0cbcb0 0x7fafac0c6840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009870 tx=0x7fafa401ed10 comp rx=0 tx=0).stop 2024-04-23T10:16:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 -- 172.21.15.29:0/2820200714 shutdown_connections 2024-04-23T10:16:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 --2- 172.21.15.29:0/2820200714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac0cbcb0 0x7fafac0c6840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 --2- 172.21.15.29:0/2820200714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac15bd80 0x7fafac0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 -- 172.21.15.29:0/2820200714 >> 172.21.15.29:0/2820200714 conn(0x7fafac0730f0 msgr2=0x7fafac073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 -- 172.21.15.29:0/2820200714 shutdown_connections 2024-04-23T10:16:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 -- 172.21.15.29:0/2820200714 wait complete. 2024-04-23T10:16:01.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.147+0000 7fafb23df640 1 Processor -- start 2024-04-23T10:16:01.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 -- start start 2024-04-23T10:16:01.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac0cbcb0 0x7fafac0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac151bb0 0x7fafac1f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafac15bd80 0x7fafac15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fafac0c6010 con 0x7fafac151bb0 2024-04-23T10:16:01.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fafac151f90 con 0x7fafac15bd80 2024-04-23T10:16:01.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fafac0c6190 con 0x7fafac0cbcb0 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac151bb0 0x7fafac1f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac151bb0 0x7fafac1f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59078/0 (socket says 172.21.15.29:59078) 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 -- 172.21.15.29:0/1241585376 learned_addr learned my addr 172.21.15.29:0/1241585376 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 -- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac0cbcb0 msgr2=0x7fafac0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac0cbcb0 0x7fafac0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 -- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafac15bd80 msgr2=0x7fafac15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafac15bd80 0x7fafac15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 -- 172.21.15.29:0/1241585376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac0b64d0 con 0x7fafac151bb0 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafab7fe640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac151bb0 0x7fafac1f4c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c7f0 tx=0x7faf9400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafa8ff9640 1 -- 172.21.15.29:0/1241585376 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94015070 con 0x7fafac151bb0 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafa8ff9640 1 -- 172.21.15.29:0/1241585376 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf94007820 con 0x7fafac151bb0 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafac0b67b0 con 0x7fafac151bb0 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafa8ff9640 1 -- 172.21.15.29:0/1241585376 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94007c10 con 0x7fafac151bb0 2024-04-23T10:16:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafac1f4160 con 0x7fafac151bb0 2024-04-23T10:16:01.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafac068d70 con 0x7fafac151bb0 2024-04-23T10:16:01.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafa8ff9640 1 -- 172.21.15.29:0/1241585376 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faf94018070 con 0x7fafac151bb0 2024-04-23T10:16:01.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafa8ff9640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faf8c068380 0x7faf8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafa8ff9640 1 -- 172.21.15.29:0/1241585376 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faf94086d10 con 0x7fafac151bb0 2024-04-23T10:16:01.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.151+0000 7fafabfff640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faf8c068380 0x7faf8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.155+0000 7fafabfff640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faf8c068380 0x7faf8c06a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf9c007fd0 tx=0x7faf9c007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.155+0000 7fafa8ff9640 1 -- 172.21.15.29:0/1241585376 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faf94056f00 con 0x7fafac151bb0 2024-04-23T10:16:01.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.315+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafac0cb940 con 0x7faf8c068380 2024-04-23T10:16:01.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.343+0000 7fafa8ff9640 1 -- 172.21.15.29:0/1241585376 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7fafac0cb940 con 0x7faf8c068380 2024-04-23T10:16:01.345 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:01.347 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:16:01.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faf8c068380 msgr2=0x7faf8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faf8c068380 0x7faf8c06a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf9c007fd0 tx=0x7faf9c007d40 comp rx=0 tx=0).stop 2024-04-23T10:16:01.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac151bb0 msgr2=0x7fafac1f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac151bb0 0x7fafac1f4c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c7f0 tx=0x7faf9400ccb0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 shutdown_connections 2024-04-23T10:16:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7faf8c068380 0x7faf8c06a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafac15bd80 0x7fafac15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafac151bb0 0x7fafac1f4c40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 --2- 172.21.15.29:0/1241585376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fafac0cbcb0 0x7fafac0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 >> 172.21.15.29:0/1241585376 conn(0x7fafac0730f0 msgr2=0x7fafac0ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 shutdown_connections 2024-04-23T10:16:01.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.347+0000 7fafb23df640 1 -- 172.21.15.29:0/1241585376 wait complete. 2024-04-23T10:16:01.363 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-23T10:16:01.197162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236020,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738700,"statfs":{"total":773094113280,"available":772852428800,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004806"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180971+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:15:43.180971+0000","last_peered":"2024-04-23T10:15:43.180971+0000","last_clean":"2024-04-23T10:15:43.180971+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:15:43.180971+0000","last_undegraded":"2024-04-23T10:15:43.180971+0000","last_fullsized":"2024-04-23T10:15:43.180971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186172+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:15:43.186172+0000","last_peered":"2024-04-23T10:15:43.186172+0000","last_clean":"2024-04-23T10:15:43.186172+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:15:43.186172+0000","last_undegraded":"2024-04-23T10:15:43.186172+0000","last_fullsized":"2024-04-23T10:15:43.186172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185322+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:15:43.185322+0000","last_peered":"2024-04-23T10:15:43.185322+0000","last_clean":"2024-04-23T10:15:43.185322+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:15:43.185322+0000","last_undegraded":"2024-04-23T10:15:43.185322+0000","last_fullsized":"2024-04-23T10:15:43.185322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186331+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:15:43.186331+0000","last_peered":"2024-04-23T10:15:43.186331+0000","last_clean":"2024-04-23T10:15:43.186331+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:15:43.186331+0000","last_undegraded":"2024-04-23T10:15:43.186331+0000","last_fullsized":"2024-04-23T10:15:43.186331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180764+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:15:43.180764+0000","last_peered":"2024-04-23T10:15:43.180764+0000","last_clean":"2024-04-23T10:15:43.180764+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:15:43.180764+0000","last_undegraded":"2024-04-23T10:15:43.180764+0000","last_fullsized":"2024-04-23T10:15:43.180764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181921+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:15:43.181921+0000","last_peered":"2024-04-23T10:15:43.181921+0000","last_clean":"2024-04-23T10:15:43.181921+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:15:43.181921+0000","last_undegraded":"2024-04-23T10:15:43.181921+0000","last_fullsized":"2024-04-23T10:15:43.181921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183360+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:15:43.183360+0000","last_peered":"2024-04-23T10:15:43.183360+0000","last_clean":"2024-04-23T10:15:43.183360+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:15:43.183360+0000","last_undegraded":"2024-04-23T10:15:43.183360+0000","last_fullsized":"2024-04-23T10:15:43.183360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077706+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:15:43.077706+0000","last_peered":"2024-04-23T10:15:43.077706+0000","last_clean":"2024-04-23T10:15:43.077706+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:15:43.077706+0000","last_undegraded":"2024-04-23T10:15:43.077706+0000","last_fullsized":"2024-04-23T10:15:43.077706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184273+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:15:43.184273+0000","last_peered":"2024-04-23T10:15:43.184273+0000","last_clean":"2024-04-23T10:15:43.184273+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:15:43.184273+0000","last_undegraded":"2024-04-23T10:15:43.184273+0000","last_fullsized":"2024-04-23T10:15:43.184273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182427+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:15:43.182427+0000","last_peered":"2024-04-23T10:15:43.182427+0000","last_clean":"2024-04-23T10:15:43.182427+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:15:43.182427+0000","last_undegraded":"2024-04-23T10:15:43.182427+0000","last_fullsized":"2024-04-23T10:15:43.182427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078673+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:15:43.078673+0000","last_peered":"2024-04-23T10:15:43.078673+0000","last_clean":"2024-04-23T10:15:43.078673+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:15:43.078673+0000","last_undegraded":"2024-04-23T10:15:43.078673+0000","last_fullsized":"2024-04-23T10:15:43.078673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183120+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:15:43.183120+0000","last_peered":"2024-04-23T10:15:43.183120+0000","last_clean":"2024-04-23T10:15:43.183120+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:15:43.183120+0000","last_undegraded":"2024-04-23T10:15:43.183120+0000","last_fullsized":"2024-04-23T10:15:43.183120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079159+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:15:43.079159+0000","last_peered":"2024-04-23T10:15:43.079159+0000","last_clean":"2024-04-23T10:15:43.079159+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:15:43.079159+0000","last_undegraded":"2024-04-23T10:15:43.079159+0000","last_fullsized":"2024-04-23T10:15:43.079159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182688+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:15:43.182688+0000","last_peered":"2024-04-23T10:15:43.182688+0000","last_clean":"2024-04-23T10:15:43.182688+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:15:43.182688+0000","last_undegraded":"2024-04-23T10:15:43.182688+0000","last_fullsized":"2024-04-23T10:15:43.182688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183425+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:15:43.183425+0000","last_peered":"2024-04-23T10:15:43.183425+0000","last_clean":"2024-04-23T10:15:43.183425+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:15:43.183425+0000","last_undegraded":"2024-04-23T10:15:43.183425+0000","last_fullsized":"2024-04-23T10:15:43.183425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185586+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:15:43.185586+0000","last_peered":"2024-04-23T10:15:43.185586+0000","last_clean":"2024-04-23T10:15:43.185586+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:15:43.185586+0000","last_undegraded":"2024-04-23T10:15:43.185586+0000","last_fullsized":"2024-04-23T10:15:43.185586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180186+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:15:43.180186+0000","last_peered":"2024-04-23T10:15:43.180186+0000","last_clean":"2024-04-23T10:15:43.180186+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:15:43.180186+0000","last_undegraded":"2024-04-23T10:15:43.180186+0000","last_fullsized":"2024-04-23T10:15:43.180186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183292+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:15:43.183292+0000","last_peered":"2024-04-23T10:15:43.183292+0000","last_clean":"2024-04-23T10:15:43.183292+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:15:43.183292+0000","last_undegraded":"2024-04-23T10:15:43.183292+0000","last_fullsized":"2024-04-23T10:15:43.183292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185347+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:15:43.185347+0000","last_peered":"2024-04-23T10:15:43.185347+0000","last_clean":"2024-04-23T10:15:43.185347+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:15:43.185347+0000","last_undegraded":"2024-04-23T10:15:43.185347+0000","last_fullsized":"2024-04-23T10:15:43.185347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180168+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:15:43.180168+0000","last_peered":"2024-04-23T10:15:43.180168+0000","last_clean":"2024-04-23T10:15:43.180168+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:15:43.180168+0000","last_undegraded":"2024-04-23T10:15:43.180168+0000","last_fullsized":"2024-04-23T10:15:43.180168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182115+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:15:43.182115+0000","last_peered":"2024-04-23T10:15:43.182115+0000","last_clean":"2024-04-23T10:15:43.182115+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:15:43.182115+0000","last_undegraded":"2024-04-23T10:15:43.182115+0000","last_fullsized":"2024-04-23T10:15:43.182115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184379+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:15:43.184379+0000","last_peered":"2024-04-23T10:15:43.184379+0000","last_clean":"2024-04-23T10:15:43.184379+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:15:43.184379+0000","last_undegraded":"2024-04-23T10:15:43.184379+0000","last_fullsized":"2024-04-23T10:15:43.184379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182073+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:15:43.182073+0000","last_peered":"2024-04-23T10:15:43.182073+0000","last_clean":"2024-04-23T10:15:43.182073+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:15:43.182073+0000","last_undegraded":"2024-04-23T10:15:43.182073+0000","last_fullsized":"2024-04-23T10:15:43.182073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183011+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:15:43.183011+0000","last_peered":"2024-04-23T10:15:43.183011+0000","last_clean":"2024-04-23T10:15:43.183011+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:15:43.183011+0000","last_undegraded":"2024-04-23T10:15:43.183011+0000","last_fullsized":"2024-04-23T10:15:43.183011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180835+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:15:43.180835+0000","last_peered":"2024-04-23T10:15:43.180835+0000","last_clean":"2024-04-23T10:15:43.180835+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:15:43.180835+0000","last_undegraded":"2024-04-23T10:15:43.180835+0000","last_fullsized":"2024-04-23T10:15:43.180835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.080051+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:15:43.080051+0000","last_peered":"2024-04-23T10:15:43.080051+0000","last_clean":"2024-04-23T10:15:43.080051+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:15:43.080051+0000","last_undegraded":"2024-04-23T10:15:43.080051+0000","last_fullsized":"2024-04-23T10:15:43.080051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183767+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:15:43.183767+0000","last_peered":"2024-04-23T10:15:43.183767+0000","last_clean":"2024-04-23T10:15:43.183767+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:15:43.183767+0000","last_undegraded":"2024-04-23T10:15:43.183767+0000","last_fullsized":"2024-04-23T10:15:43.183767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186365+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:15:43.186365+0000","last_peered":"2024-04-23T10:15:43.186365+0000","last_clean":"2024-04-23T10:15:43.186365+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:15:43.186365+0000","last_undegraded":"2024-04-23T10:15:43.186365+0000","last_fullsized":"2024-04-23T10:15:43.186365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181410+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:15:43.181410+0000","last_peered":"2024-04-23T10:15:43.181410+0000","last_clean":"2024-04-23T10:15:43.181410+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:15:43.181410+0000","last_undegraded":"2024-04-23T10:15:43.181410+0000","last_fullsized":"2024-04-23T10:15:43.181410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185049+0000","last_change":"2024-04-23T10:15:42.164860+0000","last_active":"2024-04-23T10:15:43.185049+0000","last_peered":"2024-04-23T10:15:43.185049+0000","last_clean":"2024-04-23T10:15:43.185049+0000","last_became_active":"2024-04-23T10:15:42.163816+0000","last_became_peered":"2024-04-23T10:15:42.163816+0000","last_unstale":"2024-04-23T10:15:43.185049+0000","last_undegraded":"2024-04-23T10:15:43.185049+0000","last_fullsized":"2024-04-23T10:15:43.185049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:47.776069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180146+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:15:43.180146+0000","last_peered":"2024-04-23T10:15:43.180146+0000","last_clean":"2024-04-23T10:15:43.180146+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:15:43.180146+0000","last_undegraded":"2024-04-23T10:15:43.180146+0000","last_fullsized":"2024-04-23T10:15:43.180146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183851+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:15:43.183851+0000","last_peered":"2024-04-23T10:15:43.183851+0000","last_clean":"2024-04-23T10:15:43.183851+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:15:43.183851+0000","last_undegraded":"2024-04-23T10:15:43.183851+0000","last_fullsized":"2024-04-23T10:15:43.183851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181358+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:15:43.181358+0000","last_peered":"2024-04-23T10:15:43.181358+0000","last_clean":"2024-04-23T10:15:43.181358+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:15:43.181358+0000","last_undegraded":"2024-04-23T10:15:43.181358+0000","last_fullsized":"2024-04-23T10:15:43.181358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078759+0000","last_change":"2024-04-23T10:15:38.000072+0000","last_active":"2024-04-23T10:15:43.078759+0000","last_peered":"2024-04-23T10:15:43.078759+0000","last_clean":"2024-04-23T10:15:43.078759+0000","last_became_active":"2024-04-23T10:15:37.999407+0000","last_became_peered":"2024-04-23T10:15:37.999407+0000","last_unstale":"2024-04-23T10:15:43.078759+0000","last_undegraded":"2024-04-23T10:15:43.078759+0000","last_fullsized":"2024-04-23T10:15:43.078759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:32:12.652769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180279+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:15:43.180279+0000","last_peered":"2024-04-23T10:15:43.180279+0000","last_clean":"2024-04-23T10:15:43.180279+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:15:43.180279+0000","last_undegraded":"2024-04-23T10:15:43.180279+0000","last_fullsized":"2024-04-23T10:15:43.180279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179704+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:15:43.179704+0000","last_peered":"2024-04-23T10:15:43.179704+0000","last_clean":"2024-04-23T10:15:43.179704+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:15:43.179704+0000","last_undegraded":"2024-04-23T10:15:43.179704+0000","last_fullsized":"2024-04-23T10:15:43.179704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184990+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:15:43.184990+0000","last_peered":"2024-04-23T10:15:43.184990+0000","last_clean":"2024-04-23T10:15:43.184990+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:15:43.184990+0000","last_undegraded":"2024-04-23T10:15:43.184990+0000","last_fullsized":"2024-04-23T10:15:43.184990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077914+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:15:43.077914+0000","last_peered":"2024-04-23T10:15:43.077914+0000","last_clean":"2024-04-23T10:15:43.077914+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:15:43.077914+0000","last_undegraded":"2024-04-23T10:15:43.077914+0000","last_fullsized":"2024-04-23T10:15:43.077914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180011+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:15:43.180011+0000","last_peered":"2024-04-23T10:15:43.180011+0000","last_clean":"2024-04-23T10:15:43.180011+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:15:43.180011+0000","last_undegraded":"2024-04-23T10:15:43.180011+0000","last_fullsized":"2024-04-23T10:15:43.180011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182378+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:15:43.182378+0000","last_peered":"2024-04-23T10:15:43.182378+0000","last_clean":"2024-04-23T10:15:43.182378+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:15:43.182378+0000","last_undegraded":"2024-04-23T10:15:43.182378+0000","last_fullsized":"2024-04-23T10:15:43.182378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074055+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:15:43.074055+0000","last_peered":"2024-04-23T10:15:43.074055+0000","last_clean":"2024-04-23T10:15:43.074055+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:15:43.074055+0000","last_undegraded":"2024-04-23T10:15:43.074055+0000","last_fullsized":"2024-04-23T10:15:43.074055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182513+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:15:43.182513+0000","last_peered":"2024-04-23T10:15:43.182513+0000","last_clean":"2024-04-23T10:15:43.182513+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:15:43.182513+0000","last_undegraded":"2024-04-23T10:15:43.182513+0000","last_fullsized":"2024-04-23T10:15:43.182513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179368+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:15:43.179368+0000","last_peered":"2024-04-23T10:15:43.179368+0000","last_clean":"2024-04-23T10:15:43.179368+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:15:43.179368+0000","last_undegraded":"2024-04-23T10:15:43.179368+0000","last_fullsized":"2024-04-23T10:15:43.179368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182188+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:15:43.182188+0000","last_peered":"2024-04-23T10:15:43.182188+0000","last_clean":"2024-04-23T10:15:43.182188+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:15:43.182188+0000","last_undegraded":"2024-04-23T10:15:43.182188+0000","last_fullsized":"2024-04-23T10:15:43.182188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180738+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:15:43.180738+0000","last_peered":"2024-04-23T10:15:43.180738+0000","last_clean":"2024-04-23T10:15:43.180738+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:15:43.180738+0000","last_undegraded":"2024-04-23T10:15:43.180738+0000","last_fullsized":"2024-04-23T10:15:43.180738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185653+0000","last_change":"2024-04-23T10:15:38.020047+0000","last_active":"2024-04-23T10:15:43.185653+0000","last_peered":"2024-04-23T10:15:43.185653+0000","last_clean":"2024-04-23T10:15:43.185653+0000","last_became_active":"2024-04-23T10:15:38.019277+0000","last_became_peered":"2024-04-23T10:15:38.019277+0000","last_unstale":"2024-04-23T10:15:43.185653+0000","last_undegraded":"2024-04-23T10:15:43.185653+0000","last_fullsized":"2024-04-23T10:15:43.185653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:11:05.298798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077439+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:15:43.077439+0000","last_peered":"2024-04-23T10:15:43.077439+0000","last_clean":"2024-04-23T10:15:43.077439+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:15:43.077439+0000","last_undegraded":"2024-04-23T10:15:43.077439+0000","last_fullsized":"2024-04-23T10:15:43.077439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182359+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:15:43.182359+0000","last_peered":"2024-04-23T10:15:43.182359+0000","last_clean":"2024-04-23T10:15:43.182359+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:15:43.182359+0000","last_undegraded":"2024-04-23T10:15:43.182359+0000","last_fullsized":"2024-04-23T10:15:43.182359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079122+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:15:43.079122+0000","last_peered":"2024-04-23T10:15:43.079122+0000","last_clean":"2024-04-23T10:15:43.079122+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:15:43.079122+0000","last_undegraded":"2024-04-23T10:15:43.079122+0000","last_fullsized":"2024-04-23T10:15:43.079122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182894+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:15:43.182894+0000","last_peered":"2024-04-23T10:15:43.182894+0000","last_clean":"2024-04-23T10:15:43.182894+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:15:43.182894+0000","last_undegraded":"2024-04-23T10:15:43.182894+0000","last_fullsized":"2024-04-23T10:15:43.182894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074812+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:15:43.074812+0000","last_peered":"2024-04-23T10:15:43.074812+0000","last_clean":"2024-04-23T10:15:43.074812+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:15:43.074812+0000","last_undegraded":"2024-04-23T10:15:43.074812+0000","last_fullsized":"2024-04-23T10:15:43.074812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077536+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:15:43.077536+0000","last_peered":"2024-04-23T10:15:43.077536+0000","last_clean":"2024-04-23T10:15:43.077536+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:15:43.077536+0000","last_undegraded":"2024-04-23T10:15:43.077536+0000","last_fullsized":"2024-04-23T10:15:43.077536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077818+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:15:43.077818+0000","last_peered":"2024-04-23T10:15:43.077818+0000","last_clean":"2024-04-23T10:15:43.077818+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:15:43.077818+0000","last_undegraded":"2024-04-23T10:15:43.077818+0000","last_fullsized":"2024-04-23T10:15:43.077818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180693+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:15:43.180693+0000","last_peered":"2024-04-23T10:15:43.180693+0000","last_clean":"2024-04-23T10:15:43.180693+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:15:43.180693+0000","last_undegraded":"2024-04-23T10:15:43.180693+0000","last_fullsized":"2024-04-23T10:15:43.180693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181704+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:15:43.181704+0000","last_peered":"2024-04-23T10:15:43.181704+0000","last_clean":"2024-04-23T10:15:43.181704+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:15:43.181704+0000","last_undegraded":"2024-04-23T10:15:43.181704+0000","last_fullsized":"2024-04-23T10:15:43.181704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186017+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:15:43.186017+0000","last_peered":"2024-04-23T10:15:43.186017+0000","last_clean":"2024-04-23T10:15:43.186017+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:15:43.186017+0000","last_undegraded":"2024-04-23T10:15:43.186017+0000","last_fullsized":"2024-04-23T10:15:43.186017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074930+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:15:43.074930+0000","last_peered":"2024-04-23T10:15:43.074930+0000","last_clean":"2024-04-23T10:15:43.074930+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:15:43.074930+0000","last_undegraded":"2024-04-23T10:15:43.074930+0000","last_fullsized":"2024-04-23T10:15:43.074930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.076817+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:15:43.076817+0000","last_peered":"2024-04-23T10:15:43.076817+0000","last_clean":"2024-04-23T10:15:43.076817+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:15:43.076817+0000","last_undegraded":"2024-04-23T10:15:43.076817+0000","last_fullsized":"2024-04-23T10:15:43.076817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185476+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:15:43.185476+0000","last_peered":"2024-04-23T10:15:43.185476+0000","last_clean":"2024-04-23T10:15:43.185476+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:15:43.185476+0000","last_undegraded":"2024-04-23T10:15:43.185476+0000","last_fullsized":"2024-04-23T10:15:43.185476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184056+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:15:43.184056+0000","last_peered":"2024-04-23T10:15:43.184056+0000","last_clean":"2024-04-23T10:15:43.184056+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:15:43.184056+0000","last_undegraded":"2024-04-23T10:15:43.184056+0000","last_fullsized":"2024-04-23T10:15:43.184056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181866+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:15:43.181866+0000","last_peered":"2024-04-23T10:15:43.181866+0000","last_clean":"2024-04-23T10:15:43.181866+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:15:43.181866+0000","last_undegraded":"2024-04-23T10:15:43.181866+0000","last_fullsized":"2024-04-23T10:15:43.181866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183177+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:15:43.183177+0000","last_peered":"2024-04-23T10:15:43.183177+0000","last_clean":"2024-04-23T10:15:43.183177+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:15:43.183177+0000","last_undegraded":"2024-04-23T10:15:43.183177+0000","last_fullsized":"2024-04-23T10:15:43.183177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.073780+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:15:43.073780+0000","last_peered":"2024-04-23T10:15:43.073780+0000","last_clean":"2024-04-23T10:15:43.073780+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:15:43.073780+0000","last_undegraded":"2024-04-23T10:15:43.073780+0000","last_fullsized":"2024-04-23T10:15:43.073780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180612+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:15:43.180612+0000","last_peered":"2024-04-23T10:15:43.180612+0000","last_clean":"2024-04-23T10:15:43.180612+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:15:43.180612+0000","last_undegraded":"2024-04-23T10:15:43.180612+0000","last_fullsized":"2024-04-23T10:15:43.180612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078323+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:15:43.078323+0000","last_peered":"2024-04-23T10:15:43.078323+0000","last_clean":"2024-04-23T10:15:43.078323+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:15:43.078323+0000","last_undegraded":"2024-04-23T10:15:43.078323+0000","last_fullsized":"2024-04-23T10:15:43.078323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078414+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:15:43.078414+0000","last_peered":"2024-04-23T10:15:43.078414+0000","last_clean":"2024-04-23T10:15:43.078414+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:15:43.078414+0000","last_undegraded":"2024-04-23T10:15:43.078414+0000","last_fullsized":"2024-04-23T10:15:43.078414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186321+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:15:43.186321+0000","last_peered":"2024-04-23T10:15:43.186321+0000","last_clean":"2024-04-23T10:15:43.186321+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:15:43.186321+0000","last_undegraded":"2024-04-23T10:15:43.186321+0000","last_fullsized":"2024-04-23T10:15:43.186321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182507+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:15:43.182507+0000","last_peered":"2024-04-23T10:15:43.182507+0000","last_clean":"2024-04-23T10:15:43.182507+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:15:43.182507+0000","last_undegraded":"2024-04-23T10:15:43.182507+0000","last_fullsized":"2024-04-23T10:15:43.182507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077971+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:15:43.077971+0000","last_peered":"2024-04-23T10:15:43.077971+0000","last_clean":"2024-04-23T10:15:43.077971+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:15:43.077971+0000","last_undegraded":"2024-04-23T10:15:43.077971+0000","last_fullsized":"2024-04-23T10:15:43.077971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185833+0000","last_change":"2024-04-23T10:15:42.164994+0000","last_active":"2024-04-23T10:15:43.185833+0000","last_peered":"2024-04-23T10:15:43.185833+0000","last_clean":"2024-04-23T10:15:43.185833+0000","last_became_active":"2024-04-23T10:15:42.163851+0000","last_became_peered":"2024-04-23T10:15:42.163851+0000","last_unstale":"2024-04-23T10:15:43.185833+0000","last_undegraded":"2024-04-23T10:15:43.185833+0000","last_fullsized":"2024-04-23T10:15:43.185833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:29:45.598515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179977+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:15:43.179977+0000","last_peered":"2024-04-23T10:15:43.179977+0000","last_clean":"2024-04-23T10:15:43.179977+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:15:43.179977+0000","last_undegraded":"2024-04-23T10:15:43.179977+0000","last_fullsized":"2024-04-23T10:15:43.179977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182077+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:15:43.182077+0000","last_peered":"2024-04-23T10:15:43.182077+0000","last_clean":"2024-04-23T10:15:43.182077+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:15:43.182077+0000","last_undegraded":"2024-04-23T10:15:43.182077+0000","last_fullsized":"2024-04-23T10:15:43.182077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078431+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:15:43.078431+0000","last_peered":"2024-04-23T10:15:43.078431+0000","last_clean":"2024-04-23T10:15:43.078431+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:15:43.078431+0000","last_undegraded":"2024-04-23T10:15:43.078431+0000","last_fullsized":"2024-04-23T10:15:43.078431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182647+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:15:43.182647+0000","last_peered":"2024-04-23T10:15:43.182647+0000","last_clean":"2024-04-23T10:15:43.182647+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:15:43.182647+0000","last_undegraded":"2024-04-23T10:15:43.182647+0000","last_fullsized":"2024-04-23T10:15:43.182647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:51.366095+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:15:51.366095+0000","last_peered":"2024-04-23T10:15:51.366095+0000","last_clean":"2024-04-23T10:15:51.366095+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:15:51.366095+0000","last_undegraded":"2024-04-23T10:15:51.366095+0000","last_fullsized":"2024-04-23T10:15:51.366095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180021+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:15:43.180021+0000","last_peered":"2024-04-23T10:15:43.180021+0000","last_clean":"2024-04-23T10:15:43.180021+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:15:43.180021+0000","last_undegraded":"2024-04-23T10:15:43.180021+0000","last_fullsized":"2024-04-23T10:15:43.180021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183989+0000","last_change":"2024-04-23T10:15:38.027810+0000","last_active":"2024-04-23T10:15:43.183989+0000","last_peered":"2024-04-23T10:15:43.183989+0000","last_clean":"2024-04-23T10:15:43.183989+0000","last_became_active":"2024-04-23T10:15:38.026559+0000","last_became_peered":"2024-04-23T10:15:38.026559+0000","last_unstale":"2024-04-23T10:15:43.183989+0000","last_undegraded":"2024-04-23T10:15:43.183989+0000","last_fullsized":"2024-04-23T10:15:43.183989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:08:17.720264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180357+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:15:43.180357+0000","last_peered":"2024-04-23T10:15:43.180357+0000","last_clean":"2024-04-23T10:15:43.180357+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:15:43.180357+0000","last_undegraded":"2024-04-23T10:15:43.180357+0000","last_fullsized":"2024-04-23T10:15:43.180357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184591+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:15:43.184591+0000","last_peered":"2024-04-23T10:15:43.184591+0000","last_clean":"2024-04-23T10:15:43.184591+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:15:43.184591+0000","last_undegraded":"2024-04-23T10:15:43.184591+0000","last_fullsized":"2024-04-23T10:15:43.184591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180910+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:15:43.180910+0000","last_peered":"2024-04-23T10:15:43.180910+0000","last_clean":"2024-04-23T10:15:43.180910+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:15:43.180910+0000","last_undegraded":"2024-04-23T10:15:43.180910+0000","last_fullsized":"2024-04-23T10:15:43.180910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078472+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:15:43.078472+0000","last_peered":"2024-04-23T10:15:43.078472+0000","last_clean":"2024-04-23T10:15:43.078472+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:15:43.078472+0000","last_undegraded":"2024-04-23T10:15:43.078472+0000","last_fullsized":"2024-04-23T10:15:43.078472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185228+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:15:43.185228+0000","last_peered":"2024-04-23T10:15:43.185228+0000","last_clean":"2024-04-23T10:15:43.185228+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:15:43.185228+0000","last_undegraded":"2024-04-23T10:15:43.185228+0000","last_fullsized":"2024-04-23T10:15:43.185228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078321+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:15:43.078321+0000","last_peered":"2024-04-23T10:15:43.078321+0000","last_clean":"2024-04-23T10:15:43.078321+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:15:43.078321+0000","last_undegraded":"2024-04-23T10:15:43.078321+0000","last_fullsized":"2024-04-23T10:15:43.078321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079824+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:15:43.079824+0000","last_peered":"2024-04-23T10:15:43.079824+0000","last_clean":"2024-04-23T10:15:43.079824+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:15:43.079824+0000","last_undegraded":"2024-04-23T10:15:43.079824+0000","last_fullsized":"2024-04-23T10:15:43.079824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185281+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:15:43.185281+0000","last_peered":"2024-04-23T10:15:43.185281+0000","last_clean":"2024-04-23T10:15:43.185281+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:15:43.185281+0000","last_undegraded":"2024-04-23T10:15:43.185281+0000","last_fullsized":"2024-04-23T10:15:43.185281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180558+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:15:43.180558+0000","last_peered":"2024-04-23T10:15:43.180558+0000","last_clean":"2024-04-23T10:15:43.180558+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:15:43.180558+0000","last_undegraded":"2024-04-23T10:15:43.180558+0000","last_fullsized":"2024-04-23T10:15:43.180558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179861+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:15:43.179861+0000","last_peered":"2024-04-23T10:15:43.179861+0000","last_clean":"2024-04-23T10:15:43.179861+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:15:43.179861+0000","last_undegraded":"2024-04-23T10:15:43.179861+0000","last_fullsized":"2024-04-23T10:15:43.179861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077622+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:15:43.077622+0000","last_peered":"2024-04-23T10:15:43.077622+0000","last_clean":"2024-04-23T10:15:43.077622+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:15:43.077622+0000","last_undegraded":"2024-04-23T10:15:43.077622+0000","last_fullsized":"2024-04-23T10:15:43.077622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079727+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:15:43.079727+0000","last_peered":"2024-04-23T10:15:43.079727+0000","last_clean":"2024-04-23T10:15:43.079727+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:15:43.079727+0000","last_undegraded":"2024-04-23T10:15:43.079727+0000","last_fullsized":"2024-04-23T10:15:43.079727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185263+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:15:43.185263+0000","last_peered":"2024-04-23T10:15:43.185263+0000","last_clean":"2024-04-23T10:15:43.185263+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:15:43.185263+0000","last_undegraded":"2024-04-23T10:15:43.185263+0000","last_fullsized":"2024-04-23T10:15:43.185263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185741+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:15:43.185741+0000","last_peered":"2024-04-23T10:15:43.185741+0000","last_clean":"2024-04-23T10:15:43.185741+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:15:43.185741+0000","last_undegraded":"2024-04-23T10:15:43.185741+0000","last_fullsized":"2024-04-23T10:15:43.185741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079596+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:15:43.079596+0000","last_peered":"2024-04-23T10:15:43.079596+0000","last_clean":"2024-04-23T10:15:43.079596+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:15:43.079596+0000","last_undegraded":"2024-04-23T10:15:43.079596+0000","last_fullsized":"2024-04-23T10:15:43.079596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181954+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:15:43.181954+0000","last_peered":"2024-04-23T10:15:43.181954+0000","last_clean":"2024-04-23T10:15:43.181954+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:15:43.181954+0000","last_undegraded":"2024-04-23T10:15:43.181954+0000","last_fullsized":"2024-04-23T10:15:43.181954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074391+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:15:43.074391+0000","last_peered":"2024-04-23T10:15:43.074391+0000","last_clean":"2024-04-23T10:15:43.074391+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:15:43.074391+0000","last_undegraded":"2024-04-23T10:15:43.074391+0000","last_fullsized":"2024-04-23T10:15:43.074391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185670+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:15:43.185670+0000","last_peered":"2024-04-23T10:15:43.185670+0000","last_clean":"2024-04-23T10:15:43.185670+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:15:43.185670+0000","last_undegraded":"2024-04-23T10:15:43.185670+0000","last_fullsized":"2024-04-23T10:15:43.185670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183710+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:15:43.183710+0000","last_peered":"2024-04-23T10:15:43.183710+0000","last_clean":"2024-04-23T10:15:43.183710+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:15:43.183710+0000","last_undegraded":"2024-04-23T10:15:43.183710+0000","last_fullsized":"2024-04-23T10:15:43.183710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186025+0000","last_change":"2024-04-23T10:15:42.096686+0000","last_active":"2024-04-23T10:15:43.186025+0000","last_peered":"2024-04-23T10:15:43.186025+0000","last_clean":"2024-04-23T10:15:43.186025+0000","last_became_active":"2024-04-23T10:15:42.096056+0000","last_became_peered":"2024-04-23T10:15:42.096056+0000","last_unstale":"2024-04-23T10:15:43.186025+0000","last_undegraded":"2024-04-23T10:15:43.186025+0000","last_fullsized":"2024-04-23T10:15:43.186025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:56.385523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077884+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:15:43.077884+0000","last_peered":"2024-04-23T10:15:43.077884+0000","last_clean":"2024-04-23T10:15:43.077884+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:15:43.077884+0000","last_undegraded":"2024-04-23T10:15:43.077884+0000","last_fullsized":"2024-04-23T10:15:43.077884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.073994+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:15:43.073994+0000","last_peered":"2024-04-23T10:15:43.073994+0000","last_clean":"2024-04-23T10:15:43.073994+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:15:43.073994+0000","last_undegraded":"2024-04-23T10:15:43.073994+0000","last_fullsized":"2024-04-23T10:15:43.073994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077654+0000","last_change":"2024-04-23T10:15:38.009820+0000","last_active":"2024-04-23T10:15:43.077654+0000","last_peered":"2024-04-23T10:15:43.077654+0000","last_clean":"2024-04-23T10:15:43.077654+0000","last_became_active":"2024-04-23T10:15:38.008893+0000","last_became_peered":"2024-04-23T10:15:38.008893+0000","last_unstale":"2024-04-23T10:15:43.077654+0000","last_undegraded":"2024-04-23T10:15:43.077654+0000","last_fullsized":"2024-04-23T10:15:43.077654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:22:50.250644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181828+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:15:43.181828+0000","last_peered":"2024-04-23T10:15:43.181828+0000","last_clean":"2024-04-23T10:15:43.181828+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:15:43.181828+0000","last_undegraded":"2024-04-23T10:15:43.181828+0000","last_fullsized":"2024-04-23T10:15:43.181828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186018+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:15:43.186018+0000","last_peered":"2024-04-23T10:15:43.186018+0000","last_clean":"2024-04-23T10:15:43.186018+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:15:43.186018+0000","last_undegraded":"2024-04-23T10:15:43.186018+0000","last_fullsized":"2024-04-23T10:15:43.186018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179808+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:15:43.179808+0000","last_peered":"2024-04-23T10:15:43.179808+0000","last_clean":"2024-04-23T10:15:43.179808+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:15:43.179808+0000","last_undegraded":"2024-04-23T10:15:43.179808+0000","last_fullsized":"2024-04-23T10:15:43.179808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079799+0000","last_change":"2024-04-23T10:15:38.032528+0000","last_active":"2024-04-23T10:15:43.079799+0000","last_peered":"2024-04-23T10:15:43.079799+0000","last_clean":"2024-04-23T10:15:43.079799+0000","last_became_active":"2024-04-23T10:15:38.031888+0000","last_became_peered":"2024-04-23T10:15:38.031888+0000","last_unstale":"2024-04-23T10:15:43.079799+0000","last_undegraded":"2024-04-23T10:15:43.079799+0000","last_fullsized":"2024-04-23T10:15:43.079799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:27.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186307+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:15:43.186307+0000","last_peered":"2024-04-23T10:15:43.186307+0000","last_clean":"2024-04-23T10:15:43.186307+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:15:43.186307+0000","last_undegraded":"2024-04-23T10:15:43.186307+0000","last_fullsized":"2024-04-23T10:15:43.186307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077440+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:15:43.077440+0000","last_peered":"2024-04-23T10:15:43.077440+0000","last_clean":"2024-04-23T10:15:43.077440+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:15:43.077440+0000","last_undegraded":"2024-04-23T10:15:43.077440+0000","last_fullsized":"2024-04-23T10:15:43.077440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185500+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:15:43.185500+0000","last_peered":"2024-04-23T10:15:43.185500+0000","last_clean":"2024-04-23T10:15:43.185500+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:15:43.185500+0000","last_undegraded":"2024-04-23T10:15:43.185500+0000","last_fullsized":"2024-04-23T10:15:43.185500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077430+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:15:43.077430+0000","last_peered":"2024-04-23T10:15:43.077430+0000","last_clean":"2024-04-23T10:15:43.077430+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:15:43.077430+0000","last_undegraded":"2024-04-23T10:15:43.077430+0000","last_fullsized":"2024-04-23T10:15:43.077430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181490+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:15:43.181490+0000","last_peered":"2024-04-23T10:15:43.181490+0000","last_clean":"2024-04-23T10:15:43.181490+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:15:43.181490+0000","last_undegraded":"2024-04-23T10:15:43.181490+0000","last_fullsized":"2024-04-23T10:15:43.181490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079050+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:15:43.079050+0000","last_peered":"2024-04-23T10:15:43.079050+0000","last_clean":"2024-04-23T10:15:43.079050+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:15:43.079050+0000","last_undegraded":"2024-04-23T10:15:43.079050+0000","last_fullsized":"2024-04-23T10:15:43.079050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183628+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:15:43.183628+0000","last_peered":"2024-04-23T10:15:43.183628+0000","last_clean":"2024-04-23T10:15:43.183628+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:15:43.183628+0000","last_undegraded":"2024-04-23T10:15:43.183628+0000","last_fullsized":"2024-04-23T10:15:43.183628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074767+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:15:43.074767+0000","last_peered":"2024-04-23T10:15:43.074767+0000","last_clean":"2024-04-23T10:15:43.074767+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:15:43.074767+0000","last_undegraded":"2024-04-23T10:15:43.074767+0000","last_fullsized":"2024-04-23T10:15:43.074767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078901+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:15:43.078901+0000","last_peered":"2024-04-23T10:15:43.078901+0000","last_clean":"2024-04-23T10:15:43.078901+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:15:43.078901+0000","last_undegraded":"2024-04-23T10:15:43.078901+0000","last_fullsized":"2024-04-23T10:15:43.078901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.076772+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:15:43.076772+0000","last_peered":"2024-04-23T10:15:43.076772+0000","last_clean":"2024-04-23T10:15:43.076772+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:15:43.076772+0000","last_undegraded":"2024-04-23T10:15:43.076772+0000","last_fullsized":"2024-04-23T10:15:43.076772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179961+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:15:43.179961+0000","last_peered":"2024-04-23T10:15:43.179961+0000","last_clean":"2024-04-23T10:15:43.179961+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:15:43.179961+0000","last_undegraded":"2024-04-23T10:15:43.179961+0000","last_fullsized":"2024-04-23T10:15:43.179961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179876+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:15:43.179876+0000","last_peered":"2024-04-23T10:15:43.179876+0000","last_clean":"2024-04-23T10:15:43.179876+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:15:43.179876+0000","last_undegraded":"2024-04-23T10:15:43.179876+0000","last_fullsized":"2024-04-23T10:15:43.179876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185516+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:15:43.185516+0000","last_peered":"2024-04-23T10:15:43.185516+0000","last_clean":"2024-04-23T10:15:43.185516+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:15:43.185516+0000","last_undegraded":"2024-04-23T10:15:43.185516+0000","last_fullsized":"2024-04-23T10:15:43.185516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183819+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:15:43.183819+0000","last_peered":"2024-04-23T10:15:43.183819+0000","last_clean":"2024-04-23T10:15:43.183819+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:15:43.183819+0000","last_undegraded":"2024-04-23T10:15:43.183819+0000","last_fullsized":"2024-04-23T10:15:43.183819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079377+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:15:43.079377+0000","last_peered":"2024-04-23T10:15:43.079377+0000","last_clean":"2024-04-23T10:15:43.079377+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:15:43.079377+0000","last_undegraded":"2024-04-23T10:15:43.079377+0000","last_fullsized":"2024-04-23T10:15:43.079377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079668+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:15:43.079668+0000","last_peered":"2024-04-23T10:15:43.079668+0000","last_clean":"2024-04-23T10:15:43.079668+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:15:43.079668+0000","last_undegraded":"2024-04-23T10:15:43.079668+0000","last_fullsized":"2024-04-23T10:15:43.079668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185876+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:15:43.185876+0000","last_peered":"2024-04-23T10:15:43.185876+0000","last_clean":"2024-04-23T10:15:43.185876+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:15:43.185876+0000","last_undegraded":"2024-04-23T10:15:43.185876+0000","last_fullsized":"2024-04-23T10:15:43.185876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185157+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:15:43.185157+0000","last_peered":"2024-04-23T10:15:43.185157+0000","last_clean":"2024-04-23T10:15:43.185157+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:15:43.185157+0000","last_undegraded":"2024-04-23T10:15:43.185157+0000","last_fullsized":"2024-04-23T10:15:43.185157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183096+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:15:43.183096+0000","last_peered":"2024-04-23T10:15:43.183096+0000","last_clean":"2024-04-23T10:15:43.183096+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:15:43.183096+0000","last_undegraded":"2024-04-23T10:15:43.183096+0000","last_fullsized":"2024-04-23T10:15:43.183096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077230+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:15:43.077230+0000","last_peered":"2024-04-23T10:15:43.077230+0000","last_clean":"2024-04-23T10:15:43.077230+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:15:43.077230+0000","last_undegraded":"2024-04-23T10:15:43.077230+0000","last_fullsized":"2024-04-23T10:15:43.077230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182252+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:15:43.182252+0000","last_peered":"2024-04-23T10:15:43.182252+0000","last_clean":"2024-04-23T10:15:43.182252+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:15:43.182252+0000","last_undegraded":"2024-04-23T10:15:43.182252+0000","last_fullsized":"2024-04-23T10:15:43.182252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077579+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:15:43.077579+0000","last_peered":"2024-04-23T10:15:43.077579+0000","last_clean":"2024-04-23T10:15:43.077579+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:15:43.077579+0000","last_undegraded":"2024-04-23T10:15:43.077579+0000","last_fullsized":"2024-04-23T10:15:43.077579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180320+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:15:43.180320+0000","last_peered":"2024-04-23T10:15:43.180320+0000","last_clean":"2024-04-23T10:15:43.180320+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:15:43.180320+0000","last_undegraded":"2024-04-23T10:15:43.180320+0000","last_fullsized":"2024-04-23T10:15:43.180320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181064+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:15:43.181064+0000","last_peered":"2024-04-23T10:15:43.181064+0000","last_clean":"2024-04-23T10:15:43.181064+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:15:43.181064+0000","last_undegraded":"2024-04-23T10:15:43.181064+0000","last_fullsized":"2024-04-23T10:15:43.181064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185772+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:15:43.185772+0000","last_peered":"2024-04-23T10:15:43.185772+0000","last_clean":"2024-04-23T10:15:43.185772+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:15:43.185772+0000","last_undegraded":"2024-04-23T10:15:43.185772+0000","last_fullsized":"2024-04-23T10:15:43.185772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:16:01.368 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:16:01.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f5099729640 1 Processor -- start 2024-04-23T10:16:01.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f5099729640 1 -- start start 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f5099729640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f509406f790 0x7f50940c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f5099729640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5094071160 0x7f5094073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f5099729640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5094072590 con 0x7f509406f3b0 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f5099729640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5094072fe0 con 0x7f509406f790 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f5099729640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5094158df0 con 0x7f5094071160 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f508a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f509406f790 0x7f50940c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f508a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f509406f790 0x7f50940c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59090/0 (socket says 172.21.15.29:59090) 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f508a7fc640 1 -- 172.21.15.29:0/3310316736 learned_addr learned my addr 172.21.15.29:0/3310316736 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f508a7fc640 1 -- 172.21.15.29:0/3310316736 >> v2:172.21.15.72:3300/0 conn(0x7f5094071160 msgr2=0x7f5094073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f508a7fc640 1 --2- 172.21.15.29:0/3310316736 >> v2:172.21.15.72:3300/0 conn(0x7f5094071160 0x7f5094073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f508a7fc640 1 -- 172.21.15.29:0/3310316736 >> v1:172.21.15.29:6789/0 conn(0x7f509406f3b0 legacy=0x7f5094157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.523+0000 7f508a7fc640 1 -- 172.21.15.29:0/3310316736 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5094158830 con 0x7f509406f790 2024-04-23T10:16:01.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f508a7fc640 1 --2- 172.21.15.29:0/3310316736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f790 0x7f50940c4d70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5094155a00 tx=0x7f507c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3bba4059969c99 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f50927fc640 1 -- 172.21.15.29:0/3310316736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0aa650 con 0x7f509406f790 2024-04-23T10:16:01.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f50927fc640 1 -- 172.21.15.29:0/3310316736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c0af070 con 0x7f509406f790 2024-04-23T10:16:01.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f50927fc640 1 -- 172.21.15.29:0/3310316736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0aaa10 con 0x7f509406f790 2024-04-23T10:16:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 -- 172.21.15.29:0/3310316736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f790 msgr2=0x7f50940c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 --2- 172.21.15.29:0/3310316736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f790 0x7f50940c4d70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5094155a00 tx=0x7f507c01c4f0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 -- 172.21.15.29:0/3310316736 shutdown_connections 2024-04-23T10:16:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 --2- 172.21.15.29:0/3310316736 >> v2:172.21.15.72:3300/0 conn(0x7f5094071160 0x7f5094073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 --2- 172.21.15.29:0/3310316736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f790 0x7f50940c4d70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 -- 172.21.15.29:0/3310316736 >> 172.21.15.29:0/3310316736 conn(0x7f509406cfb0 msgr2=0x7f509406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 -- 172.21.15.29:0/3310316736 shutdown_connections 2024-04-23T10:16:01.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 -- 172.21.15.29:0/3310316736 wait complete. 2024-04-23T10:16:01.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 Processor -- start 2024-04-23T10:16:01.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 -- start start 2024-04-23T10:16:01.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f3b0 0x7f5094156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.527+0000 7f5099729640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f509406f790 0x7f50941448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5099729640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5094071160 0x7f50941f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5099729640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5094152330 con 0x7f509406f3b0 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5099729640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5094158500 con 0x7f509406f790 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5099729640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f50941524b0 con 0x7f5094071160 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f3b0 0x7f5094156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f3b0 0x7f5094156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59094/0 (socket says 172.21.15.29:59094) 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 -- 172.21.15.29:0/1253386337 learned_addr learned my addr 172.21.15.29:0/1253386337 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f50937fe640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5094071160 0x7f50941f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f508a7fc640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f509406f790 0x7f50941448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 -- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5094071160 msgr2=0x7f50941f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5094071160 0x7f50941f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 -- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f509406f790 msgr2=0x7f50941448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f509406f790 0x7f50941448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 -- 172.21.15.29:0/1253386337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5094155de0 con 0x7f509406f3b0 2024-04-23T10:16:01.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5092ffd640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f3b0 0x7f5094156c20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f508400c480 tx=0x7f508400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f508bfff640 1 -- 172.21.15.29:0/1253386337 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50840052d0 con 0x7f509406f3b0 2024-04-23T10:16:01.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f508bfff640 1 -- 172.21.15.29:0/1253386337 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5084005490 con 0x7f509406f3b0 2024-04-23T10:16:01.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f508bfff640 1 -- 172.21.15.29:0/1253386337 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084012850 con 0x7f509406f3b0 2024-04-23T10:16:01.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50941560c0 con 0x7f509406f3b0 2024-04-23T10:16:01.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5094143ce0 con 0x7f509406f3b0 2024-04-23T10:16:01.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5094068d70 con 0x7f509406f3b0 2024-04-23T10:16:01.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f508bfff640 1 -- 172.21.15.29:0/1253386337 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f50840129f0 con 0x7f509406f3b0 2024-04-23T10:16:01.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f508bfff640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5074068380 0x7f507406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f508bfff640 1 -- 172.21.15.29:0/1253386337 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f50840868f0 con 0x7f509406f3b0 2024-04-23T10:16:01.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.531+0000 7f508a7fc640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5074068380 0x7f507406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.535+0000 7f508a7fc640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5074068380 0x7f507406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f507c0ae000 tx=0x7f507c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.535+0000 7f508bfff640 1 -- 172.21.15.29:0/1253386337 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5084056c00 con 0x7f509406f3b0 2024-04-23T10:16:01.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.695+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50941575c0 con 0x7f5074068380 2024-04-23T10:16:01.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.719+0000 7f508bfff640 1 -- 172.21.15.29:0/1253386337 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f507c0af040 con 0x7f5074068380 2024-04-23T10:16:01.721 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:01.724 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:16:01.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5074068380 msgr2=0x7f507406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5074068380 0x7f507406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f507c0ae000 tx=0x7f507c008040 comp rx=0 tx=0).stop 2024-04-23T10:16:01.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f3b0 msgr2=0x7f5094156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f3b0 0x7f5094156c20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f508400c480 tx=0x7f508400c940 comp rx=0 tx=0).stop 2024-04-23T10:16:01.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 shutdown_connections 2024-04-23T10:16:01.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5074068380 0x7f507406a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5094071160 0x7f50941f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f509406f790 0x7f50941448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 --2- 172.21.15.29:0/1253386337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f509406f3b0 0x7f5094156c20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 >> 172.21.15.29:0/1253386337 conn(0x7f509406cfb0 msgr2=0x7f5094073370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:01.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 shutdown_connections 2024-04-23T10:16:01.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.723+0000 7f5099729640 1 -- 172.21.15.29:0/1253386337 wait complete. 2024-04-23T10:16:01.742 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-23T10:16:01.197162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236020,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738700,"statfs":{"total":773094113280,"available":772852428800,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004806"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180971+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:15:43.180971+0000","last_peered":"2024-04-23T10:15:43.180971+0000","last_clean":"2024-04-23T10:15:43.180971+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:15:43.180971+0000","last_undegraded":"2024-04-23T10:15:43.180971+0000","last_fullsized":"2024-04-23T10:15:43.180971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186172+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:15:43.186172+0000","last_peered":"2024-04-23T10:15:43.186172+0000","last_clean":"2024-04-23T10:15:43.186172+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:15:43.186172+0000","last_undegraded":"2024-04-23T10:15:43.186172+0000","last_fullsized":"2024-04-23T10:15:43.186172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185322+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:15:43.185322+0000","last_peered":"2024-04-23T10:15:43.185322+0000","last_clean":"2024-04-23T10:15:43.185322+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:15:43.185322+0000","last_undegraded":"2024-04-23T10:15:43.185322+0000","last_fullsized":"2024-04-23T10:15:43.185322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186331+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:15:43.186331+0000","last_peered":"2024-04-23T10:15:43.186331+0000","last_clean":"2024-04-23T10:15:43.186331+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:15:43.186331+0000","last_undegraded":"2024-04-23T10:15:43.186331+0000","last_fullsized":"2024-04-23T10:15:43.186331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180764+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:15:43.180764+0000","last_peered":"2024-04-23T10:15:43.180764+0000","last_clean":"2024-04-23T10:15:43.180764+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:15:43.180764+0000","last_undegraded":"2024-04-23T10:15:43.180764+0000","last_fullsized":"2024-04-23T10:15:43.180764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181921+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:15:43.181921+0000","last_peered":"2024-04-23T10:15:43.181921+0000","last_clean":"2024-04-23T10:15:43.181921+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:15:43.181921+0000","last_undegraded":"2024-04-23T10:15:43.181921+0000","last_fullsized":"2024-04-23T10:15:43.181921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183360+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:15:43.183360+0000","last_peered":"2024-04-23T10:15:43.183360+0000","last_clean":"2024-04-23T10:15:43.183360+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:15:43.183360+0000","last_undegraded":"2024-04-23T10:15:43.183360+0000","last_fullsized":"2024-04-23T10:15:43.183360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077706+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:15:43.077706+0000","last_peered":"2024-04-23T10:15:43.077706+0000","last_clean":"2024-04-23T10:15:43.077706+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:15:43.077706+0000","last_undegraded":"2024-04-23T10:15:43.077706+0000","last_fullsized":"2024-04-23T10:15:43.077706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184273+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:15:43.184273+0000","last_peered":"2024-04-23T10:15:43.184273+0000","last_clean":"2024-04-23T10:15:43.184273+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:15:43.184273+0000","last_undegraded":"2024-04-23T10:15:43.184273+0000","last_fullsized":"2024-04-23T10:15:43.184273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182427+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:15:43.182427+0000","last_peered":"2024-04-23T10:15:43.182427+0000","last_clean":"2024-04-23T10:15:43.182427+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:15:43.182427+0000","last_undegraded":"2024-04-23T10:15:43.182427+0000","last_fullsized":"2024-04-23T10:15:43.182427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078673+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:15:43.078673+0000","last_peered":"2024-04-23T10:15:43.078673+0000","last_clean":"2024-04-23T10:15:43.078673+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:15:43.078673+0000","last_undegraded":"2024-04-23T10:15:43.078673+0000","last_fullsized":"2024-04-23T10:15:43.078673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183120+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:15:43.183120+0000","last_peered":"2024-04-23T10:15:43.183120+0000","last_clean":"2024-04-23T10:15:43.183120+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:15:43.183120+0000","last_undegraded":"2024-04-23T10:15:43.183120+0000","last_fullsized":"2024-04-23T10:15:43.183120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079159+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:15:43.079159+0000","last_peered":"2024-04-23T10:15:43.079159+0000","last_clean":"2024-04-23T10:15:43.079159+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:15:43.079159+0000","last_undegraded":"2024-04-23T10:15:43.079159+0000","last_fullsized":"2024-04-23T10:15:43.079159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182688+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:15:43.182688+0000","last_peered":"2024-04-23T10:15:43.182688+0000","last_clean":"2024-04-23T10:15:43.182688+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:15:43.182688+0000","last_undegraded":"2024-04-23T10:15:43.182688+0000","last_fullsized":"2024-04-23T10:15:43.182688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183425+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:15:43.183425+0000","last_peered":"2024-04-23T10:15:43.183425+0000","last_clean":"2024-04-23T10:15:43.183425+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:15:43.183425+0000","last_undegraded":"2024-04-23T10:15:43.183425+0000","last_fullsized":"2024-04-23T10:15:43.183425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185586+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:15:43.185586+0000","last_peered":"2024-04-23T10:15:43.185586+0000","last_clean":"2024-04-23T10:15:43.185586+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:15:43.185586+0000","last_undegraded":"2024-04-23T10:15:43.185586+0000","last_fullsized":"2024-04-23T10:15:43.185586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180186+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:15:43.180186+0000","last_peered":"2024-04-23T10:15:43.180186+0000","last_clean":"2024-04-23T10:15:43.180186+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:15:43.180186+0000","last_undegraded":"2024-04-23T10:15:43.180186+0000","last_fullsized":"2024-04-23T10:15:43.180186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183292+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:15:43.183292+0000","last_peered":"2024-04-23T10:15:43.183292+0000","last_clean":"2024-04-23T10:15:43.183292+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:15:43.183292+0000","last_undegraded":"2024-04-23T10:15:43.183292+0000","last_fullsized":"2024-04-23T10:15:43.183292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185347+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:15:43.185347+0000","last_peered":"2024-04-23T10:15:43.185347+0000","last_clean":"2024-04-23T10:15:43.185347+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:15:43.185347+0000","last_undegraded":"2024-04-23T10:15:43.185347+0000","last_fullsized":"2024-04-23T10:15:43.185347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180168+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:15:43.180168+0000","last_peered":"2024-04-23T10:15:43.180168+0000","last_clean":"2024-04-23T10:15:43.180168+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:15:43.180168+0000","last_undegraded":"2024-04-23T10:15:43.180168+0000","last_fullsized":"2024-04-23T10:15:43.180168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182115+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:15:43.182115+0000","last_peered":"2024-04-23T10:15:43.182115+0000","last_clean":"2024-04-23T10:15:43.182115+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:15:43.182115+0000","last_undegraded":"2024-04-23T10:15:43.182115+0000","last_fullsized":"2024-04-23T10:15:43.182115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184379+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:15:43.184379+0000","last_peered":"2024-04-23T10:15:43.184379+0000","last_clean":"2024-04-23T10:15:43.184379+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:15:43.184379+0000","last_undegraded":"2024-04-23T10:15:43.184379+0000","last_fullsized":"2024-04-23T10:15:43.184379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182073+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:15:43.182073+0000","last_peered":"2024-04-23T10:15:43.182073+0000","last_clean":"2024-04-23T10:15:43.182073+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:15:43.182073+0000","last_undegraded":"2024-04-23T10:15:43.182073+0000","last_fullsized":"2024-04-23T10:15:43.182073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183011+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:15:43.183011+0000","last_peered":"2024-04-23T10:15:43.183011+0000","last_clean":"2024-04-23T10:15:43.183011+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:15:43.183011+0000","last_undegraded":"2024-04-23T10:15:43.183011+0000","last_fullsized":"2024-04-23T10:15:43.183011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180835+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:15:43.180835+0000","last_peered":"2024-04-23T10:15:43.180835+0000","last_clean":"2024-04-23T10:15:43.180835+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:15:43.180835+0000","last_undegraded":"2024-04-23T10:15:43.180835+0000","last_fullsized":"2024-04-23T10:15:43.180835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.080051+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:15:43.080051+0000","last_peered":"2024-04-23T10:15:43.080051+0000","last_clean":"2024-04-23T10:15:43.080051+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:15:43.080051+0000","last_undegraded":"2024-04-23T10:15:43.080051+0000","last_fullsized":"2024-04-23T10:15:43.080051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183767+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:15:43.183767+0000","last_peered":"2024-04-23T10:15:43.183767+0000","last_clean":"2024-04-23T10:15:43.183767+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:15:43.183767+0000","last_undegraded":"2024-04-23T10:15:43.183767+0000","last_fullsized":"2024-04-23T10:15:43.183767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186365+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:15:43.186365+0000","last_peered":"2024-04-23T10:15:43.186365+0000","last_clean":"2024-04-23T10:15:43.186365+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:15:43.186365+0000","last_undegraded":"2024-04-23T10:15:43.186365+0000","last_fullsized":"2024-04-23T10:15:43.186365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181410+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:15:43.181410+0000","last_peered":"2024-04-23T10:15:43.181410+0000","last_clean":"2024-04-23T10:15:43.181410+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:15:43.181410+0000","last_undegraded":"2024-04-23T10:15:43.181410+0000","last_fullsized":"2024-04-23T10:15:43.181410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185049+0000","last_change":"2024-04-23T10:15:42.164860+0000","last_active":"2024-04-23T10:15:43.185049+0000","last_peered":"2024-04-23T10:15:43.185049+0000","last_clean":"2024-04-23T10:15:43.185049+0000","last_became_active":"2024-04-23T10:15:42.163816+0000","last_became_peered":"2024-04-23T10:15:42.163816+0000","last_unstale":"2024-04-23T10:15:43.185049+0000","last_undegraded":"2024-04-23T10:15:43.185049+0000","last_fullsized":"2024-04-23T10:15:43.185049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:47.776069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180146+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:15:43.180146+0000","last_peered":"2024-04-23T10:15:43.180146+0000","last_clean":"2024-04-23T10:15:43.180146+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:15:43.180146+0000","last_undegraded":"2024-04-23T10:15:43.180146+0000","last_fullsized":"2024-04-23T10:15:43.180146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183851+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:15:43.183851+0000","last_peered":"2024-04-23T10:15:43.183851+0000","last_clean":"2024-04-23T10:15:43.183851+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:15:43.183851+0000","last_undegraded":"2024-04-23T10:15:43.183851+0000","last_fullsized":"2024-04-23T10:15:43.183851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181358+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:15:43.181358+0000","last_peered":"2024-04-23T10:15:43.181358+0000","last_clean":"2024-04-23T10:15:43.181358+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:15:43.181358+0000","last_undegraded":"2024-04-23T10:15:43.181358+0000","last_fullsized":"2024-04-23T10:15:43.181358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078759+0000","last_change":"2024-04-23T10:15:38.000072+0000","last_active":"2024-04-23T10:15:43.078759+0000","last_peered":"2024-04-23T10:15:43.078759+0000","last_clean":"2024-04-23T10:15:43.078759+0000","last_became_active":"2024-04-23T10:15:37.999407+0000","last_became_peered":"2024-04-23T10:15:37.999407+0000","last_unstale":"2024-04-23T10:15:43.078759+0000","last_undegraded":"2024-04-23T10:15:43.078759+0000","last_fullsized":"2024-04-23T10:15:43.078759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:32:12.652769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180279+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:15:43.180279+0000","last_peered":"2024-04-23T10:15:43.180279+0000","last_clean":"2024-04-23T10:15:43.180279+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:15:43.180279+0000","last_undegraded":"2024-04-23T10:15:43.180279+0000","last_fullsized":"2024-04-23T10:15:43.180279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179704+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:15:43.179704+0000","last_peered":"2024-04-23T10:15:43.179704+0000","last_clean":"2024-04-23T10:15:43.179704+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:15:43.179704+0000","last_undegraded":"2024-04-23T10:15:43.179704+0000","last_fullsized":"2024-04-23T10:15:43.179704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184990+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:15:43.184990+0000","last_peered":"2024-04-23T10:15:43.184990+0000","last_clean":"2024-04-23T10:15:43.184990+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:15:43.184990+0000","last_undegraded":"2024-04-23T10:15:43.184990+0000","last_fullsized":"2024-04-23T10:15:43.184990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077914+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:15:43.077914+0000","last_peered":"2024-04-23T10:15:43.077914+0000","last_clean":"2024-04-23T10:15:43.077914+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:15:43.077914+0000","last_undegraded":"2024-04-23T10:15:43.077914+0000","last_fullsized":"2024-04-23T10:15:43.077914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180011+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:15:43.180011+0000","last_peered":"2024-04-23T10:15:43.180011+0000","last_clean":"2024-04-23T10:15:43.180011+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:15:43.180011+0000","last_undegraded":"2024-04-23T10:15:43.180011+0000","last_fullsized":"2024-04-23T10:15:43.180011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182378+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:15:43.182378+0000","last_peered":"2024-04-23T10:15:43.182378+0000","last_clean":"2024-04-23T10:15:43.182378+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:15:43.182378+0000","last_undegraded":"2024-04-23T10:15:43.182378+0000","last_fullsized":"2024-04-23T10:15:43.182378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074055+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:15:43.074055+0000","last_peered":"2024-04-23T10:15:43.074055+0000","last_clean":"2024-04-23T10:15:43.074055+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:15:43.074055+0000","last_undegraded":"2024-04-23T10:15:43.074055+0000","last_fullsized":"2024-04-23T10:15:43.074055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182513+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:15:43.182513+0000","last_peered":"2024-04-23T10:15:43.182513+0000","last_clean":"2024-04-23T10:15:43.182513+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:15:43.182513+0000","last_undegraded":"2024-04-23T10:15:43.182513+0000","last_fullsized":"2024-04-23T10:15:43.182513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179368+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:15:43.179368+0000","last_peered":"2024-04-23T10:15:43.179368+0000","last_clean":"2024-04-23T10:15:43.179368+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:15:43.179368+0000","last_undegraded":"2024-04-23T10:15:43.179368+0000","last_fullsized":"2024-04-23T10:15:43.179368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182188+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:15:43.182188+0000","last_peered":"2024-04-23T10:15:43.182188+0000","last_clean":"2024-04-23T10:15:43.182188+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:15:43.182188+0000","last_undegraded":"2024-04-23T10:15:43.182188+0000","last_fullsized":"2024-04-23T10:15:43.182188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180738+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:15:43.180738+0000","last_peered":"2024-04-23T10:15:43.180738+0000","last_clean":"2024-04-23T10:15:43.180738+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:15:43.180738+0000","last_undegraded":"2024-04-23T10:15:43.180738+0000","last_fullsized":"2024-04-23T10:15:43.180738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185653+0000","last_change":"2024-04-23T10:15:38.020047+0000","last_active":"2024-04-23T10:15:43.185653+0000","last_peered":"2024-04-23T10:15:43.185653+0000","last_clean":"2024-04-23T10:15:43.185653+0000","last_became_active":"2024-04-23T10:15:38.019277+0000","last_became_peered":"2024-04-23T10:15:38.019277+0000","last_unstale":"2024-04-23T10:15:43.185653+0000","last_undegraded":"2024-04-23T10:15:43.185653+0000","last_fullsized":"2024-04-23T10:15:43.185653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:11:05.298798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077439+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:15:43.077439+0000","last_peered":"2024-04-23T10:15:43.077439+0000","last_clean":"2024-04-23T10:15:43.077439+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:15:43.077439+0000","last_undegraded":"2024-04-23T10:15:43.077439+0000","last_fullsized":"2024-04-23T10:15:43.077439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182359+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:15:43.182359+0000","last_peered":"2024-04-23T10:15:43.182359+0000","last_clean":"2024-04-23T10:15:43.182359+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:15:43.182359+0000","last_undegraded":"2024-04-23T10:15:43.182359+0000","last_fullsized":"2024-04-23T10:15:43.182359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079122+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:15:43.079122+0000","last_peered":"2024-04-23T10:15:43.079122+0000","last_clean":"2024-04-23T10:15:43.079122+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:15:43.079122+0000","last_undegraded":"2024-04-23T10:15:43.079122+0000","last_fullsized":"2024-04-23T10:15:43.079122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182894+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:15:43.182894+0000","last_peered":"2024-04-23T10:15:43.182894+0000","last_clean":"2024-04-23T10:15:43.182894+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:15:43.182894+0000","last_undegraded":"2024-04-23T10:15:43.182894+0000","last_fullsized":"2024-04-23T10:15:43.182894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074812+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:15:43.074812+0000","last_peered":"2024-04-23T10:15:43.074812+0000","last_clean":"2024-04-23T10:15:43.074812+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:15:43.074812+0000","last_undegraded":"2024-04-23T10:15:43.074812+0000","last_fullsized":"2024-04-23T10:15:43.074812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077536+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:15:43.077536+0000","last_peered":"2024-04-23T10:15:43.077536+0000","last_clean":"2024-04-23T10:15:43.077536+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:15:43.077536+0000","last_undegraded":"2024-04-23T10:15:43.077536+0000","last_fullsized":"2024-04-23T10:15:43.077536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077818+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:15:43.077818+0000","last_peered":"2024-04-23T10:15:43.077818+0000","last_clean":"2024-04-23T10:15:43.077818+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:15:43.077818+0000","last_undegraded":"2024-04-23T10:15:43.077818+0000","last_fullsized":"2024-04-23T10:15:43.077818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180693+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:15:43.180693+0000","last_peered":"2024-04-23T10:15:43.180693+0000","last_clean":"2024-04-23T10:15:43.180693+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:15:43.180693+0000","last_undegraded":"2024-04-23T10:15:43.180693+0000","last_fullsized":"2024-04-23T10:15:43.180693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181704+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:15:43.181704+0000","last_peered":"2024-04-23T10:15:43.181704+0000","last_clean":"2024-04-23T10:15:43.181704+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:15:43.181704+0000","last_undegraded":"2024-04-23T10:15:43.181704+0000","last_fullsized":"2024-04-23T10:15:43.181704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186017+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:15:43.186017+0000","last_peered":"2024-04-23T10:15:43.186017+0000","last_clean":"2024-04-23T10:15:43.186017+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:15:43.186017+0000","last_undegraded":"2024-04-23T10:15:43.186017+0000","last_fullsized":"2024-04-23T10:15:43.186017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074930+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:15:43.074930+0000","last_peered":"2024-04-23T10:15:43.074930+0000","last_clean":"2024-04-23T10:15:43.074930+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:15:43.074930+0000","last_undegraded":"2024-04-23T10:15:43.074930+0000","last_fullsized":"2024-04-23T10:15:43.074930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.076817+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:15:43.076817+0000","last_peered":"2024-04-23T10:15:43.076817+0000","last_clean":"2024-04-23T10:15:43.076817+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:15:43.076817+0000","last_undegraded":"2024-04-23T10:15:43.076817+0000","last_fullsized":"2024-04-23T10:15:43.076817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185476+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:15:43.185476+0000","last_peered":"2024-04-23T10:15:43.185476+0000","last_clean":"2024-04-23T10:15:43.185476+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:15:43.185476+0000","last_undegraded":"2024-04-23T10:15:43.185476+0000","last_fullsized":"2024-04-23T10:15:43.185476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184056+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:15:43.184056+0000","last_peered":"2024-04-23T10:15:43.184056+0000","last_clean":"2024-04-23T10:15:43.184056+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:15:43.184056+0000","last_undegraded":"2024-04-23T10:15:43.184056+0000","last_fullsized":"2024-04-23T10:15:43.184056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181866+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:15:43.181866+0000","last_peered":"2024-04-23T10:15:43.181866+0000","last_clean":"2024-04-23T10:15:43.181866+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:15:43.181866+0000","last_undegraded":"2024-04-23T10:15:43.181866+0000","last_fullsized":"2024-04-23T10:15:43.181866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183177+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:15:43.183177+0000","last_peered":"2024-04-23T10:15:43.183177+0000","last_clean":"2024-04-23T10:15:43.183177+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:15:43.183177+0000","last_undegraded":"2024-04-23T10:15:43.183177+0000","last_fullsized":"2024-04-23T10:15:43.183177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.073780+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:15:43.073780+0000","last_peered":"2024-04-23T10:15:43.073780+0000","last_clean":"2024-04-23T10:15:43.073780+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:15:43.073780+0000","last_undegraded":"2024-04-23T10:15:43.073780+0000","last_fullsized":"2024-04-23T10:15:43.073780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180612+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:15:43.180612+0000","last_peered":"2024-04-23T10:15:43.180612+0000","last_clean":"2024-04-23T10:15:43.180612+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:15:43.180612+0000","last_undegraded":"2024-04-23T10:15:43.180612+0000","last_fullsized":"2024-04-23T10:15:43.180612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078323+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:15:43.078323+0000","last_peered":"2024-04-23T10:15:43.078323+0000","last_clean":"2024-04-23T10:15:43.078323+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:15:43.078323+0000","last_undegraded":"2024-04-23T10:15:43.078323+0000","last_fullsized":"2024-04-23T10:15:43.078323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078414+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:15:43.078414+0000","last_peered":"2024-04-23T10:15:43.078414+0000","last_clean":"2024-04-23T10:15:43.078414+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:15:43.078414+0000","last_undegraded":"2024-04-23T10:15:43.078414+0000","last_fullsized":"2024-04-23T10:15:43.078414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186321+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:15:43.186321+0000","last_peered":"2024-04-23T10:15:43.186321+0000","last_clean":"2024-04-23T10:15:43.186321+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:15:43.186321+0000","last_undegraded":"2024-04-23T10:15:43.186321+0000","last_fullsized":"2024-04-23T10:15:43.186321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182507+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:15:43.182507+0000","last_peered":"2024-04-23T10:15:43.182507+0000","last_clean":"2024-04-23T10:15:43.182507+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:15:43.182507+0000","last_undegraded":"2024-04-23T10:15:43.182507+0000","last_fullsized":"2024-04-23T10:15:43.182507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077971+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:15:43.077971+0000","last_peered":"2024-04-23T10:15:43.077971+0000","last_clean":"2024-04-23T10:15:43.077971+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:15:43.077971+0000","last_undegraded":"2024-04-23T10:15:43.077971+0000","last_fullsized":"2024-04-23T10:15:43.077971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185833+0000","last_change":"2024-04-23T10:15:42.164994+0000","last_active":"2024-04-23T10:15:43.185833+0000","last_peered":"2024-04-23T10:15:43.185833+0000","last_clean":"2024-04-23T10:15:43.185833+0000","last_became_active":"2024-04-23T10:15:42.163851+0000","last_became_peered":"2024-04-23T10:15:42.163851+0000","last_unstale":"2024-04-23T10:15:43.185833+0000","last_undegraded":"2024-04-23T10:15:43.185833+0000","last_fullsized":"2024-04-23T10:15:43.185833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:29:45.598515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179977+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:15:43.179977+0000","last_peered":"2024-04-23T10:15:43.179977+0000","last_clean":"2024-04-23T10:15:43.179977+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:15:43.179977+0000","last_undegraded":"2024-04-23T10:15:43.179977+0000","last_fullsized":"2024-04-23T10:15:43.179977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182077+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:15:43.182077+0000","last_peered":"2024-04-23T10:15:43.182077+0000","last_clean":"2024-04-23T10:15:43.182077+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:15:43.182077+0000","last_undegraded":"2024-04-23T10:15:43.182077+0000","last_fullsized":"2024-04-23T10:15:43.182077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078431+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:15:43.078431+0000","last_peered":"2024-04-23T10:15:43.078431+0000","last_clean":"2024-04-23T10:15:43.078431+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:15:43.078431+0000","last_undegraded":"2024-04-23T10:15:43.078431+0000","last_fullsized":"2024-04-23T10:15:43.078431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182647+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:15:43.182647+0000","last_peered":"2024-04-23T10:15:43.182647+0000","last_clean":"2024-04-23T10:15:43.182647+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:15:43.182647+0000","last_undegraded":"2024-04-23T10:15:43.182647+0000","last_fullsized":"2024-04-23T10:15:43.182647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:51.366095+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:15:51.366095+0000","last_peered":"2024-04-23T10:15:51.366095+0000","last_clean":"2024-04-23T10:15:51.366095+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:15:51.366095+0000","last_undegraded":"2024-04-23T10:15:51.366095+0000","last_fullsized":"2024-04-23T10:15:51.366095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180021+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:15:43.180021+0000","last_peered":"2024-04-23T10:15:43.180021+0000","last_clean":"2024-04-23T10:15:43.180021+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:15:43.180021+0000","last_undegraded":"2024-04-23T10:15:43.180021+0000","last_fullsized":"2024-04-23T10:15:43.180021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183989+0000","last_change":"2024-04-23T10:15:38.027810+0000","last_active":"2024-04-23T10:15:43.183989+0000","last_peered":"2024-04-23T10:15:43.183989+0000","last_clean":"2024-04-23T10:15:43.183989+0000","last_became_active":"2024-04-23T10:15:38.026559+0000","last_became_peered":"2024-04-23T10:15:38.026559+0000","last_unstale":"2024-04-23T10:15:43.183989+0000","last_undegraded":"2024-04-23T10:15:43.183989+0000","last_fullsized":"2024-04-23T10:15:43.183989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:08:17.720264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180357+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:15:43.180357+0000","last_peered":"2024-04-23T10:15:43.180357+0000","last_clean":"2024-04-23T10:15:43.180357+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:15:43.180357+0000","last_undegraded":"2024-04-23T10:15:43.180357+0000","last_fullsized":"2024-04-23T10:15:43.180357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184591+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:15:43.184591+0000","last_peered":"2024-04-23T10:15:43.184591+0000","last_clean":"2024-04-23T10:15:43.184591+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:15:43.184591+0000","last_undegraded":"2024-04-23T10:15:43.184591+0000","last_fullsized":"2024-04-23T10:15:43.184591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180910+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:15:43.180910+0000","last_peered":"2024-04-23T10:15:43.180910+0000","last_clean":"2024-04-23T10:15:43.180910+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:15:43.180910+0000","last_undegraded":"2024-04-23T10:15:43.180910+0000","last_fullsized":"2024-04-23T10:15:43.180910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078472+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:15:43.078472+0000","last_peered":"2024-04-23T10:15:43.078472+0000","last_clean":"2024-04-23T10:15:43.078472+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:15:43.078472+0000","last_undegraded":"2024-04-23T10:15:43.078472+0000","last_fullsized":"2024-04-23T10:15:43.078472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185228+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:15:43.185228+0000","last_peered":"2024-04-23T10:15:43.185228+0000","last_clean":"2024-04-23T10:15:43.185228+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:15:43.185228+0000","last_undegraded":"2024-04-23T10:15:43.185228+0000","last_fullsized":"2024-04-23T10:15:43.185228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078321+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:15:43.078321+0000","last_peered":"2024-04-23T10:15:43.078321+0000","last_clean":"2024-04-23T10:15:43.078321+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:15:43.078321+0000","last_undegraded":"2024-04-23T10:15:43.078321+0000","last_fullsized":"2024-04-23T10:15:43.078321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079824+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:15:43.079824+0000","last_peered":"2024-04-23T10:15:43.079824+0000","last_clean":"2024-04-23T10:15:43.079824+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:15:43.079824+0000","last_undegraded":"2024-04-23T10:15:43.079824+0000","last_fullsized":"2024-04-23T10:15:43.079824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185281+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:15:43.185281+0000","last_peered":"2024-04-23T10:15:43.185281+0000","last_clean":"2024-04-23T10:15:43.185281+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:15:43.185281+0000","last_undegraded":"2024-04-23T10:15:43.185281+0000","last_fullsized":"2024-04-23T10:15:43.185281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180558+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:15:43.180558+0000","last_peered":"2024-04-23T10:15:43.180558+0000","last_clean":"2024-04-23T10:15:43.180558+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:15:43.180558+0000","last_undegraded":"2024-04-23T10:15:43.180558+0000","last_fullsized":"2024-04-23T10:15:43.180558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179861+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:15:43.179861+0000","last_peered":"2024-04-23T10:15:43.179861+0000","last_clean":"2024-04-23T10:15:43.179861+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:15:43.179861+0000","last_undegraded":"2024-04-23T10:15:43.179861+0000","last_fullsized":"2024-04-23T10:15:43.179861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077622+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:15:43.077622+0000","last_peered":"2024-04-23T10:15:43.077622+0000","last_clean":"2024-04-23T10:15:43.077622+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:15:43.077622+0000","last_undegraded":"2024-04-23T10:15:43.077622+0000","last_fullsized":"2024-04-23T10:15:43.077622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079727+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:15:43.079727+0000","last_peered":"2024-04-23T10:15:43.079727+0000","last_clean":"2024-04-23T10:15:43.079727+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:15:43.079727+0000","last_undegraded":"2024-04-23T10:15:43.079727+0000","last_fullsized":"2024-04-23T10:15:43.079727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185263+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:15:43.185263+0000","last_peered":"2024-04-23T10:15:43.185263+0000","last_clean":"2024-04-23T10:15:43.185263+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:15:43.185263+0000","last_undegraded":"2024-04-23T10:15:43.185263+0000","last_fullsized":"2024-04-23T10:15:43.185263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185741+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:15:43.185741+0000","last_peered":"2024-04-23T10:15:43.185741+0000","last_clean":"2024-04-23T10:15:43.185741+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:15:43.185741+0000","last_undegraded":"2024-04-23T10:15:43.185741+0000","last_fullsized":"2024-04-23T10:15:43.185741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079596+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:15:43.079596+0000","last_peered":"2024-04-23T10:15:43.079596+0000","last_clean":"2024-04-23T10:15:43.079596+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:15:43.079596+0000","last_undegraded":"2024-04-23T10:15:43.079596+0000","last_fullsized":"2024-04-23T10:15:43.079596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181954+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:15:43.181954+0000","last_peered":"2024-04-23T10:15:43.181954+0000","last_clean":"2024-04-23T10:15:43.181954+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:15:43.181954+0000","last_undegraded":"2024-04-23T10:15:43.181954+0000","last_fullsized":"2024-04-23T10:15:43.181954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074391+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:15:43.074391+0000","last_peered":"2024-04-23T10:15:43.074391+0000","last_clean":"2024-04-23T10:15:43.074391+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:15:43.074391+0000","last_undegraded":"2024-04-23T10:15:43.074391+0000","last_fullsized":"2024-04-23T10:15:43.074391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185670+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:15:43.185670+0000","last_peered":"2024-04-23T10:15:43.185670+0000","last_clean":"2024-04-23T10:15:43.185670+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:15:43.185670+0000","last_undegraded":"2024-04-23T10:15:43.185670+0000","last_fullsized":"2024-04-23T10:15:43.185670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183710+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:15:43.183710+0000","last_peered":"2024-04-23T10:15:43.183710+0000","last_clean":"2024-04-23T10:15:43.183710+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:15:43.183710+0000","last_undegraded":"2024-04-23T10:15:43.183710+0000","last_fullsized":"2024-04-23T10:15:43.183710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186025+0000","last_change":"2024-04-23T10:15:42.096686+0000","last_active":"2024-04-23T10:15:43.186025+0000","last_peered":"2024-04-23T10:15:43.186025+0000","last_clean":"2024-04-23T10:15:43.186025+0000","last_became_active":"2024-04-23T10:15:42.096056+0000","last_became_peered":"2024-04-23T10:15:42.096056+0000","last_unstale":"2024-04-23T10:15:43.186025+0000","last_undegraded":"2024-04-23T10:15:43.186025+0000","last_fullsized":"2024-04-23T10:15:43.186025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:56.385523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077884+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:15:43.077884+0000","last_peered":"2024-04-23T10:15:43.077884+0000","last_clean":"2024-04-23T10:15:43.077884+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:15:43.077884+0000","last_undegraded":"2024-04-23T10:15:43.077884+0000","last_fullsized":"2024-04-23T10:15:43.077884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.073994+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:15:43.073994+0000","last_peered":"2024-04-23T10:15:43.073994+0000","last_clean":"2024-04-23T10:15:43.073994+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:15:43.073994+0000","last_undegraded":"2024-04-23T10:15:43.073994+0000","last_fullsized":"2024-04-23T10:15:43.073994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077654+0000","last_change":"2024-04-23T10:15:38.009820+0000","last_active":"2024-04-23T10:15:43.077654+0000","last_peered":"2024-04-23T10:15:43.077654+0000","last_clean":"2024-04-23T10:15:43.077654+0000","last_became_active":"2024-04-23T10:15:38.008893+0000","last_became_peered":"2024-04-23T10:15:38.008893+0000","last_unstale":"2024-04-23T10:15:43.077654+0000","last_undegraded":"2024-04-23T10:15:43.077654+0000","last_fullsized":"2024-04-23T10:15:43.077654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:22:50.250644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181828+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:15:43.181828+0000","last_peered":"2024-04-23T10:15:43.181828+0000","last_clean":"2024-04-23T10:15:43.181828+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:15:43.181828+0000","last_undegraded":"2024-04-23T10:15:43.181828+0000","last_fullsized":"2024-04-23T10:15:43.181828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186018+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:15:43.186018+0000","last_peered":"2024-04-23T10:15:43.186018+0000","last_clean":"2024-04-23T10:15:43.186018+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:15:43.186018+0000","last_undegraded":"2024-04-23T10:15:43.186018+0000","last_fullsized":"2024-04-23T10:15:43.186018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179808+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:15:43.179808+0000","last_peered":"2024-04-23T10:15:43.179808+0000","last_clean":"2024-04-23T10:15:43.179808+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:15:43.179808+0000","last_undegraded":"2024-04-23T10:15:43.179808+0000","last_fullsized":"2024-04-23T10:15:43.179808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079799+0000","last_change":"2024-04-23T10:15:38.032528+0000","last_active":"2024-04-23T10:15:43.079799+0000","last_peered":"2024-04-23T10:15:43.079799+0000","last_clean":"2024-04-23T10:15:43.079799+0000","last_became_active":"2024-04-23T10:15:38.031888+0000","last_became_peered":"2024-04-23T10:15:38.031888+0000","last_unstale":"2024-04-23T10:15:43.079799+0000","last_undegraded":"2024-04-23T10:15:43.079799+0000","last_fullsized":"2024-04-23T10:15:43.079799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:27.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186307+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:15:43.186307+0000","last_peered":"2024-04-23T10:15:43.186307+0000","last_clean":"2024-04-23T10:15:43.186307+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:15:43.186307+0000","last_undegraded":"2024-04-23T10:15:43.186307+0000","last_fullsized":"2024-04-23T10:15:43.186307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077440+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:15:43.077440+0000","last_peered":"2024-04-23T10:15:43.077440+0000","last_clean":"2024-04-23T10:15:43.077440+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:15:43.077440+0000","last_undegraded":"2024-04-23T10:15:43.077440+0000","last_fullsized":"2024-04-23T10:15:43.077440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185500+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:15:43.185500+0000","last_peered":"2024-04-23T10:15:43.185500+0000","last_clean":"2024-04-23T10:15:43.185500+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:15:43.185500+0000","last_undegraded":"2024-04-23T10:15:43.185500+0000","last_fullsized":"2024-04-23T10:15:43.185500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077430+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:15:43.077430+0000","last_peered":"2024-04-23T10:15:43.077430+0000","last_clean":"2024-04-23T10:15:43.077430+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:15:43.077430+0000","last_undegraded":"2024-04-23T10:15:43.077430+0000","last_fullsized":"2024-04-23T10:15:43.077430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181490+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:15:43.181490+0000","last_peered":"2024-04-23T10:15:43.181490+0000","last_clean":"2024-04-23T10:15:43.181490+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:15:43.181490+0000","last_undegraded":"2024-04-23T10:15:43.181490+0000","last_fullsized":"2024-04-23T10:15:43.181490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079050+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:15:43.079050+0000","last_peered":"2024-04-23T10:15:43.079050+0000","last_clean":"2024-04-23T10:15:43.079050+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:15:43.079050+0000","last_undegraded":"2024-04-23T10:15:43.079050+0000","last_fullsized":"2024-04-23T10:15:43.079050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183628+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:15:43.183628+0000","last_peered":"2024-04-23T10:15:43.183628+0000","last_clean":"2024-04-23T10:15:43.183628+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:15:43.183628+0000","last_undegraded":"2024-04-23T10:15:43.183628+0000","last_fullsized":"2024-04-23T10:15:43.183628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074767+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:15:43.074767+0000","last_peered":"2024-04-23T10:15:43.074767+0000","last_clean":"2024-04-23T10:15:43.074767+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:15:43.074767+0000","last_undegraded":"2024-04-23T10:15:43.074767+0000","last_fullsized":"2024-04-23T10:15:43.074767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078901+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:15:43.078901+0000","last_peered":"2024-04-23T10:15:43.078901+0000","last_clean":"2024-04-23T10:15:43.078901+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:15:43.078901+0000","last_undegraded":"2024-04-23T10:15:43.078901+0000","last_fullsized":"2024-04-23T10:15:43.078901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.076772+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:15:43.076772+0000","last_peered":"2024-04-23T10:15:43.076772+0000","last_clean":"2024-04-23T10:15:43.076772+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:15:43.076772+0000","last_undegraded":"2024-04-23T10:15:43.076772+0000","last_fullsized":"2024-04-23T10:15:43.076772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179961+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:15:43.179961+0000","last_peered":"2024-04-23T10:15:43.179961+0000","last_clean":"2024-04-23T10:15:43.179961+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:15:43.179961+0000","last_undegraded":"2024-04-23T10:15:43.179961+0000","last_fullsized":"2024-04-23T10:15:43.179961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179876+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:15:43.179876+0000","last_peered":"2024-04-23T10:15:43.179876+0000","last_clean":"2024-04-23T10:15:43.179876+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:15:43.179876+0000","last_undegraded":"2024-04-23T10:15:43.179876+0000","last_fullsized":"2024-04-23T10:15:43.179876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185516+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:15:43.185516+0000","last_peered":"2024-04-23T10:15:43.185516+0000","last_clean":"2024-04-23T10:15:43.185516+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:15:43.185516+0000","last_undegraded":"2024-04-23T10:15:43.185516+0000","last_fullsized":"2024-04-23T10:15:43.185516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183819+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:15:43.183819+0000","last_peered":"2024-04-23T10:15:43.183819+0000","last_clean":"2024-04-23T10:15:43.183819+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:15:43.183819+0000","last_undegraded":"2024-04-23T10:15:43.183819+0000","last_fullsized":"2024-04-23T10:15:43.183819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079377+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:15:43.079377+0000","last_peered":"2024-04-23T10:15:43.079377+0000","last_clean":"2024-04-23T10:15:43.079377+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:15:43.079377+0000","last_undegraded":"2024-04-23T10:15:43.079377+0000","last_fullsized":"2024-04-23T10:15:43.079377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079668+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:15:43.079668+0000","last_peered":"2024-04-23T10:15:43.079668+0000","last_clean":"2024-04-23T10:15:43.079668+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:15:43.079668+0000","last_undegraded":"2024-04-23T10:15:43.079668+0000","last_fullsized":"2024-04-23T10:15:43.079668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185876+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:15:43.185876+0000","last_peered":"2024-04-23T10:15:43.185876+0000","last_clean":"2024-04-23T10:15:43.185876+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:15:43.185876+0000","last_undegraded":"2024-04-23T10:15:43.185876+0000","last_fullsized":"2024-04-23T10:15:43.185876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185157+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:15:43.185157+0000","last_peered":"2024-04-23T10:15:43.185157+0000","last_clean":"2024-04-23T10:15:43.185157+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:15:43.185157+0000","last_undegraded":"2024-04-23T10:15:43.185157+0000","last_fullsized":"2024-04-23T10:15:43.185157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183096+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:15:43.183096+0000","last_peered":"2024-04-23T10:15:43.183096+0000","last_clean":"2024-04-23T10:15:43.183096+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:15:43.183096+0000","last_undegraded":"2024-04-23T10:15:43.183096+0000","last_fullsized":"2024-04-23T10:15:43.183096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077230+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:15:43.077230+0000","last_peered":"2024-04-23T10:15:43.077230+0000","last_clean":"2024-04-23T10:15:43.077230+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:15:43.077230+0000","last_undegraded":"2024-04-23T10:15:43.077230+0000","last_fullsized":"2024-04-23T10:15:43.077230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182252+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:15:43.182252+0000","last_peered":"2024-04-23T10:15:43.182252+0000","last_clean":"2024-04-23T10:15:43.182252+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:15:43.182252+0000","last_undegraded":"2024-04-23T10:15:43.182252+0000","last_fullsized":"2024-04-23T10:15:43.182252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077579+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:15:43.077579+0000","last_peered":"2024-04-23T10:15:43.077579+0000","last_clean":"2024-04-23T10:15:43.077579+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:15:43.077579+0000","last_undegraded":"2024-04-23T10:15:43.077579+0000","last_fullsized":"2024-04-23T10:15:43.077579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180320+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:15:43.180320+0000","last_peered":"2024-04-23T10:15:43.180320+0000","last_clean":"2024-04-23T10:15:43.180320+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:15:43.180320+0000","last_undegraded":"2024-04-23T10:15:43.180320+0000","last_fullsized":"2024-04-23T10:15:43.180320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181064+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:15:43.181064+0000","last_peered":"2024-04-23T10:15:43.181064+0000","last_clean":"2024-04-23T10:15:43.181064+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:15:43.181064+0000","last_undegraded":"2024-04-23T10:15:43.181064+0000","last_fullsized":"2024-04-23T10:15:43.181064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185772+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:15:43.185772+0000","last_peered":"2024-04-23T10:15:43.185772+0000","last_clean":"2024-04-23T10:15:43.185772+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:15:43.185772+0000","last_undegraded":"2024-04-23T10:15:43.185772+0000","last_fullsized":"2024-04-23T10:15:43.185772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:16:01.746 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-23T10:16:01.747 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T10:16:01.747 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-23T10:16:01.747 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-23T10:16:01.747 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-23T10:16:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f38899640 1 Processor -- start 2024-04-23T10:16:01.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f38899640 1 -- start start 2024-04-23T10:16:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f38899640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3406f150 0x7f9f3406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f38899640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f340c3fe0 con 0x7f9f340ccc50 2024-04-23T10:16:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f38899640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f340c42c0 con 0x7f9f34153190 2024-04-23T10:16:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f38899640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9f34159f20 con 0x7f9f3406f150 2024-04-23T10:16:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f32d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9f340ccc50 0x7f9f340cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35058/0 (socket says 172.21.15.29:35058) 2024-04-23T10:16:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f32d9d640 1 -- 172.21.15.29:0/2429131135 learned_addr learned my addr 172.21.15.29:0/2429131135 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f31d9b640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3406f150 0x7f9f3406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772099475 0 0) 0x7f9f340c3fe0 con 0x7f9f340ccc50 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f14003530 con 0x7f9f340ccc50 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3967123383 0 0) 0x7f9f14003530 con 0x7f9f340ccc50 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3406f150 msgr2=0x7f9f3406f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3406f150 0x7f9f3406f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 >> v1:172.21.15.72:6789/0 conn(0x7f9f34153190 legacy=0x7f9f34159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f340c45a0 con 0x7f9f340ccc50 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f9f2c001a00 con 0x7f9f340ccc50 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 >> v1:172.21.15.29:6789/0 conn(0x7f9f340ccc50 legacy=0x7f9f340cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f14003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3406f150 0x7f9f14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f14004d50 0x7f9f140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34159f20 con 0x7f9f140039f0 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1400bb10 con 0x7f9f14004d50 2024-04-23T10:16:01.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1400bd10 con 0x7f9f3406f150 2024-04-23T10:16:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3259c640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f14003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3259c640 1 -- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3406f150 msgr2=0x7f9f14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3259c640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3406f150 0x7f9f14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3259c640 1 -- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f14004d50 msgr2=0x7f9f140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f32d9d640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f14004d50 0x7f9f140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3259c640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f14004d50 0x7f9f140051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.911+0000 7f9f3259c640 1 -- 172.21.15.29:0/2429131135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f14003530 con 0x7f9f140039f0 2024-04-23T10:16:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f3259c640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f14003e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f24001750 tx=0x7f9f2401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1095eee184c914b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240013a0 con 0x7f9f140039f0 2024-04-23T10:16:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f240052f0 con 0x7f9f140039f0 2024-04-23T10:16:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f3159a640 1 -- 172.21.15.29:0/2429131135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24003840 con 0x7f9f140039f0 2024-04-23T10:16:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f38899640 1 -- 172.21.15.29:0/2429131135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 msgr2=0x7f9f14003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f38899640 1 --2- 172.21.15.29:0/2429131135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f14003e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f24001750 tx=0x7f9f2401c3e0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f32d9d640 1 -- 172.21.15.29:0/2429131135 reap_dead start 2024-04-23T10:16:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f38899640 1 -- 172.21.15.29:0/2429131135 shutdown_connections 2024-04-23T10:16:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f38899640 1 -- 172.21.15.29:0/2429131135 >> 172.21.15.29:0/2429131135 conn(0x7f9f3406cfb0 msgr2=0x7f9f3406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f38899640 1 -- 172.21.15.29:0/2429131135 shutdown_connections 2024-04-23T10:16:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f38899640 1 -- 172.21.15.29:0/2429131135 wait complete. 2024-04-23T10:16:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f38899640 1 Processor -- start 2024-04-23T10:16:01.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.915+0000 7f9f38899640 1 -- start start 2024-04-23T10:16:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f341f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3414bae0 0x7f9f34154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3414dbd0 0x7f9f340cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34153570 con 0x7f9f140039f0 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34159380 con 0x7f9f3414bae0 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9f340c4880 con 0x7f9f3414dbd0 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f341f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f341f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59102/0 (socket says 172.21.15.29:59102) 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 -- 172.21.15.29:0/3540869374 learned_addr learned my addr 172.21.15.29:0/3540869374 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f32d9d640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3414dbd0 0x7f9f340cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f31d9b640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3414bae0 0x7f9f34154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 -- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3414dbd0 msgr2=0x7f9f340cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3414dbd0 0x7f9f340cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 -- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3414bae0 msgr2=0x7f9f34154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3414bae0 0x7f9f34154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 -- 172.21.15.29:0/3540869374 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3414e270 con 0x7f9f140039f0 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f3259c640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f341f21b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f24001750 tx=0x7f9f14005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f2affd640 1 -- 172.21.15.29:0/3540869374 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240013a0 con 0x7f9f140039f0 2024-04-23T10:16:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f2affd640 1 -- 172.21.15.29:0/3540869374 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f240bb070 con 0x7f9f140039f0 2024-04-23T10:16:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3414e550 con 0x7f9f140039f0 2024-04-23T10:16:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f2affd640 1 -- 172.21.15.29:0/3540869374 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24007a40 con 0x7f9f140039f0 2024-04-23T10:16:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3414eb10 con 0x7f9f140039f0 2024-04-23T10:16:01.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f34068d70 con 0x7f9f140039f0 2024-04-23T10:16:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f2affd640 1 -- 172.21.15.29:0/3540869374 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f240b4040 con 0x7f9f140039f0 2024-04-23T10:16:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f2affd640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9f180683b0 0x7f9f1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f2affd640 1 -- 172.21.15.29:0/3540869374 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9f24120f80 con 0x7f9f140039f0 2024-04-23T10:16:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.919+0000 7f9f31d9b640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9f180683b0 0x7f9f1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:01.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.923+0000 7f9f31d9b640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9f180683b0 0x7f9f1806a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f340cc550 tx=0x7f9f1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:01.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:01.923+0000 7f9f2affd640 1 -- 172.21.15.29:0/3540869374 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f240160f0 con 0x7f9f140039f0 2024-04-23T10:16:02.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.123+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9f34156920 con 0x7f9f140039f0 2024-04-23T10:16:02.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.131+0000 7f9f2affd640 1 -- 172.21.15.29:0/3540869374 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168085 (secure 0 0 0) 0x7f9f240f1320 con 0x7f9f140039f0 2024-04-23T10:16:02.134 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9f180683b0 msgr2=0x7f9f1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9f180683b0 0x7f9f1806a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f340cc550 tx=0x7f9f1c008040 comp rx=0 tx=0).stop 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 msgr2=0x7f9f341f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f341f21b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f24001750 tx=0x7f9f14005840 comp rx=0 tx=0).stop 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 shutdown_connections 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9f180683b0 0x7f9f1806a870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f3414dbd0 0x7f9f340cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3414bae0 0x7f9f34154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 --2- 172.21.15.29:0/3540869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f140039f0 0x7f9f341f21b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 >> 172.21.15.29:0/3540869374 conn(0x7f9f3406cfb0 msgr2=0x7f9f3406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 shutdown_connections 2024-04-23T10:16:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.135+0000 7f9f38899640 1 -- 172.21.15.29:0/3540869374 wait complete. 2024-04-23T10:16:02.151 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2614464755},{"type":"v1","addr":"172.21.15.72:6833","nonce":2614464755}]},"active_addr":"172.21.15.72:6833/2614464755","active_change":"2024-04-23T10:15:25.171560+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1246673558}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2681516059}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1605179508}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3155071162}]}]} 2024-04-23T10:16:02.154 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-23T10:16:02.154 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T10:16:02.155 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:02.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.275+0000 7f80546b1640 1 Processor -- start 2024-04-23T10:16:02.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.275+0000 7f80546b1640 1 -- start start 2024-04-23T10:16:02.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f804c06f790 0x7f804c0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f804c071160 0x7f804c073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f804c072590 con 0x7f804c06f3b0 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f804c072fe0 con 0x7f804c06f790 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f804c158df0 con 0x7f804c071160 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f805244d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f804c06f3b0 0x7f804c157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35064/0 (socket says 172.21.15.29:35064) 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f805244d640 1 -- 172.21.15.29:0/4203627028 learned_addr learned my addr 172.21.15.29:0/4203627028 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f8051c4c640 1 --2- 172.21.15.29:0/4203627028 >> v2:172.21.15.29:3300/0 conn(0x7f804c06f790 0x7f804c0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f8052c4e640 1 --2- 172.21.15.29:0/4203627028 >> v2:172.21.15.72:3300/0 conn(0x7f804c071160 0x7f804c073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f805144b640 1 -- 172.21.15.29:0/4203627028 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234587990 0 0) 0x7f804c072590 con 0x7f804c06f3b0 2024-04-23T10:16:02.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f805144b640 1 -- 172.21.15.29:0/4203627028 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8038003530 con 0x7f804c06f3b0 2024-04-23T10:16:02.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f8051c4c640 1 -- 172.21.15.29:0/4203627028 >> v2:172.21.15.72:3300/0 conn(0x7f804c071160 msgr2=0x7f804c073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f8051c4c640 1 --2- 172.21.15.29:0/4203627028 >> v2:172.21.15.72:3300/0 conn(0x7f804c071160 0x7f804c073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f8051c4c640 1 -- 172.21.15.29:0/4203627028 >> v1:172.21.15.29:6789/0 conn(0x7f804c06f3b0 legacy=0x7f804c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f8051c4c640 1 -- 172.21.15.29:0/4203627028 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804c158830 con 0x7f804c06f790 2024-04-23T10:16:02.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f8051c4c640 1 --2- 172.21.15.29:0/4203627028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c0c4d70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f804c155a00 tx=0x7f803c01e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ab69f25ac4c403 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:02.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f805144b640 1 -- 172.21.15.29:0/4203627028 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c0a8630 con 0x7f804c06f790 2024-04-23T10:16:02.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f805144b640 1 -- 172.21.15.29:0/4203627028 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803c0a87d0 con 0x7f804c06f790 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f805144b640 1 -- 172.21.15.29:0/4203627028 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c0a8ba0 con 0x7f804c06f790 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 -- 172.21.15.29:0/4203627028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 msgr2=0x7f804c0c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 --2- 172.21.15.29:0/4203627028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c0c4d70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f804c155a00 tx=0x7f803c01e660 comp rx=0 tx=0).stop 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 -- 172.21.15.29:0/4203627028 shutdown_connections 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 --2- 172.21.15.29:0/4203627028 >> v2:172.21.15.72:3300/0 conn(0x7f804c071160 0x7f804c073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 --2- 172.21.15.29:0/4203627028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c0c4d70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 -- 172.21.15.29:0/4203627028 >> 172.21.15.29:0/4203627028 conn(0x7f804c06cfb0 msgr2=0x7f804c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 -- 172.21.15.29:0/4203627028 shutdown_connections 2024-04-23T10:16:02.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.279+0000 7f80546b1640 1 -- 172.21.15.29:0/4203627028 wait complete. 2024-04-23T10:16:02.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 Processor -- start 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 -- start start 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804c06f3b0 0x7f804c1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804c071160 0x7f804c148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f804c152330 con 0x7f804c06f790 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f804c158500 con 0x7f804c071160 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f804c1524b0 con 0x7f804c06f3b0 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59116/0 (socket says 172.21.15.29:59116) 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 -- 172.21.15.29:0/1840970469 learned_addr learned my addr 172.21.15.29:0/1840970469 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f805244d640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804c06f3b0 0x7f804c1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8052c4e640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804c071160 0x7f804c148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 -- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804c06f3b0 msgr2=0x7f804c1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804c06f3b0 0x7f804c1551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 -- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804c071160 msgr2=0x7f804c148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804c071160 0x7f804c148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 -- 172.21.15.29:0/1840970469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804c0c3280 con 0x7f804c06f790 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8051c4c640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c149fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f803c01b270 tx=0x7f803c01cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:02.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8042ffd640 1 -- 172.21.15.29:0/1840970469 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c0bf070 con 0x7f804c06f790 2024-04-23T10:16:02.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8042ffd640 1 -- 172.21.15.29:0/1840970469 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803c0a9610 con 0x7f804c06f790 2024-04-23T10:16:02.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804c14ad60 con 0x7f804c06f790 2024-04-23T10:16:02.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f8042ffd640 1 -- 172.21.15.29:0/1840970469 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c0a9a00 con 0x7f804c06f790 2024-04-23T10:16:02.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f804c14b320 con 0x7f804c06f790 2024-04-23T10:16:02.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.283+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f804c068d70 con 0x7f804c06f790 2024-04-23T10:16:02.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.287+0000 7f8042ffd640 1 -- 172.21.15.29:0/1840970469 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f803c0b2400 con 0x7f804c06f790 2024-04-23T10:16:02.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.287+0000 7f8042ffd640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8030068380 0x7f803006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.287+0000 7f8042ffd640 1 -- 172.21.15.29:0/1840970469 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f803c123060 con 0x7f804c06f790 2024-04-23T10:16:02.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.287+0000 7f805244d640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8030068380 0x7f803006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.287+0000 7f805244d640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8030068380 0x7f803006a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8048007fd0 tx=0x7f8048009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:02.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.291+0000 7f8042ffd640 1 -- 172.21.15.29:0/1840970469 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f803c0ae030 con 0x7f804c06f790 2024-04-23T10:16:02.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.455+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f804c06d530 con 0x7f804c06f790 2024-04-23T10:16:02.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.455+0000 7f8042ffd640 1 -- 172.21.15.29:0/1840970469 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f803c018280 con 0x7f804c06f790 2024-04-23T10:16:02.457 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:02.458 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:02.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8030068380 msgr2=0x7f803006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8030068380 0x7f803006a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8048007fd0 tx=0x7f8048009040 comp rx=0 tx=0).stop 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 msgr2=0x7f804c149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c149fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f803c01b270 tx=0x7f803c01cea0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 shutdown_connections 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8030068380 0x7f803006a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804c071160 0x7f804c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f804c06f790 0x7f804c149fd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 --2- 172.21.15.29:0/1840970469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804c06f3b0 0x7f804c1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 >> 172.21.15.29:0/1840970469 conn(0x7f804c06cfb0 msgr2=0x7f804c0c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:02.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 shutdown_connections 2024-04-23T10:16:02.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.459+0000 7f80546b1640 1 -- 172.21.15.29:0/1840970469 wait complete. 2024-04-23T10:16:02.477 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T10:16:02.477 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:02.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.595+0000 7f9ea7b87640 1 Processor -- start 2024-04-23T10:16:02.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.595+0000 7f9ea7b87640 1 -- start start 2024-04-23T10:16:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea7b87640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ea01443c0 0x7f9ea0074d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea7b87640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 0x7f9ea00752a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea7b87640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea015b200 con 0x7f9ea0070470 2024-04-23T10:16:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea7b87640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea015b4c0 con 0x7f9ea01443c0 2024-04-23T10:16:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea7b87640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea015b7a0 con 0x7f9ea0072f20 2024-04-23T10:16:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea6124640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9ea0070470 0x7f9ea015e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35070/0 (socket says 172.21.15.29:35070) 2024-04-23T10:16:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea6124640 1 -- 172.21.15.29:0/298357739 learned_addr learned my addr 172.21.15.29:0/298357739 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5122640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 0x7f9ea00752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5923640 1 --2- 172.21.15.29:0/298357739 >> v2:172.21.15.72:3300/0 conn(0x7f9ea01443c0 0x7f9ea0074d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598174605 0 0) 0x7f9ea015b200 con 0x7f9ea0070470 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e8c003530 con 0x7f9ea0070470 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3767785676 0 0) 0x7f9e8c003530 con 0x7f9ea0070470 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 msgr2=0x7f9ea00752a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 0x7f9ea00752a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 >> v2:172.21.15.72:3300/0 conn(0x7f9ea01443c0 msgr2=0x7f9ea0074d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 --2- 172.21.15.29:0/298357739 >> v2:172.21.15.72:3300/0 conn(0x7f9ea01443c0 0x7f9ea0074d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea015ba80 con 0x7f9ea0070470 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f9e98001a00 con 0x7f9ea0070470 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 >> v1:172.21.15.29:6789/0 conn(0x7f9ea0070470 legacy=0x7f9ea015e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8c0039c0 0x7f9e8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8c004810 0x7f9e8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 0x7f9e8c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea015b4c0 con 0x7f9e8c0039c0 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea015b7a0 con 0x7f9e8c004810 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c00ba00 con 0x7f9ea0072f20 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5923640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8c0039c0 0x7f9e8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5122640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8c004810 0x7f9e8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5923640 1 -- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 msgr2=0x7f9e8c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea6124640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 0x7f9e8c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5923640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 0x7f9e8c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5923640 1 -- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8c004810 msgr2=0x7f9e8c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5923640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8c004810 0x7f9e8c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5923640 1 -- 172.21.15.29:0/298357739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c003530 con 0x7f9e8c0039c0 2024-04-23T10:16:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea5122640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8c004810 0x7f9e8c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.599+0000 7f9ea6124640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ea0072f20 0x7f9e8c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea5923640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8c0039c0 0x7f9e8c003de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009ae0 tx=0x7f9e9c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2428df0d5e2c2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0b2070 con 0x7f9e8c0039c0 2024-04-23T10:16:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c0a55c0 con 0x7f9e8c0039c0 2024-04-23T10:16:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea4921640 1 -- 172.21.15.29:0/298357739 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0096b0 con 0x7f9e8c0039c0 2024-04-23T10:16:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- 172.21.15.29:0/298357739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8c0039c0 msgr2=0x7f9e8c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 --2- 172.21.15.29:0/298357739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8c0039c0 0x7f9e8c003de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009ae0 tx=0x7f9e9c01cab0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 -- 172.21.15.29:0/298357739 reap_dead start 2024-04-23T10:16:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- 172.21.15.29:0/298357739 shutdown_connections 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- 172.21.15.29:0/298357739 >> 172.21.15.29:0/298357739 conn(0x7f9ea006b9e0 msgr2=0x7f9ea006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- 172.21.15.29:0/298357739 shutdown_connections 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- 172.21.15.29:0/298357739 wait complete. 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 Processor -- start 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- start start 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8c0039c0 0x7f9ea00c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ea01f4ca0 0x7f9ea00c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ea00cd540 0x7f9ea015da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea015f0f0 con 0x7f9ea00cd540 2024-04-23T10:16:02.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01447a0 con 0x7f9ea01f4ca0 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea7b87640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea015f270 con 0x7f9e8c0039c0 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ea00cd540 0x7f9ea015da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ea00cd540 0x7f9ea015da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59136/0 (socket says 172.21.15.29:59136) 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 -- 172.21.15.29:0/1468035813 learned_addr learned my addr 172.21.15.29:0/1468035813 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea5122640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ea01f4ca0 0x7f9ea00c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea5923640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8c0039c0 0x7f9ea00c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 -- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8c0039c0 msgr2=0x7f9ea00c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8c0039c0 0x7f9ea00c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 -- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ea01f4ca0 msgr2=0x7f9ea00c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ea01f4ca0 0x7f9ea00c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 -- 172.21.15.29:0/1468035813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea00cdb10 con 0x7f9ea00cd540 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea5122640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ea01f4ca0 0x7f9ea00c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.603+0000 7f9ea6124640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ea00cd540 0x7f9ea015da50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ea006fb60 tx=0x7f9e98010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9e967fc640 1 -- 172.21.15.29:0/1468035813 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9801a070 con 0x7f9ea00cd540 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9e967fc640 1 -- 172.21.15.29:0/1468035813 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e98011040 con 0x7f9ea00cd540 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9e967fc640 1 -- 172.21.15.29:0/1468035813 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800eaf0 con 0x7f9ea00cd540 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea00cddf0 con 0x7f9ea00cd540 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea01f44a0 con 0x7f9ea00cd540 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea00693c0 con 0x7f9ea00cd540 2024-04-23T10:16:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9e967fc640 1 -- 172.21.15.29:0/1468035813 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e980143a0 con 0x7f9ea00cd540 2024-04-23T10:16:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9e967fc640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9e840683b0 0x7f9e8406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9e967fc640 1 -- 172.21.15.29:0/1468035813 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e98089500 con 0x7f9ea00cd540 2024-04-23T10:16:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9ea5923640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9e840683b0 0x7f9e8406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.607+0000 7f9ea5923640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9e840683b0 0x7f9e8406a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0af000 tx=0x7f9e9c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.611+0000 7f9e967fc640 1 -- 172.21.15.29:0/1468035813 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e980596f0 con 0x7f9ea00cd540 2024-04-23T10:16:02.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.775+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ea006bdf0 con 0x7f9ea00cd540 2024-04-23T10:16:02.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9e967fc640 1 -- 172.21.15.29:0/1468035813 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f9e98058ff0 con 0x7f9ea00cd540 2024-04-23T10:16:02.779 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:02.779 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9e840683b0 msgr2=0x7f9e8406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9e840683b0 0x7f9e8406a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0af000 tx=0x7f9e9c0046d0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ea00cd540 msgr2=0x7f9ea015da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ea00cd540 0x7f9ea015da50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ea006fb60 tx=0x7f9e98010c30 comp rx=0 tx=0).stop 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 shutdown_connections 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9e840683b0 0x7f9e8406a870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ea00cd540 0x7f9ea015da50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ea01f4ca0 0x7f9ea00c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 --2- 172.21.15.29:0/1468035813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8c0039c0 0x7f9ea00c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 >> 172.21.15.29:0/1468035813 conn(0x7f9ea006b9e0 msgr2=0x7f9ea015a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:02.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 shutdown_connections 2024-04-23T10:16:02.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.779+0000 7f9ea7b87640 1 -- 172.21.15.29:0/1468035813 wait complete. 2024-04-23T10:16:02.798 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T10:16:02.799 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T10:16:02.799 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T10:16:02.800 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T10:16:02.800 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-23T10:16:02.801 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-23T10:16:02.801 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-23T10:16:02.802 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-23T10:16:02.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f00924e2640 1 Processor -- start 2024-04-23T10:16:02.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f00924e2640 1 -- start start 2024-04-23T10:16:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f00924e2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f008c151030 0x7f008c0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f00924e2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 0x7f008c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f00924e2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c15a5b0 con 0x7f008c151410 2024-04-23T10:16:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f00924e2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f008c15a870 con 0x7f008c151030 2024-04-23T10:16:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f00924e2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f008c15ab50 con 0x7f008c0c7ef0 2024-04-23T10:16:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f008bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f008c151030 0x7f008c0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f008b7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f008c151410 0x7f008c0c77e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:50790/0 (socket says 172.21.15.29:50790) 2024-04-23T10:16:02.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f008b7fe640 1 -- 172.21.15.29:0/3948380656 learned_addr learned my addr 172.21.15.29:0/3948380656 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:02.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f0090a7f640 1 --2- 172.21.15.29:0/3948380656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 0x7f008c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f008affd640 1 -- 172.21.15.29:0/3948380656 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772861114 0 0) 0x7f008c15a5b0 con 0x7f008c151410 2024-04-23T10:16:02.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f008affd640 1 -- 172.21.15.29:0/3948380656 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0074003530 con 0x7f008c151410 2024-04-23T10:16:02.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f0090a7f640 1 -- 172.21.15.29:0/3948380656 >> v2:172.21.15.29:3300/0 conn(0x7f008c151030 msgr2=0x7f008c0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f0090a7f640 1 --2- 172.21.15.29:0/3948380656 >> v2:172.21.15.29:3300/0 conn(0x7f008c151030 0x7f008c0c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.979+0000 7f008affd640 1 -- 172.21.15.29:0/3948380656 <== mon.1 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 464313064 0 0) 0x7f0074003530 con 0x7f008c151410 2024-04-23T10:16:02.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f0090a7f640 1 -- 172.21.15.29:0/3948380656 >> v1:172.21.15.72:6789/0 conn(0x7f008c151410 legacy=0x7f008c0c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f0090a7f640 1 -- 172.21.15.29:0/3948380656 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c15ae30 con 0x7f008c0c7ef0 2024-04-23T10:16:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8773d61640 1 Processor -- start 2024-04-23T10:16:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe44ab79640 1 Processor -- start 2024-04-23T10:16:02.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe44ab79640 1 -- start start 2024-04-23T10:16:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f008bfff640 1 --2- 172.21.15.29:0/3948380656 >> v2:172.21.15.29:3300/0 conn(0x7f008c151030 0x7f008c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8773d61640 1 -- start start 2024-04-23T10:16:02.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8773d61640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f876c151030 0x7f876c0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8773d61640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151410 0x7f876c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8773d61640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f876c157ab0 0x7f876c0c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8773d61640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f876c15a5b0 con 0x7f876c151030 2024-04-23T10:16:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8773d61640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f876c15a870 con 0x7f876c157ab0 2024-04-23T10:16:02.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8773d61640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f876c15ab50 con 0x7f876c151410 2024-04-23T10:16:02.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe44ab79640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 0x7fe43c04c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe44ab79640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe43c0d4fa0 0x7fe43c0347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe44ab79640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe43c04c850 con 0x7fe43c0dad60 2024-04-23T10:16:02.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe44ab79640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe43c04b9c0 con 0x7fe43c0d4fa0 2024-04-23T10:16:02.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe44ab79640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe43c04bca0 con 0x7fe43c050ce0 2024-04-23T10:16:02.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe443fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe43c0d4fa0 0x7fe43c0347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe443fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe43c0d4fa0 0x7fe43c0347d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59182/0 (socket says 172.21.15.29:59182) 2024-04-23T10:16:02.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe443fff640 1 -- 172.21.15.29:0/1882409324 learned_addr learned my addr 172.21.15.29:0/1882409324 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:02.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f5efc0ad640 1 Processor -- start 2024-04-23T10:16:02.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f5efc0ad640 1 -- start start 2024-04-23T10:16:02.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8771afd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f876c151030 0x7f876c0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8771afd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f876c151030 0x7f876c0c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59166/0 (socket says 172.21.15.29:59166) 2024-04-23T10:16:02.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8771afd640 1 -- 172.21.15.29:0/219671377 learned_addr learned my addr 172.21.15.29:0/219671377 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:02.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe448915640 1 --2- 172.21.15.29:0/1882409324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 0x7fe43c04c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f87722fe640 1 --2- 172.21.15.29:0/219671377 >> v2:172.21.15.72:3300/0 conn(0x7f876c157ab0 0x7f876c0c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f87712fc640 1 --2- 172.21.15.29:0/219671377 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151410 0x7f876c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:02.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f977d7f8640 1 Processor -- start 2024-04-23T10:16:02.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe443fff640 1 -- 172.21.15.29:0/1882409324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 msgr2=0x7fe43c04c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe443fff640 1 --2- 172.21.15.29:0/1882409324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 0x7fe43c04c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe443fff640 1 -- 172.21.15.29:0/1882409324 >> v1:172.21.15.72:6789/0 conn(0x7fe43c0dad60 legacy=0x7fe43c0db1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:02.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fe443fff640 1 -- 172.21.15.29:0/1882409324 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c006ad0 con 0x7fe43c0d4fa0 2024-04-23T10:16:02.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fb926984640 1 Processor -- start 2024-04-23T10:16:02.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f977d7f8640 1 -- start start 2024-04-23T10:16:02.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f0090a7f640 1 --2- 172.21.15.29:0/3948380656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 0x7f008c0c9460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f007c0097c0 tx=0x7f007c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e2275fe785809b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8771afd640 1 -- 172.21.15.29:0/219671377 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151410 msgr2=0x7f876c0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8771afd640 1 --2- 172.21.15.29:0/219671377 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151410 0x7f876c0c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8771afd640 1 -- 172.21.15.29:0/219671377 >> v2:172.21.15.72:3300/0 conn(0x7f876c157ab0 msgr2=0x7f876c0c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8771afd640 1 --2- 172.21.15.29:0/219671377 >> v2:172.21.15.72:3300/0 conn(0x7f876c157ab0 0x7f876c0c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:02.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8771afd640 1 -- 172.21.15.29:0/219671377 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c15ae30 con 0x7f876c151030 2024-04-23T10:16:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f008affd640 1 -- 172.21.15.29:0/3948380656 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c0b0070 con 0x7f008c0c7ef0 2024-04-23T10:16:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f008affd640 1 -- 172.21.15.29:0/3948380656 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f007c0ab400 con 0x7f008c0c7ef0 2024-04-23T10:16:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f008affd640 1 -- 172.21.15.29:0/3948380656 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084001a00 con 0x7f008c0c7ef0 2024-04-23T10:16:02.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5efc0ad640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5ef4151030 0x7f5ef40c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f977d7f8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f97780b2d90 0x7f9778151b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f977d7f8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f97781520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f977d7f8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97780c2960 con 0x7f97780b29b0 2024-04-23T10:16:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f977d7f8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f9778071c20 con 0x7f97780b2d90 2024-04-23T10:16:02.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f977d7f8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f97780c2000 con 0x7f9778067b10 2024-04-23T10:16:02.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5efc0ad640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef415a5b0 con 0x7f5ef40c7ef0 2024-04-23T10:16:02.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7f8d16944640 1 Processor -- start 2024-04-23T10:16:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5efc0ad640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef415a870 con 0x7f5ef4151410 2024-04-23T10:16:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5efc0ad640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5ef415ab50 con 0x7f5ef4151030 2024-04-23T10:16:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d16944640 1 -- start start 2024-04-23T10:16:02.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5ef9648640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5ef4151410 0x7f5ef40c77e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:50794/0 (socket says 172.21.15.29:50794) 2024-04-23T10:16:02.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5ef9648640 1 -- 172.21.15.29:0/2469688893 learned_addr learned my addr 172.21.15.29:0/2469688893 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:02.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.983+0000 7fb926984640 1 -- start start 2024-04-23T10:16:02.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb926984640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9180db440 0x7fb9180e6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:02.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb926984640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91804b990 con 0x7fb9180d5000 2024-04-23T10:16:02.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb926984640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91804bc70 con 0x7fb9180347a0 2024-04-23T10:16:02.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb926984640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb918006aa0 con 0x7fb9180db440 2024-04-23T10:16:02.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb91ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb9180d5000 0x7fb91804c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35084/0 (socket says 172.21.15.29:35084) 2024-04-23T10:16:02.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb91ffff640 1 -- 172.21.15.29:0/1208936504 learned_addr learned my addr 172.21.15.29:0/1208936504 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:03.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5ef9e49640 1 --2- 172.21.15.29:0/2469688893 >> v2:172.21.15.29:3300/0 conn(0x7f5ef4151030 0x7f5ef40c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5ef9e49640 1 -- 172.21.15.29:0/2469688893 >> v1:172.21.15.72:6789/0 conn(0x7f5ef4151410 legacy=0x7f5ef40c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5ef9e49640 1 -- 172.21.15.29:0/2469688893 >> v1:172.21.15.29:6789/0 conn(0x7f5ef40c7ef0 legacy=0x7f5ef40c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5ef9e49640 1 -- 172.21.15.29:0/2469688893 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef415ae30 con 0x7f5ef4151030 2024-04-23T10:16:03.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f5ef8e47640 1 -- 172.21.15.29:0/2469688893 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591985314 0 0) 0x7f5ef415a870 con 0x7f5ef4151410 2024-04-23T10:16:03.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f9776ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f97780b29b0 0x7f97780c32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:50802/0 (socket says 172.21.15.29:50802) 2024-04-23T10:16:03.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f9776ffd640 1 -- 172.21.15.29:0/2018353923 learned_addr learned my addr 172.21.15.29:0/2018353923 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:03.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f00924e2640 1 -- 172.21.15.29:0/3948380656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 msgr2=0x7f008c0c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f00924e2640 1 --2- 172.21.15.29:0/3948380656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 0x7f008c0c9460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f007c0097c0 tx=0x7f007c01c350 comp rx=0 tx=0).stop 2024-04-23T10:16:03.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f00924e2640 1 -- 172.21.15.29:0/3948380656 shutdown_connections 2024-04-23T10:16:03.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f00924e2640 1 --2- 172.21.15.29:0/3948380656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 0x7f008c0c9460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f00924e2640 1 --2- 172.21.15.29:0/3948380656 >> v2:172.21.15.29:3300/0 conn(0x7f008c151030 0x7f008c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f00924e2640 1 -- 172.21.15.29:0/3948380656 >> 172.21.15.29:0/3948380656 conn(0x7f008c067d60 msgr2=0x7f008c074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f00924e2640 1 -- 172.21.15.29:0/3948380656 shutdown_connections 2024-04-23T10:16:03.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fe443fff640 1 --2- 172.21.15.29:0/1882409324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0d4fa0 0x7fe43c0347d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe438009870 tx=0x7fe43801ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ce7ab7e47daf35 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d16944640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d080d5000 0x7f8d080db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d16944640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d080347a0 0x7f8d080e5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d16944640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d080dbb00 con 0x7f8d08050cb0 2024-04-23T10:16:03.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d16944640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8d080d5470 con 0x7f8d080347a0 2024-04-23T10:16:03.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d16944640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0804b990 con 0x7f8d080d5000 2024-04-23T10:16:03.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f00924e2640 1 -- 172.21.15.29:0/3948380656 wait complete. 2024-04-23T10:16:03.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f97777fe640 1 --2- 172.21.15.29:0/2018353923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f97781520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb924f21640 1 --2- 172.21.15.29:0/1208936504 >> v2:172.21.15.72:3300/0 conn(0x7fb9180db440 0x7fb9180e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fe4437fe640 1 -- 172.21.15.29:0/1882409324 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380b5070 con 0x7fe43c0d4fa0 2024-04-23T10:16:03.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fe4437fe640 1 -- 172.21.15.29:0/1882409324 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4380a8a70 con 0x7fe43c0d4fa0 2024-04-23T10:16:03.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fe4437fe640 1 -- 172.21.15.29:0/1882409324 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380b0440 con 0x7fe43c0d4fa0 2024-04-23T10:16:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d0f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d080d5000 0x7f8d080db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d0f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d080d5000 0x7f8d080db5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41058/0 (socket says 172.21.15.29:41058) 2024-04-23T10:16:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d0f7fe640 1 -- 172.21.15.29:0/1690879740 learned_addr learned my addr 172.21.15.29:0/1690879740 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8d14ee1640 1 --2- 172.21.15.29:0/1690879740 >> v2:172.21.15.72:3300/0 conn(0x7f8d080347a0 0x7f8d080e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f8771afd640 1 --2- 172.21.15.29:0/219671377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151030 0x7f876c0c8f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f876c0c9ae0 tx=0x7f876401ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c579a05657117 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f97767fc640 1 --2- 172.21.15.29:0/2018353923 >> v2:172.21.15.29:3300/0 conn(0x7f97780b2d90 0x7f9778151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7f9775ffb640 1 -- 172.21.15.29:0/2018353923 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040531449 0 0) 0x7f97780c2960 con 0x7f97780b29b0 2024-04-23T10:16:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 -- 172.21.15.29:0/1882409324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0d4fa0 msgr2=0x7fe43c0347d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 --2- 172.21.15.29:0/1882409324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0d4fa0 0x7fe43c0347d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe438009870 tx=0x7fe43801ed70 comp rx=0 tx=0).stop 2024-04-23T10:16:03.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb91effd640 1 -- 172.21.15.29:0/1208936504 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88342001 0 0) 0x7fb91804b990 con 0x7fb9180d5000 2024-04-23T10:16:03.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb91effd640 1 -- 172.21.15.29:0/1208936504 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb910003450 con 0x7fb9180d5000 2024-04-23T10:16:03.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb924f21640 1 -- 172.21.15.29:0/1208936504 >> v1:172.21.15.72:6789/0 conn(0x7fb9180347a0 legacy=0x7fb9180dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb924f21640 1 -- 172.21.15.29:0/1208936504 >> v1:172.21.15.29:6789/0 conn(0x7fb9180d5000 legacy=0x7fb91804c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.987+0000 7fb924f21640 1 -- 172.21.15.29:0/1208936504 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb918006d80 con 0x7fb9180db440 2024-04-23T10:16:03.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 Processor -- start 2024-04-23T10:16:03.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 -- start start 2024-04-23T10:16:03.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 -- 172.21.15.29:0/1882409324 shutdown_connections 2024-04-23T10:16:03.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 --2- 172.21.15.29:0/1882409324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0d4fa0 0x7fe43c0347d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 --2- 172.21.15.29:0/1882409324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 0x7fe43c04c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 -- 172.21.15.29:0/1882409324 >> 172.21.15.29:0/1882409324 conn(0x7fe43c0501c0 msgr2=0x7fe43c0505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5ef9e49640 1 --2- 172.21.15.29:0/2469688893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151030 0x7f5ef40c8f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0008820 tx=0x7f5ef001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df200ad5e4d4a9c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 -- 172.21.15.29:0/1882409324 shutdown_connections 2024-04-23T10:16:03.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 0x7f008c0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f008c151030 0x7f008c1f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f008c151410 0x7f008c1456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f008c1638b0 con 0x7f008c151410 2024-04-23T10:16:03.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f008c075680 con 0x7f008c151030 2024-04-23T10:16:03.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f008c163a30 con 0x7f008c0c7ef0 2024-04-23T10:16:03.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8d0f7fe640 1 -- 172.21.15.29:0/1690879740 >> v2:172.21.15.72:3300/0 conn(0x7f8d080347a0 msgr2=0x7f8d080e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8d0f7fe640 1 --2- 172.21.15.29:0/1690879740 >> v2:172.21.15.72:3300/0 conn(0x7f8d080347a0 0x7f8d080e5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8d0f7fe640 1 -- 172.21.15.29:0/1690879740 >> v1:172.21.15.72:6789/0 conn(0x7f8d08050cb0 legacy=0x7f8d0804c2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:16:03.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8d0f7fe640 1 -- 172.21.15.29:0/1690879740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0804bc70 con 0x7f8d080d5000 2024-04-23T10:16:03.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8770afb640 1 -- 172.21.15.29:0/219671377 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640ad070 con 0x7f876c151030 2024-04-23T10:16:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008bfff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 0x7f008c0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8770afb640 1 -- 172.21.15.29:0/219671377 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87640a7ca0 con 0x7f876c151030 2024-04-23T10:16:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8770afb640 1 -- 172.21.15.29:0/219671377 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876400be60 con 0x7f876c151030 2024-04-23T10:16:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5ef8e47640 1 -- 172.21.15.29:0/2469688893 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00a6700 con 0x7f5ef4151030 2024-04-23T10:16:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5ef8e47640 1 -- 172.21.15.29:0/2469688893 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef00a68a0 con 0x7f5ef4151030 2024-04-23T10:16:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5ef8e47640 1 -- 172.21.15.29:0/2469688893 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00a6c70 con 0x7f5ef4151030 2024-04-23T10:16:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f008c151030 0x7f008c1f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f008c151030 0x7f008c1f03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:50186/0 (socket says 172.21.15.29:50186) 2024-04-23T10:16:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 -- 172.21.15.29:0/2914693430 learned_addr learned my addr 172.21.15.29:0/2914693430 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 -- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 msgr2=0x7f008c0cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f008c0c7ef0 0x7f008c0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 -- 172.21.15.29:0/2914693430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f008c151410 msgr2=0x7f008c1456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f008c151410 0x7f008c1456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 -- 172.21.15.29:0/219671377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151030 msgr2=0x7f876c0c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 --2- 172.21.15.29:0/219671377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151030 0x7f876c0c8f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f876c0c9ae0 tx=0x7f876401ed20 comp rx=0 tx=0).stop 2024-04-23T10:16:03.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 -- 172.21.15.29:0/2914693430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c072720 con 0x7f008c151030 2024-04-23T10:16:03.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 -- 172.21.15.29:0/219671377 shutdown_connections 2024-04-23T10:16:03.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 --2- 172.21.15.29:0/219671377 >> v2:172.21.15.72:3300/0 conn(0x7f876c157ab0 0x7f876c0c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 --2- 172.21.15.29:0/219671377 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151410 0x7f876c0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 --2- 172.21.15.29:0/219671377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151030 0x7f876c0c8f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 -- 172.21.15.29:0/219671377 >> 172.21.15.29:0/219671377 conn(0x7f876c067d60 msgr2=0x7f876c074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 -- 172.21.15.29:0/1882409324 wait complete. 2024-04-23T10:16:03.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 Processor -- start 2024-04-23T10:16:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 -- 172.21.15.29:0/219671377 shutdown_connections 2024-04-23T10:16:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f008b7fe640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f008c151030 0x7f008c1f03e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0084001950 tx=0x7f008400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5efc0ad640 1 -- 172.21.15.29:0/2469688893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151030 msgr2=0x7f5ef40c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5efc0ad640 1 --2- 172.21.15.29:0/2469688893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151030 0x7f5ef40c8f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0008820 tx=0x7f5ef001c720 comp rx=0 tx=0).stop 2024-04-23T10:16:03.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5efc0ad640 1 -- 172.21.15.29:0/2469688893 shutdown_connections 2024-04-23T10:16:03.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5efc0ad640 1 --2- 172.21.15.29:0/2469688893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151030 0x7f5ef40c8f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5efc0ad640 1 -- 172.21.15.29:0/2469688893 >> 172.21.15.29:0/2469688893 conn(0x7f5ef4067d60 msgr2=0x7f5ef4074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084012400 con 0x7f008c151030 2024-04-23T10:16:03.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f9775ffb640 1 -- 172.21.15.29:0/2018353923 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9760003530 con 0x7f97780b29b0 2024-04-23T10:16:03.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c1f3d40 con 0x7f008c151030 2024-04-23T10:16:03.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00840125a0 con 0x7f008c151030 2024-04-23T10:16:03.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084012990 con 0x7f008c151030 2024-04-23T10:16:03.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c14b2e0 con 0x7f008c151030 2024-04-23T10:16:03.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5efc0ad640 1 -- 172.21.15.29:0/2469688893 shutdown_connections 2024-04-23T10:16:03.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f5efc0ad640 1 -- 172.21.15.29:0/2469688893 wait complete. 2024-04-23T10:16:03.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f8773d61640 1 -- 172.21.15.29:0/219671377 wait complete. 2024-04-23T10:16:03.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7fe44ab79640 1 -- start start 2024-04-23T10:16:03.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.991+0000 7f97767fc640 1 -- 172.21.15.29:0/2018353923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 msgr2=0x7f97781520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 0x7fe43c182640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f9775ffb640 1 -- 172.21.15.29:0/2018353923 <== mon.1 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1288799007 0 0) 0x7f9760003530 con 0x7f97780b29b0 2024-04-23T10:16:03.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f008c1effc0 con 0x7f008c151030 2024-04-23T10:16:03.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c0d4fa0 0x7fe43c0ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f97767fc640 1 --2- 172.21.15.29:0/2018353923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f97781520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f97767fc640 1 -- 172.21.15.29:0/2018353923 >> v1:172.21.15.72:6789/0 conn(0x7f97780b29b0 legacy=0x7f97780c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f97767fc640 1 -- 172.21.15.29:0/2018353923 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9778071940 con 0x7f97780b2d90 2024-04-23T10:16:03.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0dad60 0x7fe43c0dc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8773d61640 1 Processor -- start 2024-04-23T10:16:03.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f97777fe640 1 --2- 172.21.15.29:0/2018353923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f97781520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:03.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d0f7fe640 1 --2- 172.21.15.29:0/1690879740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d080d5000 0x7f8d080db5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400bb10 tx=0x7f8d040213e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7b4dc0166dfcaaf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c045160 con 0x7fe43c0dad60 2024-04-23T10:16:03.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c007090 con 0x7fe43c0d4fa0 2024-04-23T10:16:03.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe43c034d10 con 0x7fe43c050ce0 2024-04-23T10:16:03.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0dad60 0x7fe43c0dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe448915640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 0x7fe43c182640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0dad60 0x7fe43c0dc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59222/0 (socket says 172.21.15.29:59222) 2024-04-23T10:16:03.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe448915640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 0x7fe43c182640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41074/0 (socket says 172.21.15.29:41074) 2024-04-23T10:16:03.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 -- 172.21.15.29:0/673370824 learned_addr learned my addr 172.21.15.29:0/673370824 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe443fff640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c0d4fa0 0x7fe43c0ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d0effd640 1 -- 172.21.15.29:0/1690879740 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d040b6070 con 0x7f8d080d5000 2024-04-23T10:16:03.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d0effd640 1 -- 172.21.15.29:0/1690879740 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d040b1600 con 0x7f8d080d5000 2024-04-23T10:16:03.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d0effd640 1 -- 172.21.15.29:0/1690879740 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d040b19d0 con 0x7f8d080d5000 2024-04-23T10:16:03.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 -- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 msgr2=0x7fe43c182640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe43c050ce0 0x7fe43c182640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 -- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c0d4fa0 msgr2=0x7fe43c0ddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe43c0d4fa0 0x7fe43c0ddec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 -- 172.21.15.29:0/673370824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c0dedd0 con 0x7fe43c0dad60 2024-04-23T10:16:03.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8773d61640 1 -- start start 2024-04-23T10:16:03.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe449116640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0dad60 0x7fe43c0dc120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe444050920 tx=0x7fe44406cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f5efc0ad640 1 Processor -- start 2024-04-23T10:16:03.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f5efc0ad640 1 -- start start 2024-04-23T10:16:03.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444091070 con 0x7fe43c0dad60 2024-04-23T10:16:03.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb924f21640 1 --2- 172.21.15.29:0/1208936504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180db440 0x7fb9180e6640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb91400dbe0 tx=0x7fb914022f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7fcc579882d9c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8773d61640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151030 0x7f876c073a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe444074480 con 0x7fe43c0dad60 2024-04-23T10:16:03.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43c0c7030 con 0x7fe43c0dad60 2024-04-23T10:16:03.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8773d61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151410 0x7f876c1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43c0dd6c0 con 0x7fe43c0dad60 2024-04-23T10:16:03.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb91effd640 1 -- 172.21.15.29:0/1208936504 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91400d2d0 con 0x7fb9180db440 2024-04-23T10:16:03.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8773d61640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f876c157ab0 0x7f876c148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151410 0x7f876c1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151410 0x7f876c1486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59228/0 (socket says 172.21.15.29:59228) 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8773d61640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f876c06edc0 con 0x7f876c151410 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8773d61640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f876c06ec40 con 0x7f876c157ab0 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8773d61640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f876c06ef40 con 0x7f876c151030 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 -- 172.21.15.29:0/3902160335 learned_addr learned my addr 172.21.15.29:0/3902160335 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8771afd640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151030 0x7f876c073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 -- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151030 msgr2=0x7f876c073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f876c151030 0x7f876c073a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 -- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f876c157ab0 msgr2=0x7f876c148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f876c157ab0 0x7f876c148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 -- 172.21.15.29:0/3902160335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c201240 con 0x7f876c151410 2024-04-23T10:16:03.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d16944640 1 -- 172.21.15.29:0/1690879740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d080d5000 msgr2=0x7f8d080db5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d16944640 1 --2- 172.21.15.29:0/1690879740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d080d5000 0x7f8d080db5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400bb10 tx=0x7f8d040213e0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d16944640 1 -- 172.21.15.29:0/1690879740 shutdown_connections 2024-04-23T10:16:03.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d16944640 1 --2- 172.21.15.29:0/1690879740 >> v2:172.21.15.72:3300/0 conn(0x7f8d080347a0 0x7f8d080e5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d16944640 1 --2- 172.21.15.29:0/1690879740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d080d5000 0x7f8d080db5c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d16944640 1 -- 172.21.15.29:0/1690879740 >> 172.21.15.29:0/1690879740 conn(0x7f8d08050190 msgr2=0x7f8d080505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d16944640 1 -- 172.21.15.29:0/1690879740 shutdown_connections 2024-04-23T10:16:03.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb91effd640 1 -- 172.21.15.29:0/1208936504 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140acb70 con 0x7fb9180db440 2024-04-23T10:16:03.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb91effd640 1 -- 172.21.15.29:0/1208936504 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91400b450 con 0x7fb9180db440 2024-04-23T10:16:03.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444069d20 con 0x7fe43c0dad60 2024-04-23T10:16:03.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe424001040 con 0x7fe43c0dad60 2024-04-23T10:16:03.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f87712fc640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151410 0x7f876c1486c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f875c00e8e0 tx=0x7f875c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f8d16944640 1 -- 172.21.15.29:0/1690879740 wait complete. 2024-04-23T10:16:03.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f97767fc640 1 --2- 172.21.15.29:0/2018353923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b2d90 0x7f9778151b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f97700097c0 tx=0x7f977001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d091313a9643639 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb926984640 1 -- 172.21.15.29:0/1208936504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180db440 msgr2=0x7fb9180e6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb926984640 1 --2- 172.21.15.29:0/1208936504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180db440 0x7fb9180e6640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb91400dbe0 tx=0x7fb914022f60 comp rx=0 tx=0).stop 2024-04-23T10:16:03.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb926984640 1 -- 172.21.15.29:0/1208936504 shutdown_connections 2024-04-23T10:16:03.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb926984640 1 --2- 172.21.15.29:0/1208936504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180db440 0x7fb9180e6640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb926984640 1 -- 172.21.15.29:0/1208936504 >> 172.21.15.29:0/1208936504 conn(0x7fb918050190 msgr2=0x7fb9180505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0084012b30 con 0x7f008c151030 2024-04-23T10:16:03.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb926984640 1 -- 172.21.15.29:0/1208936504 shutdown_connections 2024-04-23T10:16:03.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.995+0000 7fb926984640 1 -- 172.21.15.29:0/1208936504 wait complete. 2024-04-23T10:16:03.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f0088ff9640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0078068380 0x7f007806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f00840880b0 con 0x7f008c151030 2024-04-23T10:16:03.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f0088ff9640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f0078071af0 0x7f0078073f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 --> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0078074600 con 0x7f0078071af0 2024-04-23T10:16:03.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f00840884a0 con 0x7f008c151030 2024-04-23T10:16:03.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c017070 con 0x7f876c151410 2024-04-23T10:16:03.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875c00ca00 con 0x7f876c151410 2024-04-23T10:16:03.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c00cdb0 con 0x7f876c151410 2024-04-23T10:16:03.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe444094070 con 0x7fe43c0dad60 2024-04-23T10:16:03.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f9775ffb640 1 -- 172.21.15.29:0/2018353923 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b0070 con 0x7f97780b2d90 2024-04-23T10:16:03.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f9775ffb640 1 -- 172.21.15.29:0/2018353923 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700ab400 con 0x7f97780b2d90 2024-04-23T10:16:03.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efc0ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef40c7ef0 0x7f5ef41591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efc0ad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef4151030 0x7f5ef4159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f9775ffb640 1 -- 172.21.15.29:0/2018353923 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9768001a00 con 0x7f97780b2d90 2024-04-23T10:16:03.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efc0ad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151410 0x7f5ef4140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efc0ad640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef40c97f0 con 0x7f5ef4151410 2024-04-23T10:16:03.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efc0ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef40c9670 con 0x7f5ef40c7ef0 2024-04-23T10:16:03.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efc0ad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef41650d0 con 0x7f5ef4151030 2024-04-23T10:16:03.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fe4417fa640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe4280683b0 0x7fe42806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d16944640 1 Processor -- start 2024-04-23T10:16:03.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f008bfff640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0078068380 0x7f007806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f0090a7f640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f0078071af0 0x7f0078073f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151410 0x7f5ef4140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151410 0x7f5ef4140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59232/0 (socket says 172.21.15.29:59232) 2024-04-23T10:16:03.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 -- 172.21.15.29:0/3564950502 learned_addr learned my addr 172.21.15.29:0/3564950502 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c0caff0 con 0x7f876c151410 2024-04-23T10:16:03.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c2017e0 con 0x7f876c151410 2024-04-23T10:16:03.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f977d7f8640 1 -- 172.21.15.29:0/2018353923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b2d90 msgr2=0x7f9778151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f977d7f8640 1 --2- 172.21.15.29:0/2018353923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b2d90 0x7f9778151b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f97700097c0 tx=0x7f977001c330 comp rx=0 tx=0).stop 2024-04-23T10:16:03.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb926984640 1 Processor -- start 2024-04-23T10:16:03.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5ef9648640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef4151030 0x7f5ef4159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5ef9e49640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef40c7ef0 0x7f5ef41591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f977d7f8640 1 -- 172.21.15.29:0/2018353923 shutdown_connections 2024-04-23T10:16:03.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f977d7f8640 1 --2- 172.21.15.29:0/2018353923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f97781520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f977d7f8640 1 --2- 172.21.15.29:0/2018353923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b2d90 0x7f9778151b60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f977d7f8640 1 -- 172.21.15.29:0/2018353923 >> 172.21.15.29:0/2018353923 conn(0x7f97780c99b0 msgr2=0x7f97780c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb926984640 1 -- start start 2024-04-23T10:16:03.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f876c076260 con 0x7f876c151410 2024-04-23T10:16:03.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fe448915640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe4280683b0 0x7fe42806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f0090a7f640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f0078071af0 0x7f0078073f30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f008bfff640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0078068380 0x7f007806a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0080009580 tx=0x7f0080008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d16944640 1 -- start start 2024-04-23T10:16:03.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d16944640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d080347a0 0x7f8d080dd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 -- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef4151030 msgr2=0x7f5ef4159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef4151030 0x7f5ef4159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 -- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef40c7ef0 msgr2=0x7f5ef41591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef40c7ef0 0x7f5ef41591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 -- 172.21.15.29:0/3564950502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef41f33a0 con 0x7f5ef4151410 2024-04-23T10:16:03.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb926984640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9180347a0 0x7fb9180d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb926984640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180d5000 0x7fb9180d7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f5efa64a640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151410 0x7f5ef4140710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c730 tx=0x7f5eec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f977d7f8640 1 -- 172.21.15.29:0/2018353923 shutdown_connections 2024-04-23T10:16:03.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f977d7f8640 1 -- 172.21.15.29:0/2018353923 wait complete. 2024-04-23T10:16:03.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb926984640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9180db440 0x7fb9180dbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d16944640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d08050cb0 0x7f8d08034e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d16944640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d080d5000 0x7f8d0817c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d16944640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8d08007060 con 0x7f8d080347a0 2024-04-23T10:16:03.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb91ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9180347a0 0x7fb9180d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb91ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9180347a0 0x7fb9180d16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41098/0 (socket says 172.21.15.29:41098) 2024-04-23T10:16:03.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb91f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180d5000 0x7fb9180d7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7fb91f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180d5000 0x7fb9180d7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:50226/0 (socket says 172.21.15.29:50226) 2024-04-23T10:16:03.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d16944640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d08006d80 con 0x7f8d080d5000 2024-04-23T10:16:03.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d0ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d080347a0 0x7f8d080dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:02.999+0000 7f8d0f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d08050cb0 0x7f8d08034e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d08050cb0 0x7f8d08034e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41110/0 (socket says 172.21.15.29:41110) 2024-04-23T10:16:03.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0f7fe640 1 -- 172.21.15.29:0/2485238815 learned_addr learned my addr 172.21.15.29:0/2485238815 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d16944640 1 -- 172.21.15.29:0/2485238815 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8d08045130 con 0x7f8d08050cb0 2024-04-23T10:16:03.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91ffff640 1 -- 172.21.15.29:0/229880471 learned_addr learned my addr 172.21.15.29:0/229880471 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb9180d53e0 con 0x7fb9180db440 2024-04-23T10:16:03.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb918045130 con 0x7fb9180d5000 2024-04-23T10:16:03.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb918034c10 con 0x7fb9180347a0 2024-04-23T10:16:03.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d14ee1640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d080d5000 0x7f8d0817c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb924f21640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9180db440 0x7fb9180dbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91ffff640 1 -- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180d5000 msgr2=0x7fb9180d7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91ffff640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9180d5000 0x7fb9180d7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91ffff640 1 -- 172.21.15.29:0/229880471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9180db440 msgr2=0x7fb9180dbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91ffff640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9180db440 0x7fb9180dbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91ffff640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9180df0e0 con 0x7fb9180347a0 2024-04-23T10:16:03.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0f7fe640 1 -- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d080d5000 msgr2=0x7f8d0817c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0f7fe640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d080d5000 0x7f8d0817c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0f7fe640 1 -- 172.21.15.29:0/2485238815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d080347a0 msgr2=0x7f8d080dd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0f7fe640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d080347a0 0x7f8d080dd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0f7fe640 1 -- 172.21.15.29:0/2485238815 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d080dbf30 con 0x7f8d08050cb0 2024-04-23T10:16:03.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0ffff640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d080347a0 0x7f8d080dd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:03.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe444102bc0 con 0x7fe43c0dad60 2024-04-23T10:16:03.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fe448915640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe4280683b0 0x7fe42806a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe430009ac0 tx=0x7fe430009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fe4417fa640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7fe428071b20 0x7fe428073f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 --> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe444074480 con 0x7fe428071b20 2024-04-23T10:16:03.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe444109050 con 0x7fe43c0dad60 2024-04-23T10:16:03.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91ffff640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9180347a0 0x7fb9180d16e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d5b0 tx=0x7fb90c00da70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec003b80 con 0x7f5ef4151410 2024-04-23T10:16:03.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c014070 con 0x7fb9180347a0 2024-04-23T10:16:03.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef41f3660 con 0x7f5ef4151410 2024-04-23T10:16:03.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91804d4b0 con 0x7fb9180347a0 2024-04-23T10:16:03.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f875c01a070 con 0x7f876c151410 2024-04-23T10:16:03.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f87627fc640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8750068450 0x7f875006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f875c0871b0 con 0x7f876c151410 2024-04-23T10:16:03.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f87627fc640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f8750071bc0 0x7f8750074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 --> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f875c0044a0 con 0x7f8750071bc0 2024-04-23T10:16:03.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f875c0875a0 con 0x7f876c151410 2024-04-23T10:16:03.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8771afd640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8750068450 0x7f875006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0f7fe640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d08050cb0 0x7f8d08034e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400b2c0 tx=0x7f8d0401fc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f977d7f8640 1 Processor -- start 2024-04-23T10:16:03.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f977d7f8640 1 -- start start 2024-04-23T10:16:03.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fe443fff640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7fe428071b20 0x7fe428073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fe443fff640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7fe428071b20 0x7fe428073f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9180deb60 con 0x7fb9180347a0 2024-04-23T10:16:03.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef41f3c20 con 0x7f5ef4151410 2024-04-23T10:16:03.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec003d20 con 0x7f5ef4151410 2024-04-23T10:16:03.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0052f0 con 0x7f5ef4151410 2024-04-23T10:16:03.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 <== osd.7 v2:172.21.15.72:6801/1745734040 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0078074600 con 0x7f0078071af0 2024-04-23T10:16:03.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d040c1070 con 0x7f8d08050cb0 2024-04-23T10:16:03.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d040b07d0 con 0x7f8d08050cb0 2024-04-23T10:16:03.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c00b8d0 con 0x7fb9180347a0 2024-04-23T10:16:03.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c007050 con 0x7fb9180347a0 2024-04-23T10:16:03.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f87722fe640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f8750071bc0 0x7f8750074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8771afd640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8750068450 0x7f875006a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f87640b2000 tx=0x7f87640a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f87722fe640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f8750071bc0 0x7f8750074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d040b6070 con 0x7f8d08050cb0 2024-04-23T10:16:03.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d16944640 1 -- 172.21.15.29:0/2485238815 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d080dc210 con 0x7f8d08050cb0 2024-04-23T10:16:03.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f8d16944640 1 -- 172.21.15.29:0/2485238815 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d080d5b90 con 0x7f8d08050cb0 2024-04-23T10:16:03.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f977d7f8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f977814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f977d7f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b29b0 0x7f9778150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f9776ffd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f977814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f9776ffd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f977814efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41114/0 (socket says 172.21.15.29:41114) 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f97767fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b29b0 0x7f9778150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f97767fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b29b0 0x7f9778150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59264/0 (socket says 172.21.15.29:59264) 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f9776ffd640 1 -- 172.21.15.29:0/1628635185 learned_addr learned my addr 172.21.15.29:0/1628635185 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f977d7f8640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97780b2d90 0x7f97780cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f977d7f8640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9778073e00 con 0x7f97780b29b0 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f977d7f8640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9778073c80 con 0x7f97780b2d90 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f977d7f8640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9778164e10 con 0x7f9778067b10 2024-04-23T10:16:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f97777fe640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97780b2d90 0x7f97780cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472ffff640 1 Processor -- start 2024-04-23T10:16:03.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5edc001040 con 0x7f5ef4151410 2024-04-23T10:16:03.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5eec005490 con 0x7f5ef4151410 2024-04-23T10:16:03.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.003+0000 7f5eea7fc640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5ed8068480 0x7f5ed806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5eec086a60 con 0x7f5ef4151410 2024-04-23T10:16:03.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f5eea7fc640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f5ed8071b70 0x7f5ed8073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 --> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5eec010e50 con 0x7f5ed8071b70 2024-04-23T10:16:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5eec055f20 con 0x7f5ef4151410 2024-04-23T10:16:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f5ef9e49640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5ed8068480 0x7f5ed806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f5ef9648640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f5ed8071b70 0x7f5ed8073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb90c017070 con 0x7fb9180347a0 2024-04-23T10:16:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d080dc4f0 con 0x7f8d08050cb0 2024-04-23T10:16:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 <== osd.0 v2:172.21.15.29:6800/486295385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f875c0044a0 con 0x7f8750071bc0 2024-04-23T10:16:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f97767fc640 1 -- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 msgr2=0x7f977814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f97767fc640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9778067b10 0x7f977814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f97767fc640 1 -- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97780b2d90 msgr2=0x7f97780cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f97767fc640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97780b2d90 0x7f97780cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f97767fc640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97780ccc10 con 0x7f97780b29b0 2024-04-23T10:16:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f97767fc640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b29b0 0x7f9778150c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f97700ab000 tx=0x7f97700190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472ffff640 1 -- start start 2024-04-23T10:16:03.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b0040 con 0x7f97780b29b0 2024-04-23T10:16:03.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700bc070 con 0x7f97780b29b0 2024-04-23T10:16:03.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700b56c0 con 0x7f97780b29b0 2024-04-23T10:16:03.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f47280dd210 0x7f4728007ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4728047a40 0x7f47280e3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472ffff640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4728006d30 con 0x7f472804bc20 2024-04-23T10:16:03.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472ffff640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f47280e4020 con 0x7f47280dd210 2024-04-23T10:16:03.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472ffff640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f47280e3d40 con 0x7f4728047a40 2024-04-23T10:16:03.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f47280dd210 0x7f4728007ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f47280dd210 0x7f4728007ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59276/0 (socket says 172.21.15.29:59276) 2024-04-23T10:16:03.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472effd640 1 -- 172.21.15.29:0/2944422335 learned_addr learned my addr 172.21.15.29:0/2944422335 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472f7fe640 1 --2- 172.21.15.29:0/2944422335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4728047a40 0x7f47280e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f977d7f8640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97781f7cf0 con 0x7f97780b29b0 2024-04-23T10:16:03.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f977d7f8640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97781f82b0 con 0x7f97780b29b0 2024-04-23T10:16:03.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472effd640 1 -- 172.21.15.29:0/2944422335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4728047a40 msgr2=0x7f47280e3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb91cff9640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb904068380 0x7fb90406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb900001040 con 0x7fb9180347a0 2024-04-23T10:16:03.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb90c086f00 con 0x7fb9180347a0 2024-04-23T10:16:03.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb91cff9640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7fb904071a80 0x7fb904073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb90c01ce50 con 0x7fb904071a80 2024-04-23T10:16:03.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb924f21640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7fb904071a80 0x7fb904073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb90c01e050 con 0x7fb9180347a0 2024-04-23T10:16:03.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d040ba070 con 0x7f8d08050cb0 2024-04-23T10:16:03.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8d0cff9640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8cf40683d0 0x7f8cf406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f5ef9e49640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5ed8068480 0x7f5ed806a940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00b0000 tx=0x7f5ef00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472effd640 1 --2- 172.21.15.29:0/2944422335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4728047a40 0x7f47280e3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472effd640 1 -- 172.21.15.29:0/2944422335 >> v1:172.21.15.29:6789/0 conn(0x7f472804bc20 legacy=0x7f4728046e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f472effd640 1 -- 172.21.15.29:0/2944422335 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4728006fd0 con 0x7f47280dd210 2024-04-23T10:16:03.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb91f7fe640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb904068380 0x7fb90406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb924f21640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7fb904071a80 0x7fb904073ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8d04124d10 con 0x7f8d08050cb0 2024-04-23T10:16:03.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8d0cff9640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f8cf4071b40 0x7f8cf4073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 --> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d0400b110 con 0x7f8cf4071b40 2024-04-23T10:16:03.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8d04125100 con 0x7f8d08050cb0 2024-04-23T10:16:03.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8d14ee1640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f8cf4071b40 0x7f8cf4073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 <== osd.4 v2:172.21.15.72:6816/4213352672 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe444074480 con 0x7fe428071b20 2024-04-23T10:16:03.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f5ef9648640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f5ed8071b70 0x7f5ed8073fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f8d14ee1640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f8cf4071b40 0x7f8cf4073f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7fb91f7fe640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb904068380 0x7fb90406a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb920000b70 tx=0x7fb92006e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.007+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9778076260 con 0x7f97780b29b0 2024-04-23T10:16:03.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97700b3070 con 0x7f97780b29b0 2024-04-23T10:16:03.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 <== osd.5 v2:172.21.15.72:6800/4132179166 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb90c01ce50 con 0x7fb904071a80 2024-04-23T10:16:03.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f975f7fe640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f97640683b0 0x7f976406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 <== osd.1 v2:172.21.15.29:6824/808351651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d0400b110 con 0x7f8cf4071b40 2024-04-23T10:16:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9770120320 con 0x7f97780b29b0 2024-04-23T10:16:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f9776ffd640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f97640683b0 0x7f976406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f975f7fe640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7f9764071ab0 0x7f9764073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9770008eb0 con 0x7f9764071ab0 2024-04-23T10:16:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9770127050 con 0x7f97780b29b0 2024-04-23T10:16:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f97777fe640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7f9764071ab0 0x7f9764073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f472effd640 1 --2- 172.21.15.29:0/2944422335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47280dd210 0x7f4728007ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47300653d0 tx=0x7f4730098b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fda1de4d2708b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f9776ffd640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f97640683b0 0x7f976406a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9768002240 tx=0x7f9768009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f97777fe640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7f9764071ab0 0x7f9764073ef0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.011+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 <== osd.2 v2:172.21.15.29:6808/1459392502 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9770008eb0 con 0x7f9764071ab0 2024-04-23T10:16:03.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472dffb640 1 -- 172.21.15.29:0/2944422335 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47301227a0 con 0x7f47280dd210 2024-04-23T10:16:03.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472dffb640 1 -- 172.21.15.29:0/2944422335 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4730122980 con 0x7f47280dd210 2024-04-23T10:16:03.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472dffb640 1 -- 172.21.15.29:0/2944422335 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730122df0 con 0x7f47280dd210 2024-04-23T10:16:03.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472ffff640 1 -- 172.21.15.29:0/2944422335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47280dd210 msgr2=0x7f4728007ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472ffff640 1 --2- 172.21.15.29:0/2944422335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47280dd210 0x7f4728007ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47300653d0 tx=0x7f4730098b10 comp rx=0 tx=0).stop 2024-04-23T10:16:03.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472ffff640 1 -- 172.21.15.29:0/2944422335 shutdown_connections 2024-04-23T10:16:03.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472ffff640 1 --2- 172.21.15.29:0/2944422335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4728047a40 0x7f47280e3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472ffff640 1 --2- 172.21.15.29:0/2944422335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47280dd210 0x7f4728007ab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.015+0000 7f472ffff640 1 -- 172.21.15.29:0/2944422335 >> 172.21.15.29:0/2944422335 conn(0x7f47280512a0 msgr2=0x7f47280516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.019+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 <== osd.6 v2:172.21.15.72:6824/3506994715 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5eec010e50 con 0x7f5ed8071b70 2024-04-23T10:16:03.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.019+0000 7f8d0ffff640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8cf40683d0 0x7f8cf406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.019+0000 7f8d0ffff640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8cf40683d0 0x7f8cf406a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000b70 tx=0x7f8d1006e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.027+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 --> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9778145930 con 0x7f9764071ab0 2024-04-23T10:16:03.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.027+0000 7f472ffff640 1 -- 172.21.15.29:0/2944422335 shutdown_connections 2024-04-23T10:16:03.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.027+0000 7f472ffff640 1 -- 172.21.15.29:0/2944422335 wait complete. 2024-04-23T10:16:03.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.027+0000 7f975f7fe640 1 -- 172.21.15.29:0/1628635185 <== osd.2 v2:172.21.15.29:6808/1459392502 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9778145930 con 0x7f9764071ab0 2024-04-23T10:16:03.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472ffff640 1 Processor -- start 2024-04-23T10:16:03.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472ffff640 1 -- start start 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4728047a40 0x7f4728049b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280dd210 0x7f47280cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728048bd0 0x7f472817c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472ffff640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4728047720 con 0x7f4728047a40 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472ffff640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f47280475a0 con 0x7f4728048bd0 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472ffff640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f47280f02a0 con 0x7f47280dd210 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4728047a40 0x7f4728049b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4728047a40 0x7f4728049b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59286/0 (socket says 172.21.15.29:59286) 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472effd640 1 -- 172.21.15.29:0/1298618620 learned_addr learned my addr 172.21.15.29:0/1298618620 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 --> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8d080052d0 con 0x7f8cf4071b40 2024-04-23T10:16:03.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7f9764071ab0 msgr2=0x7f9764073ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7f9764071ab0 0x7f9764073ef0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f97640683b0 msgr2=0x7f976406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f97640683b0 0x7f976406a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9768002240 tx=0x7f9768009040 comp rx=0 tx=0).stop 2024-04-23T10:16:03.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472f7fe640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728048bd0 0x7f472817c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472e7fc640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280dd210 0x7f47280cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b29b0 msgr2=0x7f9778150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 --2- 172.21.15.29:0/1628635185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97780b29b0 0x7f9778150c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f97700ab000 tx=0x7f97700190d0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f97777fe640 1 -- 172.21.15.29:0/1628635185 reap_dead start 2024-04-23T10:16:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 shutdown_connections 2024-04-23T10:16:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 >> 172.21.15.29:0/1628635185 conn(0x7f97780c99b0 msgr2=0x7f97780c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 shutdown_connections 2024-04-23T10:16:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8d0cff9640 1 -- 172.21.15.29:0/2485238815 <== osd.1 v2:172.21.15.29:6824/808351651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8d080052d0 con 0x7f8cf4071b40 2024-04-23T10:16:03.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f975d7fa640 1 -- 172.21.15.29:0/1628635185 wait complete. 2024-04-23T10:16:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472e7fc640 1 -- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728048bd0 msgr2=0x7f472817c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472e7fc640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728048bd0 0x7f472817c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472e7fc640 1 -- 172.21.15.29:0/1298618620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4728047a40 msgr2=0x7f4728049b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472e7fc640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4728047a40 0x7f4728049b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472e7fc640 1 -- 172.21.15.29:0/1298618620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47280e7390 con 0x7f47280dd210 2024-04-23T10:16:03.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 --> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f008c071130 con 0x7f0078071af0 2024-04-23T10:16:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f472e7fc640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280dd210 0x7f47280cb910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f47280096e0 tx=0x7f472000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720017070 con 0x7f47280dd210 2024-04-23T10:16:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4720003620 con 0x7f47280dd210 2024-04-23T10:16:03.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47200039f0 con 0x7f47280dd210 2024-04-23T10:16:03.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f8cf4071b40 msgr2=0x7f8cf4073f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8cfa7fc640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f8cf4071b40 0x7f8cf4073f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f0088ff9640 1 -- 172.21.15.29:0/2914693430 <== osd.7 v2:172.21.15.72:6801/1745734040 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f008c071130 con 0x7f0078071af0 2024-04-23T10:16:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8cf40683d0 msgr2=0x7f8cf406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8cfa7fc640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8cf40683d0 0x7f8cf406a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000b70 tx=0x7f8d1006e040 comp rx=0 tx=0).stop 2024-04-23T10:16:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d08050cb0 msgr2=0x7f8d08034e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8cfa7fc640 1 --2- 172.21.15.29:0/2485238815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d08050cb0 0x7f8d08034e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400b2c0 tx=0x7f8d0401fc20 comp rx=0 tx=0).stop 2024-04-23T10:16:03.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.031+0000 7f8d14ee1640 1 -- 172.21.15.29:0/2485238815 reap_dead start 2024-04-23T10:16:03.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 shutdown_connections 2024-04-23T10:16:03.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 >> 172.21.15.29:0/2485238815 conn(0x7f8d08050190 msgr2=0x7f8d0804f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 shutdown_connections 2024-04-23T10:16:03.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f0078071af0 msgr2=0x7f0078073f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f00924e2640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f0078071af0 0x7f0078073f30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f8cfa7fc640 1 -- 172.21.15.29:0/2485238815 wait complete. 2024-04-23T10:16:03.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47281803a0 con 0x7f47280dd210 2024-04-23T10:16:03.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4728180640 con 0x7f47280dd210 2024-04-23T10:16:03.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4728005720 con 0x7f47280dd210 2024-04-23T10:16:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 --> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f876c150860 con 0x7f8750071bc0 2024-04-23T10:16:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f472001a070 con 0x7f47280dd210 2024-04-23T10:16:03.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.035+0000 7f87627fc640 1 -- 172.21.15.29:0/3902160335 <== osd.0 v2:172.21.15.29:6800/486295385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f876c150860 con 0x7f8750071bc0 2024-04-23T10:16:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f47177fe640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f471c068450 0x7f471c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4720086a30 con 0x7f47280dd210 2024-04-23T10:16:03.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f47177fe640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7f471c071bc0 0x7f471c074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 --> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4720024ea0 con 0x7f471c071bc0 2024-04-23T10:16:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4720086e20 con 0x7f47280dd210 2024-04-23T10:16:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f472effd640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f471c068450 0x7f471c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f472f7fe640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7f471c071bc0 0x7f471c074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f472f7fe640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7f471c071bc0 0x7f471c074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f472effd640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f471c068450 0x7f471c06a910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4730051690 tx=0x7f473006e030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 --> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb900002de0 con 0x7fb904071a80 2024-04-23T10:16:03.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 <== osd.3 v2:172.21.15.29:6816/657827017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4720024ea0 con 0x7f471c071bc0 2024-04-23T10:16:03.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb91cff9640 1 -- 172.21.15.29:0/229880471 <== osd.5 v2:172.21.15.72:6800/4132179166 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb900002de0 con 0x7fb904071a80 2024-04-23T10:16:03.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7fb904071a80 msgr2=0x7fb904073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7fb904071a80 0x7fb904073ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb904068380 msgr2=0x7fb90406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 --> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe424002de0 con 0x7fe428071b20 2024-04-23T10:16:03.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb904068380 0x7fb90406a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb920000b70 tx=0x7fb92006e040 comp rx=0 tx=0).stop 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9180347a0 msgr2=0x7fb9180d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 --2- 172.21.15.29:0/229880471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9180347a0 0x7fb9180d16e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d5b0 tx=0x7fb90c00da70 comp rx=0 tx=0).stop 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb924f21640 1 -- 172.21.15.29:0/229880471 reap_dead start 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 shutdown_connections 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 >> 172.21.15.29:0/229880471 conn(0x7fb918050190 msgr2=0x7fb9180d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 shutdown_connections 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7fb926984640 1 -- 172.21.15.29:0/229880471 wait complete. 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0078068380 msgr2=0x7f007806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f00924e2640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0078068380 0x7f007806a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0080009580 tx=0x7f0080008040 comp rx=0 tx=0).stop 2024-04-23T10:16:03.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f008c151030 msgr2=0x7f008c1f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.039+0000 7f00924e2640 1 --2- 172.21.15.29:0/2914693430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f008c151030 0x7f008c1f03e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0084001950 tx=0x7f008400a430 comp rx=0 tx=0).stop 2024-04-23T10:16:03.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7fe4417fa640 1 -- 172.21.15.29:0/673370824 <== osd.4 v2:172.21.15.72:6816/4213352672 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe424002de0 con 0x7fe428071b20 2024-04-23T10:16:03.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f8750071bc0 msgr2=0x7f8750074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f8750071bc0 0x7f8750074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8750068450 msgr2=0x7f875006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8750068450 0x7f875006a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f87640b2000 tx=0x7f87640a9070 comp rx=0 tx=0).stop 2024-04-23T10:16:03.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151410 msgr2=0x7f876c1486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 --2- 172.21.15.29:0/3902160335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f876c151410 0x7f876c1486c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f875c00e8e0 tx=0x7f875c00eda0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f87722fe640 1 -- 172.21.15.29:0/3902160335 reap_dead start 2024-04-23T10:16:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 shutdown_connections 2024-04-23T10:16:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 >> 172.21.15.29:0/3902160335 conn(0x7f876c067d60 msgr2=0x7f876c0c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 shutdown_connections 2024-04-23T10:16:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f8773d61640 1 -- 172.21.15.29:0/3902160335 wait complete. 2024-04-23T10:16:03.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 --> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5edc002de0 con 0x7f5ed8071b70 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.043+0000 7f0090a7f640 1 -- 172.21.15.29:0/2914693430 reap_dead start 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7fe428071b20 msgr2=0x7fe428073f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe44ab79640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7fe428071b20 0x7fe428073f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe4280683b0 msgr2=0x7fe42806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe44ab79640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe4280683b0 0x7fe42806a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe430009ac0 tx=0x7fe430009190 comp rx=0 tx=0).stop 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0dad60 msgr2=0x7fe43c0dc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe44ab79640 1 --2- 172.21.15.29:0/673370824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe43c0dad60 0x7fe43c0dc120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe444050920 tx=0x7fe44406cdc0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe449116640 1 -- 172.21.15.29:0/673370824 reap_dead start 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 shutdown_connections 2024-04-23T10:16:03.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 >> 172.21.15.29:0/673370824 conn(0x7fe43c0501c0 msgr2=0x7fe43c04d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f5eea7fc640 1 -- 172.21.15.29:0/3564950502 <== osd.6 v2:172.21.15.72:6824/3506994715 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5edc002de0 con 0x7f5ed8071b70 2024-04-23T10:16:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f5ed8071b70 msgr2=0x7f5ed8073fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f5efc0ad640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f5ed8071b70 0x7f5ed8073fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5ed8068480 msgr2=0x7f5ed806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f5efc0ad640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5ed8068480 0x7f5ed806a940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00b0000 tx=0x7f5ef00a7000 comp rx=0 tx=0).stop 2024-04-23T10:16:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151410 msgr2=0x7f5ef4140710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f5efc0ad640 1 --2- 172.21.15.29:0/3564950502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ef4151410 0x7f5ef4140710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c730 tx=0x7f5eec00cbf0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f5efa64a640 1 -- 172.21.15.29:0/3564950502 reap_dead start 2024-04-23T10:16:03.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 shutdown_connections 2024-04-23T10:16:03.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 >> 172.21.15.29:0/2914693430 conn(0x7f008c067d60 msgr2=0x7f008c150140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 shutdown_connections 2024-04-23T10:16:03.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.047+0000 7f00924e2640 1 -- 172.21.15.29:0/2914693430 wait complete. 2024-04-23T10:16:03.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.051+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 shutdown_connections 2024-04-23T10:16:03.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.051+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 >> 172.21.15.29:0/3564950502 conn(0x7f5ef4067d60 msgr2=0x7f5ef40c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.051+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 shutdown_connections 2024-04-23T10:16:03.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.051+0000 7fe44ab79640 1 -- 172.21.15.29:0/673370824 wait complete. 2024-04-23T10:16:03.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.051+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 shutdown_connections 2024-04-23T10:16:03.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.051+0000 7f5efc0ad640 1 -- 172.21.15.29:0/3564950502 wait complete. 2024-04-23T10:16:03.105 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2024-04-23T10:16:03.105 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T10:16:03.106 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-04-23T10:16:03.106 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T10:16:03.107 INFO:teuthology.orchestra.run.smithi029.stdout:55834574859 2024-04-23T10:16:03.107 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T10:16:03.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 --> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4728005720 con 0x7f471c071bc0 2024-04-23T10:16:03.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f47177fe640 1 -- 172.21.15.29:0/1298618620 <== osd.3 v2:172.21.15.29:6816/657827017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4728005720 con 0x7f471c071bc0 2024-04-23T10:16:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7f471c071bc0 msgr2=0x7f471c074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7f471c071bc0 0x7f471c074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f471c068450 msgr2=0x7f471c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f471c068450 0x7f471c06a910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4730051690 tx=0x7f473006e030 comp rx=0 tx=0).stop 2024-04-23T10:16:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280dd210 msgr2=0x7f47280cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 --2- 172.21.15.29:0/1298618620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280dd210 0x7f47280cb910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f47280096e0 tx=0x7f472000c7b0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472f7fe640 1 -- 172.21.15.29:0/1298618620 reap_dead start 2024-04-23T10:16:03.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 shutdown_connections 2024-04-23T10:16:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 >> 172.21.15.29:0/1298618620 conn(0x7f47280512a0 msgr2=0x7f47280db5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 shutdown_connections 2024-04-23T10:16:03.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.067+0000 7f472ffff640 1 -- 172.21.15.29:0/1298618620 wait complete. 2024-04-23T10:16:03.110 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-04-23T10:16:03.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T10:16:03.111 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-04-23T10:16:03.112 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T10:16:03.112 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-04-23T10:16:03.112 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T10:16:03.113 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-04-23T10:16:03.113 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T10:16:03.114 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-04-23T10:16:03.115 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T10:16:03.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09ee2b640 1 Processor -- start 2024-04-23T10:16:03.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09ee2b640 1 -- start start 2024-04-23T10:16:03.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d28b18640 1 Processor -- start 2024-04-23T10:16:03.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09ee2b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe098151410 0x7fe0980c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09ee2b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098157ab0 0x7fe0980c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09ee2b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe09815a5b0 con 0x7fe098151030 2024-04-23T10:16:03.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09ee2b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe09815a870 con 0x7fe098151410 2024-04-23T10:16:03.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09ee2b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe09815ab50 con 0x7fe098157ab0 2024-04-23T10:16:03.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09d3c8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098157ab0 0x7fe0980c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09d3c8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098157ab0 0x7fe0980c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41136/0 (socket says 172.21.15.29:41136) 2024-04-23T10:16:03.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09d3c8640 1 -- 172.21.15.29:0/3256447065 learned_addr learned my addr 172.21.15.29:0/3256447065 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe097fff640 1 --2- 172.21.15.29:0/3256447065 >> v2:172.21.15.72:3300/0 conn(0x7fe098151410 0x7fe0980c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d28b18640 1 -- start start 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d28b18640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d241593d0 0x7f7d240c3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d28b18640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7d240c8820 0x7f7d240c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d28b18640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2415ff40 con 0x7f7d240c9460 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d28b18640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7d24160220 con 0x7f7d240c8820 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d28b18640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7d24162950 con 0x7f7d241593d0 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d2259c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d241593d0 0x7f7d240c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d2259c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d241593d0 0x7f7d240c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41152/0 (socket says 172.21.15.29:41152) 2024-04-23T10:16:03.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d2259c640 1 -- 172.21.15.29:0/3416464759 learned_addr learned my addr 172.21.15.29:0/3416464759 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09d3c8640 1 -- 172.21.15.29:0/3256447065 >> v2:172.21.15.72:3300/0 conn(0x7fe098151410 msgr2=0x7fe0980c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09d3c8640 1 --2- 172.21.15.29:0/3256447065 >> v2:172.21.15.72:3300/0 conn(0x7fe098151410 0x7fe0980c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09d3c8640 1 -- 172.21.15.29:0/3256447065 >> v1:172.21.15.29:6789/0 conn(0x7fe098151030 legacy=0x7fe0980c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7fe09d3c8640 1 -- 172.21.15.29:0/3256447065 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09815ae30 con 0x7fe098157ab0 2024-04-23T10:16:03.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d21d9b640 1 --2- 172.21.15.29:0/3416464759 >> v2:172.21.15.29:3300/0 conn(0x7f7d240c8820 0x7f7d240c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d2259c640 1 -- 172.21.15.29:0/3416464759 >> v2:172.21.15.29:3300/0 conn(0x7f7d240c8820 msgr2=0x7f7d240c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d2259c640 1 --2- 172.21.15.29:0/3416464759 >> v2:172.21.15.29:3300/0 conn(0x7f7d240c8820 0x7f7d240c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d2259c640 1 -- 172.21.15.29:0/3416464759 >> v1:172.21.15.29:6789/0 conn(0x7f7d240c9460 legacy=0x7f7d2415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7efcaa1c0640 1 Processor -- start 2024-04-23T10:16:03.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.331+0000 7f7d2259c640 1 -- 172.21.15.29:0/3416464759 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d24162c30 con 0x7f7d241593d0 2024-04-23T10:16:03.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efcaa1c0640 1 -- start start 2024-04-23T10:16:03.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efcaa1c0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca4151130 0x7efca4071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efcaa1c0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efca40c80f0 0x7efca4157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efcaa1c0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca40c85c0 con 0x7efca40c7370 2024-04-23T10:16:03.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efcaa1c0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7efca40c88a0 con 0x7efca40c80f0 2024-04-23T10:16:03.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efcaa1c0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efca40c8b80 con 0x7efca4151130 2024-04-23T10:16:03.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2bf0c6640 1 Processor -- start 2024-04-23T10:16:03.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efca2ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efca40c80f0 0x7efca4157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2bf0c6640 1 -- start start 2024-04-23T10:16:03.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efca2ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efca40c80f0 0x7efca4157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59312/0 (socket says 172.21.15.29:59312) 2024-04-23T10:16:03.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efca37fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca4151130 0x7efca4071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efca2ffd640 1 -- 172.21.15.29:0/3151518153 learned_addr learned my addr 172.21.15.29:0/3151518153 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efca2ffd640 1 -- 172.21.15.29:0/3151518153 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca4151130 msgr2=0x7efca4071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efca2ffd640 1 --2- 172.21.15.29:0/3151518153 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca4151130 0x7efca4071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efca2ffd640 1 -- 172.21.15.29:0/3151518153 >> v1:172.21.15.72:6789/0 conn(0x7efca40c7370 legacy=0x7efca415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7efca2ffd640 1 -- 172.21.15.29:0/3151518153 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca40c8e60 con 0x7efca40c80f0 2024-04-23T10:16:03.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe09d3c8640 1 --2- 172.21.15.29:0/3256447065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098157ab0 0x7fe0980c7d20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe08c008870 tx=0x7fe08c01e910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31432b799cd546c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2bf0c6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b8075470 0x7fe2b8150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2bf0c6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2b8157ab0 0x7fe2b80c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2bf0c6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b815a870 con 0x7fe2b8151310 2024-04-23T10:16:03.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2bf0c6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b815ab50 con 0x7fe2b8157ab0 2024-04-23T10:16:03.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2bf0c6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b815ae30 con 0x7fe2b8075470 2024-04-23T10:16:03.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b7fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe2b8151310 0x7fe2b80c8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35134/0 (socket says 172.21.15.29:35134) 2024-04-23T10:16:03.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b7fff640 1 -- 172.21.15.29:0/2330895791 learned_addr learned my addr 172.21.15.29:0/2330895791 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:03.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7f016a0d8640 1 Processor -- start 2024-04-23T10:16:03.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7f7d2259c640 1 --2- 172.21.15.29:0/3416464759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d241593d0 0x7f7d240c3990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009870 tx=0x7f7d1801ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6bccba02ec96aa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7f016a0d8640 1 -- start start 2024-04-23T10:16:03.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7f18beb68640 1 Processor -- start 2024-04-23T10:16:03.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7f18beb68640 1 -- start start 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2733264482 0 0) 0x7fe2b815a870 con 0x7fe2b8151310 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2a0003530 con 0x7fe2b8151310 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2246521027 0 0) 0x7fe2a0003530 con 0x7fe2b8151310 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b8075470 msgr2=0x7fe2b8150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b8075470 0x7fe2b8150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 >> v2:172.21.15.72:3300/0 conn(0x7fe2b8157ab0 msgr2=0x7fe2b80c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 --2- 172.21.15.29:0/2330895791 >> v2:172.21.15.72:3300/0 conn(0x7fe2b8157ab0 0x7fe2b80c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b815b110 con 0x7fe2b8151310 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fe2a8001680 con 0x7fe2b8151310 2024-04-23T10:16:03.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 >> v1:172.21.15.29:6789/0 conn(0x7fe2b8151310 legacy=0x7fe2b80c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2a00039c0 0x7fe2a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0004810 0x7fe2a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2a0005220 0x7fe2a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b815ab50 con 0x7fe2a0004810 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b815ae30 con 0x7fe2a0005220 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.335+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a000c1d0 con 0x7fe2a00039c0 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe0977fe640 1 -- 172.21.15.29:0/3256447065 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0ad070 con 0x7fe098157ab0 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe0977fe640 1 -- 172.21.15.29:0/3256447065 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe08c0a78b0 con 0x7fe098157ab0 2024-04-23T10:16:03.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe0977fe640 1 -- 172.21.15.29:0/3256447065 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0a7c80 con 0x7fe098157ab0 2024-04-23T10:16:03.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d2159a640 1 -- 172.21.15.29:0/3416464759 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180b5070 con 0x7f7d241593d0 2024-04-23T10:16:03.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f016a0d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f016406f150 0x7f016406f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f016a0d8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01640ccc50 0x7f01640cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f016a0d8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01640cd5c0 con 0x7f0164153190 2024-04-23T10:16:03.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f016a0d8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0164159f20 con 0x7f016406f150 2024-04-23T10:16:03.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f016a0d8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0164159380 con 0x7f01640ccc50 2024-04-23T10:16:03.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18beb68640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18b8073230 0x7f18b815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18beb68640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b8159360 con 0x7f18b8152b40 2024-04-23T10:16:03.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18beb68640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b8159640 con 0x7f18b8071a70 2024-04-23T10:16:03.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18beb68640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f18b815c0c0 con 0x7f18b8073230 2024-04-23T10:16:03.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18be367640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18b8073230 0x7f18b815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18be367640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18b8073230 0x7f18b815cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:50280/0 (socket says 172.21.15.29:50280) 2024-04-23T10:16:03.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18be367640 1 -- 172.21.15.29:0/1249698711 learned_addr learned my addr 172.21.15.29:0/1249698711 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d2159a640 1 -- 172.21.15.29:0/3416464759 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d180a89d0 con 0x7f7d241593d0 2024-04-23T10:16:03.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d2159a640 1 -- 172.21.15.29:0/3416464759 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d180a8da0 con 0x7f7d241593d0 2024-04-23T10:16:03.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f48430d3640 1 Processor -- start 2024-04-23T10:16:03.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f48430d3640 1 -- start start 2024-04-23T10:16:03.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18be367640 1 -- 172.21.15.29:0/1249698711 >> v1:172.21.15.72:6789/0 conn(0x7f18b8071a70 legacy=0x7f18b80c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18be367640 1 -- 172.21.15.29:0/1249698711 >> v1:172.21.15.29:6789/0 conn(0x7f18b8152b40 legacy=0x7f18b8158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f18be367640 1 -- 172.21.15.29:0/1249698711 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b8159920 con 0x7f18b8073230 2024-04-23T10:16:03.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 -- 172.21.15.29:0/3256447065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098157ab0 msgr2=0x7fe0980c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 --2- 172.21.15.29:0/3256447065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098157ab0 0x7fe0980c7d20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe08c008870 tx=0x7fe08c01e910 comp rx=0 tx=0).stop 2024-04-23T10:16:03.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 -- 172.21.15.29:0/3256447065 shutdown_connections 2024-04-23T10:16:03.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 --2- 172.21.15.29:0/3256447065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098157ab0 0x7fe0980c7d20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 --2- 172.21.15.29:0/3256447065 >> v2:172.21.15.72:3300/0 conn(0x7fe098151410 0x7fe0980c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 -- 172.21.15.29:0/3256447065 >> 172.21.15.29:0/3256447065 conn(0x7fe098067d60 msgr2=0x7fe098074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 -- 172.21.15.29:0/3256447065 shutdown_connections 2024-04-23T10:16:03.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 -- 172.21.15.29:0/3256447065 wait complete. 2024-04-23T10:16:03.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe2b7fff640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0004810 0x7fe2a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe2bd663640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2a0005220 0x7fe2a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7efca2ffd640 1 --2- 172.21.15.29:0/3151518153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 0x7efca4157ac0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc940091e0 tx=0x7efc94023170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a469c279a873eb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f0162ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f016406f150 0x7f016406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f0162ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f016406f150 0x7f016406f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59322/0 (socket says 172.21.15.29:59322) 2024-04-23T10:16:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f0162ffd640 1 -- 172.21.15.29:0/1705328712 learned_addr learned my addr 172.21.15.29:0/1705328712 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f0162ffd640 1 -- 172.21.15.29:0/1705328712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01640ccc50 msgr2=0x7f01640cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f0162ffd640 1 --2- 172.21.15.29:0/1705328712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01640ccc50 0x7f01640cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f0162ffd640 1 -- 172.21.15.29:0/1705328712 >> v1:172.21.15.29:6789/0 conn(0x7f0164153190 legacy=0x7f0164159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f0162ffd640 1 -- 172.21.15.29:0/1705328712 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01640c3fe0 con 0x7f016406f150 2024-04-23T10:16:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7efca27fc640 1 -- 172.21.15.29:0/3151518153 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940b9070 con 0x7efca40c80f0 2024-04-23T10:16:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7efca27fc640 1 -- 172.21.15.29:0/3151518153 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc940b4440 con 0x7efca40c80f0 2024-04-23T10:16:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7efca27fc640 1 -- 172.21.15.29:0/3151518153 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940b4810 con 0x7efca40c80f0 2024-04-23T10:16:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe2bce62640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2a00039c0 0x7fe2a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe2bd663640 1 -- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2a00039c0 msgr2=0x7fe2a0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe2bd663640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2a00039c0 0x7fe2a0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe2bd663640 1 -- 172.21.15.29:0/2330895791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0004810 msgr2=0x7fe2a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe2bd663640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0004810 0x7fe2a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe2bd663640 1 -- 172.21.15.29:0/2330895791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b815b110 con 0x7fe2a0005220 2024-04-23T10:16:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d28b18640 1 -- 172.21.15.29:0/3416464759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d241593d0 msgr2=0x7f7d240c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d28b18640 1 --2- 172.21.15.29:0/3416464759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d241593d0 0x7f7d240c3990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009870 tx=0x7f7d1801ed10 comp rx=0 tx=0).stop 2024-04-23T10:16:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d28b18640 1 -- 172.21.15.29:0/3416464759 shutdown_connections 2024-04-23T10:16:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d28b18640 1 --2- 172.21.15.29:0/3416464759 >> v2:172.21.15.29:3300/0 conn(0x7f7d240c8820 0x7f7d240c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d28b18640 1 --2- 172.21.15.29:0/3416464759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d241593d0 0x7f7d240c3990 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d28b18640 1 -- 172.21.15.29:0/3416464759 >> 172.21.15.29:0/3416464759 conn(0x7f7d24067d60 msgr2=0x7f7d24074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d28b18640 1 -- 172.21.15.29:0/3416464759 shutdown_connections 2024-04-23T10:16:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f7d28b18640 1 -- 172.21.15.29:0/3416464759 wait complete. 2024-04-23T10:16:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f48430d3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 Processor -- start 2024-04-23T10:16:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f48420d1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f48420d1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41190/0 (socket says 172.21.15.29:41190) 2024-04-23T10:16:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f48420d1640 1 -- 172.21.15.29:0/1649858754 learned_addr learned my addr 172.21.15.29:0/1649858754 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7f48430d3640 1 -- 172.21.15.29:0/1649858754 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483404ef10 con 0x7f48340dd800 2024-04-23T10:16:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48430d3640 1 -- 172.21.15.29:0/1649858754 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483404f1f0 con 0x7f4834050be0 2024-04-23T10:16:03.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.339+0000 7fe09ee2b640 1 -- start start 2024-04-23T10:16:03.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 -- 172.21.15.29:0/3151518153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 msgr2=0x7efca4157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/3151518153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 0x7efca4157ac0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc940091e0 tx=0x7efc94023170 comp rx=0 tx=0).stop 2024-04-23T10:16:03.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48430d3640 1 -- 172.21.15.29:0/1649858754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f483404fe00 con 0x7f4834007470 2024-04-23T10:16:03.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f0162ffd640 1 --2- 172.21.15.29:0/1705328712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f016406f150 0x7f016406f580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0154009870 tx=0x7f015401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2e9f2dccf1ab87 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 Processor -- start 2024-04-23T10:16:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48410cf640 1 -- 172.21.15.29:0/1649858754 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530941218 0 0) 0x7f483404ef10 con 0x7f48340dd800 2024-04-23T10:16:03.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09ee2b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098151030 0x7fe0981580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2bd663640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2a0005220 0x7fe2a000b9d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009860 tx=0x7fe2ac01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d10f488142d529 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 -- start start 2024-04-23T10:16:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 -- 172.21.15.29:0/3151518153 shutdown_connections 2024-04-23T10:16:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/3151518153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 0x7efca4157ac0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/3151518153 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca4151130 0x7efca4071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 -- 172.21.15.29:0/3151518153 >> 172.21.15.29:0/3151518153 conn(0x7efca406cfb0 msgr2=0x7efca406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48410cf640 1 -- 172.21.15.29:0/1649858754 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4828003530 con 0x7f48340dd800 2024-04-23T10:16:03.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09ee2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe098151410 0x7fe098158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18be367640 1 --2- 172.21.15.29:0/1249698711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8073230 0x7f18b815cb10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18b815c240 tx=0x7f18b001f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f289a67d0bffe20d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 -- 172.21.15.29:0/3151518153 shutdown_connections 2024-04-23T10:16:03.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f01627fc640 1 -- 172.21.15.29:0/1705328712 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01540b5070 con 0x7f016406f150 2024-04-23T10:16:03.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f01627fc640 1 -- 172.21.15.29:0/1705328712 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01540a87f0 con 0x7f016406f150 2024-04-23T10:16:03.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f01627fc640 1 -- 172.21.15.29:0/1705328712 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01540a8bc0 con 0x7f016406f150 2024-04-23T10:16:03.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48410cf640 1 -- 172.21.15.29:0/1649858754 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467675254 0 0) 0x7f483404f1f0 con 0x7f4834050be0 2024-04-23T10:16:03.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48410cf640 1 -- 172.21.15.29:0/1649858754 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f483404ef10 con 0x7f4834050be0 2024-04-23T10:16:03.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098151030 0x7fe0981580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098151030 0x7fe0981580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41204/0 (socket says 172.21.15.29:41204) 2024-04-23T10:16:03.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48420d1640 1 -- 172.21.15.29:0/1649858754 >> v1:172.21.15.72:6789/0 conn(0x7f4834050be0 legacy=0x7f48340dd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 -- 172.21.15.29:0/2634454306 learned_addr learned my addr 172.21.15.29:0/2634454306 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09ee2b640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe098157ab0 0x7fe0981f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18bcb64640 1 -- 172.21.15.29:0/1249698711 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b4070 con 0x7f18b8073230 2024-04-23T10:16:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18bcb64640 1 -- 172.21.15.29:0/1249698711 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00af400 con 0x7f18b8073230 2024-04-23T10:16:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18bcb64640 1 -- 172.21.15.29:0/1249698711 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00af7d0 con 0x7f18b8073230 2024-04-23T10:16:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0b0070 con 0x7fe2a0005220 2024-04-23T10:16:03.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0ab620 con 0x7fe2a0005220 2024-04-23T10:16:03.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2b77fe640 1 -- 172.21.15.29:0/2330895791 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac009460 con 0x7fe2a0005220 2024-04-23T10:16:03.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe097fff640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe098151410 0x7fe098158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09d3c8640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe098157ab0 0x7fe0981f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09ee2b640 1 -- 172.21.15.29:0/2634454306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe098163c40 con 0x7fe098151410 2024-04-23T10:16:03.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09ee2b640 1 -- 172.21.15.29:0/2634454306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe098163ac0 con 0x7fe098157ab0 2024-04-23T10:16:03.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09ee2b640 1 -- 172.21.15.29:0/2634454306 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe098163dc0 con 0x7fe098151030 2024-04-23T10:16:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 -- 172.21.15.29:0/1705328712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f016406f150 msgr2=0x7f016406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 --2- 172.21.15.29:0/1705328712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f016406f150 0x7f016406f580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0154009870 tx=0x7f015401eb30 comp rx=0 tx=0).stop 2024-04-23T10:16:03.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d240c8820 0x7f7d2415ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d240c9460 0x7f7d240c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d241593d0 0x7f7d24157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7d241597b0 con 0x7f7d240c8820 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7d241631f0 con 0x7f7d241593d0 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7d24163710 con 0x7f7d240c9460 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d241593d0 0x7f7d24157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d241593d0 0x7f7d24157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:50318/0 (socket says 172.21.15.29:50318) 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d21d9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d240c9460 0x7f7d240c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 -- 172.21.15.29:0/2082522833 learned_addr learned my addr 172.21.15.29:0/2082522833 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 -- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe098157ab0 msgr2=0x7fe0981f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe098157ab0 0x7fe0981f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 -- 172.21.15.29:0/2634454306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe098151410 msgr2=0x7fe098158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe098151410 0x7fe098158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 -- 172.21.15.29:0/2634454306 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0981f6620 con 0x7fe098151030 2024-04-23T10:16:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 -- 172.21.15.29:0/1705328712 shutdown_connections 2024-04-23T10:16:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 --2- 172.21.15.29:0/1705328712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01640ccc50 0x7f01640cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 --2- 172.21.15.29:0/1705328712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f016406f150 0x7f016406f580 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 -- 172.21.15.29:0/1705328712 >> 172.21.15.29:0/1705328712 conn(0x7f016406cfb0 msgr2=0x7f016406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 -- 172.21.15.29:0/1705328712 shutdown_connections 2024-04-23T10:16:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09cbc7640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098151030 0x7fe0981580e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe08800b410 tx=0x7fe08800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 -- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d240c9460 msgr2=0x7f7d240c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d240c9460 0x7f7d240c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 -- 172.21.15.29:0/2082522833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d240c8820 msgr2=0x7f7d2415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d240c8820 0x7f7d2415ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 -- 172.21.15.29:0/2082522833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2415f560 con 0x7f7d241593d0 2024-04-23T10:16:03.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe0957fa640 1 -- 172.21.15.29:0/2634454306 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088015020 con 0x7fe098151030 2024-04-23T10:16:03.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09ee2b640 1 -- 172.21.15.29:0/2634454306 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe098154250 con 0x7fe098151030 2024-04-23T10:16:03.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2a0005220 msgr2=0x7fe2a000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2bf0c6640 1 --2- 172.21.15.29:0/2330895791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2a0005220 0x7fe2a000b9d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009860 tx=0x7fe2ac01c380 comp rx=0 tx=0).stop 2024-04-23T10:16:03.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d22d9d640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d241593d0 0x7f7d24157eb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c420 tx=0x7f7d1400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2bd663640 1 -- 172.21.15.29:0/2330895791 reap_dead start 2024-04-23T10:16:03.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18beb68640 1 -- 172.21.15.29:0/1249698711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8073230 msgr2=0x7f18b815cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18beb68640 1 --2- 172.21.15.29:0/1249698711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8073230 0x7f18b815cb10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18b815c240 tx=0x7f18b001f200 comp rx=0 tx=0).stop 2024-04-23T10:16:03.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe09ee2b640 1 -- 172.21.15.29:0/2634454306 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0981f5280 con 0x7fe098151030 2024-04-23T10:16:03.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/2330895791 shutdown_connections 2024-04-23T10:16:03.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/2330895791 >> 172.21.15.29:0/2330895791 conn(0x7fe2b8067d60 msgr2=0x7fe2b8074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18beb68640 1 -- 172.21.15.29:0/1249698711 shutdown_connections 2024-04-23T10:16:03.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18beb68640 1 --2- 172.21.15.29:0/1249698711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8073230 0x7f18b815cb10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18beb68640 1 -- 172.21.15.29:0/1249698711 >> 172.21.15.29:0/1249698711 conn(0x7f18b806d550 msgr2=0x7f18b8074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48420d1640 1 -- 172.21.15.29:0/1649858754 >> v1:172.21.15.29:6789/0 conn(0x7f48340dd800 legacy=0x7f4834038ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48420d1640 1 -- 172.21.15.29:0/1649858754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483404f4d0 con 0x7f4834007470 2024-04-23T10:16:03.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 -- 172.21.15.29:0/3151518153 wait complete. 2024-04-23T10:16:03.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7efcaa1c0640 1 Processor -- start 2024-04-23T10:16:03.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/2330895791 shutdown_connections 2024-04-23T10:16:03.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d12ffd640 1 -- 172.21.15.29:0/2082522833 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14011790 con 0x7f7d241593d0 2024-04-23T10:16:03.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d12ffd640 1 -- 172.21.15.29:0/2082522833 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d14017070 con 0x7f7d241593d0 2024-04-23T10:16:03.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d24161de0 con 0x7f7d241593d0 2024-04-23T10:16:03.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 -- 172.21.15.29:0/1705328712 wait complete. 2024-04-23T10:16:03.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f18beb68640 1 -- 172.21.15.29:0/1249698711 shutdown_connections 2024-04-23T10:16:03.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48420d1640 1 --2- 172.21.15.29:0/1649858754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e7260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f483c07c670 tx=0x7f483c098b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=358fc7c78ecb9068 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 Processor -- start 2024-04-23T10:16:03.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f48410cf640 1 -- 172.21.15.29:0/1649858754 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c12e070 con 0x7f4834007470 2024-04-23T10:16:03.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48410cf640 1 -- 172.21.15.29:0/1649858754 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483c121900 con 0x7f4834007470 2024-04-23T10:16:03.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48410cf640 1 -- 172.21.15.29:0/1649858754 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c121d30 con 0x7f4834007470 2024-04-23T10:16:03.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe0957fa640 1 -- 172.21.15.29:0/2634454306 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe088011830 con 0x7fe098151030 2024-04-23T10:16:03.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/2330895791 wait complete. 2024-04-23T10:16:03.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d241623a0 con 0x7f7d241593d0 2024-04-23T10:16:03.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f7d12ffd640 1 -- 172.21.15.29:0/2082522833 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14011b70 con 0x7f7d241593d0 2024-04-23T10:16:03.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bf0c6640 1 Processor -- start 2024-04-23T10:16:03.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efcaa1c0640 1 -- start start 2024-04-23T10:16:03.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.343+0000 7f016a0d8640 1 -- start start 2024-04-23T10:16:03.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 -- 172.21.15.29:0/1249698711 wait complete. 2024-04-23T10:16:03.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f016a0d8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f016406f150 0x7f0164142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f016a0d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01640ccc50 0x7f0164151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f016a0d8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0164153190 0x7f0164151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f016a0d8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0164159010 con 0x7f01640ccc50 2024-04-23T10:16:03.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f016a0d8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f01640c45a0 con 0x7f016406f150 2024-04-23T10:16:03.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f016a0d8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0164153570 con 0x7f0164153190 2024-04-23T10:16:03.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48430d3640 1 -- 172.21.15.29:0/1649858754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 msgr2=0x7f48340e7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 Processor -- start 2024-04-23T10:16:03.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 -- start start 2024-04-23T10:16:03.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48430d3640 1 --2- 172.21.15.29:0/1649858754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e7260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f483c07c670 tx=0x7f483c098b90 comp rx=0 tx=0).stop 2024-04-23T10:16:03.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0163fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0164153190 0x7f0164151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f01637fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f016406f150 0x7f0164142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f6f738ca640 1 Processor -- start 2024-04-23T10:16:03.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0162ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01640ccc50 0x7f0164151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0163fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0164153190 0x7f0164151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41214/0 (socket says 172.21.15.29:41214) 2024-04-23T10:16:03.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0163fff640 1 -- 172.21.15.29:0/2412903402 learned_addr learned my addr 172.21.15.29:0/2412903402 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48430d3640 1 -- 172.21.15.29:0/1649858754 shutdown_connections 2024-04-23T10:16:03.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48430d3640 1 --2- 172.21.15.29:0/1649858754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e7260 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f6f738ca640 1 -- start start 2024-04-23T10:16:03.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48430d3640 1 -- 172.21.15.29:0/1649858754 >> 172.21.15.29:0/1649858754 conn(0x7f4834051010 msgr2=0x7f4834051420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48430d3640 1 -- 172.21.15.29:0/1649858754 shutdown_connections 2024-04-23T10:16:03.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f48430d3640 1 -- 172.21.15.29:0/1649858754 wait complete. 2024-04-23T10:16:03.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8071a70 0x7f18b81533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18b8073230 0x7f18b80cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b8152b40 0x7f18b80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f18b815d050 con 0x7f18b8073230 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f18b815c680 con 0x7f18b8071a70 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18beb68640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f18b8152f20 con 0x7f18b8152b40 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b8152b40 0x7f18b80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18bd365640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18b8073230 0x7f18b80cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b8152b40 0x7f18b80cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41262/0 (socket says 172.21.15.29:41262) 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 -- 172.21.15.29:0/2945112373 learned_addr learned my addr 172.21.15.29:0/2945112373 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe07effd640 1 -- 172.21.15.29:0/2634454306 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe098076260 con 0x7fe098151030 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bf0c6640 1 -- start start 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bf0c6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0005220 0x7fe2b8168730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bf0c6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81580e0 0x7fe2b81381b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bf0c6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81386f0 0x7fe2b814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bf0c6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b8150f50 con 0x7fe2a0005220 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bf0c6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b8150dd0 con 0x7fe2b81386f0 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bf0c6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b81510d0 con 0x7fe2b81580e0 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81580e0 0x7fe2b81381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bd663640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81386f0 0x7fe2b814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81580e0 0x7fe2b81381b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41230/0 (socket says 172.21.15.29:41230) 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bd663640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81386f0 0x7fe2b814e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:50342/0 (socket says 172.21.15.29:50342) 2024-04-23T10:16:03.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2b7fff640 1 -- 172.21.15.29:0/3423612395 learned_addr learned my addr 172.21.15.29:0/3423612395 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bce62640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0005220 0x7fe2b8168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efcaa1c0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca40c7370 0x7efca41472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efcaa1c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 0x7efca41f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efcaa1c0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca4151130 0x7efca41eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efcaa1c0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efca40716a0 con 0x7efca40c80f0 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efcaa1c0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efca41575a0 con 0x7efca4151130 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efcaa1c0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efca4151510 con 0x7efca40c7370 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca4151130 0x7efca41eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca4151130 0x7efca41eeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:50352/0 (socket says 172.21.15.29:50352) 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca3fff640 1 -- 172.21.15.29:0/2789025878 learned_addr learned my addr 172.21.15.29:0/2789025878 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca37fe640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca40c7370 0x7efca41472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0162ffd640 1 -- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0164153190 msgr2=0x7f0164151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0162ffd640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0164153190 0x7f0164151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0162ffd640 1 -- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f016406f150 msgr2=0x7f0164142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0162ffd640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f016406f150 0x7f0164142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0162ffd640 1 -- 172.21.15.29:0/2412903402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01640cc760 con 0x7f01640ccc50 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f01637fe640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f016406f150 0x7f0164142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f0162ffd640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01640ccc50 0x7f0164151340 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f01540af000 tx=0x7f015401b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f014bfff640 1 -- 172.21.15.29:0/2412903402 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01540b5050 con 0x7f01640ccc50 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f014bfff640 1 -- 172.21.15.29:0/2412903402 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01540b6040 con 0x7f01640ccc50 2024-04-23T10:16:03.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f014bfff640 1 -- 172.21.15.29:0/2412903402 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01540b0930 con 0x7f01640ccc50 2024-04-23T10:16:03.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe0957fa640 1 -- 172.21.15.29:0/2634454306 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088011c20 con 0x7fe098151030 2024-04-23T10:16:03.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe0957fa640 1 -- 172.21.15.29:0/2634454306 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe088018020 con 0x7fe098151030 2024-04-23T10:16:03.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01641f2c80 con 0x7f01640ccc50 2024-04-23T10:16:03.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01641ef820 con 0x7f01640ccc50 2024-04-23T10:16:03.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f7d12ffd640 1 -- 172.21.15.29:0/2082522833 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d14011d10 con 0x7f7d241593d0 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18bdb66640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8071a70 0x7f18b81533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 -- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8071a70 msgr2=0x7f18b81533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8071a70 0x7f18b81533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 -- 172.21.15.29:0/2945112373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18b8073230 msgr2=0x7f18b80cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18b8073230 0x7f18b80cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 -- 172.21.15.29:0/2945112373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b81fd390 con 0x7f18b8152b40 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18bd365640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18b8073230 0x7f18b80cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7f18be367640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b8152b40 0x7f18b80cc9a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f18b001ce30 tx=0x7f18b001bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe0957fa640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe084068480 0x7fe08406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bd663640 1 -- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81580e0 msgr2=0x7fe2b81381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bd663640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81580e0 0x7fe2b81381b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bd663640 1 -- 172.21.15.29:0/3423612395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0005220 msgr2=0x7fe2b8168730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bd663640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0005220 0x7fe2b8168730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7fe2bd663640 1 -- 172.21.15.29:0/3423612395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b81f8d40 con 0x7fe2b81386f0 2024-04-23T10:16:03.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca2ffd640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 0x7efca41f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca37fe640 1 -- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca4151130 msgr2=0x7efca41eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca37fe640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca4151130 0x7efca41eeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca37fe640 1 -- 172.21.15.29:0/2789025878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 msgr2=0x7efca41f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca37fe640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 0x7efca41f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca37fe640 1 -- 172.21.15.29:0/2789025878 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca4147820 con 0x7efca40c7370 2024-04-23T10:16:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.347+0000 7efca2ffd640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 0x7efca41f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7efca37fe640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca40c7370 0x7efca41472e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00f9b0 tx=0x7efc8c00fe70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe097fff640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe084068480 0x7fe08406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2bd663640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81386f0 0x7fe2b814e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0ab000 tx=0x7fe2a0005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48430d3640 1 Processor -- start 2024-04-23T10:16:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe0957fa640 1 -- 172.21.15.29:0/2634454306 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe088086dd0 con 0x7fe098151030 2024-04-23T10:16:03.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0164068d70 con 0x7f01640ccc50 2024-04-23T10:16:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f6f738ca640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f6c151130 0x7f6f6c071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48430d3640 1 -- start start 2024-04-23T10:16:03.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f6f738ca640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 0x7f6f6c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2b57fa640 1 -- 172.21.15.29:0/3423612395 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0b0040 con 0x7fe2b81386f0 2024-04-23T10:16:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2b57fa640 1 -- 172.21.15.29:0/3423612395 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0ab7d0 con 0x7fe2b81386f0 2024-04-23T10:16:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2b57fa640 1 -- 172.21.15.29:0/3423612395 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0abb80 con 0x7fe2b81386f0 2024-04-23T10:16:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f6f71666640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f6c151130 0x7f6f6c071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f6f71666640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f6c151130 0x7f6f6c071160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:50374/0 (socket says 172.21.15.29:50374) 2024-04-23T10:16:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f6f71e67640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6f6c0c7370 0x7f6f6c15a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35160/0 (socket says 172.21.15.29:35160) 2024-04-23T10:16:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f6f71666640 1 -- 172.21.15.29:0/2929179026 learned_addr learned my addr 172.21.15.29:0/2929179026 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe097fff640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe084068480 0x7fe08406a940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe098074720 tx=0x7fe09000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b81f9020 con 0x7fe2b81386f0 2024-04-23T10:16:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b81f95e0 con 0x7fe2b81386f0 2024-04-23T10:16:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48430d3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48430d3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4834050be0 0x7f48340e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b8076260 con 0x7fe2b81386f0 2024-04-23T10:16:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41278/0 (socket says 172.21.15.29:41278) 2024-04-23T10:16:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48430d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340dd800 0x7f48340e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 -- 172.21.15.29:0/2321016491 learned_addr learned my addr 172.21.15.29:0/2321016491 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f48340f1410 con 0x7f48340dd800 2024-04-23T10:16:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4834051e10 con 0x7f4834050be0 2024-04-23T10:16:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48340f1590 con 0x7f4834007470 2024-04-23T10:16:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48418d0640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4834050be0 0x7f48340e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f014bfff640 1 -- 172.21.15.29:0/2412903402 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01540c1030 con 0x7f01640ccc50 2024-04-23T10:16:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 -- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4834050be0 msgr2=0x7f48340e56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4834050be0 0x7f48340e56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 -- 172.21.15.29:0/2321016491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340dd800 msgr2=0x7f48340e5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340dd800 0x7f48340e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 -- 172.21.15.29:0/2321016491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483404e6d0 con 0x7f4834007470 2024-04-23T10:16:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f7d12ffd640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7d04068400 0x7f7d0406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f014bfff640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f01500683d0 0x7f015006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f7d12ffd640 1 -- 172.21.15.29:0/2082522833 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7d14086970 con 0x7f7d241593d0 2024-04-23T10:16:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f7d2259c640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7d04068400 0x7f7d0406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f01637fe640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f01500683d0 0x7f015006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f014bfff640 1 -- 172.21.15.29:0/2412903402 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f01541242b0 con 0x7f01640ccc50 2024-04-23T10:16:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f48420d1640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e04e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f483c02db60 tx=0x7f483c0959d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d24076260 con 0x7f7d241593d0 2024-04-23T10:16:03.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f01637fe640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f01500683d0 0x7f015006a890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0158007fd0 tx=0x7f0158009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2b57fa640 1 -- 172.21.15.29:0/3423612395 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2ac0c0060 con 0x7fe2b81386f0 2024-04-23T10:16:03.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2b57fa640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2a4068450 0x7fe2a406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2b57fa640 1 -- 172.21.15.29:0/3423612395 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe2ac120720 con 0x7fe2b81386f0 2024-04-23T10:16:03.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7fe2bce62640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2a4068450 0x7fe2a406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f7d2259c640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7d04068400 0x7f7d0406a8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d180b2000 tx=0x7f7d18004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.351+0000 7f6f70e65640 1 --2- 172.21.15.29:0/2929179026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 0x7f6f6c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f6f738ca640 1 -- 172.21.15.29:0/2929179026 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c0c85c0 con 0x7f6f6c0c7370 2024-04-23T10:16:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f6f738ca640 1 -- 172.21.15.29:0/2929179026 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6f6c0c88a0 con 0x7f6f6c151130 2024-04-23T10:16:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f6f738ca640 1 -- 172.21.15.29:0/2929179026 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c0c8b80 con 0x7f6f6c0c80f0 2024-04-23T10:16:03.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7fe2bce62640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2a4068450 0x7fe2a406a910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80c9c20 tx=0x7fe2b0009650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f18ae7fc640 1 -- 172.21.15.29:0/2945112373 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00c0070 con 0x7f18b8152b40 2024-04-23T10:16:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f18ae7fc640 1 -- 172.21.15.29:0/2945112373 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00090d0 con 0x7f18b8152b40 2024-04-23T10:16:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b81548e0 con 0x7f18b8152b40 2024-04-23T10:16:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b81fd610 con 0x7f18b8152b40 2024-04-23T10:16:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f4832ffd640 1 -- 172.21.15.29:0/2321016491 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c12e040 con 0x7f4834007470 2024-04-23T10:16:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f4832ffd640 1 -- 172.21.15.29:0/2321016491 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483c139070 con 0x7f4834007470 2024-04-23T10:16:03.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f4832ffd640 1 -- 172.21.15.29:0/2321016491 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c129970 con 0x7f4834007470 2024-04-23T10:16:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7fe0957fa640 1 -- 172.21.15.29:0/2634454306 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe08801f020 con 0x7fe098151030 2024-04-23T10:16:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483404bcf0 con 0x7f4834007470 2024-04-23T10:16:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f483417d910 con 0x7f4834007470 2024-04-23T10:16:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b8076260 con 0x7f18b8152b40 2024-04-23T10:16:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48240052a0 con 0x7f4834007470 2024-04-23T10:16:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7efc9bfff640 1 -- 172.21.15.29:0/2789025878 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c017070 con 0x7efca40c7370 2024-04-23T10:16:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f6f71666640 1 -- 172.21.15.29:0/2929179026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 msgr2=0x7f6f6c157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7efc9bfff640 1 -- 172.21.15.29:0/2789025878 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c00dbf0 con 0x7efca40c7370 2024-04-23T10:16:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f6f71666640 1 --2- 172.21.15.29:0/2929179026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 0x7f6f6c157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f6f71666640 1 -- 172.21.15.29:0/2929179026 >> v1:172.21.15.29:6789/0 conn(0x7f6f6c0c7370 legacy=0x7f6f6c15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7efc9bfff640 1 -- 172.21.15.29:0/2789025878 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c012460 con 0x7efca40c7370 2024-04-23T10:16:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f6f71666640 1 -- 172.21.15.29:0/2929179026 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c0c8e60 con 0x7f6f6c151130 2024-04-23T10:16:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca4156ab0 con 0x7efca40c7370 2024-04-23T10:16:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efca41550d0 con 0x7efca40c7370 2024-04-23T10:16:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f18ae7fc640 1 -- 172.21.15.29:0/2945112373 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b4040 con 0x7f18b8152b40 2024-04-23T10:16:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f6f71666640 1 --2- 172.21.15.29:0/2929179026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151130 0x7f6f6c071160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400c2e0 tx=0x7f6f64020610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=334184f8d7fc92da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.355+0000 7f4832ffd640 1 -- 172.21.15.29:0/2321016491 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f483c129b10 con 0x7f4834007470 2024-04-23T10:16:03.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f4832ffd640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48200683d0 0x7f482006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f18ae7fc640 1 -- 172.21.15.29:0/2945112373 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18b00c3070 con 0x7f18b8152b40 2024-04-23T10:16:03.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7fe2b57fa640 1 -- 172.21.15.29:0/3423612395 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2ac016090 con 0x7fe2b81386f0 2024-04-23T10:16:03.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc880052a0 con 0x7efca40c7370 2024-04-23T10:16:03.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f014bfff640 1 -- 172.21.15.29:0/2412903402 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01540c8060 con 0x7f01640ccc50 2024-04-23T10:16:03.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f18ae7fc640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f189c068380 0x7f189c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f48418d0640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48200683d0 0x7f482006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f18bdb66640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f189c068380 0x7f189c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f18ae7fc640 1 -- 172.21.15.29:0/2945112373 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f18b01248e0 con 0x7f18b8152b40 2024-04-23T10:16:03.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f48418d0640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48200683d0 0x7f482006a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4834038e20 tx=0x7f4838009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.359+0000 7f4832ffd640 1 -- 172.21.15.29:0/2321016491 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f483c129e00 con 0x7f4834007470 2024-04-23T10:16:03.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.363+0000 7f18ae7fc640 1 -- 172.21.15.29:0/2945112373 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18b00ca080 con 0x7f18b8152b40 2024-04-23T10:16:03.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.363+0000 7f18bdb66640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f189c068380 0x7f189c06a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18b4007fd0 tx=0x7f18b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f7d12ffd640 1 -- 172.21.15.29:0/2082522833 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d14056c60 con 0x7f7d241593d0 2024-04-23T10:16:03.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f4832ffd640 1 -- 172.21.15.29:0/2321016491 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f483c142020 con 0x7f4834007470 2024-04-23T10:16:03.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f63fff640 1 -- 172.21.15.29:0/2929179026 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f640b5070 con 0x7f6f6c151130 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f63fff640 1 -- 172.21.15.29:0/2929179026 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640b0600 con 0x7f6f6c151130 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f63fff640 1 -- 172.21.15.29:0/2929179026 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f640b09d0 con 0x7f6f6c151130 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 -- 172.21.15.29:0/2929179026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151130 msgr2=0x7f6f6c071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 --2- 172.21.15.29:0/2929179026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151130 0x7f6f6c071160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400c2e0 tx=0x7f6f64020610 comp rx=0 tx=0).stop 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 -- 172.21.15.29:0/2929179026 shutdown_connections 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 --2- 172.21.15.29:0/2929179026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 0x7f6f6c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 --2- 172.21.15.29:0/2929179026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151130 0x7f6f6c071160 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400c2e0 tx=0x7f6f64020610 comp rx=0 tx=0).stop 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 -- 172.21.15.29:0/2929179026 >> 172.21.15.29:0/2929179026 conn(0x7f6f6c06cfb0 msgr2=0x7f6f6c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7efc9bfff640 1 -- 172.21.15.29:0/2789025878 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc8c01a070 con 0x7efca40c7370 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7efc9bfff640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc84068400 0x7efc8406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7efc9bfff640 1 -- 172.21.15.29:0/2789025878 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efc8c0873c0 con 0x7efca40c7370 2024-04-23T10:16:03.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7efca2ffd640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc84068400 0x7efc8406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 -- 172.21.15.29:0/2929179026 shutdown_connections 2024-04-23T10:16:03.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 -- 172.21.15.29:0/2929179026 wait complete. 2024-04-23T10:16:03.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7efca2ffd640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc84068400 0x7efc8406a8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efc940b6000 tx=0x7efc940ae070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 Processor -- start 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.367+0000 7f6f738ca640 1 -- start start 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c0c7370 0x7f6f6c1f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 0x7f6f6c1f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f6c1f5140 0x7f6f6c1f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c0716a0 con 0x7f6f6c1f5140 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c1575a0 con 0x7f6f6c0c7370 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c151510 con 0x7f6f6c0c80f0 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c0c7370 0x7f6f6c1f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c0c7370 0x7f6f6c1f8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:50392/0 (socket says 172.21.15.29:50392) 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 -- 172.21.15.29:0/898563764 learned_addr learned my addr 172.21.15.29:0/898563764 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71e67640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f6c1f5140 0x7f6f6c1f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7efc9bfff640 1 -- 172.21.15.29:0/2789025878 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc8c057060 con 0x7efca40c7370 2024-04-23T10:16:03.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 -- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 msgr2=0x7f6f6c1f8e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T10:16:03.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 0x7f6f6c1f8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 -- 172.21.15.29:0/898563764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f6c1f5140 msgr2=0x7f6f6c1f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f6c1f5140 0x7f6f6c1f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 -- 172.21.15.29:0/898563764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c15afd0 con 0x7f6f6c0c7370 2024-04-23T10:16:03.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f71666640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c0c7370 0x7f6f6c1f8910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f640b3040 tx=0x7f6f6401d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f61ffb640 1 -- 172.21.15.29:0/898563764 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f640b5040 con 0x7f6f6c0c7370 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c15b290 con 0x7f6f6c0c7370 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6c159340 con 0x7f6f6c0c7370 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f61ffb640 1 -- 172.21.15.29:0/898563764 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640b07b0 con 0x7f6f6c0c7370 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.371+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6c0c6100 con 0x7f6f6c0c7370 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.375+0000 7f6f61ffb640 1 -- 172.21.15.29:0/898563764 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f640b0ba0 con 0x7f6f6c0c7370 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.375+0000 7f6f61ffb640 1 -- 172.21.15.29:0/898563764 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f640c2020 con 0x7f6f6c0c7370 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.375+0000 7f6f61ffb640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f500683b0 0x7f6f5006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.375+0000 7f6f61ffb640 1 -- 172.21.15.29:0/898563764 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6f641249f0 con 0x7f6f6c0c7370 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.375+0000 7f6f70e65640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f500683b0 0x7f6f5006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.375+0000 7f6f70e65640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f500683b0 0x7f6f5006a870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0c6c50 tx=0x7f6f5c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.383+0000 7f6f61ffb640 1 -- 172.21.15.29:0/898563764 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f6c0c6100 con 0x7f6f6c0c7370 2024-04-23T10:16:03.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.679+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f01640c4870 con 0x7f01640ccc50 2024-04-23T10:16:03.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.679+0000 7f014bfff640 1 -- 172.21.15.29:0/2412903402 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01640cd5c0 con 0x7f01640ccc50 2024-04-23T10:16:03.679 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-04-23T10:16:03.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.679+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe2b80c8340 con 0x7fe2b81386f0 2024-04-23T10:16:03.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.679+0000 7fe2b57fa640 1 -- 172.21.15.29:0/3423612395 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe2ac0f0330 con 0x7fe2b81386f0 2024-04-23T10:16:03.681 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-04-23T10:16:03.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f01500683d0 msgr2=0x7f015006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f01500683d0 0x7f015006a890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0158007fd0 tx=0x7f0158009040 comp rx=0 tx=0).stop 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01640ccc50 msgr2=0x7f0164151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01640ccc50 0x7f0164151340 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f01540af000 tx=0x7f015401b8d0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 shutdown_connections 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f01500683d0 0x7f015006a890 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0164153190 0x7f0164151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01640ccc50 0x7f0164151340 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 --2- 172.21.15.29:0/2412903402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f016406f150 0x7f0164142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 >> 172.21.15.29:0/2412903402 conn(0x7f016406cfb0 msgr2=0x7f01640c6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 shutdown_connections 2024-04-23T10:16:03.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7f016a0d8640 1 -- 172.21.15.29:0/2412903402 wait complete. 2024-04-23T10:16:03.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2a4068450 msgr2=0x7fe2a406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2a4068450 0x7fe2a406a910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80c9c20 tx=0x7fe2b0009650 comp rx=0 tx=0).stop 2024-04-23T10:16:03.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81386f0 msgr2=0x7fe2b814e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81386f0 0x7fe2b814e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0ab000 tx=0x7fe2a0005840 comp rx=0 tx=0).stop 2024-04-23T10:16:03.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 shutdown_connections 2024-04-23T10:16:03.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2a4068450 0x7fe2a406a910 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81386f0 0x7fe2b814e840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81580e0 0x7fe2b81381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 --2- 172.21.15.29:0/3423612395 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2a0005220 0x7fe2b8168730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 >> 172.21.15.29:0/3423612395 conn(0x7fe2b8067d60 msgr2=0x7fe2b80ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 shutdown_connections 2024-04-23T10:16:03.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.683+0000 7fe2bf0c6640 1 -- 172.21.15.29:0/3423612395 wait complete. 2024-04-23T10:16:03.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.691+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f18b80c98e0 con 0x7f18b8152b40 2024-04-23T10:16:03.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.691+0000 7f18ae7fc640 1 -- 172.21.15.29:0/2945112373 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18b81fd390 con 0x7f18b8152b40 2024-04-23T10:16:03.692 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-04-23T10:16:03.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f189c068380 msgr2=0x7f189c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f189c068380 0x7f189c06a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18b4007fd0 tx=0x7f18b4009040 comp rx=0 tx=0).stop 2024-04-23T10:16:03.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b8152b40 msgr2=0x7f18b80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b8152b40 0x7f18b80cc9a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f18b001ce30 tx=0x7f18b001bfa0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 shutdown_connections 2024-04-23T10:16:03.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f189c068380 0x7f189c06a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b8152b40 0x7f18b80cc9a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18b8073230 0x7f18b80cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 --2- 172.21.15.29:0/2945112373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b8071a70 0x7f18b81533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 >> 172.21.15.29:0/2945112373 conn(0x7f18b806d550 msgr2=0x7f18b8157020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 shutdown_connections 2024-04-23T10:16:03.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.695+0000 7f18beb68640 1 -- 172.21.15.29:0/2945112373 wait complete. 2024-04-23T10:16:03.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.699+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7efc88005860 con 0x7efca40c7370 2024-04-23T10:16:03.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.699+0000 7efc9bfff640 1 -- 172.21.15.29:0/2789025878 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc8c05b360 con 0x7efca40c7370 2024-04-23T10:16:03.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.699+0000 7fe07effd640 1 -- 172.21.15.29:0/2634454306 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe0980c8340 con 0x7fe098151030 2024-04-23T10:16:03.702 INFO:teuthology.orchestra.run.smithi029.stdout:55834574856 2024-04-23T10:16:03.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7fe0957fa640 1 -- 172.21.15.29:0/2634454306 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe088056fa0 con 0x7fe098151030 2024-04-23T10:16:03.702 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-04-23T10:16:03.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7d240742b0 con 0x7f7d241593d0 2024-04-23T10:16:03.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7f7d12ffd640 1 -- 172.21.15.29:0/2082522833 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d14056560 con 0x7f7d241593d0 2024-04-23T10:16:03.704 INFO:teuthology.orchestra.run.smithi029.stdout:55834574858 2024-04-23T10:16:03.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4824005860 con 0x7f4834007470 2024-04-23T10:16:03.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7f4832ffd640 1 -- 172.21.15.29:0/2321016491 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f483c0928e0 con 0x7f4834007470 2024-04-23T10:16:03.704 INFO:teuthology.orchestra.run.smithi029.stdout:55834574859 2024-04-23T10:16:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7fe07effd640 1 -- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe084068480 msgr2=0x7fe08406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7fe07effd640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe084068480 0x7fe08406a940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe098074720 tx=0x7fe09000b040 comp rx=0 tx=0).stop 2024-04-23T10:16:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7fe07effd640 1 -- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098151030 msgr2=0x7fe0981580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7fe07effd640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098151030 0x7fe0981580e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe08800b410 tx=0x7fe08800b8d0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc84068400 msgr2=0x7efc8406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc84068400 0x7efc8406a8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efc940b6000 tx=0x7efc940ae070 comp rx=0 tx=0).stop 2024-04-23T10:16:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca40c7370 msgr2=0x7efca41472e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca40c7370 0x7efca41472e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00f9b0 tx=0x7efc8c00fe70 comp rx=0 tx=0).stop 2024-04-23T10:16:03.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 shutdown_connections 2024-04-23T10:16:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efc84068400 0x7efc8406a8c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca4151130 0x7efca41eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca40c80f0 0x7efca41f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 --2- 172.21.15.29:0/2789025878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efca40c7370 0x7efca41472e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.703+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 >> 172.21.15.29:0/2789025878 conn(0x7efca406cfb0 msgr2=0x7efca4150410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 shutdown_connections 2024-04-23T10:16:03.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7efcaa1c0640 1 -- 172.21.15.29:0/2789025878 wait complete. 2024-04-23T10:16:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7fe07effd640 1 -- 172.21.15.29:0/2634454306 shutdown_connections 2024-04-23T10:16:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7fe07effd640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe084068480 0x7fe08406a940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7fe07effd640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe098157ab0 0x7fe0981f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7fe07effd640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe098151410 0x7fe098158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7fe07effd640 1 --2- 172.21.15.29:0/2634454306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe098151030 0x7fe0981580e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7fe07effd640 1 -- 172.21.15.29:0/2634454306 >> 172.21.15.29:0/2634454306 conn(0x7fe098067d60 msgr2=0x7fe0980cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7fe07effd640 1 -- 172.21.15.29:0/2634454306 shutdown_connections 2024-04-23T10:16:03.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7fe07effd640 1 -- 172.21.15.29:0/2634454306 wait complete. 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48200683d0 msgr2=0x7f482006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48200683d0 0x7f482006a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4834038e20 tx=0x7f4838009040 comp rx=0 tx=0).stop 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 msgr2=0x7f48340e04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e04e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f483c02db60 tx=0x7f483c0959d0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 shutdown_connections 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48200683d0 0x7f482006a890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340dd800 0x7f48340e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4834050be0 0x7f48340e56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 --2- 172.21.15.29:0/2321016491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4834007470 0x7f48340e04e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 >> 172.21.15.29:0/2321016491 conn(0x7f4834051010 msgr2=0x7f4834005930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 shutdown_connections 2024-04-23T10:16:03.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.707+0000 7f48430d3640 1 -- 172.21.15.29:0/2321016491 wait complete. 2024-04-23T10:16:03.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7d04068400 msgr2=0x7f7d0406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7d04068400 0x7f7d0406a8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d180b2000 tx=0x7f7d18004740 comp rx=0 tx=0).stop 2024-04-23T10:16:03.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d241593d0 msgr2=0x7f7d24157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d241593d0 0x7f7d24157eb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c420 tx=0x7f7d1400c8e0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 shutdown_connections 2024-04-23T10:16:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7d04068400 0x7f7d0406a8c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d241593d0 0x7f7d24157eb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-04-23T10:16:03.716 DEBUG:teuthology.parallel:result is None 2024-04-23T10:16:03.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d240c9460 0x7f7d240c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 --2- 172.21.15.29:0/2082522833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d240c8820 0x7f7d2415ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 >> 172.21.15.29:0/2082522833 conn(0x7f7d24067d60 msgr2=0x7f7d240cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 shutdown_connections 2024-04-23T10:16:03.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.715+0000 7f7d28b18640 1 -- 172.21.15.29:0/2082522833 wait complete. 2024-04-23T10:16:03.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-04-23T10:16:03.717 DEBUG:teuthology.parallel:result is None 2024-04-23T10:16:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.719+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6f6c068d70 con 0x7f6f6c0c7370 2024-04-23T10:16:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.719+0000 7f6f61ffb640 1 -- 172.21.15.29:0/898563764 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f640c9020 con 0x7f6f6c0c7370 2024-04-23T10:16:03.718 INFO:teuthology.orchestra.run.smithi029.stdout:55834574857 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f500683b0 msgr2=0x7f6f5006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f500683b0 0x7f6f5006a870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0c6c50 tx=0x7f6f5c009190 comp rx=0 tx=0).stop 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c0c7370 msgr2=0x7f6f6c1f8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c0c7370 0x7f6f6c1f8910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f640b3040 tx=0x7f6f6401d3b0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 shutdown_connections 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f500683b0 0x7f6f5006a870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f6c1f5140 0x7f6f6c1f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0c80f0 0x7f6f6c1f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 --2- 172.21.15.29:0/898563764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c0c7370 0x7f6f6c1f8910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 >> 172.21.15.29:0/898563764 conn(0x7f6f6c06cfb0 msgr2=0x7f6f6c0c99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 shutdown_connections 2024-04-23T10:16:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.723+0000 7f6f738ca640 1 -- 172.21.15.29:0/898563764 wait complete. 2024-04-23T10:16:03.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-23T10:16:03.725 DEBUG:teuthology.parallel:result is None 2024-04-23T10:16:03.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-23T10:16:03.737 DEBUG:teuthology.parallel:result is None 2024-04-23T10:16:03.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-04-23T10:16:03.737 DEBUG:teuthology.parallel:result is None 2024-04-23T10:16:03.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-23T10:16:03.740 DEBUG:teuthology.parallel:result is None 2024-04-23T10:16:03.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-23T10:16:03.745 DEBUG:teuthology.parallel:result is None 2024-04-23T10:16:03.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-23T10:16:03.746 DEBUG:teuthology.parallel:result is None 2024-04-23T10:16:03.746 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T10:16:03.747 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:16:03.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fcd12e640 1 Processor -- start 2024-04-23T10:16:03.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fcd12e640 1 -- start start 2024-04-23T10:16:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fcd12e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fc80754a0 0x7f1fc8159390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fcd12e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fc8075880 0x7f1fc81598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fcd12e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc80c4de0 con 0x7f1fc8141ee0 2024-04-23T10:16:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fcd12e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc80c5960 con 0x7f1fc8075880 2024-04-23T10:16:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fcd12e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc80c50c0 con 0x7f1fc80754a0 2024-04-23T10:16:03.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fbe59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fc8075880 0x7f1fc81598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fc759e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1fc8141ee0 0x7f1fc8142350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35172/0 (socket says 172.21.15.29:35172) 2024-04-23T10:16:03.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fc759e640 1 -- 172.21.15.29:0/3548034273 learned_addr learned my addr 172.21.15.29:0/3548034273 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:03.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fc6d9d640 1 --2- 172.21.15.29:0/3548034273 >> v2:172.21.15.72:3300/0 conn(0x7f1fc80754a0 0x7f1fc8159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fbe59c640 1 -- 172.21.15.29:0/3548034273 >> v2:172.21.15.72:3300/0 conn(0x7f1fc80754a0 msgr2=0x7f1fc8159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:03.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fbe59c640 1 --2- 172.21.15.29:0/3548034273 >> v2:172.21.15.72:3300/0 conn(0x7f1fc80754a0 0x7f1fc8159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fbe59c640 1 -- 172.21.15.29:0/3548034273 >> v1:172.21.15.29:6789/0 conn(0x7f1fc8141ee0 legacy=0x7f1fc8142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fbe59c640 1 -- 172.21.15.29:0/3548034273 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc80c53a0 con 0x7f1fc8075880 2024-04-23T10:16:03.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.899+0000 7f1fc659c640 1 -- 172.21.15.29:0/3548034273 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013183143 0 0) 0x7f1fc80c4de0 con 0x7f1fc8141ee0 2024-04-23T10:16:03.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 --2- 172.21.15.29:0/3548034273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc81598d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1fc806c580 tx=0x7f1fb001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f41fec8ce8f4ca server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fc659c640 1 -- 172.21.15.29:0/3548034273 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00b5070 con 0x7f1fc8075880 2024-04-23T10:16:03.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fc659c640 1 -- 172.21.15.29:0/3548034273 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb00a8970 con 0x7f1fc8075880 2024-04-23T10:16:03.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fc659c640 1 -- 172.21.15.29:0/3548034273 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00a8d40 con 0x7f1fc8075880 2024-04-23T10:16:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- 172.21.15.29:0/3548034273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 msgr2=0x7f1fc81598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/3548034273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc81598d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1fc806c580 tx=0x7f1fb001ec70 comp rx=0 tx=0).stop 2024-04-23T10:16:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- 172.21.15.29:0/3548034273 shutdown_connections 2024-04-23T10:16:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/3548034273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc81598d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/3548034273 >> v2:172.21.15.72:3300/0 conn(0x7f1fc80754a0 0x7f1fc8159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- 172.21.15.29:0/3548034273 >> 172.21.15.29:0/3548034273 conn(0x7f1fc8068180 msgr2=0x7f1fc806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- 172.21.15.29:0/3548034273 shutdown_connections 2024-04-23T10:16:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- 172.21.15.29:0/3548034273 wait complete. 2024-04-23T10:16:03.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 Processor -- start 2024-04-23T10:16:03.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- start start 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fc80754a0 0x7f1fc813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc813f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fc8141ee0 0x7f1fc815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc80ce360 con 0x7f1fc8075880 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc80ce1e0 con 0x7f1fc8141ee0 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc80c6f60 con 0x7f1fc80754a0 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc813f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc813f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59410/0 (socket says 172.21.15.29:59410) 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 -- 172.21.15.29:0/1449778353 learned_addr learned my addr 172.21.15.29:0/1449778353 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fc759e640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fc8141ee0 0x7f1fc815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fc6d9d640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fc80754a0 0x7f1fc813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 -- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fc80754a0 msgr2=0x7f1fc813fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fc80754a0 0x7f1fc813fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 -- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fc8141ee0 msgr2=0x7f1fc815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fc8141ee0 0x7f1fc815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 -- 172.21.15.29:0/1449778353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc80cce30 con 0x7f1fc8075880 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbe59c640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc813f5f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00b3040 tx=0x7f1fb001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbffff640 1 -- 172.21.15.29:0/1449778353 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00bf070 con 0x7f1fc8075880 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbffff640 1 -- 172.21.15.29:0/1449778353 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb00b0740 con 0x7f1fc8075880 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc80cd0d0 con 0x7f1fc8075880 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fbffff640 1 -- 172.21.15.29:0/1449778353 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00b5040 con 0x7f1fc8075880 2024-04-23T10:16:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.903+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc81ef600 con 0x7f1fc8075880 2024-04-23T10:16:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.907+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc80693c0 con 0x7f1fc8075880 2024-04-23T10:16:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.907+0000 7f1fbffff640 1 -- 172.21.15.29:0/1449778353 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1fb00c2070 con 0x7f1fc8075880 2024-04-23T10:16:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.907+0000 7f1fbffff640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1fa8068380 0x7f1fa806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.907+0000 7f1fbffff640 1 -- 172.21.15.29:0/1449778353 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1fb0123500 con 0x7f1fc8075880 2024-04-23T10:16:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.907+0000 7f1fc6d9d640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1fa8068380 0x7f1fa806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.907+0000 7f1fc6d9d640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1fa8068380 0x7f1fa806a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009790 tx=0x7f1fb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:03.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:03.911+0000 7f1fbffff640 1 -- 172.21.15.29:0/1449778353 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1fb00187d0 con 0x7f1fc8075880 2024-04-23T10:16:04.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.063+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fc81408d0 con 0x7f1fa8068380 2024-04-23T10:16:04.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.083+0000 7f1fbffff640 1 -- 172.21.15.29:0/1449778353 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f1fc81408d0 con 0x7f1fa8068380 2024-04-23T10:16:04.085 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:04.087 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:16:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1fa8068380 msgr2=0x7f1fa806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1fa8068380 0x7f1fa806a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009790 tx=0x7f1fb8008040 comp rx=0 tx=0).stop 2024-04-23T10:16:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 msgr2=0x7f1fc813f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc813f5f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00b3040 tx=0x7f1fb001ba10 comp rx=0 tx=0).stop 2024-04-23T10:16:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 shutdown_connections 2024-04-23T10:16:04.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1fa8068380 0x7f1fa806a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fc8141ee0 0x7f1fc815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8075880 0x7f1fc813f5f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 --2- 172.21.15.29:0/1449778353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fc80754a0 0x7f1fc813fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 >> 172.21.15.29:0/1449778353 conn(0x7f1fc8068180 msgr2=0x7f1fc8159290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 shutdown_connections 2024-04-23T10:16:04.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.087+0000 7f1fcd12e640 1 -- 172.21.15.29:0/1449778353 wait complete. 2024-04-23T10:16:04.101 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-23T10:16:03.197747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236020,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738700,"statfs":{"total":773094113280,"available":772852428800,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004779"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180971+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:15:43.180971+0000","last_peered":"2024-04-23T10:15:43.180971+0000","last_clean":"2024-04-23T10:15:43.180971+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:15:43.180971+0000","last_undegraded":"2024-04-23T10:15:43.180971+0000","last_fullsized":"2024-04-23T10:15:43.180971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186172+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:15:43.186172+0000","last_peered":"2024-04-23T10:15:43.186172+0000","last_clean":"2024-04-23T10:15:43.186172+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:15:43.186172+0000","last_undegraded":"2024-04-23T10:15:43.186172+0000","last_fullsized":"2024-04-23T10:15:43.186172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185322+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:15:43.185322+0000","last_peered":"2024-04-23T10:15:43.185322+0000","last_clean":"2024-04-23T10:15:43.185322+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:15:43.185322+0000","last_undegraded":"2024-04-23T10:15:43.185322+0000","last_fullsized":"2024-04-23T10:15:43.185322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186331+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:15:43.186331+0000","last_peered":"2024-04-23T10:15:43.186331+0000","last_clean":"2024-04-23T10:15:43.186331+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:15:43.186331+0000","last_undegraded":"2024-04-23T10:15:43.186331+0000","last_fullsized":"2024-04-23T10:15:43.186331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180764+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:15:43.180764+0000","last_peered":"2024-04-23T10:15:43.180764+0000","last_clean":"2024-04-23T10:15:43.180764+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:15:43.180764+0000","last_undegraded":"2024-04-23T10:15:43.180764+0000","last_fullsized":"2024-04-23T10:15:43.180764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181921+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:15:43.181921+0000","last_peered":"2024-04-23T10:15:43.181921+0000","last_clean":"2024-04-23T10:15:43.181921+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:15:43.181921+0000","last_undegraded":"2024-04-23T10:15:43.181921+0000","last_fullsized":"2024-04-23T10:15:43.181921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183360+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:15:43.183360+0000","last_peered":"2024-04-23T10:15:43.183360+0000","last_clean":"2024-04-23T10:15:43.183360+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:15:43.183360+0000","last_undegraded":"2024-04-23T10:15:43.183360+0000","last_fullsized":"2024-04-23T10:15:43.183360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077706+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:15:43.077706+0000","last_peered":"2024-04-23T10:15:43.077706+0000","last_clean":"2024-04-23T10:15:43.077706+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:15:43.077706+0000","last_undegraded":"2024-04-23T10:15:43.077706+0000","last_fullsized":"2024-04-23T10:15:43.077706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184273+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:15:43.184273+0000","last_peered":"2024-04-23T10:15:43.184273+0000","last_clean":"2024-04-23T10:15:43.184273+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:15:43.184273+0000","last_undegraded":"2024-04-23T10:15:43.184273+0000","last_fullsized":"2024-04-23T10:15:43.184273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182427+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:15:43.182427+0000","last_peered":"2024-04-23T10:15:43.182427+0000","last_clean":"2024-04-23T10:15:43.182427+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:15:43.182427+0000","last_undegraded":"2024-04-23T10:15:43.182427+0000","last_fullsized":"2024-04-23T10:15:43.182427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078673+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:15:43.078673+0000","last_peered":"2024-04-23T10:15:43.078673+0000","last_clean":"2024-04-23T10:15:43.078673+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:15:43.078673+0000","last_undegraded":"2024-04-23T10:15:43.078673+0000","last_fullsized":"2024-04-23T10:15:43.078673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183120+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:15:43.183120+0000","last_peered":"2024-04-23T10:15:43.183120+0000","last_clean":"2024-04-23T10:15:43.183120+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:15:43.183120+0000","last_undegraded":"2024-04-23T10:15:43.183120+0000","last_fullsized":"2024-04-23T10:15:43.183120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079159+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:15:43.079159+0000","last_peered":"2024-04-23T10:15:43.079159+0000","last_clean":"2024-04-23T10:15:43.079159+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:15:43.079159+0000","last_undegraded":"2024-04-23T10:15:43.079159+0000","last_fullsized":"2024-04-23T10:15:43.079159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182688+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:15:43.182688+0000","last_peered":"2024-04-23T10:15:43.182688+0000","last_clean":"2024-04-23T10:15:43.182688+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:15:43.182688+0000","last_undegraded":"2024-04-23T10:15:43.182688+0000","last_fullsized":"2024-04-23T10:15:43.182688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183425+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:15:43.183425+0000","last_peered":"2024-04-23T10:15:43.183425+0000","last_clean":"2024-04-23T10:15:43.183425+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:15:43.183425+0000","last_undegraded":"2024-04-23T10:15:43.183425+0000","last_fullsized":"2024-04-23T10:15:43.183425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185586+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:15:43.185586+0000","last_peered":"2024-04-23T10:15:43.185586+0000","last_clean":"2024-04-23T10:15:43.185586+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:15:43.185586+0000","last_undegraded":"2024-04-23T10:15:43.185586+0000","last_fullsized":"2024-04-23T10:15:43.185586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180186+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:15:43.180186+0000","last_peered":"2024-04-23T10:15:43.180186+0000","last_clean":"2024-04-23T10:15:43.180186+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:15:43.180186+0000","last_undegraded":"2024-04-23T10:15:43.180186+0000","last_fullsized":"2024-04-23T10:15:43.180186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183292+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:15:43.183292+0000","last_peered":"2024-04-23T10:15:43.183292+0000","last_clean":"2024-04-23T10:15:43.183292+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:15:43.183292+0000","last_undegraded":"2024-04-23T10:15:43.183292+0000","last_fullsized":"2024-04-23T10:15:43.183292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185347+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:15:43.185347+0000","last_peered":"2024-04-23T10:15:43.185347+0000","last_clean":"2024-04-23T10:15:43.185347+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:15:43.185347+0000","last_undegraded":"2024-04-23T10:15:43.185347+0000","last_fullsized":"2024-04-23T10:15:43.185347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180168+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:15:43.180168+0000","last_peered":"2024-04-23T10:15:43.180168+0000","last_clean":"2024-04-23T10:15:43.180168+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:15:43.180168+0000","last_undegraded":"2024-04-23T10:15:43.180168+0000","last_fullsized":"2024-04-23T10:15:43.180168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182115+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:15:43.182115+0000","last_peered":"2024-04-23T10:15:43.182115+0000","last_clean":"2024-04-23T10:15:43.182115+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:15:43.182115+0000","last_undegraded":"2024-04-23T10:15:43.182115+0000","last_fullsized":"2024-04-23T10:15:43.182115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184379+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:15:43.184379+0000","last_peered":"2024-04-23T10:15:43.184379+0000","last_clean":"2024-04-23T10:15:43.184379+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:15:43.184379+0000","last_undegraded":"2024-04-23T10:15:43.184379+0000","last_fullsized":"2024-04-23T10:15:43.184379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182073+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:15:43.182073+0000","last_peered":"2024-04-23T10:15:43.182073+0000","last_clean":"2024-04-23T10:15:43.182073+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:15:43.182073+0000","last_undegraded":"2024-04-23T10:15:43.182073+0000","last_fullsized":"2024-04-23T10:15:43.182073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183011+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:15:43.183011+0000","last_peered":"2024-04-23T10:15:43.183011+0000","last_clean":"2024-04-23T10:15:43.183011+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:15:43.183011+0000","last_undegraded":"2024-04-23T10:15:43.183011+0000","last_fullsized":"2024-04-23T10:15:43.183011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180835+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:15:43.180835+0000","last_peered":"2024-04-23T10:15:43.180835+0000","last_clean":"2024-04-23T10:15:43.180835+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:15:43.180835+0000","last_undegraded":"2024-04-23T10:15:43.180835+0000","last_fullsized":"2024-04-23T10:15:43.180835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.080051+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:15:43.080051+0000","last_peered":"2024-04-23T10:15:43.080051+0000","last_clean":"2024-04-23T10:15:43.080051+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:15:43.080051+0000","last_undegraded":"2024-04-23T10:15:43.080051+0000","last_fullsized":"2024-04-23T10:15:43.080051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183767+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:15:43.183767+0000","last_peered":"2024-04-23T10:15:43.183767+0000","last_clean":"2024-04-23T10:15:43.183767+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:15:43.183767+0000","last_undegraded":"2024-04-23T10:15:43.183767+0000","last_fullsized":"2024-04-23T10:15:43.183767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186365+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:15:43.186365+0000","last_peered":"2024-04-23T10:15:43.186365+0000","last_clean":"2024-04-23T10:15:43.186365+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:15:43.186365+0000","last_undegraded":"2024-04-23T10:15:43.186365+0000","last_fullsized":"2024-04-23T10:15:43.186365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181410+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:15:43.181410+0000","last_peered":"2024-04-23T10:15:43.181410+0000","last_clean":"2024-04-23T10:15:43.181410+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:15:43.181410+0000","last_undegraded":"2024-04-23T10:15:43.181410+0000","last_fullsized":"2024-04-23T10:15:43.181410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185049+0000","last_change":"2024-04-23T10:15:42.164860+0000","last_active":"2024-04-23T10:15:43.185049+0000","last_peered":"2024-04-23T10:15:43.185049+0000","last_clean":"2024-04-23T10:15:43.185049+0000","last_became_active":"2024-04-23T10:15:42.163816+0000","last_became_peered":"2024-04-23T10:15:42.163816+0000","last_unstale":"2024-04-23T10:15:43.185049+0000","last_undegraded":"2024-04-23T10:15:43.185049+0000","last_fullsized":"2024-04-23T10:15:43.185049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:47.776069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180146+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:15:43.180146+0000","last_peered":"2024-04-23T10:15:43.180146+0000","last_clean":"2024-04-23T10:15:43.180146+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:15:43.180146+0000","last_undegraded":"2024-04-23T10:15:43.180146+0000","last_fullsized":"2024-04-23T10:15:43.180146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183851+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:15:43.183851+0000","last_peered":"2024-04-23T10:15:43.183851+0000","last_clean":"2024-04-23T10:15:43.183851+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:15:43.183851+0000","last_undegraded":"2024-04-23T10:15:43.183851+0000","last_fullsized":"2024-04-23T10:15:43.183851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181358+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:15:43.181358+0000","last_peered":"2024-04-23T10:15:43.181358+0000","last_clean":"2024-04-23T10:15:43.181358+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:15:43.181358+0000","last_undegraded":"2024-04-23T10:15:43.181358+0000","last_fullsized":"2024-04-23T10:15:43.181358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078759+0000","last_change":"2024-04-23T10:15:38.000072+0000","last_active":"2024-04-23T10:15:43.078759+0000","last_peered":"2024-04-23T10:15:43.078759+0000","last_clean":"2024-04-23T10:15:43.078759+0000","last_became_active":"2024-04-23T10:15:37.999407+0000","last_became_peered":"2024-04-23T10:15:37.999407+0000","last_unstale":"2024-04-23T10:15:43.078759+0000","last_undegraded":"2024-04-23T10:15:43.078759+0000","last_fullsized":"2024-04-23T10:15:43.078759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:32:12.652769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180279+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:15:43.180279+0000","last_peered":"2024-04-23T10:15:43.180279+0000","last_clean":"2024-04-23T10:15:43.180279+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:15:43.180279+0000","last_undegraded":"2024-04-23T10:15:43.180279+0000","last_fullsized":"2024-04-23T10:15:43.180279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179704+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:15:43.179704+0000","last_peered":"2024-04-23T10:15:43.179704+0000","last_clean":"2024-04-23T10:15:43.179704+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:15:43.179704+0000","last_undegraded":"2024-04-23T10:15:43.179704+0000","last_fullsized":"2024-04-23T10:15:43.179704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184990+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:15:43.184990+0000","last_peered":"2024-04-23T10:15:43.184990+0000","last_clean":"2024-04-23T10:15:43.184990+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:15:43.184990+0000","last_undegraded":"2024-04-23T10:15:43.184990+0000","last_fullsized":"2024-04-23T10:15:43.184990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077914+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:15:43.077914+0000","last_peered":"2024-04-23T10:15:43.077914+0000","last_clean":"2024-04-23T10:15:43.077914+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:15:43.077914+0000","last_undegraded":"2024-04-23T10:15:43.077914+0000","last_fullsized":"2024-04-23T10:15:43.077914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180011+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:15:43.180011+0000","last_peered":"2024-04-23T10:15:43.180011+0000","last_clean":"2024-04-23T10:15:43.180011+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:15:43.180011+0000","last_undegraded":"2024-04-23T10:15:43.180011+0000","last_fullsized":"2024-04-23T10:15:43.180011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182378+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:15:43.182378+0000","last_peered":"2024-04-23T10:15:43.182378+0000","last_clean":"2024-04-23T10:15:43.182378+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:15:43.182378+0000","last_undegraded":"2024-04-23T10:15:43.182378+0000","last_fullsized":"2024-04-23T10:15:43.182378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074055+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:15:43.074055+0000","last_peered":"2024-04-23T10:15:43.074055+0000","last_clean":"2024-04-23T10:15:43.074055+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:15:43.074055+0000","last_undegraded":"2024-04-23T10:15:43.074055+0000","last_fullsized":"2024-04-23T10:15:43.074055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182513+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:15:43.182513+0000","last_peered":"2024-04-23T10:15:43.182513+0000","last_clean":"2024-04-23T10:15:43.182513+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:15:43.182513+0000","last_undegraded":"2024-04-23T10:15:43.182513+0000","last_fullsized":"2024-04-23T10:15:43.182513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179368+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:15:43.179368+0000","last_peered":"2024-04-23T10:15:43.179368+0000","last_clean":"2024-04-23T10:15:43.179368+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:15:43.179368+0000","last_undegraded":"2024-04-23T10:15:43.179368+0000","last_fullsized":"2024-04-23T10:15:43.179368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182188+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:15:43.182188+0000","last_peered":"2024-04-23T10:15:43.182188+0000","last_clean":"2024-04-23T10:15:43.182188+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:15:43.182188+0000","last_undegraded":"2024-04-23T10:15:43.182188+0000","last_fullsized":"2024-04-23T10:15:43.182188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180738+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:15:43.180738+0000","last_peered":"2024-04-23T10:15:43.180738+0000","last_clean":"2024-04-23T10:15:43.180738+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:15:43.180738+0000","last_undegraded":"2024-04-23T10:15:43.180738+0000","last_fullsized":"2024-04-23T10:15:43.180738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185653+0000","last_change":"2024-04-23T10:15:38.020047+0000","last_active":"2024-04-23T10:15:43.185653+0000","last_peered":"2024-04-23T10:15:43.185653+0000","last_clean":"2024-04-23T10:15:43.185653+0000","last_became_active":"2024-04-23T10:15:38.019277+0000","last_became_peered":"2024-04-23T10:15:38.019277+0000","last_unstale":"2024-04-23T10:15:43.185653+0000","last_undegraded":"2024-04-23T10:15:43.185653+0000","last_fullsized":"2024-04-23T10:15:43.185653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:11:05.298798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077439+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:15:43.077439+0000","last_peered":"2024-04-23T10:15:43.077439+0000","last_clean":"2024-04-23T10:15:43.077439+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:15:43.077439+0000","last_undegraded":"2024-04-23T10:15:43.077439+0000","last_fullsized":"2024-04-23T10:15:43.077439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182359+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:15:43.182359+0000","last_peered":"2024-04-23T10:15:43.182359+0000","last_clean":"2024-04-23T10:15:43.182359+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:15:43.182359+0000","last_undegraded":"2024-04-23T10:15:43.182359+0000","last_fullsized":"2024-04-23T10:15:43.182359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079122+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:15:43.079122+0000","last_peered":"2024-04-23T10:15:43.079122+0000","last_clean":"2024-04-23T10:15:43.079122+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:15:43.079122+0000","last_undegraded":"2024-04-23T10:15:43.079122+0000","last_fullsized":"2024-04-23T10:15:43.079122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182894+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:15:43.182894+0000","last_peered":"2024-04-23T10:15:43.182894+0000","last_clean":"2024-04-23T10:15:43.182894+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:15:43.182894+0000","last_undegraded":"2024-04-23T10:15:43.182894+0000","last_fullsized":"2024-04-23T10:15:43.182894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074812+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:15:43.074812+0000","last_peered":"2024-04-23T10:15:43.074812+0000","last_clean":"2024-04-23T10:15:43.074812+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:15:43.074812+0000","last_undegraded":"2024-04-23T10:15:43.074812+0000","last_fullsized":"2024-04-23T10:15:43.074812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077536+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:15:43.077536+0000","last_peered":"2024-04-23T10:15:43.077536+0000","last_clean":"2024-04-23T10:15:43.077536+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:15:43.077536+0000","last_undegraded":"2024-04-23T10:15:43.077536+0000","last_fullsized":"2024-04-23T10:15:43.077536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077818+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:15:43.077818+0000","last_peered":"2024-04-23T10:15:43.077818+0000","last_clean":"2024-04-23T10:15:43.077818+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:15:43.077818+0000","last_undegraded":"2024-04-23T10:15:43.077818+0000","last_fullsized":"2024-04-23T10:15:43.077818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180693+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:15:43.180693+0000","last_peered":"2024-04-23T10:15:43.180693+0000","last_clean":"2024-04-23T10:15:43.180693+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:15:43.180693+0000","last_undegraded":"2024-04-23T10:15:43.180693+0000","last_fullsized":"2024-04-23T10:15:43.180693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181704+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:15:43.181704+0000","last_peered":"2024-04-23T10:15:43.181704+0000","last_clean":"2024-04-23T10:15:43.181704+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:15:43.181704+0000","last_undegraded":"2024-04-23T10:15:43.181704+0000","last_fullsized":"2024-04-23T10:15:43.181704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186017+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:15:43.186017+0000","last_peered":"2024-04-23T10:15:43.186017+0000","last_clean":"2024-04-23T10:15:43.186017+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:15:43.186017+0000","last_undegraded":"2024-04-23T10:15:43.186017+0000","last_fullsized":"2024-04-23T10:15:43.186017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074930+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:15:43.074930+0000","last_peered":"2024-04-23T10:15:43.074930+0000","last_clean":"2024-04-23T10:15:43.074930+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:15:43.074930+0000","last_undegraded":"2024-04-23T10:15:43.074930+0000","last_fullsized":"2024-04-23T10:15:43.074930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.076817+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:15:43.076817+0000","last_peered":"2024-04-23T10:15:43.076817+0000","last_clean":"2024-04-23T10:15:43.076817+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:15:43.076817+0000","last_undegraded":"2024-04-23T10:15:43.076817+0000","last_fullsized":"2024-04-23T10:15:43.076817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185476+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:15:43.185476+0000","last_peered":"2024-04-23T10:15:43.185476+0000","last_clean":"2024-04-23T10:15:43.185476+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:15:43.185476+0000","last_undegraded":"2024-04-23T10:15:43.185476+0000","last_fullsized":"2024-04-23T10:15:43.185476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184056+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:15:43.184056+0000","last_peered":"2024-04-23T10:15:43.184056+0000","last_clean":"2024-04-23T10:15:43.184056+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:15:43.184056+0000","last_undegraded":"2024-04-23T10:15:43.184056+0000","last_fullsized":"2024-04-23T10:15:43.184056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181866+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:15:43.181866+0000","last_peered":"2024-04-23T10:15:43.181866+0000","last_clean":"2024-04-23T10:15:43.181866+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:15:43.181866+0000","last_undegraded":"2024-04-23T10:15:43.181866+0000","last_fullsized":"2024-04-23T10:15:43.181866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183177+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:15:43.183177+0000","last_peered":"2024-04-23T10:15:43.183177+0000","last_clean":"2024-04-23T10:15:43.183177+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:15:43.183177+0000","last_undegraded":"2024-04-23T10:15:43.183177+0000","last_fullsized":"2024-04-23T10:15:43.183177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.073780+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:15:43.073780+0000","last_peered":"2024-04-23T10:15:43.073780+0000","last_clean":"2024-04-23T10:15:43.073780+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:15:43.073780+0000","last_undegraded":"2024-04-23T10:15:43.073780+0000","last_fullsized":"2024-04-23T10:15:43.073780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180612+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:15:43.180612+0000","last_peered":"2024-04-23T10:15:43.180612+0000","last_clean":"2024-04-23T10:15:43.180612+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:15:43.180612+0000","last_undegraded":"2024-04-23T10:15:43.180612+0000","last_fullsized":"2024-04-23T10:15:43.180612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078323+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:15:43.078323+0000","last_peered":"2024-04-23T10:15:43.078323+0000","last_clean":"2024-04-23T10:15:43.078323+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:15:43.078323+0000","last_undegraded":"2024-04-23T10:15:43.078323+0000","last_fullsized":"2024-04-23T10:15:43.078323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078414+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:15:43.078414+0000","last_peered":"2024-04-23T10:15:43.078414+0000","last_clean":"2024-04-23T10:15:43.078414+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:15:43.078414+0000","last_undegraded":"2024-04-23T10:15:43.078414+0000","last_fullsized":"2024-04-23T10:15:43.078414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186321+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:15:43.186321+0000","last_peered":"2024-04-23T10:15:43.186321+0000","last_clean":"2024-04-23T10:15:43.186321+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:15:43.186321+0000","last_undegraded":"2024-04-23T10:15:43.186321+0000","last_fullsized":"2024-04-23T10:15:43.186321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182507+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:15:43.182507+0000","last_peered":"2024-04-23T10:15:43.182507+0000","last_clean":"2024-04-23T10:15:43.182507+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:15:43.182507+0000","last_undegraded":"2024-04-23T10:15:43.182507+0000","last_fullsized":"2024-04-23T10:15:43.182507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077971+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:15:43.077971+0000","last_peered":"2024-04-23T10:15:43.077971+0000","last_clean":"2024-04-23T10:15:43.077971+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:15:43.077971+0000","last_undegraded":"2024-04-23T10:15:43.077971+0000","last_fullsized":"2024-04-23T10:15:43.077971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185833+0000","last_change":"2024-04-23T10:15:42.164994+0000","last_active":"2024-04-23T10:15:43.185833+0000","last_peered":"2024-04-23T10:15:43.185833+0000","last_clean":"2024-04-23T10:15:43.185833+0000","last_became_active":"2024-04-23T10:15:42.163851+0000","last_became_peered":"2024-04-23T10:15:42.163851+0000","last_unstale":"2024-04-23T10:15:43.185833+0000","last_undegraded":"2024-04-23T10:15:43.185833+0000","last_fullsized":"2024-04-23T10:15:43.185833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:29:45.598515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179977+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:15:43.179977+0000","last_peered":"2024-04-23T10:15:43.179977+0000","last_clean":"2024-04-23T10:15:43.179977+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:15:43.179977+0000","last_undegraded":"2024-04-23T10:15:43.179977+0000","last_fullsized":"2024-04-23T10:15:43.179977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182077+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:15:43.182077+0000","last_peered":"2024-04-23T10:15:43.182077+0000","last_clean":"2024-04-23T10:15:43.182077+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:15:43.182077+0000","last_undegraded":"2024-04-23T10:15:43.182077+0000","last_fullsized":"2024-04-23T10:15:43.182077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078431+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:15:43.078431+0000","last_peered":"2024-04-23T10:15:43.078431+0000","last_clean":"2024-04-23T10:15:43.078431+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:15:43.078431+0000","last_undegraded":"2024-04-23T10:15:43.078431+0000","last_fullsized":"2024-04-23T10:15:43.078431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182647+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:15:43.182647+0000","last_peered":"2024-04-23T10:15:43.182647+0000","last_clean":"2024-04-23T10:15:43.182647+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:15:43.182647+0000","last_undegraded":"2024-04-23T10:15:43.182647+0000","last_fullsized":"2024-04-23T10:15:43.182647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:51.366095+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:15:51.366095+0000","last_peered":"2024-04-23T10:15:51.366095+0000","last_clean":"2024-04-23T10:15:51.366095+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:15:51.366095+0000","last_undegraded":"2024-04-23T10:15:51.366095+0000","last_fullsized":"2024-04-23T10:15:51.366095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180021+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:15:43.180021+0000","last_peered":"2024-04-23T10:15:43.180021+0000","last_clean":"2024-04-23T10:15:43.180021+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:15:43.180021+0000","last_undegraded":"2024-04-23T10:15:43.180021+0000","last_fullsized":"2024-04-23T10:15:43.180021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183989+0000","last_change":"2024-04-23T10:15:38.027810+0000","last_active":"2024-04-23T10:15:43.183989+0000","last_peered":"2024-04-23T10:15:43.183989+0000","last_clean":"2024-04-23T10:15:43.183989+0000","last_became_active":"2024-04-23T10:15:38.026559+0000","last_became_peered":"2024-04-23T10:15:38.026559+0000","last_unstale":"2024-04-23T10:15:43.183989+0000","last_undegraded":"2024-04-23T10:15:43.183989+0000","last_fullsized":"2024-04-23T10:15:43.183989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:08:17.720264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180357+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:15:43.180357+0000","last_peered":"2024-04-23T10:15:43.180357+0000","last_clean":"2024-04-23T10:15:43.180357+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:15:43.180357+0000","last_undegraded":"2024-04-23T10:15:43.180357+0000","last_fullsized":"2024-04-23T10:15:43.180357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184591+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:15:43.184591+0000","last_peered":"2024-04-23T10:15:43.184591+0000","last_clean":"2024-04-23T10:15:43.184591+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:15:43.184591+0000","last_undegraded":"2024-04-23T10:15:43.184591+0000","last_fullsized":"2024-04-23T10:15:43.184591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180910+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:15:43.180910+0000","last_peered":"2024-04-23T10:15:43.180910+0000","last_clean":"2024-04-23T10:15:43.180910+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:15:43.180910+0000","last_undegraded":"2024-04-23T10:15:43.180910+0000","last_fullsized":"2024-04-23T10:15:43.180910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078472+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:15:43.078472+0000","last_peered":"2024-04-23T10:15:43.078472+0000","last_clean":"2024-04-23T10:15:43.078472+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:15:43.078472+0000","last_undegraded":"2024-04-23T10:15:43.078472+0000","last_fullsized":"2024-04-23T10:15:43.078472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185228+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:15:43.185228+0000","last_peered":"2024-04-23T10:15:43.185228+0000","last_clean":"2024-04-23T10:15:43.185228+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:15:43.185228+0000","last_undegraded":"2024-04-23T10:15:43.185228+0000","last_fullsized":"2024-04-23T10:15:43.185228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078321+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:15:43.078321+0000","last_peered":"2024-04-23T10:15:43.078321+0000","last_clean":"2024-04-23T10:15:43.078321+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:15:43.078321+0000","last_undegraded":"2024-04-23T10:15:43.078321+0000","last_fullsized":"2024-04-23T10:15:43.078321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079824+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:15:43.079824+0000","last_peered":"2024-04-23T10:15:43.079824+0000","last_clean":"2024-04-23T10:15:43.079824+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:15:43.079824+0000","last_undegraded":"2024-04-23T10:15:43.079824+0000","last_fullsized":"2024-04-23T10:15:43.079824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185281+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:15:43.185281+0000","last_peered":"2024-04-23T10:15:43.185281+0000","last_clean":"2024-04-23T10:15:43.185281+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:15:43.185281+0000","last_undegraded":"2024-04-23T10:15:43.185281+0000","last_fullsized":"2024-04-23T10:15:43.185281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180558+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:15:43.180558+0000","last_peered":"2024-04-23T10:15:43.180558+0000","last_clean":"2024-04-23T10:15:43.180558+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:15:43.180558+0000","last_undegraded":"2024-04-23T10:15:43.180558+0000","last_fullsized":"2024-04-23T10:15:43.180558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179861+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:15:43.179861+0000","last_peered":"2024-04-23T10:15:43.179861+0000","last_clean":"2024-04-23T10:15:43.179861+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:15:43.179861+0000","last_undegraded":"2024-04-23T10:15:43.179861+0000","last_fullsized":"2024-04-23T10:15:43.179861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077622+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:15:43.077622+0000","last_peered":"2024-04-23T10:15:43.077622+0000","last_clean":"2024-04-23T10:15:43.077622+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:15:43.077622+0000","last_undegraded":"2024-04-23T10:15:43.077622+0000","last_fullsized":"2024-04-23T10:15:43.077622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079727+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:15:43.079727+0000","last_peered":"2024-04-23T10:15:43.079727+0000","last_clean":"2024-04-23T10:15:43.079727+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:15:43.079727+0000","last_undegraded":"2024-04-23T10:15:43.079727+0000","last_fullsized":"2024-04-23T10:15:43.079727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185263+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:15:43.185263+0000","last_peered":"2024-04-23T10:15:43.185263+0000","last_clean":"2024-04-23T10:15:43.185263+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:15:43.185263+0000","last_undegraded":"2024-04-23T10:15:43.185263+0000","last_fullsized":"2024-04-23T10:15:43.185263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185741+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:15:43.185741+0000","last_peered":"2024-04-23T10:15:43.185741+0000","last_clean":"2024-04-23T10:15:43.185741+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:15:43.185741+0000","last_undegraded":"2024-04-23T10:15:43.185741+0000","last_fullsized":"2024-04-23T10:15:43.185741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079596+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:15:43.079596+0000","last_peered":"2024-04-23T10:15:43.079596+0000","last_clean":"2024-04-23T10:15:43.079596+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:15:43.079596+0000","last_undegraded":"2024-04-23T10:15:43.079596+0000","last_fullsized":"2024-04-23T10:15:43.079596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181954+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:15:43.181954+0000","last_peered":"2024-04-23T10:15:43.181954+0000","last_clean":"2024-04-23T10:15:43.181954+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:15:43.181954+0000","last_undegraded":"2024-04-23T10:15:43.181954+0000","last_fullsized":"2024-04-23T10:15:43.181954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074391+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:15:43.074391+0000","last_peered":"2024-04-23T10:15:43.074391+0000","last_clean":"2024-04-23T10:15:43.074391+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:15:43.074391+0000","last_undegraded":"2024-04-23T10:15:43.074391+0000","last_fullsized":"2024-04-23T10:15:43.074391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185670+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:15:43.185670+0000","last_peered":"2024-04-23T10:15:43.185670+0000","last_clean":"2024-04-23T10:15:43.185670+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:15:43.185670+0000","last_undegraded":"2024-04-23T10:15:43.185670+0000","last_fullsized":"2024-04-23T10:15:43.185670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183710+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:15:43.183710+0000","last_peered":"2024-04-23T10:15:43.183710+0000","last_clean":"2024-04-23T10:15:43.183710+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:15:43.183710+0000","last_undegraded":"2024-04-23T10:15:43.183710+0000","last_fullsized":"2024-04-23T10:15:43.183710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186025+0000","last_change":"2024-04-23T10:15:42.096686+0000","last_active":"2024-04-23T10:15:43.186025+0000","last_peered":"2024-04-23T10:15:43.186025+0000","last_clean":"2024-04-23T10:15:43.186025+0000","last_became_active":"2024-04-23T10:15:42.096056+0000","last_became_peered":"2024-04-23T10:15:42.096056+0000","last_unstale":"2024-04-23T10:15:43.186025+0000","last_undegraded":"2024-04-23T10:15:43.186025+0000","last_fullsized":"2024-04-23T10:15:43.186025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:56.385523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077884+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:15:43.077884+0000","last_peered":"2024-04-23T10:15:43.077884+0000","last_clean":"2024-04-23T10:15:43.077884+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:15:43.077884+0000","last_undegraded":"2024-04-23T10:15:43.077884+0000","last_fullsized":"2024-04-23T10:15:43.077884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.073994+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:15:43.073994+0000","last_peered":"2024-04-23T10:15:43.073994+0000","last_clean":"2024-04-23T10:15:43.073994+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:15:43.073994+0000","last_undegraded":"2024-04-23T10:15:43.073994+0000","last_fullsized":"2024-04-23T10:15:43.073994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077654+0000","last_change":"2024-04-23T10:15:38.009820+0000","last_active":"2024-04-23T10:15:43.077654+0000","last_peered":"2024-04-23T10:15:43.077654+0000","last_clean":"2024-04-23T10:15:43.077654+0000","last_became_active":"2024-04-23T10:15:38.008893+0000","last_became_peered":"2024-04-23T10:15:38.008893+0000","last_unstale":"2024-04-23T10:15:43.077654+0000","last_undegraded":"2024-04-23T10:15:43.077654+0000","last_fullsized":"2024-04-23T10:15:43.077654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:22:50.250644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181828+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:15:43.181828+0000","last_peered":"2024-04-23T10:15:43.181828+0000","last_clean":"2024-04-23T10:15:43.181828+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:15:43.181828+0000","last_undegraded":"2024-04-23T10:15:43.181828+0000","last_fullsized":"2024-04-23T10:15:43.181828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186018+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:15:43.186018+0000","last_peered":"2024-04-23T10:15:43.186018+0000","last_clean":"2024-04-23T10:15:43.186018+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:15:43.186018+0000","last_undegraded":"2024-04-23T10:15:43.186018+0000","last_fullsized":"2024-04-23T10:15:43.186018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179808+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:15:43.179808+0000","last_peered":"2024-04-23T10:15:43.179808+0000","last_clean":"2024-04-23T10:15:43.179808+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:15:43.179808+0000","last_undegraded":"2024-04-23T10:15:43.179808+0000","last_fullsized":"2024-04-23T10:15:43.179808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079799+0000","last_change":"2024-04-23T10:15:38.032528+0000","last_active":"2024-04-23T10:15:43.079799+0000","last_peered":"2024-04-23T10:15:43.079799+0000","last_clean":"2024-04-23T10:15:43.079799+0000","last_became_active":"2024-04-23T10:15:38.031888+0000","last_became_peered":"2024-04-23T10:15:38.031888+0000","last_unstale":"2024-04-23T10:15:43.079799+0000","last_undegraded":"2024-04-23T10:15:43.079799+0000","last_fullsized":"2024-04-23T10:15:43.079799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:27.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186307+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:15:43.186307+0000","last_peered":"2024-04-23T10:15:43.186307+0000","last_clean":"2024-04-23T10:15:43.186307+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:15:43.186307+0000","last_undegraded":"2024-04-23T10:15:43.186307+0000","last_fullsized":"2024-04-23T10:15:43.186307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077440+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:15:43.077440+0000","last_peered":"2024-04-23T10:15:43.077440+0000","last_clean":"2024-04-23T10:15:43.077440+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:15:43.077440+0000","last_undegraded":"2024-04-23T10:15:43.077440+0000","last_fullsized":"2024-04-23T10:15:43.077440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185500+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:15:43.185500+0000","last_peered":"2024-04-23T10:15:43.185500+0000","last_clean":"2024-04-23T10:15:43.185500+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:15:43.185500+0000","last_undegraded":"2024-04-23T10:15:43.185500+0000","last_fullsized":"2024-04-23T10:15:43.185500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077430+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:15:43.077430+0000","last_peered":"2024-04-23T10:15:43.077430+0000","last_clean":"2024-04-23T10:15:43.077430+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:15:43.077430+0000","last_undegraded":"2024-04-23T10:15:43.077430+0000","last_fullsized":"2024-04-23T10:15:43.077430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181490+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:15:43.181490+0000","last_peered":"2024-04-23T10:15:43.181490+0000","last_clean":"2024-04-23T10:15:43.181490+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:15:43.181490+0000","last_undegraded":"2024-04-23T10:15:43.181490+0000","last_fullsized":"2024-04-23T10:15:43.181490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079050+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:15:43.079050+0000","last_peered":"2024-04-23T10:15:43.079050+0000","last_clean":"2024-04-23T10:15:43.079050+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:15:43.079050+0000","last_undegraded":"2024-04-23T10:15:43.079050+0000","last_fullsized":"2024-04-23T10:15:43.079050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183628+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:15:43.183628+0000","last_peered":"2024-04-23T10:15:43.183628+0000","last_clean":"2024-04-23T10:15:43.183628+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:15:43.183628+0000","last_undegraded":"2024-04-23T10:15:43.183628+0000","last_fullsized":"2024-04-23T10:15:43.183628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074767+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:15:43.074767+0000","last_peered":"2024-04-23T10:15:43.074767+0000","last_clean":"2024-04-23T10:15:43.074767+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:15:43.074767+0000","last_undegraded":"2024-04-23T10:15:43.074767+0000","last_fullsized":"2024-04-23T10:15:43.074767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078901+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:15:43.078901+0000","last_peered":"2024-04-23T10:15:43.078901+0000","last_clean":"2024-04-23T10:15:43.078901+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:15:43.078901+0000","last_undegraded":"2024-04-23T10:15:43.078901+0000","last_fullsized":"2024-04-23T10:15:43.078901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.076772+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:15:43.076772+0000","last_peered":"2024-04-23T10:15:43.076772+0000","last_clean":"2024-04-23T10:15:43.076772+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:15:43.076772+0000","last_undegraded":"2024-04-23T10:15:43.076772+0000","last_fullsized":"2024-04-23T10:15:43.076772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179961+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:15:43.179961+0000","last_peered":"2024-04-23T10:15:43.179961+0000","last_clean":"2024-04-23T10:15:43.179961+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:15:43.179961+0000","last_undegraded":"2024-04-23T10:15:43.179961+0000","last_fullsized":"2024-04-23T10:15:43.179961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179876+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:15:43.179876+0000","last_peered":"2024-04-23T10:15:43.179876+0000","last_clean":"2024-04-23T10:15:43.179876+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:15:43.179876+0000","last_undegraded":"2024-04-23T10:15:43.179876+0000","last_fullsized":"2024-04-23T10:15:43.179876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185516+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:15:43.185516+0000","last_peered":"2024-04-23T10:15:43.185516+0000","last_clean":"2024-04-23T10:15:43.185516+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:15:43.185516+0000","last_undegraded":"2024-04-23T10:15:43.185516+0000","last_fullsized":"2024-04-23T10:15:43.185516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183819+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:15:43.183819+0000","last_peered":"2024-04-23T10:15:43.183819+0000","last_clean":"2024-04-23T10:15:43.183819+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:15:43.183819+0000","last_undegraded":"2024-04-23T10:15:43.183819+0000","last_fullsized":"2024-04-23T10:15:43.183819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079377+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:15:43.079377+0000","last_peered":"2024-04-23T10:15:43.079377+0000","last_clean":"2024-04-23T10:15:43.079377+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:15:43.079377+0000","last_undegraded":"2024-04-23T10:15:43.079377+0000","last_fullsized":"2024-04-23T10:15:43.079377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079668+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:15:43.079668+0000","last_peered":"2024-04-23T10:15:43.079668+0000","last_clean":"2024-04-23T10:15:43.079668+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:15:43.079668+0000","last_undegraded":"2024-04-23T10:15:43.079668+0000","last_fullsized":"2024-04-23T10:15:43.079668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185876+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:15:43.185876+0000","last_peered":"2024-04-23T10:15:43.185876+0000","last_clean":"2024-04-23T10:15:43.185876+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:15:43.185876+0000","last_undegraded":"2024-04-23T10:15:43.185876+0000","last_fullsized":"2024-04-23T10:15:43.185876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185157+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:15:43.185157+0000","last_peered":"2024-04-23T10:15:43.185157+0000","last_clean":"2024-04-23T10:15:43.185157+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:15:43.185157+0000","last_undegraded":"2024-04-23T10:15:43.185157+0000","last_fullsized":"2024-04-23T10:15:43.185157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183096+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:15:43.183096+0000","last_peered":"2024-04-23T10:15:43.183096+0000","last_clean":"2024-04-23T10:15:43.183096+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:15:43.183096+0000","last_undegraded":"2024-04-23T10:15:43.183096+0000","last_fullsized":"2024-04-23T10:15:43.183096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077230+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:15:43.077230+0000","last_peered":"2024-04-23T10:15:43.077230+0000","last_clean":"2024-04-23T10:15:43.077230+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:15:43.077230+0000","last_undegraded":"2024-04-23T10:15:43.077230+0000","last_fullsized":"2024-04-23T10:15:43.077230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182252+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:15:43.182252+0000","last_peered":"2024-04-23T10:15:43.182252+0000","last_clean":"2024-04-23T10:15:43.182252+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:15:43.182252+0000","last_undegraded":"2024-04-23T10:15:43.182252+0000","last_fullsized":"2024-04-23T10:15:43.182252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077579+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:15:43.077579+0000","last_peered":"2024-04-23T10:15:43.077579+0000","last_clean":"2024-04-23T10:15:43.077579+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:15:43.077579+0000","last_undegraded":"2024-04-23T10:15:43.077579+0000","last_fullsized":"2024-04-23T10:15:43.077579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180320+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:15:43.180320+0000","last_peered":"2024-04-23T10:15:43.180320+0000","last_clean":"2024-04-23T10:15:43.180320+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:15:43.180320+0000","last_undegraded":"2024-04-23T10:15:43.180320+0000","last_fullsized":"2024-04-23T10:15:43.180320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181064+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:15:43.181064+0000","last_peered":"2024-04-23T10:15:43.181064+0000","last_clean":"2024-04-23T10:15:43.181064+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:15:43.181064+0000","last_undegraded":"2024-04-23T10:15:43.181064+0000","last_fullsized":"2024-04-23T10:15:43.181064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185772+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:15:43.185772+0000","last_peered":"2024-04-23T10:15:43.185772+0000","last_clean":"2024-04-23T10:15:43.185772+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:15:43.185772+0000","last_undegraded":"2024-04-23T10:15:43.185772+0000","last_fullsized":"2024-04-23T10:15:43.185772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:16:04.106 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:16:04.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4337bd3640 1 Processor -- start 2024-04-23T10:16:04.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4337bd3640 1 -- start start 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4337bd3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43300ced40 0x7f43300c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4337bd3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4330073b70 con 0x7f43300ce960 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4337bd3640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4330073e10 con 0x7f43300cbaf0 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4337bd3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f43300740f0 con 0x7f43300ced40 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433596f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f43300ce960 0x7f43300cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35184/0 (socket says 172.21.15.29:35184) 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433596f640 1 -- 172.21.15.29:0/965836569 learned_addr learned my addr 172.21.15.29:0/965836569 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433516e640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43300ced40 0x7f43300c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231256792 0 0) 0x7f4330073b70 con 0x7f43300ce960 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f431c003530 con 0x7f43300ce960 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 283931211 0 0) 0x7f431c003530 con 0x7f43300ce960 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43300ced40 msgr2=0x7f43300c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43300ced40 0x7f43300c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 >> v1:172.21.15.72:6789/0 conn(0x7f43300cbaf0 legacy=0x7f4330152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43300ca8d0 con 0x7f43300ce960 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f4320001680 con 0x7f43300ce960 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 >> v1:172.21.15.29:6789/0 conn(0x7f43300ce960 legacy=0x7f43300cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0039f0 0x7f431c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f431c004810 0x7f431c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c0051d0 0x7f431c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f43300740f0 con 0x7f431c0051d0 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f431c00c0d0 con 0x7f431c0039f0 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f431c00c2d0 con 0x7f431c004810 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433516e640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43300ced40 0x7f43300c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4336170640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c0051d0 0x7f431c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433596f640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0039f0 0x7f431c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4336170640 1 -- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f431c004810 msgr2=0x7f431c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:04.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4336170640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f431c004810 0x7f431c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4336170640 1 -- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0039f0 msgr2=0x7f431c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:04.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4336170640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0039f0 0x7f431c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f4336170640 1 -- 172.21.15.29:0/965836569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c003530 con 0x7f431c0051d0 2024-04-23T10:16:04.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.259+0000 7f433596f640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0039f0 0x7f431c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4336170640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c0051d0 0x7f431c00b9d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4328001e40 tx=0x7f432801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfbe77dde49c626 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328001a90 con 0x7f431c0051d0 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4328003b80 con 0x7f431c0051d0 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433496d640 1 -- 172.21.15.29:0/965836569 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328005080 con 0x7f431c0051d0 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- 172.21.15.29:0/965836569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c0051d0 msgr2=0x7f431c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 --2- 172.21.15.29:0/965836569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c0051d0 0x7f431c00b9d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4328001e40 tx=0x7f432801c760 comp rx=0 tx=0).stop 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4336170640 1 -- 172.21.15.29:0/965836569 reap_dead start 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- 172.21.15.29:0/965836569 shutdown_connections 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- 172.21.15.29:0/965836569 >> 172.21.15.29:0/965836569 conn(0x7f4330070f60 msgr2=0x7f4330071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- 172.21.15.29:0/965836569 shutdown_connections 2024-04-23T10:16:04.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- 172.21.15.29:0/965836569 wait complete. 2024-04-23T10:16:04.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 Processor -- start 2024-04-23T10:16:04.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- start start 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0051d0 0x7f43301422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43301ee3e0 0x7f4330146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4330146fd0 0x7f4330147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4330074380 con 0x7f43301ee3e0 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f43300cae90 con 0x7f431c0051d0 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4337bd3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4330074500 con 0x7f4330146fd0 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433516e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43301ee3e0 0x7f4330146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433516e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43301ee3e0 0x7f4330146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59426/0 (socket says 172.21.15.29:59426) 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433516e640 1 -- 172.21.15.29:0/2901115592 learned_addr learned my addr 172.21.15.29:0/2901115592 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433596f640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0051d0 0x7f43301422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f4336170640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4330146fd0 0x7f4330147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433516e640 1 -- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4330146fd0 msgr2=0x7f4330147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433516e640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4330146fd0 0x7f4330147da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433516e640 1 -- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0051d0 msgr2=0x7f43301422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433516e640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0051d0 0x7f43301422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.263+0000 7f433516e640 1 -- 172.21.15.29:0/2901115592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433015a000 con 0x7f43301ee3e0 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f433516e640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43301ee3e0 0x7f4330146a90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f432c00d410 tx=0x7f432c00d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f43267fc640 1 -- 172.21.15.29:0/2901115592 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c0125f0 con 0x7f43301ee3e0 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f43267fc640 1 -- 172.21.15.29:0/2901115592 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432c018070 con 0x7f43301ee3e0 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43301459f0 con 0x7f43301ee3e0 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f43267fc640 1 -- 172.21.15.29:0/2901115592 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c0129b0 con 0x7f43301ee3e0 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4330145fb0 con 0x7f43301ee3e0 2024-04-23T10:16:04.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43300693c0 con 0x7f43301ee3e0 2024-04-23T10:16:04.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f43267fc640 1 -- 172.21.15.29:0/2901115592 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f432c012b50 con 0x7f43301ee3e0 2024-04-23T10:16:04.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f43267fc640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4314068380 0x7f431406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f43267fc640 1 -- 172.21.15.29:0/2901115592 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f432c086dd0 con 0x7f43301ee3e0 2024-04-23T10:16:04.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f433596f640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4314068380 0x7f431406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.267+0000 7f433596f640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4314068380 0x7f431406a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4320001ec0 tx=0x7f4320009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:04.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.271+0000 7f43267fc640 1 -- 172.21.15.29:0/2901115592 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f432c01a310 con 0x7f43301ee3e0 2024-04-23T10:16:04.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.427+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43301457a0 con 0x7f4314068380 2024-04-23T10:16:04.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.443+0000 7f43267fc640 1 -- 172.21.15.29:0/2901115592 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f43301457a0 con 0x7f4314068380 2024-04-23T10:16:04.446 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:16:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4314068380 msgr2=0x7f431406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4314068380 0x7f431406a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4320001ec0 tx=0x7f4320009040 comp rx=0 tx=0).stop 2024-04-23T10:16:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43301ee3e0 msgr2=0x7f4330146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43301ee3e0 0x7f4330146a90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f432c00d410 tx=0x7f432c00d8d0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 shutdown_connections 2024-04-23T10:16:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4314068380 0x7f431406a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4330146fd0 0x7f4330147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43301ee3e0 0x7f4330146a90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 --2- 172.21.15.29:0/2901115592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f431c0051d0 0x7f43301422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 >> 172.21.15.29:0/2901115592 conn(0x7f4330070f60 msgr2=0x7f43300c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 shutdown_connections 2024-04-23T10:16:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.447+0000 7f4337bd3640 1 -- 172.21.15.29:0/2901115592 wait complete. 2024-04-23T10:16:04.462 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-23T10:16:03.197747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236020,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738700,"statfs":{"total":773094113280,"available":772852428800,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004779"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180971+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:15:43.180971+0000","last_peered":"2024-04-23T10:15:43.180971+0000","last_clean":"2024-04-23T10:15:43.180971+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:15:43.180971+0000","last_undegraded":"2024-04-23T10:15:43.180971+0000","last_fullsized":"2024-04-23T10:15:43.180971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186172+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:15:43.186172+0000","last_peered":"2024-04-23T10:15:43.186172+0000","last_clean":"2024-04-23T10:15:43.186172+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:15:43.186172+0000","last_undegraded":"2024-04-23T10:15:43.186172+0000","last_fullsized":"2024-04-23T10:15:43.186172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185322+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:15:43.185322+0000","last_peered":"2024-04-23T10:15:43.185322+0000","last_clean":"2024-04-23T10:15:43.185322+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:15:43.185322+0000","last_undegraded":"2024-04-23T10:15:43.185322+0000","last_fullsized":"2024-04-23T10:15:43.185322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186331+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:15:43.186331+0000","last_peered":"2024-04-23T10:15:43.186331+0000","last_clean":"2024-04-23T10:15:43.186331+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:15:43.186331+0000","last_undegraded":"2024-04-23T10:15:43.186331+0000","last_fullsized":"2024-04-23T10:15:43.186331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180764+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:15:43.180764+0000","last_peered":"2024-04-23T10:15:43.180764+0000","last_clean":"2024-04-23T10:15:43.180764+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:15:43.180764+0000","last_undegraded":"2024-04-23T10:15:43.180764+0000","last_fullsized":"2024-04-23T10:15:43.180764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181921+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:15:43.181921+0000","last_peered":"2024-04-23T10:15:43.181921+0000","last_clean":"2024-04-23T10:15:43.181921+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:15:43.181921+0000","last_undegraded":"2024-04-23T10:15:43.181921+0000","last_fullsized":"2024-04-23T10:15:43.181921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183360+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:15:43.183360+0000","last_peered":"2024-04-23T10:15:43.183360+0000","last_clean":"2024-04-23T10:15:43.183360+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:15:43.183360+0000","last_undegraded":"2024-04-23T10:15:43.183360+0000","last_fullsized":"2024-04-23T10:15:43.183360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077706+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:15:43.077706+0000","last_peered":"2024-04-23T10:15:43.077706+0000","last_clean":"2024-04-23T10:15:43.077706+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:15:43.077706+0000","last_undegraded":"2024-04-23T10:15:43.077706+0000","last_fullsized":"2024-04-23T10:15:43.077706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184273+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:15:43.184273+0000","last_peered":"2024-04-23T10:15:43.184273+0000","last_clean":"2024-04-23T10:15:43.184273+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:15:43.184273+0000","last_undegraded":"2024-04-23T10:15:43.184273+0000","last_fullsized":"2024-04-23T10:15:43.184273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182427+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:15:43.182427+0000","last_peered":"2024-04-23T10:15:43.182427+0000","last_clean":"2024-04-23T10:15:43.182427+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:15:43.182427+0000","last_undegraded":"2024-04-23T10:15:43.182427+0000","last_fullsized":"2024-04-23T10:15:43.182427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078673+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:15:43.078673+0000","last_peered":"2024-04-23T10:15:43.078673+0000","last_clean":"2024-04-23T10:15:43.078673+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:15:43.078673+0000","last_undegraded":"2024-04-23T10:15:43.078673+0000","last_fullsized":"2024-04-23T10:15:43.078673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183120+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:15:43.183120+0000","last_peered":"2024-04-23T10:15:43.183120+0000","last_clean":"2024-04-23T10:15:43.183120+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:15:43.183120+0000","last_undegraded":"2024-04-23T10:15:43.183120+0000","last_fullsized":"2024-04-23T10:15:43.183120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079159+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:15:43.079159+0000","last_peered":"2024-04-23T10:15:43.079159+0000","last_clean":"2024-04-23T10:15:43.079159+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:15:43.079159+0000","last_undegraded":"2024-04-23T10:15:43.079159+0000","last_fullsized":"2024-04-23T10:15:43.079159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182688+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:15:43.182688+0000","last_peered":"2024-04-23T10:15:43.182688+0000","last_clean":"2024-04-23T10:15:43.182688+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:15:43.182688+0000","last_undegraded":"2024-04-23T10:15:43.182688+0000","last_fullsized":"2024-04-23T10:15:43.182688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183425+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:15:43.183425+0000","last_peered":"2024-04-23T10:15:43.183425+0000","last_clean":"2024-04-23T10:15:43.183425+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:15:43.183425+0000","last_undegraded":"2024-04-23T10:15:43.183425+0000","last_fullsized":"2024-04-23T10:15:43.183425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185586+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:15:43.185586+0000","last_peered":"2024-04-23T10:15:43.185586+0000","last_clean":"2024-04-23T10:15:43.185586+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:15:43.185586+0000","last_undegraded":"2024-04-23T10:15:43.185586+0000","last_fullsized":"2024-04-23T10:15:43.185586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180186+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:15:43.180186+0000","last_peered":"2024-04-23T10:15:43.180186+0000","last_clean":"2024-04-23T10:15:43.180186+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:15:43.180186+0000","last_undegraded":"2024-04-23T10:15:43.180186+0000","last_fullsized":"2024-04-23T10:15:43.180186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183292+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:15:43.183292+0000","last_peered":"2024-04-23T10:15:43.183292+0000","last_clean":"2024-04-23T10:15:43.183292+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:15:43.183292+0000","last_undegraded":"2024-04-23T10:15:43.183292+0000","last_fullsized":"2024-04-23T10:15:43.183292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185347+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:15:43.185347+0000","last_peered":"2024-04-23T10:15:43.185347+0000","last_clean":"2024-04-23T10:15:43.185347+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:15:43.185347+0000","last_undegraded":"2024-04-23T10:15:43.185347+0000","last_fullsized":"2024-04-23T10:15:43.185347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180168+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:15:43.180168+0000","last_peered":"2024-04-23T10:15:43.180168+0000","last_clean":"2024-04-23T10:15:43.180168+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:15:43.180168+0000","last_undegraded":"2024-04-23T10:15:43.180168+0000","last_fullsized":"2024-04-23T10:15:43.180168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182115+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:15:43.182115+0000","last_peered":"2024-04-23T10:15:43.182115+0000","last_clean":"2024-04-23T10:15:43.182115+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:15:43.182115+0000","last_undegraded":"2024-04-23T10:15:43.182115+0000","last_fullsized":"2024-04-23T10:15:43.182115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184379+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:15:43.184379+0000","last_peered":"2024-04-23T10:15:43.184379+0000","last_clean":"2024-04-23T10:15:43.184379+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:15:43.184379+0000","last_undegraded":"2024-04-23T10:15:43.184379+0000","last_fullsized":"2024-04-23T10:15:43.184379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182073+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:15:43.182073+0000","last_peered":"2024-04-23T10:15:43.182073+0000","last_clean":"2024-04-23T10:15:43.182073+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:15:43.182073+0000","last_undegraded":"2024-04-23T10:15:43.182073+0000","last_fullsized":"2024-04-23T10:15:43.182073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183011+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:15:43.183011+0000","last_peered":"2024-04-23T10:15:43.183011+0000","last_clean":"2024-04-23T10:15:43.183011+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:15:43.183011+0000","last_undegraded":"2024-04-23T10:15:43.183011+0000","last_fullsized":"2024-04-23T10:15:43.183011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180835+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:15:43.180835+0000","last_peered":"2024-04-23T10:15:43.180835+0000","last_clean":"2024-04-23T10:15:43.180835+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:15:43.180835+0000","last_undegraded":"2024-04-23T10:15:43.180835+0000","last_fullsized":"2024-04-23T10:15:43.180835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.080051+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:15:43.080051+0000","last_peered":"2024-04-23T10:15:43.080051+0000","last_clean":"2024-04-23T10:15:43.080051+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:15:43.080051+0000","last_undegraded":"2024-04-23T10:15:43.080051+0000","last_fullsized":"2024-04-23T10:15:43.080051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183767+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:15:43.183767+0000","last_peered":"2024-04-23T10:15:43.183767+0000","last_clean":"2024-04-23T10:15:43.183767+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:15:43.183767+0000","last_undegraded":"2024-04-23T10:15:43.183767+0000","last_fullsized":"2024-04-23T10:15:43.183767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186365+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:15:43.186365+0000","last_peered":"2024-04-23T10:15:43.186365+0000","last_clean":"2024-04-23T10:15:43.186365+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:15:43.186365+0000","last_undegraded":"2024-04-23T10:15:43.186365+0000","last_fullsized":"2024-04-23T10:15:43.186365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181410+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:15:43.181410+0000","last_peered":"2024-04-23T10:15:43.181410+0000","last_clean":"2024-04-23T10:15:43.181410+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:15:43.181410+0000","last_undegraded":"2024-04-23T10:15:43.181410+0000","last_fullsized":"2024-04-23T10:15:43.181410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185049+0000","last_change":"2024-04-23T10:15:42.164860+0000","last_active":"2024-04-23T10:15:43.185049+0000","last_peered":"2024-04-23T10:15:43.185049+0000","last_clean":"2024-04-23T10:15:43.185049+0000","last_became_active":"2024-04-23T10:15:42.163816+0000","last_became_peered":"2024-04-23T10:15:42.163816+0000","last_unstale":"2024-04-23T10:15:43.185049+0000","last_undegraded":"2024-04-23T10:15:43.185049+0000","last_fullsized":"2024-04-23T10:15:43.185049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:47.776069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180146+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:15:43.180146+0000","last_peered":"2024-04-23T10:15:43.180146+0000","last_clean":"2024-04-23T10:15:43.180146+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:15:43.180146+0000","last_undegraded":"2024-04-23T10:15:43.180146+0000","last_fullsized":"2024-04-23T10:15:43.180146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183851+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:15:43.183851+0000","last_peered":"2024-04-23T10:15:43.183851+0000","last_clean":"2024-04-23T10:15:43.183851+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:15:43.183851+0000","last_undegraded":"2024-04-23T10:15:43.183851+0000","last_fullsized":"2024-04-23T10:15:43.183851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181358+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:15:43.181358+0000","last_peered":"2024-04-23T10:15:43.181358+0000","last_clean":"2024-04-23T10:15:43.181358+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:15:43.181358+0000","last_undegraded":"2024-04-23T10:15:43.181358+0000","last_fullsized":"2024-04-23T10:15:43.181358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078759+0000","last_change":"2024-04-23T10:15:38.000072+0000","last_active":"2024-04-23T10:15:43.078759+0000","last_peered":"2024-04-23T10:15:43.078759+0000","last_clean":"2024-04-23T10:15:43.078759+0000","last_became_active":"2024-04-23T10:15:37.999407+0000","last_became_peered":"2024-04-23T10:15:37.999407+0000","last_unstale":"2024-04-23T10:15:43.078759+0000","last_undegraded":"2024-04-23T10:15:43.078759+0000","last_fullsized":"2024-04-23T10:15:43.078759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:32:12.652769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180279+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:15:43.180279+0000","last_peered":"2024-04-23T10:15:43.180279+0000","last_clean":"2024-04-23T10:15:43.180279+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:15:43.180279+0000","last_undegraded":"2024-04-23T10:15:43.180279+0000","last_fullsized":"2024-04-23T10:15:43.180279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179704+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:15:43.179704+0000","last_peered":"2024-04-23T10:15:43.179704+0000","last_clean":"2024-04-23T10:15:43.179704+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:15:43.179704+0000","last_undegraded":"2024-04-23T10:15:43.179704+0000","last_fullsized":"2024-04-23T10:15:43.179704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184990+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:15:43.184990+0000","last_peered":"2024-04-23T10:15:43.184990+0000","last_clean":"2024-04-23T10:15:43.184990+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:15:43.184990+0000","last_undegraded":"2024-04-23T10:15:43.184990+0000","last_fullsized":"2024-04-23T10:15:43.184990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077914+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:15:43.077914+0000","last_peered":"2024-04-23T10:15:43.077914+0000","last_clean":"2024-04-23T10:15:43.077914+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:15:43.077914+0000","last_undegraded":"2024-04-23T10:15:43.077914+0000","last_fullsized":"2024-04-23T10:15:43.077914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180011+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:15:43.180011+0000","last_peered":"2024-04-23T10:15:43.180011+0000","last_clean":"2024-04-23T10:15:43.180011+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:15:43.180011+0000","last_undegraded":"2024-04-23T10:15:43.180011+0000","last_fullsized":"2024-04-23T10:15:43.180011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182378+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:15:43.182378+0000","last_peered":"2024-04-23T10:15:43.182378+0000","last_clean":"2024-04-23T10:15:43.182378+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:15:43.182378+0000","last_undegraded":"2024-04-23T10:15:43.182378+0000","last_fullsized":"2024-04-23T10:15:43.182378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074055+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:15:43.074055+0000","last_peered":"2024-04-23T10:15:43.074055+0000","last_clean":"2024-04-23T10:15:43.074055+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:15:43.074055+0000","last_undegraded":"2024-04-23T10:15:43.074055+0000","last_fullsized":"2024-04-23T10:15:43.074055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182513+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:15:43.182513+0000","last_peered":"2024-04-23T10:15:43.182513+0000","last_clean":"2024-04-23T10:15:43.182513+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:15:43.182513+0000","last_undegraded":"2024-04-23T10:15:43.182513+0000","last_fullsized":"2024-04-23T10:15:43.182513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179368+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:15:43.179368+0000","last_peered":"2024-04-23T10:15:43.179368+0000","last_clean":"2024-04-23T10:15:43.179368+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:15:43.179368+0000","last_undegraded":"2024-04-23T10:15:43.179368+0000","last_fullsized":"2024-04-23T10:15:43.179368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182188+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:15:43.182188+0000","last_peered":"2024-04-23T10:15:43.182188+0000","last_clean":"2024-04-23T10:15:43.182188+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:15:43.182188+0000","last_undegraded":"2024-04-23T10:15:43.182188+0000","last_fullsized":"2024-04-23T10:15:43.182188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180738+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:15:43.180738+0000","last_peered":"2024-04-23T10:15:43.180738+0000","last_clean":"2024-04-23T10:15:43.180738+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:15:43.180738+0000","last_undegraded":"2024-04-23T10:15:43.180738+0000","last_fullsized":"2024-04-23T10:15:43.180738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185653+0000","last_change":"2024-04-23T10:15:38.020047+0000","last_active":"2024-04-23T10:15:43.185653+0000","last_peered":"2024-04-23T10:15:43.185653+0000","last_clean":"2024-04-23T10:15:43.185653+0000","last_became_active":"2024-04-23T10:15:38.019277+0000","last_became_peered":"2024-04-23T10:15:38.019277+0000","last_unstale":"2024-04-23T10:15:43.185653+0000","last_undegraded":"2024-04-23T10:15:43.185653+0000","last_fullsized":"2024-04-23T10:15:43.185653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:11:05.298798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077439+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:15:43.077439+0000","last_peered":"2024-04-23T10:15:43.077439+0000","last_clean":"2024-04-23T10:15:43.077439+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:15:43.077439+0000","last_undegraded":"2024-04-23T10:15:43.077439+0000","last_fullsized":"2024-04-23T10:15:43.077439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182359+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:15:43.182359+0000","last_peered":"2024-04-23T10:15:43.182359+0000","last_clean":"2024-04-23T10:15:43.182359+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:15:43.182359+0000","last_undegraded":"2024-04-23T10:15:43.182359+0000","last_fullsized":"2024-04-23T10:15:43.182359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079122+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:15:43.079122+0000","last_peered":"2024-04-23T10:15:43.079122+0000","last_clean":"2024-04-23T10:15:43.079122+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:15:43.079122+0000","last_undegraded":"2024-04-23T10:15:43.079122+0000","last_fullsized":"2024-04-23T10:15:43.079122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182894+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:15:43.182894+0000","last_peered":"2024-04-23T10:15:43.182894+0000","last_clean":"2024-04-23T10:15:43.182894+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:15:43.182894+0000","last_undegraded":"2024-04-23T10:15:43.182894+0000","last_fullsized":"2024-04-23T10:15:43.182894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074812+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:15:43.074812+0000","last_peered":"2024-04-23T10:15:43.074812+0000","last_clean":"2024-04-23T10:15:43.074812+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:15:43.074812+0000","last_undegraded":"2024-04-23T10:15:43.074812+0000","last_fullsized":"2024-04-23T10:15:43.074812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077536+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:15:43.077536+0000","last_peered":"2024-04-23T10:15:43.077536+0000","last_clean":"2024-04-23T10:15:43.077536+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:15:43.077536+0000","last_undegraded":"2024-04-23T10:15:43.077536+0000","last_fullsized":"2024-04-23T10:15:43.077536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077818+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:15:43.077818+0000","last_peered":"2024-04-23T10:15:43.077818+0000","last_clean":"2024-04-23T10:15:43.077818+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:15:43.077818+0000","last_undegraded":"2024-04-23T10:15:43.077818+0000","last_fullsized":"2024-04-23T10:15:43.077818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180693+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:15:43.180693+0000","last_peered":"2024-04-23T10:15:43.180693+0000","last_clean":"2024-04-23T10:15:43.180693+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:15:43.180693+0000","last_undegraded":"2024-04-23T10:15:43.180693+0000","last_fullsized":"2024-04-23T10:15:43.180693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181704+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:15:43.181704+0000","last_peered":"2024-04-23T10:15:43.181704+0000","last_clean":"2024-04-23T10:15:43.181704+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:15:43.181704+0000","last_undegraded":"2024-04-23T10:15:43.181704+0000","last_fullsized":"2024-04-23T10:15:43.181704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186017+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:15:43.186017+0000","last_peered":"2024-04-23T10:15:43.186017+0000","last_clean":"2024-04-23T10:15:43.186017+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:15:43.186017+0000","last_undegraded":"2024-04-23T10:15:43.186017+0000","last_fullsized":"2024-04-23T10:15:43.186017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074930+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:15:43.074930+0000","last_peered":"2024-04-23T10:15:43.074930+0000","last_clean":"2024-04-23T10:15:43.074930+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:15:43.074930+0000","last_undegraded":"2024-04-23T10:15:43.074930+0000","last_fullsized":"2024-04-23T10:15:43.074930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.076817+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:15:43.076817+0000","last_peered":"2024-04-23T10:15:43.076817+0000","last_clean":"2024-04-23T10:15:43.076817+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:15:43.076817+0000","last_undegraded":"2024-04-23T10:15:43.076817+0000","last_fullsized":"2024-04-23T10:15:43.076817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185476+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:15:43.185476+0000","last_peered":"2024-04-23T10:15:43.185476+0000","last_clean":"2024-04-23T10:15:43.185476+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:15:43.185476+0000","last_undegraded":"2024-04-23T10:15:43.185476+0000","last_fullsized":"2024-04-23T10:15:43.185476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184056+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:15:43.184056+0000","last_peered":"2024-04-23T10:15:43.184056+0000","last_clean":"2024-04-23T10:15:43.184056+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:15:43.184056+0000","last_undegraded":"2024-04-23T10:15:43.184056+0000","last_fullsized":"2024-04-23T10:15:43.184056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181866+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:15:43.181866+0000","last_peered":"2024-04-23T10:15:43.181866+0000","last_clean":"2024-04-23T10:15:43.181866+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:15:43.181866+0000","last_undegraded":"2024-04-23T10:15:43.181866+0000","last_fullsized":"2024-04-23T10:15:43.181866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183177+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:15:43.183177+0000","last_peered":"2024-04-23T10:15:43.183177+0000","last_clean":"2024-04-23T10:15:43.183177+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:15:43.183177+0000","last_undegraded":"2024-04-23T10:15:43.183177+0000","last_fullsized":"2024-04-23T10:15:43.183177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.073780+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:15:43.073780+0000","last_peered":"2024-04-23T10:15:43.073780+0000","last_clean":"2024-04-23T10:15:43.073780+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:15:43.073780+0000","last_undegraded":"2024-04-23T10:15:43.073780+0000","last_fullsized":"2024-04-23T10:15:43.073780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180612+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:15:43.180612+0000","last_peered":"2024-04-23T10:15:43.180612+0000","last_clean":"2024-04-23T10:15:43.180612+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:15:43.180612+0000","last_undegraded":"2024-04-23T10:15:43.180612+0000","last_fullsized":"2024-04-23T10:15:43.180612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078323+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:15:43.078323+0000","last_peered":"2024-04-23T10:15:43.078323+0000","last_clean":"2024-04-23T10:15:43.078323+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:15:43.078323+0000","last_undegraded":"2024-04-23T10:15:43.078323+0000","last_fullsized":"2024-04-23T10:15:43.078323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078414+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:15:43.078414+0000","last_peered":"2024-04-23T10:15:43.078414+0000","last_clean":"2024-04-23T10:15:43.078414+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:15:43.078414+0000","last_undegraded":"2024-04-23T10:15:43.078414+0000","last_fullsized":"2024-04-23T10:15:43.078414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186321+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:15:43.186321+0000","last_peered":"2024-04-23T10:15:43.186321+0000","last_clean":"2024-04-23T10:15:43.186321+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:15:43.186321+0000","last_undegraded":"2024-04-23T10:15:43.186321+0000","last_fullsized":"2024-04-23T10:15:43.186321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182507+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:15:43.182507+0000","last_peered":"2024-04-23T10:15:43.182507+0000","last_clean":"2024-04-23T10:15:43.182507+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:15:43.182507+0000","last_undegraded":"2024-04-23T10:15:43.182507+0000","last_fullsized":"2024-04-23T10:15:43.182507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077971+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:15:43.077971+0000","last_peered":"2024-04-23T10:15:43.077971+0000","last_clean":"2024-04-23T10:15:43.077971+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:15:43.077971+0000","last_undegraded":"2024-04-23T10:15:43.077971+0000","last_fullsized":"2024-04-23T10:15:43.077971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185833+0000","last_change":"2024-04-23T10:15:42.164994+0000","last_active":"2024-04-23T10:15:43.185833+0000","last_peered":"2024-04-23T10:15:43.185833+0000","last_clean":"2024-04-23T10:15:43.185833+0000","last_became_active":"2024-04-23T10:15:42.163851+0000","last_became_peered":"2024-04-23T10:15:42.163851+0000","last_unstale":"2024-04-23T10:15:43.185833+0000","last_undegraded":"2024-04-23T10:15:43.185833+0000","last_fullsized":"2024-04-23T10:15:43.185833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:29:45.598515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179977+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:15:43.179977+0000","last_peered":"2024-04-23T10:15:43.179977+0000","last_clean":"2024-04-23T10:15:43.179977+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:15:43.179977+0000","last_undegraded":"2024-04-23T10:15:43.179977+0000","last_fullsized":"2024-04-23T10:15:43.179977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182077+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:15:43.182077+0000","last_peered":"2024-04-23T10:15:43.182077+0000","last_clean":"2024-04-23T10:15:43.182077+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:15:43.182077+0000","last_undegraded":"2024-04-23T10:15:43.182077+0000","last_fullsized":"2024-04-23T10:15:43.182077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078431+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:15:43.078431+0000","last_peered":"2024-04-23T10:15:43.078431+0000","last_clean":"2024-04-23T10:15:43.078431+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:15:43.078431+0000","last_undegraded":"2024-04-23T10:15:43.078431+0000","last_fullsized":"2024-04-23T10:15:43.078431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182647+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:15:43.182647+0000","last_peered":"2024-04-23T10:15:43.182647+0000","last_clean":"2024-04-23T10:15:43.182647+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:15:43.182647+0000","last_undegraded":"2024-04-23T10:15:43.182647+0000","last_fullsized":"2024-04-23T10:15:43.182647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:51.366095+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:15:51.366095+0000","last_peered":"2024-04-23T10:15:51.366095+0000","last_clean":"2024-04-23T10:15:51.366095+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:15:51.366095+0000","last_undegraded":"2024-04-23T10:15:51.366095+0000","last_fullsized":"2024-04-23T10:15:51.366095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180021+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:15:43.180021+0000","last_peered":"2024-04-23T10:15:43.180021+0000","last_clean":"2024-04-23T10:15:43.180021+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:15:43.180021+0000","last_undegraded":"2024-04-23T10:15:43.180021+0000","last_fullsized":"2024-04-23T10:15:43.180021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183989+0000","last_change":"2024-04-23T10:15:38.027810+0000","last_active":"2024-04-23T10:15:43.183989+0000","last_peered":"2024-04-23T10:15:43.183989+0000","last_clean":"2024-04-23T10:15:43.183989+0000","last_became_active":"2024-04-23T10:15:38.026559+0000","last_became_peered":"2024-04-23T10:15:38.026559+0000","last_unstale":"2024-04-23T10:15:43.183989+0000","last_undegraded":"2024-04-23T10:15:43.183989+0000","last_fullsized":"2024-04-23T10:15:43.183989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:08:17.720264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180357+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:15:43.180357+0000","last_peered":"2024-04-23T10:15:43.180357+0000","last_clean":"2024-04-23T10:15:43.180357+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:15:43.180357+0000","last_undegraded":"2024-04-23T10:15:43.180357+0000","last_fullsized":"2024-04-23T10:15:43.180357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.184591+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:15:43.184591+0000","last_peered":"2024-04-23T10:15:43.184591+0000","last_clean":"2024-04-23T10:15:43.184591+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:15:43.184591+0000","last_undegraded":"2024-04-23T10:15:43.184591+0000","last_fullsized":"2024-04-23T10:15:43.184591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180910+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:15:43.180910+0000","last_peered":"2024-04-23T10:15:43.180910+0000","last_clean":"2024-04-23T10:15:43.180910+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:15:43.180910+0000","last_undegraded":"2024-04-23T10:15:43.180910+0000","last_fullsized":"2024-04-23T10:15:43.180910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078472+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:15:43.078472+0000","last_peered":"2024-04-23T10:15:43.078472+0000","last_clean":"2024-04-23T10:15:43.078472+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:15:43.078472+0000","last_undegraded":"2024-04-23T10:15:43.078472+0000","last_fullsized":"2024-04-23T10:15:43.078472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185228+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:15:43.185228+0000","last_peered":"2024-04-23T10:15:43.185228+0000","last_clean":"2024-04-23T10:15:43.185228+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:15:43.185228+0000","last_undegraded":"2024-04-23T10:15:43.185228+0000","last_fullsized":"2024-04-23T10:15:43.185228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078321+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:15:43.078321+0000","last_peered":"2024-04-23T10:15:43.078321+0000","last_clean":"2024-04-23T10:15:43.078321+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:15:43.078321+0000","last_undegraded":"2024-04-23T10:15:43.078321+0000","last_fullsized":"2024-04-23T10:15:43.078321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079824+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:15:43.079824+0000","last_peered":"2024-04-23T10:15:43.079824+0000","last_clean":"2024-04-23T10:15:43.079824+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:15:43.079824+0000","last_undegraded":"2024-04-23T10:15:43.079824+0000","last_fullsized":"2024-04-23T10:15:43.079824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185281+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:15:43.185281+0000","last_peered":"2024-04-23T10:15:43.185281+0000","last_clean":"2024-04-23T10:15:43.185281+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:15:43.185281+0000","last_undegraded":"2024-04-23T10:15:43.185281+0000","last_fullsized":"2024-04-23T10:15:43.185281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180558+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:15:43.180558+0000","last_peered":"2024-04-23T10:15:43.180558+0000","last_clean":"2024-04-23T10:15:43.180558+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:15:43.180558+0000","last_undegraded":"2024-04-23T10:15:43.180558+0000","last_fullsized":"2024-04-23T10:15:43.180558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179861+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:15:43.179861+0000","last_peered":"2024-04-23T10:15:43.179861+0000","last_clean":"2024-04-23T10:15:43.179861+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:15:43.179861+0000","last_undegraded":"2024-04-23T10:15:43.179861+0000","last_fullsized":"2024-04-23T10:15:43.179861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077622+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:15:43.077622+0000","last_peered":"2024-04-23T10:15:43.077622+0000","last_clean":"2024-04-23T10:15:43.077622+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:15:43.077622+0000","last_undegraded":"2024-04-23T10:15:43.077622+0000","last_fullsized":"2024-04-23T10:15:43.077622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079727+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:15:43.079727+0000","last_peered":"2024-04-23T10:15:43.079727+0000","last_clean":"2024-04-23T10:15:43.079727+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:15:43.079727+0000","last_undegraded":"2024-04-23T10:15:43.079727+0000","last_fullsized":"2024-04-23T10:15:43.079727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185263+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:15:43.185263+0000","last_peered":"2024-04-23T10:15:43.185263+0000","last_clean":"2024-04-23T10:15:43.185263+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:15:43.185263+0000","last_undegraded":"2024-04-23T10:15:43.185263+0000","last_fullsized":"2024-04-23T10:15:43.185263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185741+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:15:43.185741+0000","last_peered":"2024-04-23T10:15:43.185741+0000","last_clean":"2024-04-23T10:15:43.185741+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:15:43.185741+0000","last_undegraded":"2024-04-23T10:15:43.185741+0000","last_fullsized":"2024-04-23T10:15:43.185741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079596+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:15:43.079596+0000","last_peered":"2024-04-23T10:15:43.079596+0000","last_clean":"2024-04-23T10:15:43.079596+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:15:43.079596+0000","last_undegraded":"2024-04-23T10:15:43.079596+0000","last_fullsized":"2024-04-23T10:15:43.079596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181954+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:15:43.181954+0000","last_peered":"2024-04-23T10:15:43.181954+0000","last_clean":"2024-04-23T10:15:43.181954+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:15:43.181954+0000","last_undegraded":"2024-04-23T10:15:43.181954+0000","last_fullsized":"2024-04-23T10:15:43.181954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074391+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:15:43.074391+0000","last_peered":"2024-04-23T10:15:43.074391+0000","last_clean":"2024-04-23T10:15:43.074391+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:15:43.074391+0000","last_undegraded":"2024-04-23T10:15:43.074391+0000","last_fullsized":"2024-04-23T10:15:43.074391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185670+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:15:43.185670+0000","last_peered":"2024-04-23T10:15:43.185670+0000","last_clean":"2024-04-23T10:15:43.185670+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:15:43.185670+0000","last_undegraded":"2024-04-23T10:15:43.185670+0000","last_fullsized":"2024-04-23T10:15:43.185670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183710+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:15:43.183710+0000","last_peered":"2024-04-23T10:15:43.183710+0000","last_clean":"2024-04-23T10:15:43.183710+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:15:43.183710+0000","last_undegraded":"2024-04-23T10:15:43.183710+0000","last_fullsized":"2024-04-23T10:15:43.183710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186025+0000","last_change":"2024-04-23T10:15:42.096686+0000","last_active":"2024-04-23T10:15:43.186025+0000","last_peered":"2024-04-23T10:15:43.186025+0000","last_clean":"2024-04-23T10:15:43.186025+0000","last_became_active":"2024-04-23T10:15:42.096056+0000","last_became_peered":"2024-04-23T10:15:42.096056+0000","last_unstale":"2024-04-23T10:15:43.186025+0000","last_undegraded":"2024-04-23T10:15:43.186025+0000","last_fullsized":"2024-04-23T10:15:43.186025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:56.385523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077884+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:15:43.077884+0000","last_peered":"2024-04-23T10:15:43.077884+0000","last_clean":"2024-04-23T10:15:43.077884+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:15:43.077884+0000","last_undegraded":"2024-04-23T10:15:43.077884+0000","last_fullsized":"2024-04-23T10:15:43.077884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.073994+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:15:43.073994+0000","last_peered":"2024-04-23T10:15:43.073994+0000","last_clean":"2024-04-23T10:15:43.073994+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:15:43.073994+0000","last_undegraded":"2024-04-23T10:15:43.073994+0000","last_fullsized":"2024-04-23T10:15:43.073994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077654+0000","last_change":"2024-04-23T10:15:38.009820+0000","last_active":"2024-04-23T10:15:43.077654+0000","last_peered":"2024-04-23T10:15:43.077654+0000","last_clean":"2024-04-23T10:15:43.077654+0000","last_became_active":"2024-04-23T10:15:38.008893+0000","last_became_peered":"2024-04-23T10:15:38.008893+0000","last_unstale":"2024-04-23T10:15:43.077654+0000","last_undegraded":"2024-04-23T10:15:43.077654+0000","last_fullsized":"2024-04-23T10:15:43.077654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:22:50.250644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181828+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:15:43.181828+0000","last_peered":"2024-04-23T10:15:43.181828+0000","last_clean":"2024-04-23T10:15:43.181828+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:15:43.181828+0000","last_undegraded":"2024-04-23T10:15:43.181828+0000","last_fullsized":"2024-04-23T10:15:43.181828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186018+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:15:43.186018+0000","last_peered":"2024-04-23T10:15:43.186018+0000","last_clean":"2024-04-23T10:15:43.186018+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:15:43.186018+0000","last_undegraded":"2024-04-23T10:15:43.186018+0000","last_fullsized":"2024-04-23T10:15:43.186018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179808+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:15:43.179808+0000","last_peered":"2024-04-23T10:15:43.179808+0000","last_clean":"2024-04-23T10:15:43.179808+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:15:43.179808+0000","last_undegraded":"2024-04-23T10:15:43.179808+0000","last_fullsized":"2024-04-23T10:15:43.179808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079799+0000","last_change":"2024-04-23T10:15:38.032528+0000","last_active":"2024-04-23T10:15:43.079799+0000","last_peered":"2024-04-23T10:15:43.079799+0000","last_clean":"2024-04-23T10:15:43.079799+0000","last_became_active":"2024-04-23T10:15:38.031888+0000","last_became_peered":"2024-04-23T10:15:38.031888+0000","last_unstale":"2024-04-23T10:15:43.079799+0000","last_undegraded":"2024-04-23T10:15:43.079799+0000","last_fullsized":"2024-04-23T10:15:43.079799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:27.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.186307+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:15:43.186307+0000","last_peered":"2024-04-23T10:15:43.186307+0000","last_clean":"2024-04-23T10:15:43.186307+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:15:43.186307+0000","last_undegraded":"2024-04-23T10:15:43.186307+0000","last_fullsized":"2024-04-23T10:15:43.186307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077440+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:15:43.077440+0000","last_peered":"2024-04-23T10:15:43.077440+0000","last_clean":"2024-04-23T10:15:43.077440+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:15:43.077440+0000","last_undegraded":"2024-04-23T10:15:43.077440+0000","last_fullsized":"2024-04-23T10:15:43.077440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185500+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:15:43.185500+0000","last_peered":"2024-04-23T10:15:43.185500+0000","last_clean":"2024-04-23T10:15:43.185500+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:15:43.185500+0000","last_undegraded":"2024-04-23T10:15:43.185500+0000","last_fullsized":"2024-04-23T10:15:43.185500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077430+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:15:43.077430+0000","last_peered":"2024-04-23T10:15:43.077430+0000","last_clean":"2024-04-23T10:15:43.077430+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:15:43.077430+0000","last_undegraded":"2024-04-23T10:15:43.077430+0000","last_fullsized":"2024-04-23T10:15:43.077430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181490+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:15:43.181490+0000","last_peered":"2024-04-23T10:15:43.181490+0000","last_clean":"2024-04-23T10:15:43.181490+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:15:43.181490+0000","last_undegraded":"2024-04-23T10:15:43.181490+0000","last_fullsized":"2024-04-23T10:15:43.181490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079050+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:15:43.079050+0000","last_peered":"2024-04-23T10:15:43.079050+0000","last_clean":"2024-04-23T10:15:43.079050+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:15:43.079050+0000","last_undegraded":"2024-04-23T10:15:43.079050+0000","last_fullsized":"2024-04-23T10:15:43.079050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183628+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:15:43.183628+0000","last_peered":"2024-04-23T10:15:43.183628+0000","last_clean":"2024-04-23T10:15:43.183628+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:15:43.183628+0000","last_undegraded":"2024-04-23T10:15:43.183628+0000","last_fullsized":"2024-04-23T10:15:43.183628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.074767+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:15:43.074767+0000","last_peered":"2024-04-23T10:15:43.074767+0000","last_clean":"2024-04-23T10:15:43.074767+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:15:43.074767+0000","last_undegraded":"2024-04-23T10:15:43.074767+0000","last_fullsized":"2024-04-23T10:15:43.074767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.078901+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:15:43.078901+0000","last_peered":"2024-04-23T10:15:43.078901+0000","last_clean":"2024-04-23T10:15:43.078901+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:15:43.078901+0000","last_undegraded":"2024-04-23T10:15:43.078901+0000","last_fullsized":"2024-04-23T10:15:43.078901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.076772+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:15:43.076772+0000","last_peered":"2024-04-23T10:15:43.076772+0000","last_clean":"2024-04-23T10:15:43.076772+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:15:43.076772+0000","last_undegraded":"2024-04-23T10:15:43.076772+0000","last_fullsized":"2024-04-23T10:15:43.076772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179961+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:15:43.179961+0000","last_peered":"2024-04-23T10:15:43.179961+0000","last_clean":"2024-04-23T10:15:43.179961+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:15:43.179961+0000","last_undegraded":"2024-04-23T10:15:43.179961+0000","last_fullsized":"2024-04-23T10:15:43.179961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.179876+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:15:43.179876+0000","last_peered":"2024-04-23T10:15:43.179876+0000","last_clean":"2024-04-23T10:15:43.179876+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:15:43.179876+0000","last_undegraded":"2024-04-23T10:15:43.179876+0000","last_fullsized":"2024-04-23T10:15:43.179876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185516+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:15:43.185516+0000","last_peered":"2024-04-23T10:15:43.185516+0000","last_clean":"2024-04-23T10:15:43.185516+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:15:43.185516+0000","last_undegraded":"2024-04-23T10:15:43.185516+0000","last_fullsized":"2024-04-23T10:15:43.185516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183819+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:15:43.183819+0000","last_peered":"2024-04-23T10:15:43.183819+0000","last_clean":"2024-04-23T10:15:43.183819+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:15:43.183819+0000","last_undegraded":"2024-04-23T10:15:43.183819+0000","last_fullsized":"2024-04-23T10:15:43.183819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079377+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:15:43.079377+0000","last_peered":"2024-04-23T10:15:43.079377+0000","last_clean":"2024-04-23T10:15:43.079377+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:15:43.079377+0000","last_undegraded":"2024-04-23T10:15:43.079377+0000","last_fullsized":"2024-04-23T10:15:43.079377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.079668+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:15:43.079668+0000","last_peered":"2024-04-23T10:15:43.079668+0000","last_clean":"2024-04-23T10:15:43.079668+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:15:43.079668+0000","last_undegraded":"2024-04-23T10:15:43.079668+0000","last_fullsized":"2024-04-23T10:15:43.079668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185876+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:15:43.185876+0000","last_peered":"2024-04-23T10:15:43.185876+0000","last_clean":"2024-04-23T10:15:43.185876+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:15:43.185876+0000","last_undegraded":"2024-04-23T10:15:43.185876+0000","last_fullsized":"2024-04-23T10:15:43.185876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185157+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:15:43.185157+0000","last_peered":"2024-04-23T10:15:43.185157+0000","last_clean":"2024-04-23T10:15:43.185157+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:15:43.185157+0000","last_undegraded":"2024-04-23T10:15:43.185157+0000","last_fullsized":"2024-04-23T10:15:43.185157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.183096+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:15:43.183096+0000","last_peered":"2024-04-23T10:15:43.183096+0000","last_clean":"2024-04-23T10:15:43.183096+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:15:43.183096+0000","last_undegraded":"2024-04-23T10:15:43.183096+0000","last_fullsized":"2024-04-23T10:15:43.183096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077230+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:15:43.077230+0000","last_peered":"2024-04-23T10:15:43.077230+0000","last_clean":"2024-04-23T10:15:43.077230+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:15:43.077230+0000","last_undegraded":"2024-04-23T10:15:43.077230+0000","last_fullsized":"2024-04-23T10:15:43.077230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.182252+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:15:43.182252+0000","last_peered":"2024-04-23T10:15:43.182252+0000","last_clean":"2024-04-23T10:15:43.182252+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:15:43.182252+0000","last_undegraded":"2024-04-23T10:15:43.182252+0000","last_fullsized":"2024-04-23T10:15:43.182252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.077579+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:15:43.077579+0000","last_peered":"2024-04-23T10:15:43.077579+0000","last_clean":"2024-04-23T10:15:43.077579+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:15:43.077579+0000","last_undegraded":"2024-04-23T10:15:43.077579+0000","last_fullsized":"2024-04-23T10:15:43.077579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.180320+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:15:43.180320+0000","last_peered":"2024-04-23T10:15:43.180320+0000","last_clean":"2024-04-23T10:15:43.180320+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:15:43.180320+0000","last_undegraded":"2024-04-23T10:15:43.180320+0000","last_fullsized":"2024-04-23T10:15:43.180320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.181064+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:15:43.181064+0000","last_peered":"2024-04-23T10:15:43.181064+0000","last_clean":"2024-04-23T10:15:43.181064+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:15:43.181064+0000","last_undegraded":"2024-04-23T10:15:43.181064+0000","last_fullsized":"2024-04-23T10:15:43.181064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:15:43.185772+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:15:43.185772+0000","last_peered":"2024-04-23T10:15:43.185772+0000","last_clean":"2024-04-23T10:15:43.185772+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:15:43.185772+0000","last_undegraded":"2024-04-23T10:15:43.185772+0000","last_fullsized":"2024-04-23T10:15:43.185772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:16:04.467 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T10:16:04.467 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T10:16:04.467 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-23T10:16:04.467 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:16:04.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.615+0000 7f898226c640 1 Processor -- start 2024-04-23T10:16:04.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.615+0000 7f898226c640 1 -- start start 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f898226c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c0cea00 0x7f897c15cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f898226c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f897c15d190 0x7f897c152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f898226c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f897c1593a0 con 0x7f897c158ef0 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f898226c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f897c15c4e0 con 0x7f897c15d190 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f898226c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f897c159680 con 0x7f897c0cea00 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8973fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f897c15d190 0x7f897c152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8980809640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f897c158ef0 0x7f897c073bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:58680/0 (socket says 172.21.15.29:58680) 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8973fff640 1 --2- 172.21.15.29:0/3622156252 >> v2:172.21.15.72:3300/0 conn(0x7f897c15d190 0x7f897c152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:59126/0 (socket says 172.21.15.29:59126) 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8980809640 1 -- 172.21.15.29:0/3622156252 learned_addr learned my addr 172.21.15.29:0/3622156252 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f897bfff640 1 --2- 172.21.15.29:0/3622156252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c0cea00 0x7f897c15cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8973fff640 1 -- 172.21.15.29:0/3622156252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c0cea00 msgr2=0x7f897c15cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8973fff640 1 --2- 172.21.15.29:0/3622156252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c0cea00 0x7f897c15cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8973fff640 1 -- 172.21.15.29:0/3622156252 >> v1:172.21.15.72:6789/0 conn(0x7f897c158ef0 legacy=0x7f897c073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8973fff640 1 -- 172.21.15.29:0/3622156252 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c159960 con 0x7f897c15d190 2024-04-23T10:16:04.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f8973fff640 1 --2- 172.21.15.29:0/3622156252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c15d190 0x7f897c152ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f896c0097c0 tx=0x7f896c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a77e33eeff110915 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:04.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f897b7fe640 1 -- 172.21.15.29:0/3622156252 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c0a7070 con 0x7f897c15d190 2024-04-23T10:16:04.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f897b7fe640 1 -- 172.21.15.29:0/3622156252 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c0b0070 con 0x7f897c15d190 2024-04-23T10:16:04.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f897b7fe640 1 -- 172.21.15.29:0/3622156252 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c0ab890 con 0x7f897c15d190 2024-04-23T10:16:04.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f898226c640 1 -- 172.21.15.29:0/3622156252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c15d190 msgr2=0x7f897c152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.619+0000 7f898226c640 1 --2- 172.21.15.29:0/3622156252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c15d190 0x7f897c152ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f896c0097c0 tx=0x7f896c01c470 comp rx=0 tx=0).stop 2024-04-23T10:16:04.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- 172.21.15.29:0/3622156252 shutdown_connections 2024-04-23T10:16:04.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 --2- 172.21.15.29:0/3622156252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c15d190 0x7f897c152ca0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 --2- 172.21.15.29:0/3622156252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c0cea00 0x7f897c15cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- 172.21.15.29:0/3622156252 >> 172.21.15.29:0/3622156252 conn(0x7f897c070f40 msgr2=0x7f897c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:04.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- 172.21.15.29:0/3622156252 shutdown_connections 2024-04-23T10:16:04.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- 172.21.15.29:0/3622156252 wait complete. 2024-04-23T10:16:04.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 Processor -- start 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- start start 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0cea00 0x7f897c1f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c158ef0 0x7f897c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897c15d190 0x7f897c0c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f897c153360 con 0x7f897c15d190 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1531e0 con 0x7f897c0cea00 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f897c1534e0 con 0x7f897c158ef0 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897c15d190 0x7f897c0c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897c15d190 0x7f897c0c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38130/0 (socket says 172.21.15.29:38130) 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 -- 172.21.15.29:0/3315664755 learned_addr learned my addr 172.21.15.29:0/3315664755 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f897bfff640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0cea00 0x7f897c1f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8973fff640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c158ef0 0x7f897c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 -- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c158ef0 msgr2=0x7f897c151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c158ef0 0x7f897c151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 -- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0cea00 msgr2=0x7f897c1f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0cea00 0x7f897c1f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 -- 172.21.15.29:0/3315664755 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c14d280 con 0x7f897c15d190 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f897bfff640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0cea00 0x7f897c1f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8973fff640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c158ef0 0x7f897c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f8980809640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897c15d190 0x7f897c0c5d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f897400cad0 tx=0x7f897400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f89797fa640 1 -- 172.21.15.29:0/3315664755 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974017070 con 0x7f897c15d190 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f89797fa640 1 -- 172.21.15.29:0/3315664755 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897400ac30 con 0x7f897c15d190 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f89797fa640 1 -- 172.21.15.29:0/3315664755 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974012400 con 0x7f897c15d190 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c14d520 con 0x7f897c15d190 2024-04-23T10:16:04.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c15bf90 con 0x7f897c15d190 2024-04-23T10:16:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.623+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c0693c0 con 0x7f897c15d190 2024-04-23T10:16:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.627+0000 7f89797fa640 1 -- 172.21.15.29:0/3315664755 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f897401a070 con 0x7f897c15d190 2024-04-23T10:16:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.627+0000 7f89797fa640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f895c068380 0x7f895c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.627+0000 7f89797fa640 1 -- 172.21.15.29:0/3315664755 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8974086a20 con 0x7f897c15d190 2024-04-23T10:16:04.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.627+0000 7f897bfff640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f895c068380 0x7f895c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:04.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.627+0000 7f897bfff640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f895c068380 0x7f895c06a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8964009ae0 tx=0x7f8964008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.631+0000 7f89797fa640 1 -- 172.21.15.29:0/3315664755 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8974056ca0 con 0x7f897c15d190 2024-04-23T10:16:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.819+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f897c14f3c0 con 0x7f897c15d190 2024-04-23T10:16:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.819+0000 7f89797fa640 1 -- 172.21.15.29:0/3315664755 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f89740565a0 con 0x7f897c15d190 2024-04-23T10:16:04.820 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:04.821 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-23T10:16:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f895c068380 msgr2=0x7f895c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f895c068380 0x7f895c06a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8964009ae0 tx=0x7f8964008040 comp rx=0 tx=0).stop 2024-04-23T10:16:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897c15d190 msgr2=0x7f897c0c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897c15d190 0x7f897c0c5d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f897400cad0 tx=0x7f897400cf90 comp rx=0 tx=0).stop 2024-04-23T10:16:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 shutdown_connections 2024-04-23T10:16:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f895c068380 0x7f895c06a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f897c15d190 0x7f897c0c5d70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897c158ef0 0x7f897c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 --2- 172.21.15.29:0/3315664755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0cea00 0x7f897c1f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 >> 172.21.15.29:0/3315664755 conn(0x7f897c070f40 msgr2=0x7f897c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 shutdown_connections 2024-04-23T10:16:04.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:04.823+0000 7f898226c640 1 -- 172.21.15.29:0/3315664755 wait complete. 2024-04-23T10:16:07.054 INFO:tasks.ceph.mds.f.smithi072.stderr:2024-04-23T10:16:07.054+0000 7fe6e021a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-23T10:16:07.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:16:07.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.971+0000 7f48f80f4640 1 Processor -- start 2024-04-23T10:16:07.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.971+0000 7f48f80f4640 1 -- start start 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.971+0000 7f48f80f4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f0075140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.971+0000 7f48f80f4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f48f015fab0 0x7f48f015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.971+0000 7f48f80f4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f0163980 con 0x7f48f01597a0 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.971+0000 7f48f80f4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f48f0160460 con 0x7f48f015fab0 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.971+0000 7f48f80f4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48f0159b80 con 0x7f48f0074d60 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f5e90640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f48f01597a0 0x7f48f00704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57964/0 (socket says 172.21.15.29:57964) 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f5e90640 1 -- 172.21.15.29:0/1279229892 learned_addr learned my addr 172.21.15.29:0/1279229892 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f6691640 1 --2- 172.21.15.29:0/1279229892 >> v2:172.21.15.72:3300/0 conn(0x7f48f015fab0 0x7f48f015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f568f640 1 --2- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f0075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f4e8e640 1 -- 172.21.15.29:0/1279229892 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835496120 0 0) 0x7f48f0163980 con 0x7f48f01597a0 2024-04-23T10:16:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f4e8e640 1 -- 172.21.15.29:0/1279229892 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48dc003530 con 0x7f48f01597a0 2024-04-23T10:16:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f6691640 1 -- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 msgr2=0x7f48f0075140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f4e8e640 1 -- 172.21.15.29:0/1279229892 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 275778956 0 0) 0x7f48dc003530 con 0x7f48f01597a0 2024-04-23T10:16:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f6691640 1 --2- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f0075140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f6691640 1 -- 172.21.15.29:0/1279229892 >> v1:172.21.15.29:6789/0 conn(0x7f48f01597a0 legacy=0x7f48f00704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:07.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f6691640 1 -- 172.21.15.29:0/1279229892 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f0162e80 con 0x7f48f015fab0 2024-04-23T10:16:07.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f568f640 1 --2- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f0075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:07.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f6691640 1 --2- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f015fab0 0x7f48f015ff20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009d90 tx=0x7f48e801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e221b2311bf04f41 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:07.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f4e8e640 1 -- 172.21.15.29:0/1279229892 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e80ac070 con 0x7f48f015fab0 2024-04-23T10:16:07.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f4e8e640 1 -- 172.21.15.29:0/1279229892 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e80a64a0 con 0x7f48f015fab0 2024-04-23T10:16:07.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.975+0000 7f48f4e8e640 1 -- 172.21.15.29:0/1279229892 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec001680 con 0x7f48f015fab0 2024-04-23T10:16:07.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f015fab0 msgr2=0x7f48f015ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:07.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 --2- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f015fab0 0x7f48f015ff20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009d90 tx=0x7f48e801c890 comp rx=0 tx=0).stop 2024-04-23T10:16:07.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- 172.21.15.29:0/1279229892 shutdown_connections 2024-04-23T10:16:07.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 --2- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f015fab0 0x7f48f015ff20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:07.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 --2- 172.21.15.29:0/1279229892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f0075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:07.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- 172.21.15.29:0/1279229892 >> 172.21.15.29:0/1279229892 conn(0x7f48f006b9e0 msgr2=0x7f48f006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:07.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- 172.21.15.29:0/1279229892 shutdown_connections 2024-04-23T10:16:07.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- 172.21.15.29:0/1279229892 wait complete. 2024-04-23T10:16:07.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 Processor -- start 2024-04-23T10:16:07.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- start start 2024-04-23T10:16:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f01f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f01597a0 0x7f48f015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48f015fab0 0x7f48f00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0070bc0 con 0x7f48f015fab0 2024-04-23T10:16:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01636a0 con 0x7f48f01597a0 2024-04-23T10:16:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48f0070d40 con 0x7f48f0074d60 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48f015fab0 0x7f48f00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48f015fab0 0x7f48f00cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38136/0 (socket says 172.21.15.29:38136) 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 -- 172.21.15.29:0/2041338335 learned_addr learned my addr 172.21.15.29:0/2041338335 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f5e90640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f01f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f568f640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f01597a0 0x7f48f015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 -- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 msgr2=0x7f48f01f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f01f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 -- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f01597a0 msgr2=0x7f48f015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f01597a0 0x7f48f015eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 -- 172.21.15.29:0/2041338335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f01f8a70 con 0x7f48f015fab0 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f5e90640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f01f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f6691640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48f015fab0 0x7f48f00cd570 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f48e801d130 tx=0x7f48e8019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:07.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48e67fc640 1 -- 172.21.15.29:0/2041338335 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e80ac070 con 0x7f48f015fab0 2024-04-23T10:16:07.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48e67fc640 1 -- 172.21.15.29:0/2041338335 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e8004040 con 0x7f48f015fab0 2024-04-23T10:16:07.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f01fc000 con 0x7f48f015fab0 2024-04-23T10:16:07.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48e67fc640 1 -- 172.21.15.29:0/2041338335 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8009450 con 0x7f48f015fab0 2024-04-23T10:16:07.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.979+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f01fb240 con 0x7f48f015fab0 2024-04-23T10:16:07.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.983+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f006c970 con 0x7f48f015fab0 2024-04-23T10:16:07.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.983+0000 7f48e67fc640 1 -- 172.21.15.29:0/2041338335 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48e80af070 con 0x7f48f015fab0 2024-04-23T10:16:07.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.983+0000 7f48e67fc640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48d4068380 0x7f48d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:07.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.983+0000 7f48e67fc640 1 -- 172.21.15.29:0/2041338335 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f48e8121270 con 0x7f48f015fab0 2024-04-23T10:16:07.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.983+0000 7f48f5e90640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48d4068380 0x7f48d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:07.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.983+0000 7f48f5e90640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48d4068380 0x7f48d406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48ec007af0 tx=0x7f48ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:07.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:07.987+0000 7f48e67fc640 1 -- 172.21.15.29:0/2041338335 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f48f01f8a70 con 0x7f48f015fab0 2024-04-23T10:16:08.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.179+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f48f00c80f0 con 0x7f48f015fab0 2024-04-23T10:16:08.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48e67fc640 1 -- 172.21.15.29:0/2041338335 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f48e8016480 con 0x7f48f015fab0 2024-04-23T10:16:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:08.182 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-23T10:16:08.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48d4068380 msgr2=0x7f48d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:08.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48d4068380 0x7f48d406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48ec007af0 tx=0x7f48ec009040 comp rx=0 tx=0).stop 2024-04-23T10:16:08.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48f015fab0 msgr2=0x7f48f00cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:08.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48f015fab0 0x7f48f00cd570 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f48e801d130 tx=0x7f48e8019630 comp rx=0 tx=0).stop 2024-04-23T10:16:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 shutdown_connections 2024-04-23T10:16:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48d4068380 0x7f48d406a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48f015fab0 0x7f48f00cd570 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48f01597a0 0x7f48f015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 --2- 172.21.15.29:0/2041338335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48f0074d60 0x7f48f01f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 >> 172.21.15.29:0/2041338335 conn(0x7f48f006b9e0 msgr2=0x7f48f0158140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 shutdown_connections 2024-04-23T10:16:08.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:08.183+0000 7f48f80f4640 1 -- 172.21.15.29:0/2041338335 wait complete. 2024-04-23T10:16:11.200 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:16:11.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6c882640 1 Processor -- start 2024-04-23T10:16:11.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6c882640 1 -- start start 2024-04-23T10:16:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6c882640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b68153190 0x7f6b68159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6c882640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6b680cd360 0x7f6b6806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6c882640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b680c3fe0 con 0x7f6b6806f150 2024-04-23T10:16:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6c882640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f6b68159380 con 0x7f6b680cd360 2024-04-23T10:16:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6c882640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680c42c0 con 0x7f6b68153190 2024-04-23T10:16:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b66d9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6b680cd360 0x7f6b6806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b65d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6b6806f150 0x7f6b680ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57972/0 (socket says 172.21.15.29:57972) 2024-04-23T10:16:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b65d9b640 1 -- 172.21.15.29:0/495633118 learned_addr learned my addr 172.21.15.29:0/495633118 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6659c640 1 --2- 172.21.15.29:0/495633118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b68153190 0x7f6b68159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b66d9d640 1 -- 172.21.15.29:0/495633118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b68153190 msgr2=0x7f6b68159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b66d9d640 1 --2- 172.21.15.29:0/495633118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b68153190 0x7f6b68159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b66d9d640 1 -- 172.21.15.29:0/495633118 >> v1:172.21.15.29:6789/0 conn(0x7f6b6806f150 legacy=0x7f6b680ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6559a640 1 -- 172.21.15.29:0/495633118 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430600487 0 0) 0x7f6b680c3fe0 con 0x7f6b6806f150 2024-04-23T10:16:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b66d9d640 1 -- 172.21.15.29:0/495633118 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680c45a0 con 0x7f6b680cd360 2024-04-23T10:16:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.335+0000 7f6b6659c640 1 --2- 172.21.15.29:0/495633118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b68153190 0x7f6b68159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:11.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b66d9d640 1 --2- 172.21.15.29:0/495633118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b680cd360 0x7f6b6806f550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009d90 tx=0x7f6b6001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf0a186d63a8a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:11.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6559a640 1 -- 172.21.15.29:0/495633118 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b600b4070 con 0x7f6b680cd360 2024-04-23T10:16:11.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6559a640 1 -- 172.21.15.29:0/495633118 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b600af600 con 0x7f6b680cd360 2024-04-23T10:16:11.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6559a640 1 -- 172.21.15.29:0/495633118 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b600af9d0 con 0x7f6b680cd360 2024-04-23T10:16:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 -- 172.21.15.29:0/495633118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b680cd360 msgr2=0x7f6b6806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 --2- 172.21.15.29:0/495633118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b680cd360 0x7f6b6806f550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009d90 tx=0x7f6b6001f150 comp rx=0 tx=0).stop 2024-04-23T10:16:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 -- 172.21.15.29:0/495633118 shutdown_connections 2024-04-23T10:16:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 --2- 172.21.15.29:0/495633118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b680cd360 0x7f6b6806f550 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 --2- 172.21.15.29:0/495633118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b68153190 0x7f6b68159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 -- 172.21.15.29:0/495633118 >> 172.21.15.29:0/495633118 conn(0x7f6b6806cfb0 msgr2=0x7f6b6806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 -- 172.21.15.29:0/495633118 shutdown_connections 2024-04-23T10:16:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 -- 172.21.15.29:0/495633118 wait complete. 2024-04-23T10:16:11.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 Processor -- start 2024-04-23T10:16:11.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.339+0000 7f6b6c882640 1 -- start start 2024-04-23T10:16:11.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6806f150 0x7f6b681512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:11.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b680cd360 0x7f6b681f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:11.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b68153190 0x7f6b681e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:11.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680c4880 con 0x7f6b68153190 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68153570 con 0x7f6b6806f150 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680c9070 con 0x7f6b680cd360 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b68153190 0x7f6b681e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b68153190 0x7f6b681e2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38144/0 (socket says 172.21.15.29:38144) 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 -- 172.21.15.29:0/3280671400 learned_addr learned my addr 172.21.15.29:0/3280671400 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6659c640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6806f150 0x7f6b681512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b65d9b640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b680cd360 0x7f6b681f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 -- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b680cd360 msgr2=0x7f6b681f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b680cd360 0x7f6b681f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 -- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6806f150 msgr2=0x7f6b681512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6806f150 0x7f6b681512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 -- 172.21.15.29:0/3280671400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68157b30 con 0x7f6b68153190 2024-04-23T10:16:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6659c640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6806f150 0x7f6b681512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:11.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b66d9d640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b68153190 0x7f6b681e2330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6b600b2040 tx=0x7f6b6001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:11.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b56ffd640 1 -- 172.21.15.29:0/3280671400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b600b4040 con 0x7f6b68153190 2024-04-23T10:16:11.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b56ffd640 1 -- 172.21.15.29:0/3280671400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b600c1070 con 0x7f6b68153190 2024-04-23T10:16:11.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b68157e10 con 0x7f6b68153190 2024-04-23T10:16:11.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b56ffd640 1 -- 172.21.15.29:0/3280671400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60009450 con 0x7f6b68153190 2024-04-23T10:16:11.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b681583d0 con 0x7f6b68153190 2024-04-23T10:16:11.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b68068d70 con 0x7f6b68153190 2024-04-23T10:16:11.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b56ffd640 1 -- 172.21.15.29:0/3280671400 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b600ba6b0 con 0x7f6b68153190 2024-04-23T10:16:11.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b56ffd640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b48068380 0x7f6b4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:11.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b56ffd640 1 -- 172.21.15.29:0/3280671400 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6b601261c0 con 0x7f6b68153190 2024-04-23T10:16:11.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.343+0000 7f6b6659c640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b48068380 0x7f6b4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:11.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.347+0000 7f6b6659c640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b48068380 0x7f6b4806a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800b990 tx=0x7f6b58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:11.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.347+0000 7f6b56ffd640 1 -- 172.21.15.29:0/3280671400 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b60018cb0 con 0x7f6b68153190 2024-04-23T10:16:11.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.547+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6b68150c30 con 0x7f6b68153190 2024-04-23T10:16:11.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.547+0000 7f6b56ffd640 1 -- 172.21.15.29:0/3280671400 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f6b600f6520 con 0x7f6b68153190 2024-04-23T10:16:11.548 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:11.548 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-23T10:16:11.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b48068380 msgr2=0x7f6b4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:11.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b48068380 0x7f6b4806a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800b990 tx=0x7f6b58008040 comp rx=0 tx=0).stop 2024-04-23T10:16:11.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b68153190 msgr2=0x7f6b681e2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b68153190 0x7f6b681e2330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6b600b2040 tx=0x7f6b6001bef0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 shutdown_connections 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b48068380 0x7f6b4806a840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b68153190 0x7f6b681e2330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b680cd360 0x7f6b681f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 --2- 172.21.15.29:0/3280671400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6806f150 0x7f6b681512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 >> 172.21.15.29:0/3280671400 conn(0x7f6b6806cfb0 msgr2=0x7f6b6806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 shutdown_connections 2024-04-23T10:16:11.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:11.551+0000 7f6b6c882640 1 -- 172.21.15.29:0/3280671400 wait complete. 2024-04-23T10:16:12.054 INFO:tasks.ceph.mds.f.smithi072.stderr:2024-04-23T10:16:12.054+0000 7fe6e021a640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-23T10:16:14.567 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:16:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f3995d7f640 1 Processor -- start 2024-04-23T10:16:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f3995d7f640 1 -- start start 2024-04-23T10:16:14.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f3995d7f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3990153190 0x7f3990159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f3995d7f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39900cd360 0x7f399006f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f3995d7f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39900c3fe0 con 0x7f399006f150 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f3995d7f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3990159380 con 0x7f39900cd360 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f3995d7f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f39900c42c0 con 0x7f3990153190 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f398effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f399006f150 0x7f39900ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52984/0 (socket says 172.21.15.29:52984) 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.698+0000 7f398effd640 1 -- 172.21.15.29:0/1705532041 learned_addr learned my addr 172.21.15.29:0/1705532041 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398f7fe640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3990153190 0x7f3990159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398ffff640 1 --2- 172.21.15.29:0/1705532041 >> v2:172.21.15.72:3300/0 conn(0x7f39900cd360 0x7f399006f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969535688 0 0) 0x7f39900c3fe0 con 0x7f399006f150 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3978003530 con 0x7f399006f150 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532456517 0 0) 0x7f3978003530 con 0x7f399006f150 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3990153190 msgr2=0x7f3990159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:14.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3990153190 0x7f3990159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 >> v2:172.21.15.72:3300/0 conn(0x7f39900cd360 msgr2=0x7f399006f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 --2- 172.21.15.29:0/1705532041 >> v2:172.21.15.72:3300/0 conn(0x7f39900cd360 0x7f399006f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39900c45a0 con 0x7f399006f150 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f3984001680 con 0x7f399006f150 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 >> v1:172.21.15.29:6789/0 conn(0x7f399006f150 legacy=0x7f39900ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3990153190 0x7f39780039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f3978004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004d50 0x7f39780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3990159380 con 0x7f3978003f40 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f39900c42c0 con 0x7f3978004d50 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f397800ba00 con 0x7f3990153190 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398effd640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f3978004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398ffff640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004d50 0x7f39780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398f7fe640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3990153190 0x7f39780039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398effd640 1 -- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3990153190 msgr2=0x7f39780039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:14.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398effd640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3990153190 0x7f39780039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398effd640 1 -- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004d50 msgr2=0x7f39780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:14.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398effd640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3978004d50 0x7f39780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398effd640 1 -- 172.21.15.29:0/1705532041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3978003530 con 0x7f3978003f40 2024-04-23T10:16:14.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398effd640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f3978004810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f398400c210 tx=0x7f398401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7af6e665e5b0d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:14.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984007d60 con 0x7f3978003f40 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39840a9020 con 0x7f3978003f40 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.702+0000 7f398e7fc640 1 -- 172.21.15.29:0/1705532041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39840a5be0 con 0x7f3978003f40 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- 172.21.15.29:0/1705532041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 msgr2=0x7f3978004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 --2- 172.21.15.29:0/1705532041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f3978004810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f398400c210 tx=0x7f398401cca0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398ffff640 1 -- 172.21.15.29:0/1705532041 reap_dead start 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- 172.21.15.29:0/1705532041 shutdown_connections 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- 172.21.15.29:0/1705532041 >> 172.21.15.29:0/1705532041 conn(0x7f399006cfb0 msgr2=0x7f399006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- 172.21.15.29:0/1705532041 shutdown_connections 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- 172.21.15.29:0/1705532041 wait complete. 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 Processor -- start 2024-04-23T10:16:14.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- start start 2024-04-23T10:16:14.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f39900c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39900c8930 0x7f39901f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3990154e60 0x7f3990155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f39900c4880 con 0x7f3978003f40 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3990153570 con 0x7f3990154e60 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f39900c9070 con 0x7f39900c8930 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f39900c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f39900c7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58740/0 (socket says 172.21.15.29:58740) 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 -- 172.21.15.29:0/3908690159 learned_addr learned my addr 172.21.15.29:0/3908690159 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398ffff640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3990154e60 0x7f3990155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398effd640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39900c8930 0x7f39901f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 -- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39900c8930 msgr2=0x7f39901f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39900c8930 0x7f39901f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 -- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3990154e60 msgr2=0x7f3990155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3990154e60 0x7f3990155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 -- 172.21.15.29:0/3908690159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39901f41d0 con 0x7f3978003f40 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398ffff640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3990154e60 0x7f3990155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398effd640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39900c8930 0x7f39901f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f398f7fe640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f39900c7010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3980007f90 tx=0x7f3980011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3977fff640 1 -- 172.21.15.29:0/3908690159 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398001a020 con 0x7f3978003f40 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3977fff640 1 -- 172.21.15.29:0/3908690159 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3980016470 con 0x7f3978003f40 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39901503c0 con 0x7f3978003f40 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3977fff640 1 -- 172.21.15.29:0/3908690159 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980016860 con 0x7f3978003f40 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.706+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3990150980 con 0x7f3978003f40 2024-04-23T10:16:14.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.710+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3990068d70 con 0x7f3978003f40 2024-04-23T10:16:14.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.710+0000 7f3977fff640 1 -- 172.21.15.29:0/3908690159 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f398001d020 con 0x7f3978003f40 2024-04-23T10:16:14.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.710+0000 7f3977fff640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f397c0683b0 0x7f397c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:14.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.710+0000 7f3977fff640 1 -- 172.21.15.29:0/3908690159 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39800882a0 con 0x7f3978003f40 2024-04-23T10:16:14.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.710+0000 7f398effd640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f397c0683b0 0x7f397c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:14.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.710+0000 7f398effd640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f397c0683b0 0x7f397c06a870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39840aa000 tx=0x7f3984000ff0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:14.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.714+0000 7f3977fff640 1 -- 172.21.15.29:0/3908690159 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3980024020 con 0x7f3978003f40 2024-04-23T10:16:14.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.914+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3990158930 con 0x7f3978003f40 2024-04-23T10:16:14.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.914+0000 7f3977fff640 1 -- 172.21.15.29:0/3908690159 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f3980058500 con 0x7f3978003f40 2024-04-23T10:16:14.916 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:14.916 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-23T10:16:14.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f397c0683b0 msgr2=0x7f397c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:14.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f397c0683b0 0x7f397c06a870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39840aa000 tx=0x7f3984000ff0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 msgr2=0x7f39900c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f39900c7010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3980007f90 tx=0x7f3980011660 comp rx=0 tx=0).stop 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 shutdown_connections 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f397c0683b0 0x7f397c06a870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3990154e60 0x7f3990155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39900c8930 0x7f39901f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 --2- 172.21.15.29:0/3908690159 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3978003f40 0x7f39900c7010 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 >> 172.21.15.29:0/3908690159 conn(0x7f399006cfb0 msgr2=0x7f3990151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 shutdown_connections 2024-04-23T10:16:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:14.918+0000 7f3995d7f640 1 -- 172.21.15.29:0/3908690159 wait complete. 2024-04-23T10:16:15.422 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:16:15.425 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:16:17.055 INFO:tasks.ceph.mds.f.smithi072.stderr:2024-04-23T10:16:17.053+0000 7fe6e021a640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-23T10:16:17.936 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:16:18.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd58c0b640 1 Processor -- start 2024-04-23T10:16:18.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd58c0b640 1 -- start start 2024-04-23T10:16:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd58c0b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd54153190 0x7fcd54159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd58c0b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5406f150 0x7fcd5406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd58c0b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd540ccc50 0x7fcd540cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd58c0b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fcd54159380 con 0x7fcd54153190 2024-04-23T10:16:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd58c0b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcd540cd5c0 con 0x7fcd540ccc50 2024-04-23T10:16:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd58c0b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcd540c3fe0 con 0x7fcd5406f150 2024-04-23T10:16:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd5259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd54153190 0x7fcd54159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd5259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd54153190 0x7fcd54159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58748/0 (socket says 172.21.15.29:58748) 2024-04-23T10:16:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd5259c640 1 -- 172.21.15.29:0/481318289 learned_addr learned my addr 172.21.15.29:0/481318289 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd51d9b640 1 --2- 172.21.15.29:0/481318289 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5406f150 0x7fcd5406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd5259c640 1 -- 172.21.15.29:0/481318289 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5406f150 msgr2=0x7fcd5406f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd5259c640 1 --2- 172.21.15.29:0/481318289 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5406f150 0x7fcd5406f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd5259c640 1 -- 172.21.15.29:0/481318289 >> v2:172.21.15.72:3300/0 conn(0x7fcd540ccc50 msgr2=0x7fcd540cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd52d9d640 1 --2- 172.21.15.29:0/481318289 >> v2:172.21.15.72:3300/0 conn(0x7fcd540ccc50 0x7fcd540cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd5259c640 1 --2- 172.21.15.29:0/481318289 >> v2:172.21.15.72:3300/0 conn(0x7fcd540ccc50 0x7fcd540cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.070+0000 7fcd5259c640 1 -- 172.21.15.29:0/481318289 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd540c42c0 con 0x7fcd54153190 2024-04-23T10:16:18.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd5259c640 1 --2- 172.21.15.29:0/481318289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54153190 0x7fcd54159810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd5406e440 tx=0x7fcd4801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc9aa15da56232b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd5159a640 1 -- 172.21.15.29:0/481318289 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480b5070 con 0x7fcd54153190 2024-04-23T10:16:18.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd5159a640 1 -- 172.21.15.29:0/481318289 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd480a89d0 con 0x7fcd54153190 2024-04-23T10:16:18.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd5159a640 1 -- 172.21.15.29:0/481318289 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480a8da0 con 0x7fcd54153190 2024-04-23T10:16:18.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 -- 172.21.15.29:0/481318289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54153190 msgr2=0x7fcd54159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/481318289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54153190 0x7fcd54159810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd5406e440 tx=0x7fcd4801ed10 comp rx=0 tx=0).stop 2024-04-23T10:16:18.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 -- 172.21.15.29:0/481318289 shutdown_connections 2024-04-23T10:16:18.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/481318289 >> v2:172.21.15.72:3300/0 conn(0x7fcd540ccc50 0x7fcd540cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/481318289 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5406f150 0x7fcd5406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/481318289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54153190 0x7fcd54159810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 -- 172.21.15.29:0/481318289 >> 172.21.15.29:0/481318289 conn(0x7fcd5406cfb0 msgr2=0x7fcd5406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 -- 172.21.15.29:0/481318289 shutdown_connections 2024-04-23T10:16:18.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.074+0000 7fcd58c0b640 1 -- 172.21.15.29:0/481318289 wait complete. 2024-04-23T10:16:18.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 Processor -- start 2024-04-23T10:16:18.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 -- start start 2024-04-23T10:16:18.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd5406f150 0x7fcd54156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd540ccc50 0x7fcd541eea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd54153190 0x7fcd541eef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54153570 con 0x7fcd5406f150 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54159010 con 0x7fcd54153190 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcd540c4880 con 0x7fcd540ccc50 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd5406f150 0x7fcd54156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd5406f150 0x7fcd54156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58754/0 (socket says 172.21.15.29:58754) 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 -- 172.21.15.29:0/2276720311 learned_addr learned my addr 172.21.15.29:0/2276720311 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd51d9b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd540ccc50 0x7fcd541eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd52d9d640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd54153190 0x7fcd541eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 -- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd540ccc50 msgr2=0x7fcd541eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd540ccc50 0x7fcd541eea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 -- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd54153190 msgr2=0x7fcd541eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd54153190 0x7fcd541eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 -- 172.21.15.29:0/2276720311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd54150d50 con 0x7fcd5406f150 2024-04-23T10:16:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd52d9d640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd54153190 0x7fcd541eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd5259c640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd5406f150 0x7fcd54156fd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c10 tx=0x7fcd4801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd42ffd640 1 -- 172.21.15.29:0/2276720311 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480b5070 con 0x7fcd5406f150 2024-04-23T10:16:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd42ffd640 1 -- 172.21.15.29:0/2276720311 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd480b0a50 con 0x7fcd5406f150 2024-04-23T10:16:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd541f2200 con 0x7fcd5406f150 2024-04-23T10:16:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd42ffd640 1 -- 172.21.15.29:0/2276720311 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480b0e00 con 0x7fcd5406f150 2024-04-23T10:16:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.078+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd541f27c0 con 0x7fcd5406f150 2024-04-23T10:16:18.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.082+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd54068d70 con 0x7fcd5406f150 2024-04-23T10:16:18.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.082+0000 7fcd42ffd640 1 -- 172.21.15.29:0/2276720311 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd480c2060 con 0x7fcd5406f150 2024-04-23T10:16:18.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.082+0000 7fcd42ffd640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcd34068380 0x7fcd3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.082+0000 7fcd42ffd640 1 -- 172.21.15.29:0/2276720311 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcd48123cf0 con 0x7fcd5406f150 2024-04-23T10:16:18.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.082+0000 7fcd51d9b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcd34068380 0x7fcd3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.082+0000 7fcd51d9b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcd34068380 0x7fcd3406a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd54069850 tx=0x7fcd44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.086+0000 7fcd42ffd640 1 -- 172.21.15.29:0/2276720311 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd48128070 con 0x7fcd5406f150 2024-04-23T10:16:18.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.282+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd5406f9d0 con 0x7fcd5406f150 2024-04-23T10:16:18.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd42ffd640 1 -- 172.21.15.29:0/2276720311 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcd48018870 con 0x7fcd5406f150 2024-04-23T10:16:18.287 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:18.287 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T10:16:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcd34068380 msgr2=0x7fcd3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcd34068380 0x7fcd3406a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd54069850 tx=0x7fcd44008040 comp rx=0 tx=0).stop 2024-04-23T10:16:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd5406f150 msgr2=0x7fcd54156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd5406f150 0x7fcd54156fd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c10 tx=0x7fcd4801bab0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 shutdown_connections 2024-04-23T10:16:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcd34068380 0x7fcd3406a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd54153190 0x7fcd541eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd540ccc50 0x7fcd541eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 --2- 172.21.15.29:0/2276720311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd5406f150 0x7fcd54156fd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 >> 172.21.15.29:0/2276720311 conn(0x7fcd5406cfb0 msgr2=0x7fcd5406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 shutdown_connections 2024-04-23T10:16:18.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.286+0000 7fcd58c0b640 1 -- 172.21.15.29:0/2276720311 wait complete. 2024-04-23T10:16:18.306 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-23T10:16:18.307 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:18.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc1dd36640 1 Processor -- start 2024-04-23T10:16:18.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc1dd36640 1 -- start start 2024-04-23T10:16:18.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc1dd36640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 0x7fcc1815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc1dd36640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc180753a0 0x7fcc18143f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc1dd36640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcc180c8250 0x7fcc18144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc1dd36640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fcc18072280 con 0x7fcc180c8250 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc1dd36640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1815e720 con 0x7fcc180753a0 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc1dd36640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcc180cb020 con 0x7fcc18074fc0 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc17fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcc180c8250 0x7fcc18144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc17fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcc180c8250 0x7fcc18144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58758/0 (socket says 172.21.15.29:58758) 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc17fff640 1 -- 172.21.15.29:0/1638365356 learned_addr learned my addr 172.21.15.29:0/1638365356 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc16ffd640 1 --2- 172.21.15.29:0/1638365356 >> v2:172.21.15.72:3300/0 conn(0x7fcc180753a0 0x7fcc18143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc177fe640 1 --2- 172.21.15.29:0/1638365356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 0x7fcc1815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc17fff640 1 -- 172.21.15.29:0/1638365356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 msgr2=0x7fcc1815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc17fff640 1 --2- 172.21.15.29:0/1638365356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 0x7fcc1815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc17fff640 1 -- 172.21.15.29:0/1638365356 >> v2:172.21.15.72:3300/0 conn(0x7fcc180753a0 msgr2=0x7fcc18143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc17fff640 1 --2- 172.21.15.29:0/1638365356 >> v2:172.21.15.72:3300/0 conn(0x7fcc180753a0 0x7fcc18143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.434+0000 7fcc17fff640 1 -- 172.21.15.29:0/1638365356 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1815e9e0 con 0x7fcc180c8250 2024-04-23T10:16:18.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc17fff640 1 --2- 172.21.15.29:0/1638365356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180c8250 0x7fcc18144450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcc18070be0 tx=0x7fcc1001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701e48f0e81623ea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc167fc640 1 -- 172.21.15.29:0/1638365356 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc100b4070 con 0x7fcc180c8250 2024-04-23T10:16:18.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc167fc640 1 -- 172.21.15.29:0/1638365356 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc100af400 con 0x7fcc180c8250 2024-04-23T10:16:18.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc167fc640 1 -- 172.21.15.29:0/1638365356 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc100af7d0 con 0x7fcc180c8250 2024-04-23T10:16:18.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 -- 172.21.15.29:0/1638365356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180c8250 msgr2=0x7fcc18144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/1638365356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180c8250 0x7fcc18144450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcc18070be0 tx=0x7fcc1001f1e0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 -- 172.21.15.29:0/1638365356 shutdown_connections 2024-04-23T10:16:18.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/1638365356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180c8250 0x7fcc18144450 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/1638365356 >> v2:172.21.15.72:3300/0 conn(0x7fcc180753a0 0x7fcc18143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/1638365356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 0x7fcc1815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 -- 172.21.15.29:0/1638365356 >> 172.21.15.29:0/1638365356 conn(0x7fcc1806fde0 msgr2=0x7fcc180701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 -- 172.21.15.29:0/1638365356 shutdown_connections 2024-04-23T10:16:18.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 -- 172.21.15.29:0/1638365356 wait complete. 2024-04-23T10:16:18.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 Processor -- start 2024-04-23T10:16:18.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 -- start start 2024-04-23T10:16:18.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 0x7fcc180cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.438+0000 7fcc1dd36640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180753a0 0x7fcc180cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc1dd36640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc180c8250 0x7fcc181f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc1dd36640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1815f280 con 0x7fcc180753a0 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc1dd36640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1815efa0 con 0x7fcc180c8250 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc1dd36640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1815f560 con 0x7fcc18074fc0 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180753a0 0x7fcc180cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180753a0 0x7fcc180cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58762/0 (socket says 172.21.15.29:58762) 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 -- 172.21.15.29:0/916426522 learned_addr learned my addr 172.21.15.29:0/916426522 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc177fe640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 0x7fcc180cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 -- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 msgr2=0x7fcc180cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc17fff640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc180c8250 0x7fcc181f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 0x7fcc180cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 -- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc180c8250 msgr2=0x7fcc181f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc180c8250 0x7fcc181f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 -- 172.21.15.29:0/916426522 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc180ce1a0 con 0x7fcc180753a0 2024-04-23T10:16:18.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc17fff640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc180c8250 0x7fcc181f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:18.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc16ffd640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180753a0 0x7fcc180cca20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00e930 tx=0x7fcc0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcbfffff640 1 -- 172.21.15.29:0/916426522 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c017070 con 0x7fcc180753a0 2024-04-23T10:16:18.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcbfffff640 1 -- 172.21.15.29:0/916426522 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0c00ca00 con 0x7fcc180753a0 2024-04-23T10:16:18.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcbfffff640 1 -- 172.21.15.29:0/916426522 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00cdd0 con 0x7fcc180753a0 2024-04-23T10:16:18.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc180cb720 con 0x7fcc180753a0 2024-04-23T10:16:18.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc180cbce0 con 0x7fcc180753a0 2024-04-23T10:16:18.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc18068d70 con 0x7fcc180753a0 2024-04-23T10:16:18.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcbfffff640 1 -- 172.21.15.29:0/916426522 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc0c01a070 con 0x7fcc180753a0 2024-04-23T10:16:18.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcbfffff640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcc040683b0 0x7fcc0406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcbfffff640 1 -- 172.21.15.29:0/916426522 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcc0c0870b0 con 0x7fcc180753a0 2024-04-23T10:16:18.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc177fe640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcc040683b0 0x7fcc0406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.442+0000 7fcc177fe640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcc040683b0 0x7fcc0406a870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009710 tx=0x7fcc08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.446+0000 7fcbfffff640 1 -- 172.21.15.29:0/916426522 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc0c057360 con 0x7fcc180753a0 2024-04-23T10:16:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.610+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc18074300 con 0x7fcc180753a0 2024-04-23T10:16:18.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcbfffff640 1 -- 172.21.15.29:0/916426522 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7fcc0c056c60 con 0x7fcc180753a0 2024-04-23T10:16:18.615 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:18.615 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcc040683b0 msgr2=0x7fcc0406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcc040683b0 0x7fcc0406a870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009710 tx=0x7fcc08008040 comp rx=0 tx=0).stop 2024-04-23T10:16:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180753a0 msgr2=0x7fcc180cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180753a0 0x7fcc180cca20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00e930 tx=0x7fcc0c00edf0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 shutdown_connections 2024-04-23T10:16:18.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcc040683b0 0x7fcc0406a870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc180c8250 0x7fcc181f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180753a0 0x7fcc180cca20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 --2- 172.21.15.29:0/916426522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc18074fc0 0x7fcc180cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 >> 172.21.15.29:0/916426522 conn(0x7fcc1806fde0 msgr2=0x7fcc18142f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 shutdown_connections 2024-04-23T10:16:18.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.614+0000 7fcc1dd36640 1 -- 172.21.15.29:0/916426522 wait complete. 2024-04-23T10:16:18.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:16:18.636 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:16:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d65408640 1 Processor -- start 2024-04-23T10:16:18.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d65408640 1 -- start start 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d65408640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d60074fc0 0x7f8d600c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d65408640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d60162bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d65408640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d60075860 0x7f8d60163130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d65408640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8d60163b10 con 0x7f8d60074fc0 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d65408640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8d60163830 con 0x7f8d60075860 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d65408640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6015f710 con 0x7f8d600753a0 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d60074fc0 0x7f8d600c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8d60074fc0 0x7f8d600c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58764/0 (socket says 172.21.15.29:58764) 2024-04-23T10:16:18.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5effd640 1 -- 172.21.15.29:0/2462248460 learned_addr learned my addr 172.21.15.29:0/2462248460 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:18.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5f7fe640 1 --2- 172.21.15.29:0/2462248460 >> v2:172.21.15.72:3300/0 conn(0x7f8d60075860 0x7f8d60163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5e7fc640 1 --2- 172.21.15.29:0/2462248460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d60162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5effd640 1 -- 172.21.15.29:0/2462248460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 msgr2=0x7f8d60162bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5effd640 1 --2- 172.21.15.29:0/2462248460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d60162bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5effd640 1 -- 172.21.15.29:0/2462248460 >> v2:172.21.15.72:3300/0 conn(0x7f8d60075860 msgr2=0x7f8d60163130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5effd640 1 --2- 172.21.15.29:0/2462248460 >> v2:172.21.15.72:3300/0 conn(0x7f8d60075860 0x7f8d60163130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5effd640 1 -- 172.21.15.29:0/2462248460 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6015f9f0 con 0x7f8d60074fc0 2024-04-23T10:16:18.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.762+0000 7f8d5e7fc640 1 --2- 172.21.15.29:0/2462248460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d60162bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:18.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d5effd640 1 --2- 172.21.15.29:0/2462248460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60074fc0 0x7f8d600c8e80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d600cad60 tx=0x7f8d5001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d79bad54fcdaf4a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d5dffb640 1 -- 172.21.15.29:0/2462248460 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d500b5070 con 0x7f8d60074fc0 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d5dffb640 1 -- 172.21.15.29:0/2462248460 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d500a89d0 con 0x7f8d60074fc0 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d5dffb640 1 -- 172.21.15.29:0/2462248460 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d500a8da0 con 0x7f8d60074fc0 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 -- 172.21.15.29:0/2462248460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60074fc0 msgr2=0x7f8d600c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 --2- 172.21.15.29:0/2462248460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60074fc0 0x7f8d600c8e80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d600cad60 tx=0x7f8d5001ed10 comp rx=0 tx=0).stop 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 -- 172.21.15.29:0/2462248460 shutdown_connections 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 --2- 172.21.15.29:0/2462248460 >> v2:172.21.15.72:3300/0 conn(0x7f8d60075860 0x7f8d60163130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 --2- 172.21.15.29:0/2462248460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d60162bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 --2- 172.21.15.29:0/2462248460 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60074fc0 0x7f8d600c8e80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 -- 172.21.15.29:0/2462248460 >> 172.21.15.29:0/2462248460 conn(0x7f8d6006b9e0 msgr2=0x7f8d6006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 -- 172.21.15.29:0/2462248460 shutdown_connections 2024-04-23T10:16:18.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 -- 172.21.15.29:0/2462248460 wait complete. 2024-04-23T10:16:18.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 Processor -- start 2024-04-23T10:16:18.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.766+0000 7f8d65408640 1 -- start start 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d60074fc0 0x7f8d600cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d601f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60075860 0x7f8d6014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601604d0 con 0x7f8d60075860 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6015ffb0 con 0x7f8d60074fc0 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8d600c93c0 con 0x7f8d600753a0 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60075860 0x7f8d6014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60075860 0x7f8d6014d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58778/0 (socket says 172.21.15.29:58778) 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 -- 172.21.15.29:0/4005184765 learned_addr learned my addr 172.21.15.29:0/4005184765 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:18.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5effd640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d60074fc0 0x7f8d600cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5e7fc640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d601f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 -- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 msgr2=0x7f8d601f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d601f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 -- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d60074fc0 msgr2=0x7f8d600cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d60074fc0 0x7f8d600cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 -- 172.21.15.29:0/4005184765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d601f8410 con 0x7f8d60075860 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5effd640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d60074fc0 0x7f8d600cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5e7fc640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d601f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5f7fe640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60075860 0x7f8d6014d900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800e930 tx=0x7f8d5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d477fe640 1 -- 172.21.15.29:0/4005184765 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58017070 con 0x7f8d60075860 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d477fe640 1 -- 172.21.15.29:0/4005184765 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5800c9a0 con 0x7f8d60075860 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d60160960 con 0x7f8d60075860 2024-04-23T10:16:18.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d477fe640 1 -- 172.21.15.29:0/4005184765 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800cd70 con 0x7f8d60075860 2024-04-23T10:16:18.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d601f86b0 con 0x7f8d60075860 2024-04-23T10:16:18.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d601f88b0 con 0x7f8d60075860 2024-04-23T10:16:18.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d477fe640 1 -- 172.21.15.29:0/4005184765 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d5801a070 con 0x7f8d60075860 2024-04-23T10:16:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d477fe640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d4c0683b0 0x7f8d4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d477fe640 1 -- 172.21.15.29:0/4005184765 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8d58086c10 con 0x7f8d60075860 2024-04-23T10:16:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5effd640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d4c0683b0 0x7f8d4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.770+0000 7f8d5effd640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d4c0683b0 0x7f8d4c06a870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8d500b2000 tx=0x7f8d500aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.774+0000 7f8d477fe640 1 -- 172.21.15.29:0/4005184765 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d601f88b0 con 0x7f8d60075860 2024-04-23T10:16:18.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.938+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d60156580 con 0x7f8d60075860 2024-04-23T10:16:18.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d477fe640 1 -- 172.21.15.29:0/4005184765 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f8d5805be20 con 0x7f8d60075860 2024-04-23T10:16:18.942 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:16:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d4c0683b0 msgr2=0x7f8d4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d4c0683b0 0x7f8d4c06a870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8d500b2000 tx=0x7f8d500aa070 comp rx=0 tx=0).stop 2024-04-23T10:16:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60075860 msgr2=0x7f8d6014d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60075860 0x7f8d6014d900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800e930 tx=0x7f8d5800edf0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 shutdown_connections 2024-04-23T10:16:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d4c0683b0 0x7f8d4c06a870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d60075860 0x7f8d6014d900 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d600753a0 0x7f8d601f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 --2- 172.21.15.29:0/4005184765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d60074fc0 0x7f8d600cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 >> 172.21.15.29:0/4005184765 conn(0x7f8d6006b9e0 msgr2=0x7f8d6015d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 shutdown_connections 2024-04-23T10:16:18.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:18.942+0000 7f8d65408640 1 -- 172.21.15.29:0/4005184765 wait complete. 2024-04-23T10:16:18.962 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:16:19.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.086+0000 7f226a7b4640 1 Processor -- start 2024-04-23T10:16:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.086+0000 7f226a7b4640 1 -- start start 2024-04-23T10:16:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f226a7b4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2264153190 0x7f2264159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f226a7b4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f226406f150 0x7f226406f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f226a7b4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22640c3fe0 con 0x7f22640ccc50 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f226a7b4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2264159380 con 0x7f2264153190 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f226a7b4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f22640c42c0 con 0x7f226406f150 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2268d51640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f22640ccc50 0x7f22640cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52988/0 (socket says 172.21.15.29:52988) 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2268d51640 1 -- 172.21.15.29:0/1927732130 learned_addr learned my addr 172.21.15.29:0/1927732130 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2263fff640 1 --2- 172.21.15.29:0/1927732130 >> v2:172.21.15.29:3300/0 conn(0x7f2264153190 0x7f2264159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f22637fe640 1 --2- 172.21.15.29:0/1927732130 >> v2:172.21.15.72:3300/0 conn(0x7f226406f150 0x7f226406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2262ffd640 1 -- 172.21.15.29:0/1927732130 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080035818 0 0) 0x7f22640c3fe0 con 0x7f22640ccc50 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2262ffd640 1 -- 172.21.15.29:0/1927732130 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f224c003530 con 0x7f22640ccc50 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2263fff640 1 -- 172.21.15.29:0/1927732130 >> v2:172.21.15.72:3300/0 conn(0x7f226406f150 msgr2=0x7f226406f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2263fff640 1 --2- 172.21.15.29:0/1927732130 >> v2:172.21.15.72:3300/0 conn(0x7f226406f150 0x7f226406f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2263fff640 1 -- 172.21.15.29:0/1927732130 >> v1:172.21.15.29:6789/0 conn(0x7f22640ccc50 legacy=0x7f22640cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2263fff640 1 -- 172.21.15.29:0/1927732130 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22640c45a0 con 0x7f2264153190 2024-04-23T10:16:19.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2263fff640 1 --2- 172.21.15.29:0/1927732130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264159810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2264159500 tx=0x7f225801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51745ee31832f0c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2262ffd640 1 -- 172.21.15.29:0/1927732130 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580b5070 con 0x7f2264153190 2024-04-23T10:16:19.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2262ffd640 1 -- 172.21.15.29:0/1927732130 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22580a8950 con 0x7f2264153190 2024-04-23T10:16:19.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.090+0000 7f2262ffd640 1 -- 172.21.15.29:0/1927732130 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580a8d00 con 0x7f2264153190 2024-04-23T10:16:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- 172.21.15.29:0/1927732130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 msgr2=0x7f2264159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1927732130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264159810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2264159500 tx=0x7f225801ec50 comp rx=0 tx=0).stop 2024-04-23T10:16:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- 172.21.15.29:0/1927732130 shutdown_connections 2024-04-23T10:16:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1927732130 >> v2:172.21.15.72:3300/0 conn(0x7f226406f150 0x7f226406f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1927732130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264159810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- 172.21.15.29:0/1927732130 >> 172.21.15.29:0/1927732130 conn(0x7f226406cfb0 msgr2=0x7f226406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- 172.21.15.29:0/1927732130 shutdown_connections 2024-04-23T10:16:19.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- 172.21.15.29:0/1927732130 wait complete. 2024-04-23T10:16:19.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 Processor -- start 2024-04-23T10:16:19.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- start start 2024-04-23T10:16:19.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f226406f150 0x7f226414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22640ccc50 0x7f226414d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f22640c4880 con 0x7f2264153190 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2264153570 con 0x7f22640ccc50 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f226a7b4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f22640c9070 con 0x7f226406f150 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f2268d51640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f2268d51640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58790/0 (socket says 172.21.15.29:58790) 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f2268d51640 1 -- 172.21.15.29:0/1847454086 learned_addr learned my addr 172.21.15.29:0/1847454086 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f22637fe640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22640ccc50 0x7f226414d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.094+0000 7f2263fff640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f226406f150 0x7f226414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2268d51640 1 -- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f226406f150 msgr2=0x7f226414b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2268d51640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f226406f150 0x7f226414b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2268d51640 1 -- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22640ccc50 msgr2=0x7f226414d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2268d51640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22640ccc50 0x7f226414d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2268d51640 1 -- 172.21.15.29:0/1847454086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22641f28d0 con 0x7f2264153190 2024-04-23T10:16:19.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2263fff640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f226406f150 0x7f226414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:19.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2268d51640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264155580 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f225c00cb40 tx=0x7f225c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2260ff9640 1 -- 172.21.15.29:0/1847454086 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c017070 con 0x7f2264153190 2024-04-23T10:16:19.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2260ff9640 1 -- 172.21.15.29:0/1847454086 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c00aca0 con 0x7f2264153190 2024-04-23T10:16:19.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2260ff9640 1 -- 172.21.15.29:0/1847454086 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c012620 con 0x7f2264153190 2024-04-23T10:16:19.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22641f1dd0 con 0x7f2264153190 2024-04-23T10:16:19.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22641f2310 con 0x7f2264153190 2024-04-23T10:16:19.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2264068d70 con 0x7f2264153190 2024-04-23T10:16:19.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2260ff9640 1 -- 172.21.15.29:0/1847454086 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f225c01a070 con 0x7f2264153190 2024-04-23T10:16:19.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2260ff9640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2250068380 0x7f225006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2260ff9640 1 -- 172.21.15.29:0/1847454086 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f225c086b80 con 0x7f2264153190 2024-04-23T10:16:19.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2263fff640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2250068380 0x7f225006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.098+0000 7f2263fff640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2250068380 0x7f225006a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22580b2000 tx=0x7f22580aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.102+0000 7f2260ff9640 1 -- 172.21.15.29:0/1847454086 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f225c056680 con 0x7f2264153190 2024-04-23T10:16:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.266+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2264156920 con 0x7f2264153190 2024-04-23T10:16:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.266+0000 7f2260ff9640 1 -- 172.21.15.29:0/1847454086 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f225c05a980 con 0x7f2264153190 2024-04-23T10:16:19.268 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2250068380 msgr2=0x7f225006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2250068380 0x7f225006a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22580b2000 tx=0x7f22580aa070 comp rx=0 tx=0).stop 2024-04-23T10:16:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 msgr2=0x7f2264155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264155580 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f225c00cb40 tx=0x7f225c00a060 comp rx=0 tx=0).stop 2024-04-23T10:16:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 shutdown_connections 2024-04-23T10:16:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2250068380 0x7f225006a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2264153190 0x7f2264155580 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22640ccc50 0x7f226414d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 --2- 172.21.15.29:0/1847454086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f226406f150 0x7f226414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 >> 172.21.15.29:0/1847454086 conn(0x7f226406cfb0 msgr2=0x7f2264156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 shutdown_connections 2024-04-23T10:16:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.270+0000 7f226a7b4640 1 -- 172.21.15.29:0/1847454086 wait complete. 2024-04-23T10:16:19.288 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:16:19.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.406+0000 7fcecb6e4640 1 Processor -- start 2024-04-23T10:16:19.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.406+0000 7fcecb6e4640 1 -- start start 2024-04-23T10:16:19.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.406+0000 7fcecb6e4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcec40cee20 0x7fcec4073f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.406+0000 7fcecb6e4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec40c8f30 con 0x7fcec40cf200 2024-04-23T10:16:19.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.406+0000 7fcecb6e4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec40c62d0 con 0x7fcec4158ed0 2024-04-23T10:16:19.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.406+0000 7fcecb6e4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcec40c65b0 con 0x7fcec40cee20 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.406+0000 7fcec8c7f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcec40cf200 0x7fcec40c8480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53000/0 (socket says 172.21.15.29:53000) 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.406+0000 7fcec8c7f640 1 -- 172.21.15.29:0/147176390 learned_addr learned my addr 172.21.15.29:0/147176390 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcec9480640 1 --2- 172.21.15.29:0/147176390 >> v2:172.21.15.72:3300/0 conn(0x7fcec40cee20 0x7fcec4073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcebbfff640 1 -- 172.21.15.29:0/147176390 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887822168 0 0) 0x7fcec40c8f30 con 0x7fcec40cf200 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcebbfff640 1 -- 172.21.15.29:0/147176390 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceb0003530 con 0x7fcec40cf200 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcec9480640 1 -- 172.21.15.29:0/147176390 >> v1:172.21.15.72:6789/0 conn(0x7fcec4158ed0 legacy=0x7fcec41592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcebbfff640 1 -- 172.21.15.29:0/147176390 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3525027070 0 0) 0x7fceb0003530 con 0x7fcec40cf200 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcec9480640 1 -- 172.21.15.29:0/147176390 >> v1:172.21.15.29:6789/0 conn(0x7fcec40cf200 legacy=0x7fcec40c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcec9480640 1 -- 172.21.15.29:0/147176390 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40c6890 con 0x7fcec40cee20 2024-04-23T10:16:19.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcec9480640 1 --2- 172.21.15.29:0/147176390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec40cee20 0x7fcec4073f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcec00097c0 tx=0x7fcec001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8880bafad4e69378 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcebbfff640 1 -- 172.21.15.29:0/147176390 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec00b0070 con 0x7fcec40cee20 2024-04-23T10:16:19.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcebbfff640 1 -- 172.21.15.29:0/147176390 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec00ab400 con 0x7fcec40cee20 2024-04-23T10:16:19.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcebbfff640 1 -- 172.21.15.29:0/147176390 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4001680 con 0x7fcec40cee20 2024-04-23T10:16:19.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcecb6e4640 1 -- 172.21.15.29:0/147176390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec40cee20 msgr2=0x7fcec4073f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcecb6e4640 1 --2- 172.21.15.29:0/147176390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec40cee20 0x7fcec4073f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcec00097c0 tx=0x7fcec001c3c0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcecb6e4640 1 -- 172.21.15.29:0/147176390 shutdown_connections 2024-04-23T10:16:19.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.410+0000 7fcecb6e4640 1 --2- 172.21.15.29:0/147176390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec40cee20 0x7fcec4073f40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- 172.21.15.29:0/147176390 >> 172.21.15.29:0/147176390 conn(0x7fcec406fc90 msgr2=0x7fcec4074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:19.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- 172.21.15.29:0/147176390 shutdown_connections 2024-04-23T10:16:19.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- 172.21.15.29:0/147176390 wait complete. 2024-04-23T10:16:19.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 Processor -- start 2024-04-23T10:16:19.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- start start 2024-04-23T10:16:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcec40cee20 0x7fcec415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec40cf200 0x7fcec4150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4158ed0 0x7fcec414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4167410 con 0x7fcec40cf200 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4167290 con 0x7fcec4158ed0 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcec4167590 con 0x7fcec40cee20 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec40cf200 0x7fcec4150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec40cf200 0x7fcec4150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58800/0 (socket says 172.21.15.29:58800) 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 -- 172.21.15.29:0/63133122 learned_addr learned my addr 172.21.15.29:0/63133122 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec9480640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcec40cee20 0x7fcec415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 -- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcec40cee20 msgr2=0x7fcec415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcec40cee20 0x7fcec415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 -- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4158ed0 msgr2=0x7fcec414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec9c81640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4158ed0 0x7fcec414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4158ed0 0x7fcec414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 -- 172.21.15.29:0/63133122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40cbfd0 con 0x7fcec40cf200 2024-04-23T10:16:19.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec9480640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcec40cee20 0x7fcec415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:19.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec9c81640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4158ed0 0x7fcec414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:19.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcec8c7f640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec40cf200 0x7fcec4150de0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fceb400c700 tx=0x7fceb400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fceb9ffb640 1 -- 172.21.15.29:0/63133122 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4017070 con 0x7fcec40cf200 2024-04-23T10:16:19.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fceb9ffb640 1 -- 172.21.15.29:0/63133122 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb4005ae0 con 0x7fcec40cf200 2024-04-23T10:16:19.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec40cc2b0 con 0x7fcec40cf200 2024-04-23T10:16:19.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fceb9ffb640 1 -- 172.21.15.29:0/63133122 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4007070 con 0x7fcec40cf200 2024-04-23T10:16:19.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec41f2360 con 0x7fcec40cf200 2024-04-23T10:16:19.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.414+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec40693c0 con 0x7fcec40cf200 2024-04-23T10:16:19.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.418+0000 7fceb9ffb640 1 -- 172.21.15.29:0/63133122 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fceb401a070 con 0x7fcec40cf200 2024-04-23T10:16:19.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.418+0000 7fceb9ffb640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcea8068380 0x7fcea806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.418+0000 7fceb9ffb640 1 -- 172.21.15.29:0/63133122 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fceb40862b0 con 0x7fcec40cf200 2024-04-23T10:16:19.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.418+0000 7fcec9480640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcea8068380 0x7fcea806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.418+0000 7fcec9480640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcea8068380 0x7fcea806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcec00ad000 tx=0x7fcec00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.422+0000 7fceb9ffb640 1 -- 172.21.15.29:0/63133122 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fceb4055e50 con 0x7fcec40cf200 2024-04-23T10:16:19.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.582+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcec4074030 con 0x7fcec40cf200 2024-04-23T10:16:19.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.582+0000 7fceb9ffb640 1 -- 172.21.15.29:0/63133122 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fceb405a150 con 0x7fcec40cf200 2024-04-23T10:16:19.584 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:16:19.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcea8068380 msgr2=0x7fcea806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcea8068380 0x7fcea806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcec00ad000 tx=0x7fcec00a6000 comp rx=0 tx=0).stop 2024-04-23T10:16:19.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec40cf200 msgr2=0x7fcec4150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec40cf200 0x7fcec4150de0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fceb400c700 tx=0x7fceb400cbc0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 shutdown_connections 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcea8068380 0x7fcea806a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4158ed0 0x7fcec414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec40cf200 0x7fcec4150de0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 --2- 172.21.15.29:0/63133122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcec40cee20 0x7fcec415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 >> 172.21.15.29:0/63133122 conn(0x7fcec406fc90 msgr2=0x7fcec40c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 shutdown_connections 2024-04-23T10:16:19.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.586+0000 7fcecb6e4640 1 -- 172.21.15.29:0/63133122 wait complete. 2024-04-23T10:16:19.602 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:16:19.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98bc0d1640 1 Processor -- start 2024-04-23T10:16:19.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98bc0d1640 1 -- start start 2024-04-23T10:16:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98bc0d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98b406f3b0 0x7f98b40c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98bc0d1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98b4071160 0x7f98b4073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98bc0d1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b4072590 con 0x7f98b406f790 2024-04-23T10:16:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98bc0d1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f98b4072fe0 con 0x7f98b406f3b0 2024-04-23T10:16:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98bc0d1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f98b4158df0 con 0x7f98b4071160 2024-04-23T10:16:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98b9e6d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98b406f3b0 0x7f98b40c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98b966c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f98b406f790 0x7f98b4157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53008/0 (socket says 172.21.15.29:53008) 2024-04-23T10:16:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98b966c640 1 -- 172.21.15.29:0/1836606913 learned_addr learned my addr 172.21.15.29:0/1836606913 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98ba66e640 1 --2- 172.21.15.29:0/1836606913 >> v2:172.21.15.72:3300/0 conn(0x7f98b4071160 0x7f98b4073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98b9e6d640 1 -- 172.21.15.29:0/1836606913 >> v2:172.21.15.72:3300/0 conn(0x7f98b4071160 msgr2=0x7f98b4073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98b9e6d640 1 --2- 172.21.15.29:0/1836606913 >> v2:172.21.15.72:3300/0 conn(0x7f98b4071160 0x7f98b4073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98b9e6d640 1 -- 172.21.15.29:0/1836606913 >> v1:172.21.15.29:6789/0 conn(0x7f98b406f790 legacy=0x7f98b4157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.730+0000 7f98b9e6d640 1 -- 172.21.15.29:0/1836606913 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b4158830 con 0x7f98b406f3b0 2024-04-23T10:16:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98b9e6d640 1 --2- 172.21.15.29:0/1836606913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f3b0 0x7f98b40c4d70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98b4155a00 tx=0x7f98b001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d463d9027d08604 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98b8e6b640 1 -- 172.21.15.29:0/1836606913 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b00ab650 con 0x7f98b406f3b0 2024-04-23T10:16:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98b8e6b640 1 -- 172.21.15.29:0/1836606913 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b00b0070 con 0x7f98b406f3b0 2024-04-23T10:16:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98b8e6b640 1 -- 172.21.15.29:0/1836606913 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b00aba10 con 0x7f98b406f3b0 2024-04-23T10:16:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1836606913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f3b0 msgr2=0x7f98b40c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1836606913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f3b0 0x7f98b40c4d70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98b4155a00 tx=0x7f98b001c450 comp rx=0 tx=0).stop 2024-04-23T10:16:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1836606913 shutdown_connections 2024-04-23T10:16:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1836606913 >> v2:172.21.15.72:3300/0 conn(0x7f98b4071160 0x7f98b4073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1836606913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f3b0 0x7f98b40c4d70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1836606913 >> 172.21.15.29:0/1836606913 conn(0x7f98b406cfb0 msgr2=0x7f98b406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1836606913 shutdown_connections 2024-04-23T10:16:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1836606913 wait complete. 2024-04-23T10:16:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 Processor -- start 2024-04-23T10:16:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.734+0000 7f98bc0d1640 1 -- start start 2024-04-23T10:16:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b406f3b0 0x7f98b41554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f790 0x7f98b4142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4071160 0x7f98b41563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f98b4152330 con 0x7f98b406f790 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f98b4158500 con 0x7f98b406f3b0 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f98b41524b0 con 0x7f98b4071160 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f790 0x7f98b4142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f790 0x7f98b4142a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58816/0 (socket says 172.21.15.29:58816) 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 -- 172.21.15.29:0/1701582084 learned_addr learned my addr 172.21.15.29:0/1701582084 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b9e6d640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b406f3b0 0x7f98b41554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98ba66e640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4071160 0x7f98b41563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 -- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4071160 msgr2=0x7f98b41563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4071160 0x7f98b41563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 -- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b406f3b0 msgr2=0x7f98b41554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b406f3b0 0x7f98b41554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 -- 172.21.15.29:0/1701582084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b40c4d50 con 0x7f98b406f790 2024-04-23T10:16:19.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b966c640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f790 0x7f98b4142a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c420 tx=0x7f98a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98aa7fc640 1 -- 172.21.15.29:0/1701582084 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4017070 con 0x7f98b406f790 2024-04-23T10:16:19.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98aa7fc640 1 -- 172.21.15.29:0/1701582084 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a4005cf0 con 0x7f98b406f790 2024-04-23T10:16:19.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98aa7fc640 1 -- 172.21.15.29:0/1701582084 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a40072f0 con 0x7f98b406f790 2024-04-23T10:16:19.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b41f3e30 con 0x7f98b406f790 2024-04-23T10:16:19.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b41f43f0 con 0x7f98b406f790 2024-04-23T10:16:19.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b4068d70 con 0x7f98b406f790 2024-04-23T10:16:19.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98aa7fc640 1 -- 172.21.15.29:0/1701582084 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98a401a070 con 0x7f98b406f790 2024-04-23T10:16:19.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98aa7fc640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f98980683b0 0x7f989806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:19.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98aa7fc640 1 -- 172.21.15.29:0/1701582084 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f98a4085f20 con 0x7f98b406f790 2024-04-23T10:16:19.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.738+0000 7f98b9e6d640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f98980683b0 0x7f989806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:19.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.742+0000 7f98b9e6d640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f98980683b0 0x7f989806a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f98b00af000 tx=0x7f98b00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:19.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.742+0000 7f98aa7fc640 1 -- 172.21.15.29:0/1701582084 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98a4055be0 con 0x7f98b406f790 2024-04-23T10:16:19.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.910+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f98b4072240 con 0x7f98b406f790 2024-04-23T10:16:19.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.910+0000 7f98aa7fc640 1 -- 172.21.15.29:0/1701582084 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f98a4059ee0 con 0x7f98b406f790 2024-04-23T10:16:19.912 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.910+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f98980683b0 msgr2=0x7f989806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.910+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f98980683b0 0x7f989806a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f98b00af000 tx=0x7f98b00a7000 comp rx=0 tx=0).stop 2024-04-23T10:16:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.910+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f790 msgr2=0x7f98b4142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f790 0x7f98b4142a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c420 tx=0x7f98a400c8e0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 shutdown_connections 2024-04-23T10:16:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f98980683b0 0x7f989806a870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4071160 0x7f98b41563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98b406f790 0x7f98b4142a50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 --2- 172.21.15.29:0/1701582084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b406f3b0 0x7f98b41554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 >> 172.21.15.29:0/1701582084 conn(0x7f98b406cfb0 msgr2=0x7f98b406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 shutdown_connections 2024-04-23T10:16:19.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:19.914+0000 7f98bc0d1640 1 -- 172.21.15.29:0/1701582084 wait complete. 2024-04-23T10:16:19.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:20.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.050+0000 7fd6f8c52640 1 Processor -- start 2024-04-23T10:16:20.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.050+0000 7fd6f8c52640 1 -- start start 2024-04-23T10:16:20.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6f406f150 0x7fd6f406f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f40ccc50 0x7fd6f40cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f40cd5c0 con 0x7fd6f4153190 2024-04-23T10:16:20.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f4159f20 con 0x7fd6f406f150 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f4159380 con 0x7fd6f40ccc50 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f1d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6f406f150 0x7fd6f406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd6f4153190 0x7fd6f4159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53016/0 (socket says 172.21.15.29:53016) 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f259c640 1 -- 172.21.15.29:0/3528401158 learned_addr learned my addr 172.21.15.29:0/3528401158 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f2d9d640 1 --2- 172.21.15.29:0/3528401158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f40ccc50 0x7fd6f40cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f159a640 1 -- 172.21.15.29:0/3528401158 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468941532 0 0) 0x7fd6e4001120 con 0x7fd6f4153190 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f159a640 1 -- 172.21.15.29:0/3528401158 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6dc003530 con 0x7fd6f4153190 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f1d9b640 1 -- 172.21.15.29:0/3528401158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f40ccc50 msgr2=0x7fd6f40cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f1d9b640 1 --2- 172.21.15.29:0/3528401158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f40ccc50 0x7fd6f40cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f1d9b640 1 -- 172.21.15.29:0/3528401158 >> v1:172.21.15.29:6789/0 conn(0x7fd6f4153190 legacy=0x7fd6f4159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f1d9b640 1 -- 172.21.15.29:0/3528401158 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f40c3fe0 con 0x7fd6f406f150 2024-04-23T10:16:20.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f1d9b640 1 --2- 172.21.15.29:0/3528401158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f406f150 0x7fd6f406f580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80097c0 tx=0x7fd6e801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3904532bb20e5b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f159a640 1 -- 172.21.15.29:0/3528401158 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80b5070 con 0x7fd6f406f150 2024-04-23T10:16:20.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f159a640 1 -- 172.21.15.29:0/3528401158 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e80a8990 con 0x7fd6f406f150 2024-04-23T10:16:20.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f159a640 1 -- 172.21.15.29:0/3528401158 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80a8d60 con 0x7fd6f406f150 2024-04-23T10:16:20.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 -- 172.21.15.29:0/3528401158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f406f150 msgr2=0x7fd6f406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/3528401158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f406f150 0x7fd6f406f580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80097c0 tx=0x7fd6e801ec90 comp rx=0 tx=0).stop 2024-04-23T10:16:20.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 -- 172.21.15.29:0/3528401158 shutdown_connections 2024-04-23T10:16:20.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/3528401158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f40ccc50 0x7fd6f40cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/3528401158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f406f150 0x7fd6f406f580 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 -- 172.21.15.29:0/3528401158 >> 172.21.15.29:0/3528401158 conn(0x7fd6f406cfb0 msgr2=0x7fd6f406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:20.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.054+0000 7fd6f8c52640 1 -- 172.21.15.29:0/3528401158 shutdown_connections 2024-04-23T10:16:20.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 -- 172.21.15.29:0/3528401158 wait complete. 2024-04-23T10:16:20.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 Processor -- start 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 -- start start 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f406f150 0x7fd6f415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f40ccc50 0x7fd6f414b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f4153190 0x7fd6f41423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4159010 con 0x7fd6f40ccc50 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f40c45a0 con 0x7fd6f406f150 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f4153570 con 0x7fd6f4153190 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f40ccc50 0x7fd6f414b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f40ccc50 0x7fd6f414b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58836/0 (socket says 172.21.15.29:58836) 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 -- 172.21.15.29:0/641002080 learned_addr learned my addr 172.21.15.29:0/641002080 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f259c640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f406f150 0x7fd6f415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f2d9d640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f4153190 0x7fd6f41423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 -- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f4153190 msgr2=0x7fd6f41423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f4153190 0x7fd6f41423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 -- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f406f150 msgr2=0x7fd6f415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f406f150 0x7fd6f415a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 -- 172.21.15.29:0/641002080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f4146cd0 con 0x7fd6f40ccc50 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f1d9b640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f40ccc50 0x7fd6f414b3e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80b3040 tx=0x7fd6e801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6e2ffd640 1 -- 172.21.15.29:0/641002080 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80bf070 con 0x7fd6f40ccc50 2024-04-23T10:16:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6e2ffd640 1 -- 172.21.15.29:0/641002080 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e80b0720 con 0x7fd6f40ccc50 2024-04-23T10:16:20.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6e2ffd640 1 -- 172.21.15.29:0/641002080 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80b5040 con 0x7fd6f40ccc50 2024-04-23T10:16:20.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f41583f0 con 0x7fd6f40ccc50 2024-04-23T10:16:20.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f4158690 con 0x7fd6f40ccc50 2024-04-23T10:16:20.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.058+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f4068d70 con 0x7fd6f40ccc50 2024-04-23T10:16:20.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.062+0000 7fd6e2ffd640 1 -- 172.21.15.29:0/641002080 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6e80c2070 con 0x7fd6f40ccc50 2024-04-23T10:16:20.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.062+0000 7fd6e2ffd640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd6d40683b0 0x7fd6d406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.062+0000 7fd6e2ffd640 1 -- 172.21.15.29:0/641002080 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd6e8123270 con 0x7fd6f40ccc50 2024-04-23T10:16:20.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.062+0000 7fd6f259c640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd6d40683b0 0x7fd6d406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.062+0000 7fd6f259c640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd6d40683b0 0x7fd6d406a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4005890 tx=0x7fd6e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.066+0000 7fd6e2ffd640 1 -- 172.21.15.29:0/641002080 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd6f4146cd0 con 0x7fd6f40ccc50 2024-04-23T10:16:20.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.258+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6f41eee10 con 0x7fd6f40ccc50 2024-04-23T10:16:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.258+0000 7fd6e2ffd640 1 -- 172.21.15.29:0/641002080 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6895 (secure 0 0 0) 0x7fd6e80187f0 con 0x7fd6f40ccc50 2024-04-23T10:16:20.261 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:20.261 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:15.286621+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288,4250,4230,4212]},"id":1}]} 2024-04-23T10:16:20.262 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2024-04-23T10:16:20.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd6d40683b0 msgr2=0x7fd6d406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd6d40683b0 0x7fd6d406a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4005890 tx=0x7fd6e4009040 comp rx=0 tx=0).stop 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f40ccc50 msgr2=0x7fd6f414b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f40ccc50 0x7fd6f414b3e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80b3040 tx=0x7fd6e801ba30 comp rx=0 tx=0).stop 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 shutdown_connections 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd6d40683b0 0x7fd6d406a870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6f4153190 0x7fd6f41423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6f40ccc50 0x7fd6f414b3e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 --2- 172.21.15.29:0/641002080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f406f150 0x7fd6f415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 >> 172.21.15.29:0/641002080 conn(0x7fd6f406cfb0 msgr2=0x7fd6f40c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 shutdown_connections 2024-04-23T10:16:20.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.262+0000 7fd6f8c52640 1 -- 172.21.15.29:0/641002080 wait complete. 2024-04-23T10:16:20.279 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:20.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.390+0000 7f0a3f523640 1 Processor -- start 2024-04-23T10:16:20.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.390+0000 7f0a3f523640 1 -- start start 2024-04-23T10:16:20.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3f523640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0a38159840 0x7f0a38072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3f523640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a380c3470 0x7f0a3806f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3f523640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a38071400 con 0x7f0a380c70c0 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3f523640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0a38160030 con 0x7f0a38159840 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3f523640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0a381604c0 con 0x7f0a380c3470 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3d2bf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0a38159840 0x7f0a38072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3d2bf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0a38159840 0x7f0a38072550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58846/0 (socket says 172.21.15.29:58846) 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3d2bf640 1 -- 172.21.15.29:0/1555801488 learned_addr learned my addr 172.21.15.29:0/1555801488 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3dac0640 1 --2- 172.21.15.29:0/1555801488 >> v2:172.21.15.72:3300/0 conn(0x7f0a380c3470 0x7f0a3806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3d2bf640 1 -- 172.21.15.29:0/1555801488 >> v2:172.21.15.72:3300/0 conn(0x7f0a380c3470 msgr2=0x7f0a3806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3d2bf640 1 --2- 172.21.15.29:0/1555801488 >> v2:172.21.15.72:3300/0 conn(0x7f0a380c3470 0x7f0a3806f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3d2bf640 1 -- 172.21.15.29:0/1555801488 >> v1:172.21.15.72:6789/0 conn(0x7f0a380c70c0 legacy=0x7f0a38162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.394+0000 7f0a3d2bf640 1 -- 172.21.15.29:0/1555801488 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a380c7890 con 0x7f0a38159840 2024-04-23T10:16:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3d2bf640 1 --2- 172.21.15.29:0/1555801488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a38159840 0x7f0a38072550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a3806c860 tx=0x7f0a3001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60e7576a64cf366 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a2ffff640 1 -- 172.21.15.29:0/1555801488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a300a5700 con 0x7f0a38159840 2024-04-23T10:16:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a2ffff640 1 -- 172.21.15.29:0/1555801488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a300a58a0 con 0x7f0a38159840 2024-04-23T10:16:20.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a2ffff640 1 -- 172.21.15.29:0/1555801488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a300a5c70 con 0x7f0a38159840 2024-04-23T10:16:20.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- 172.21.15.29:0/1555801488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a38159840 msgr2=0x7f0a38072550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1555801488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a38159840 0x7f0a38072550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a3806c860 tx=0x7f0a3001c930 comp rx=0 tx=0).stop 2024-04-23T10:16:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- 172.21.15.29:0/1555801488 shutdown_connections 2024-04-23T10:16:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1555801488 >> v2:172.21.15.72:3300/0 conn(0x7f0a380c3470 0x7f0a3806f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1555801488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a38159840 0x7f0a38072550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- 172.21.15.29:0/1555801488 >> 172.21.15.29:0/1555801488 conn(0x7f0a3806cfb0 msgr2=0x7f0a3806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- 172.21.15.29:0/1555801488 shutdown_connections 2024-04-23T10:16:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- 172.21.15.29:0/1555801488 wait complete. 2024-04-23T10:16:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 Processor -- start 2024-04-23T10:16:20.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- start start 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a380c3470 0x7f0a38162b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a380c70c0 0x7f0a38148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a38159840 0x7f0a381fbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0a38163280 con 0x7f0a380c70c0 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3815fcc0 con 0x7f0a380c3470 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3f523640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0a38159c20 con 0x7f0a38159840 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a380c70c0 0x7f0a38148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a380c70c0 0x7f0a38148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58850/0 (socket says 172.21.15.29:58850) 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 -- 172.21.15.29:0/1742262563 learned_addr learned my addr 172.21.15.29:0/1742262563 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:20.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3dac0640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a38159840 0x7f0a381fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3d2bf640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a380c3470 0x7f0a38162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 -- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a38159840 msgr2=0x7f0a381fbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a38159840 0x7f0a381fbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 -- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a380c3470 msgr2=0x7f0a38162b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a380c3470 0x7f0a38162b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 -- 172.21.15.29:0/1742262563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a38161150 con 0x7f0a380c70c0 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3dac0640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a38159840 0x7f0a381fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3d2bf640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a380c3470 0x7f0a38162b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.398+0000 7f0a3cabe640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a380c70c0 0x7f0a38148880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800c460 tx=0x7f0a2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a2dffb640 1 -- 172.21.15.29:0/1742262563 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28016020 con 0x7f0a380c70c0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a2dffb640 1 -- 172.21.15.29:0/1742262563 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a280052d0 con 0x7f0a380c70c0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a380cb1d0 con 0x7f0a380c70c0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a2dffb640 1 -- 172.21.15.29:0/1742262563 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28007260 con 0x7f0a380c70c0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3815e980 con 0x7f0a380c70c0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a38068d70 con 0x7f0a380c70c0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a2dffb640 1 -- 172.21.15.29:0/1742262563 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a28007400 con 0x7f0a380c70c0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a2dffb640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0a1c068380 0x7f0a1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a2dffb640 1 -- 172.21.15.29:0/1742262563 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0a280866d0 con 0x7f0a380c70c0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a3d2bf640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0a1c068380 0x7f0a1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.402+0000 7f0a3d2bf640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0a1c068380 0x7f0a1c06a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a300ae000 tx=0x7f0a300a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.406+0000 7f0a2dffb640 1 -- 172.21.15.29:0/1742262563 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a28020020 con 0x7f0a380c70c0 2024-04-23T10:16:20.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.562+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a380c7a60 con 0x7f0a380c70c0 2024-04-23T10:16:20.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a2dffb640 1 -- 172.21.15.29:0/1742262563 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f0a28005480 con 0x7f0a380c70c0 2024-04-23T10:16:20.568 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:20.568 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:20.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0a1c068380 msgr2=0x7f0a1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0a1c068380 0x7f0a1c06a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a300ae000 tx=0x7f0a300a7070 comp rx=0 tx=0).stop 2024-04-23T10:16:20.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a380c70c0 msgr2=0x7f0a38148880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a380c70c0 0x7f0a38148880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800c460 tx=0x7f0a2800c920 comp rx=0 tx=0).stop 2024-04-23T10:16:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 shutdown_connections 2024-04-23T10:16:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0a1c068380 0x7f0a1c06a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a38159840 0x7f0a381fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a380c70c0 0x7f0a38148880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 --2- 172.21.15.29:0/1742262563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a380c3470 0x7f0a38162b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.566+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 >> 172.21.15.29:0/1742262563 conn(0x7f0a3806cfb0 msgr2=0x7f0a380ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.570+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 shutdown_connections 2024-04-23T10:16:20.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.570+0000 7f0a3f523640 1 -- 172.21.15.29:0/1742262563 wait complete. 2024-04-23T10:16:20.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:16:20.586 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:16:20.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.698+0000 7f7f1915d640 1 Processor -- start 2024-04-23T10:16:20.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.698+0000 7f7f1915d640 1 -- start start 2024-04-23T10:16:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f1915d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f14153190 0x7f7f14159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f1915d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f140c3fe0 con 0x7f7f1406f150 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f1915d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f140c42c0 con 0x7f7f140cd360 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f1915d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7f14159380 con 0x7f7f14153190 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f1259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7f1406f150 0x7f7f140ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:53024/0 (socket says 172.21.15.29:53024) 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f1259c640 1 -- 172.21.15.29:0/2555120194 learned_addr learned my addr 172.21.15.29:0/2555120194 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82113967 0 0) 0x7f7f140c3fe0 con 0x7f7f1406f150 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7efc003530 con 0x7f7f1406f150 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f14153190 0x7f7f14159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4123425172 0 0) 0x7f7efc003530 con 0x7f7f1406f150 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f14153190 msgr2=0x7f7f14159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f14153190 0x7f7f14159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 >> v1:172.21.15.72:6789/0 conn(0x7f7f140cd360 legacy=0x7f7f14163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f140c45a0 con 0x7f7f1406f150 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f7f08001680 con 0x7f7f1406f150 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 >> v1:172.21.15.29:6789/0 conn(0x7f7f1406f150 legacy=0x7f7f140ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7efc0039f0 0x7f7efc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc004810 0x7f7efc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7efc0051d0 0x7f7efc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7f14159380 con 0x7f7efc0039f0 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc00c080 con 0x7f7efc004810 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7efc00c280 con 0x7f7efc0051d0 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f14153190 0x7f7f14159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7efc0039f0 0x7f7efc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f1359e640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7efc0051d0 0x7f7efc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f1259c640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc004810 0x7f7efc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 -- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7efc0051d0 msgr2=0x7f7efc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7efc0051d0 0x7f7efc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 -- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc004810 msgr2=0x7f7efc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:20.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc004810 0x7f7efc004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 -- 172.21.15.29:0/2555120194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc003530 con 0x7f7efc0039f0 2024-04-23T10:16:20.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7efc0039f0 0x7f7efc003e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f140ca230 tx=0x7f7f0401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4352ec7664fa07c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400f040 con 0x7f7efc0039f0 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f040b0070 con 0x7f7efc0039f0 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.702+0000 7f7f11d9b640 1 -- 172.21.15.29:0/2555120194 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f040ab880 con 0x7f7efc0039f0 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- 172.21.15.29:0/2555120194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7efc0039f0 msgr2=0x7f7efc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 --2- 172.21.15.29:0/2555120194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7efc0039f0 0x7f7efc003e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f140ca230 tx=0x7f7f0401c410 comp rx=0 tx=0).stop 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1359e640 1 -- 172.21.15.29:0/2555120194 reap_dead start 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- 172.21.15.29:0/2555120194 shutdown_connections 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- 172.21.15.29:0/2555120194 >> 172.21.15.29:0/2555120194 conn(0x7f7f1406cfb0 msgr2=0x7f7f1406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- 172.21.15.29:0/2555120194 shutdown_connections 2024-04-23T10:16:20.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- 172.21.15.29:0/2555120194 wait complete. 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 Processor -- start 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- start start 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc0039f0 0x7f7f1414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f1414c6e0 0x7f7f1415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f141ec830 0x7f7f141eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7f140c4880 con 0x7f7f1414c6e0 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7f14153570 con 0x7f7efc0039f0 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7f140c9070 con 0x7f7f141ec830 2024-04-23T10:16:20.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f1414c6e0 0x7f7f1415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f1414c6e0 0x7f7f1415c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58876/0 (socket says 172.21.15.29:58876) 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 -- 172.21.15.29:0/4130030162 learned_addr learned my addr 172.21.15.29:0/4130030162 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc0039f0 0x7f7f1414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1359e640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f141ec830 0x7f7f141eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 -- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f141ec830 msgr2=0x7f7f141eccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f141ec830 0x7f7f141eccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 -- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc0039f0 msgr2=0x7f7f1414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc0039f0 0x7f7f1414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 -- 172.21.15.29:0/4130030162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f141ed200 con 0x7f7f1414c6e0 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1359e640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f141ec830 0x7f7f141eccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:20.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1259c640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f1414c6e0 0x7f7f1415c760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7f08010c60 tx=0x7f7f0800e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7efb7fe640 1 -- 172.21.15.29:0/4130030162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0801b070 con 0x7f7f1414c6e0 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7efb7fe640 1 -- 172.21.15.29:0/4130030162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f08011040 con 0x7f7f1414c6e0 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1415d0a0 con 0x7f7f1414c6e0 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7efb7fe640 1 -- 172.21.15.29:0/4130030162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f080143a0 con 0x7f7f1414c6e0 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.706+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f141f0120 con 0x7f7f1414c6e0 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.710+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f14068d70 con 0x7f7f1414c6e0 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.710+0000 7f7efb7fe640 1 -- 172.21.15.29:0/4130030162 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f0801e070 con 0x7f7f1414c6e0 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.710+0000 7f7efb7fe640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7f000683b0 0x7f7f0006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:20.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.710+0000 7f7efb7fe640 1 -- 172.21.15.29:0/4130030162 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7f080898a0 con 0x7f7f1414c6e0 2024-04-23T10:16:20.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.710+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7f000683b0 0x7f7f0006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:20.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.710+0000 7f7f12d9d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7f000683b0 0x7f7f0006a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f040af000 tx=0x7f7f040046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:20.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.714+0000 7f7efb7fe640 1 -- 172.21.15.29:0/4130030162 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f08059430 con 0x7f7f1414c6e0 2024-04-23T10:16:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7f14156920 con 0x7f7f1414c6e0 2024-04-23T10:16:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7efb7fe640 1 -- 172.21.15.29:0/4130030162 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f7f0805d730 con 0x7f7f1414c6e0 2024-04-23T10:16:20.872 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:16:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7f000683b0 msgr2=0x7f7f0006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7f000683b0 0x7f7f0006a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f040af000 tx=0x7f7f040046d0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f1414c6e0 msgr2=0x7f7f1415c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f1414c6e0 0x7f7f1415c760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7f08010c60 tx=0x7f7f0800e4d0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 shutdown_connections 2024-04-23T10:16:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7f000683b0 0x7f7f0006a870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f141ec830 0x7f7f141eccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f1414c6e0 0x7f7f1415c760 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 --2- 172.21.15.29:0/4130030162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7efc0039f0 0x7f7f1414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 >> 172.21.15.29:0/4130030162 conn(0x7f7f1406cfb0 msgr2=0x7f7f1406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 shutdown_connections 2024-04-23T10:16:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:20.870+0000 7f7f1915d640 1 -- 172.21.15.29:0/4130030162 wait complete. 2024-04-23T10:16:20.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:16:21.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfceb99640 1 Processor -- start 2024-04-23T10:16:21.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfceb99640 1 -- start start 2024-04-23T10:16:21.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfceb99640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfc806f3b0 0x7fcfc80c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfceb99640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc80c7600 0x7fcfc8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfceb99640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc815eae0 con 0x7fcfc80c8950 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfceb99640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc8073b70 con 0x7fcfc806f3b0 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfceb99640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc815edc0 con 0x7fcfc80c7600 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcc935640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfc806f3b0 0x7fcfc80c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcc935640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfc806f3b0 0x7fcfc80c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58884/0 (socket says 172.21.15.29:58884) 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcc935640 1 -- 172.21.15.29:0/1143847972 learned_addr learned my addr 172.21.15.29:0/1143847972 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcd136640 1 --2- 172.21.15.29:0/1143847972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc80c7600 0x7fcfc8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcc935640 1 -- 172.21.15.29:0/1143847972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc80c7600 msgr2=0x7fcfc8071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcc935640 1 --2- 172.21.15.29:0/1143847972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc80c7600 0x7fcfc8071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcc935640 1 -- 172.21.15.29:0/1143847972 >> v1:172.21.15.29:6789/0 conn(0x7fcfc80c8950 legacy=0x7fcfc8154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcc935640 1 -- 172.21.15.29:0/1143847972 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc815f0a0 con 0x7fcfc806f3b0 2024-04-23T10:16:21.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.018+0000 7fcfcd136640 1 --2- 172.21.15.29:0/1143847972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc80c7600 0x7fcfc8071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:21.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcc935640 1 --2- 172.21.15.29:0/1143847972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc806f3b0 0x7fcfc80c70c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009870 tx=0x7fcfb801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43680d8bbb039890 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfc77fe640 1 -- 172.21.15.29:0/1143847972 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80b5070 con 0x7fcfc806f3b0 2024-04-23T10:16:21.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfc77fe640 1 -- 172.21.15.29:0/1143847972 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb80a8a50 con 0x7fcfc806f3b0 2024-04-23T10:16:21.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfc77fe640 1 -- 172.21.15.29:0/1143847972 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80a8e20 con 0x7fcfc806f3b0 2024-04-23T10:16:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- 172.21.15.29:0/1143847972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc806f3b0 msgr2=0x7fcfc80c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 --2- 172.21.15.29:0/1143847972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc806f3b0 0x7fcfc80c70c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009870 tx=0x7fcfb801ed50 comp rx=0 tx=0).stop 2024-04-23T10:16:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- 172.21.15.29:0/1143847972 shutdown_connections 2024-04-23T10:16:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 --2- 172.21.15.29:0/1143847972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc80c7600 0x7fcfc8071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 --2- 172.21.15.29:0/1143847972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc806f3b0 0x7fcfc80c70c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- 172.21.15.29:0/1143847972 >> 172.21.15.29:0/1143847972 conn(0x7fcfc806cfb0 msgr2=0x7fcfc806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- 172.21.15.29:0/1143847972 shutdown_connections 2024-04-23T10:16:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- 172.21.15.29:0/1143847972 wait complete. 2024-04-23T10:16:21.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 Processor -- start 2024-04-23T10:16:21.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- start start 2024-04-23T10:16:21.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc806f3b0 0x7fcfc80cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc80c7600 0x7fcfc8146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc80c8950 0x7fcfc81f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8071960 con 0x7fcfc80c8950 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc815f660 con 0x7fcfc80c7600 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfceb99640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc815e780 con 0x7fcfc806f3b0 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc80c8950 0x7fcfc81f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc80c8950 0x7fcfc81f1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58898/0 (socket says 172.21.15.29:58898) 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 -- 172.21.15.29:0/2343152723 learned_addr learned my addr 172.21.15.29:0/2343152723 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfc7fff640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc80c7600 0x7fcfc8146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcc935640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc806f3b0 0x7fcfc80cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 -- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc806f3b0 msgr2=0x7fcfc80cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc806f3b0 0x7fcfc80cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 -- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc80c7600 msgr2=0x7fcfc8146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc80c7600 0x7fcfc8146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 -- 172.21.15.29:0/2343152723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc814c7e0 con 0x7fcfc80c8950 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcc935640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc806f3b0 0x7fcfc80cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfcd136640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc80c8950 0x7fcfc81f1310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000cf20 tx=0x7fcfc000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfc57fa640 1 -- 172.21.15.29:0/2343152723 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc001a070 con 0x7fcfc80c8950 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.022+0000 7fcfc57fa640 1 -- 172.21.15.29:0/2343152723 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc000d840 con 0x7fcfc80c8950 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc814bf40 con 0x7fcfc80c8950 2024-04-23T10:16:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfc57fa640 1 -- 172.21.15.29:0/2343152723 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc000dc30 con 0x7fcfc80c8950 2024-04-23T10:16:21.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc814c500 con 0x7fcfc80c8950 2024-04-23T10:16:21.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc8068d70 con 0x7fcfc80c8950 2024-04-23T10:16:21.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfc57fa640 1 -- 172.21.15.29:0/2343152723 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcfc001d070 con 0x7fcfc80c8950 2024-04-23T10:16:21.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfc57fa640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcfb4068380 0x7fcfb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfc57fa640 1 -- 172.21.15.29:0/2343152723 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcfc0087520 con 0x7fcfc80c8950 2024-04-23T10:16:21.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfcc935640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcfb4068380 0x7fcfb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.026+0000 7fcfcc935640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcfb4068380 0x7fcfb406a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80b2000 tx=0x7fcfb80aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.030+0000 7fcfc57fa640 1 -- 172.21.15.29:0/2343152723 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcfc0057810 con 0x7fcfc80c8950 2024-04-23T10:16:21.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.194+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcfc80c7a60 con 0x7fcfc80c8950 2024-04-23T10:16:21.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.194+0000 7fcfc57fa640 1 -- 172.21.15.29:0/2343152723 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fcfc0057110 con 0x7fcfc80c8950 2024-04-23T10:16:21.197 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:21.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcfb4068380 msgr2=0x7fcfb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcfb4068380 0x7fcfb406a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80b2000 tx=0x7fcfb80aa070 comp rx=0 tx=0).stop 2024-04-23T10:16:21.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc80c8950 msgr2=0x7fcfc81f1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc80c8950 0x7fcfc81f1310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000cf20 tx=0x7fcfc000a7d0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 shutdown_connections 2024-04-23T10:16:21.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcfb4068380 0x7fcfb406a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfc80c8950 0x7fcfc81f1310 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfc80c7600 0x7fcfc8146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 --2- 172.21.15.29:0/2343152723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcfc806f3b0 0x7fcfc80cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 >> 172.21.15.29:0/2343152723 conn(0x7fcfc806cfb0 msgr2=0x7fcfc8074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:21.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 shutdown_connections 2024-04-23T10:16:21.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.198+0000 7fcfceb99640 1 -- 172.21.15.29:0/2343152723 wait complete. 2024-04-23T10:16:21.217 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:16:21.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.342+0000 7f7254d7b640 1 Processor -- start 2024-04-23T10:16:21.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.342+0000 7f7254d7b640 1 -- start start 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f7254d7b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 0x7f72500c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f7254d7b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72500c8910 0x7f725015e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f7254d7b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72500c7fe0 con 0x7f7250155390 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f7254d7b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f725015bf20 con 0x7f72500c8910 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f7254d7b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f725006e600 con 0x7f72500c7bc0 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f724ed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72500c8910 0x7f725015e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f724ed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72500c8910 0x7f725015e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58904/0 (socket says 172.21.15.29:58904) 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f724ed9d640 1 -- 172.21.15.29:0/3369711816 learned_addr learned my addr 172.21.15.29:0/3369711816 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f724dd9b640 1 --2- 172.21.15.29:0/3369711816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 0x7f72500c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f724ed9d640 1 -- 172.21.15.29:0/3369711816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 msgr2=0x7f72500c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:21.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f724ed9d640 1 --2- 172.21.15.29:0/3369711816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 0x7f72500c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f724ed9d640 1 -- 172.21.15.29:0/3369711816 >> v1:172.21.15.72:6789/0 conn(0x7f7250155390 legacy=0x7f725006dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.346+0000 7f724ed9d640 1 -- 172.21.15.29:0/3369711816 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725015b310 con 0x7f72500c8910 2024-04-23T10:16:21.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f724ed9d640 1 --2- 172.21.15.29:0/3369711816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72500c8910 0x7f725015e840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7248009e50 tx=0x7f724801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a12fd11e0ff1241 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f724d59a640 1 -- 172.21.15.29:0/3369711816 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480b4070 con 0x7f72500c8910 2024-04-23T10:16:21.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f724d59a640 1 -- 172.21.15.29:0/3369711816 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480af400 con 0x7f72500c8910 2024-04-23T10:16:21.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f724d59a640 1 -- 172.21.15.29:0/3369711816 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480af7d0 con 0x7f72500c8910 2024-04-23T10:16:21.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 -- 172.21.15.29:0/3369711816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72500c8910 msgr2=0x7f725015e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 --2- 172.21.15.29:0/3369711816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72500c8910 0x7f725015e840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7248009e50 tx=0x7f724801f210 comp rx=0 tx=0).stop 2024-04-23T10:16:21.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 -- 172.21.15.29:0/3369711816 shutdown_connections 2024-04-23T10:16:21.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 --2- 172.21.15.29:0/3369711816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72500c8910 0x7f725015e840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 --2- 172.21.15.29:0/3369711816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 0x7f72500c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 -- 172.21.15.29:0/3369711816 >> 172.21.15.29:0/3369711816 conn(0x7f72500c9e20 msgr2=0x7f72500ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:21.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 -- 172.21.15.29:0/3369711816 shutdown_connections 2024-04-23T10:16:21.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 -- 172.21.15.29:0/3369711816 wait complete. 2024-04-23T10:16:21.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 Processor -- start 2024-04-23T10:16:21.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.354+0000 7f7254d7b640 1 -- start start 2024-04-23T10:16:21.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 0x7f72501f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72500c8910 0x7f725015d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7250155390 0x7f72500b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f725015bbb0 con 0x7f7250155390 2024-04-23T10:16:21.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f725015b8d0 con 0x7f72500c8910 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7250155770 con 0x7f72500c7bc0 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7250155390 0x7f72500b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7250155390 0x7f72500b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58906/0 (socket says 172.21.15.29:58906) 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 -- 172.21.15.29:0/357071899 learned_addr learned my addr 172.21.15.29:0/357071899 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724e59c640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 0x7f72501f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724dd9b640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72500c8910 0x7f725015d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 -- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 msgr2=0x7f72501f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 0x7f72501f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 -- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72500c8910 msgr2=0x7f725015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72500c8910 0x7f725015d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 -- 172.21.15.29:0/357071899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725015e4a0 con 0x7f7250155390 2024-04-23T10:16:21.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724dd9b640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72500c8910 0x7f725015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:21.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724ed9d640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7250155390 0x7f72500b0a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f724801ce40 tx=0x7f724801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f723effd640 1 -- 172.21.15.29:0/357071899 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480b4040 con 0x7f7250155390 2024-04-23T10:16:21.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f723effd640 1 -- 172.21.15.29:0/357071899 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480090d0 con 0x7f7250155390 2024-04-23T10:16:21.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72500c5a70 con 0x7f7250155390 2024-04-23T10:16:21.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f723effd640 1 -- 172.21.15.29:0/357071899 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7248009510 con 0x7f7250155390 2024-04-23T10:16:21.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72500b0200 con 0x7f7250155390 2024-04-23T10:16:21.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7250068d70 con 0x7f7250155390 2024-04-23T10:16:21.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f723effd640 1 -- 172.21.15.29:0/357071899 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72480a8d10 con 0x7f7250155390 2024-04-23T10:16:21.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f723effd640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7230068380 0x7f723006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f723effd640 1 -- 172.21.15.29:0/357071899 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7248124540 con 0x7f7250155390 2024-04-23T10:16:21.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.358+0000 7f724e59c640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7230068380 0x7f723006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.362+0000 7f724e59c640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7230068380 0x7f723006a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7240001650 tx=0x7f7240009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.366+0000 7f723effd640 1 -- 172.21.15.29:0/357071899 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7248018d70 con 0x7f7250155390 2024-04-23T10:16:21.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.522+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f72500c81b0 con 0x7f7250155390 2024-04-23T10:16:21.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.522+0000 7f723effd640 1 -- 172.21.15.29:0/357071899 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f72480f4800 con 0x7f7250155390 2024-04-23T10:16:21.525 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:16:21.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7230068380 msgr2=0x7f723006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7230068380 0x7f723006a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7240001650 tx=0x7f7240009040 comp rx=0 tx=0).stop 2024-04-23T10:16:21.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7250155390 msgr2=0x7f72500b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7250155390 0x7f72500b0a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f724801ce40 tx=0x7f724801bfb0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 shutdown_connections 2024-04-23T10:16:21.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7230068380 0x7f723006a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7250155390 0x7f72500b0a00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72500c8910 0x7f725015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 --2- 172.21.15.29:0/357071899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72500c7bc0 0x7f72501f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 >> 172.21.15.29:0/357071899 conn(0x7f72500c9e20 msgr2=0x7f7250072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:21.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 shutdown_connections 2024-04-23T10:16:21.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.526+0000 7f7254d7b640 1 -- 172.21.15.29:0/357071899 wait complete. 2024-04-23T10:16:21.543 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:16:21.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84c100b640 1 Processor -- start 2024-04-23T10:16:21.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84c100b640 1 -- start start 2024-04-23T10:16:21.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84c100b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84bc0ce960 0x7f84bc0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84c100b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f84bc0ced40 0x7f84bc0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84c100b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84bc073b70 con 0x7f84bc074380 2024-04-23T10:16:21.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84c100b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc0740f0 con 0x7f84bc0ced40 2024-04-23T10:16:21.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84c100b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc073e10 con 0x7f84bc0ce960 2024-04-23T10:16:21.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84ba59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f84bc0ced40 0x7f84bc0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84bad9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84bc0ce960 0x7f84bc0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84bb59e640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f84bc074380 0x7f84bc152c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:33548/0 (socket says 172.21.15.29:33548) 2024-04-23T10:16:21.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84bb59e640 1 -- 172.21.15.29:0/897770126 learned_addr learned my addr 172.21.15.29:0/897770126 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:21.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84ba59c640 1 -- 172.21.15.29:0/897770126 >> v2:172.21.15.72:3300/0 conn(0x7f84bc0ce960 msgr2=0x7f84bc0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:21.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84ba59c640 1 --2- 172.21.15.29:0/897770126 >> v2:172.21.15.72:3300/0 conn(0x7f84bc0ce960 0x7f84bc0c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84ba59c640 1 -- 172.21.15.29:0/897770126 >> v1:172.21.15.72:6789/0 conn(0x7f84bc074380 legacy=0x7f84bc152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.662+0000 7f84ba59c640 1 -- 172.21.15.29:0/897770126 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc0ca8d0 con 0x7f84bc0ced40 2024-04-23T10:16:21.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84ba59c640 1 --2- 172.21.15.29:0/897770126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc0ced40 0x7f84bc0cb3e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f84bc074270 tx=0x7f84ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a464bb0710d55ad7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84b9d9b640 1 -- 172.21.15.29:0/897770126 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0b0070 con 0x7f84bc0ced40 2024-04-23T10:16:21.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84b9d9b640 1 -- 172.21.15.29:0/897770126 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac004230 con 0x7f84bc0ced40 2024-04-23T10:16:21.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84b9d9b640 1 -- 172.21.15.29:0/897770126 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac003620 con 0x7f84bc0ced40 2024-04-23T10:16:21.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 -- 172.21.15.29:0/897770126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc0ced40 msgr2=0x7f84bc0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 --2- 172.21.15.29:0/897770126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc0ced40 0x7f84bc0cb3e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f84bc074270 tx=0x7f84ac01c460 comp rx=0 tx=0).stop 2024-04-23T10:16:21.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 -- 172.21.15.29:0/897770126 shutdown_connections 2024-04-23T10:16:21.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 --2- 172.21.15.29:0/897770126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc0ced40 0x7f84bc0cb3e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 --2- 172.21.15.29:0/897770126 >> v2:172.21.15.72:3300/0 conn(0x7f84bc0ce960 0x7f84bc0c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 -- 172.21.15.29:0/897770126 >> 172.21.15.29:0/897770126 conn(0x7f84bc070f60 msgr2=0x7f84bc071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:21.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 -- 172.21.15.29:0/897770126 shutdown_connections 2024-04-23T10:16:21.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 -- 172.21.15.29:0/897770126 wait complete. 2024-04-23T10:16:21.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 Processor -- start 2024-04-23T10:16:21.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.666+0000 7f84c100b640 1 -- start start 2024-04-23T10:16:21.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc074380 0x7f84bc13fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84bc0ce960 0x7f84bc1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84bc0ced40 0x7f84bc148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0cbcf0 con 0x7f84bc074380 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0cbb70 con 0x7f84bc0ced40 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc166030 con 0x7f84bc0ce960 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc074380 0x7f84bc13fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc074380 0x7f84bc13fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58928/0 (socket says 172.21.15.29:58928) 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 -- 172.21.15.29:0/1149502837 learned_addr learned my addr 172.21.15.29:0/1149502837 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:21.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bb59e640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84bc0ced40 0x7f84bc148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84ba59c640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84bc0ce960 0x7f84bc1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 -- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84bc0ce960 msgr2=0x7f84bc1487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84bc0ce960 0x7f84bc1487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 -- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84bc0ced40 msgr2=0x7f84bc148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84bc0ced40 0x7f84bc148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 -- 172.21.15.29:0/1149502837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc1425e0 con 0x7f84bc074380 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84bad9d640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc074380 0x7f84bc13fe50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f84b000e960 tx=0x7f84b000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84a37fe640 1 -- 172.21.15.29:0/1149502837 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0017070 con 0x7f84bc074380 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84a37fe640 1 -- 172.21.15.29:0/1149502837 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b000ca00 con 0x7f84bc074380 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc1473f0 con 0x7f84bc074380 2024-04-23T10:16:21.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84a37fe640 1 -- 172.21.15.29:0/1149502837 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b000cdb0 con 0x7f84bc074380 2024-04-23T10:16:21.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc142df0 con 0x7f84bc074380 2024-04-23T10:16:21.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84bc0693c0 con 0x7f84bc074380 2024-04-23T10:16:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84a37fe640 1 -- 172.21.15.29:0/1149502837 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84b001a070 con 0x7f84bc074380 2024-04-23T10:16:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84a37fe640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f84a8068380 0x7f84a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84a37fe640 1 -- 172.21.15.29:0/1149502837 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f84b00874c0 con 0x7f84bc074380 2024-04-23T10:16:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.670+0000 7f84ba59c640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f84a8068380 0x7f84a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.674+0000 7f84ba59c640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f84a8068380 0x7f84a806a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0ad000 tx=0x7f84ac0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.674+0000 7f84a37fe640 1 -- 172.21.15.29:0/1149502837 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84b0057820 con 0x7f84bc074380 2024-04-23T10:16:21.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.838+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f84bc0cc7d0 con 0x7f84bc074380 2024-04-23T10:16:21.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84a37fe640 1 -- 172.21.15.29:0/1149502837 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f84b0057120 con 0x7f84bc074380 2024-04-23T10:16:21.843 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f84a8068380 msgr2=0x7f84a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f84a8068380 0x7f84a806a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0ad000 tx=0x7f84ac0a6000 comp rx=0 tx=0).stop 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc074380 msgr2=0x7f84bc13fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc074380 0x7f84bc13fe50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f84b000e960 tx=0x7f84b000ee20 comp rx=0 tx=0).stop 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 shutdown_connections 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f84a8068380 0x7f84a806a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84bc0ced40 0x7f84bc148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84bc0ce960 0x7f84bc1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 --2- 172.21.15.29:0/1149502837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84bc074380 0x7f84bc13fe50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 >> 172.21.15.29:0/1149502837 conn(0x7f84bc070f60 msgr2=0x7f84bc071340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:21.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 shutdown_connections 2024-04-23T10:16:21.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.842+0000 7f84c100b640 1 -- 172.21.15.29:0/1149502837 wait complete. 2024-04-23T10:16:21.862 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb446f640 1 Processor -- start 2024-04-23T10:16:21.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb446f640 1 -- start start 2024-04-23T10:16:21.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb446f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbac074fc0 0x7ffbac15cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb446f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffbac15d3e0 0x7ffbac0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb446f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac0753a0 0x7ffbac152e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb446f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ffbac0cd630 con 0x7ffbac074fc0 2024-04-23T10:16:21.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb446f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ffbac15ca10 con 0x7ffbac15d3e0 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb446f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffbac0cd860 con 0x7ffbac0753a0 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb220b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbac074fc0 0x7ffbac15cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb220b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbac074fc0 0x7ffbac15cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58934/0 (socket says 172.21.15.29:58934) 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb220b640 1 -- 172.21.15.29:0/481394686 learned_addr learned my addr 172.21.15.29:0/481394686 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb1a0a640 1 --2- 172.21.15.29:0/481394686 >> v2:172.21.15.72:3300/0 conn(0x7ffbac15d3e0 0x7ffbac0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb2a0c640 1 --2- 172.21.15.29:0/481394686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac0753a0 0x7ffbac152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb220b640 1 -- 172.21.15.29:0/481394686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac0753a0 msgr2=0x7ffbac152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb220b640 1 --2- 172.21.15.29:0/481394686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac0753a0 0x7ffbac152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb220b640 1 -- 172.21.15.29:0/481394686 >> v2:172.21.15.72:3300/0 conn(0x7ffbac15d3e0 msgr2=0x7ffbac0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb220b640 1 --2- 172.21.15.29:0/481394686 >> v2:172.21.15.72:3300/0 conn(0x7ffbac15d3e0 0x7ffbac0ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.982+0000 7ffbb220b640 1 -- 172.21.15.29:0/481394686 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac0cdb20 con 0x7ffbac074fc0 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb220b640 1 --2- 172.21.15.29:0/481394686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac074fc0 0x7ffbac15cea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0747f0 tx=0x7ffba801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f392eee218ba7f4f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb1209640 1 -- 172.21.15.29:0/481394686 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80b5070 con 0x7ffbac074fc0 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb1209640 1 -- 172.21.15.29:0/481394686 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba80a89d0 con 0x7ffbac074fc0 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb1209640 1 -- 172.21.15.29:0/481394686 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80a8da0 con 0x7ffbac074fc0 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 -- 172.21.15.29:0/481394686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac074fc0 msgr2=0x7ffbac15cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 --2- 172.21.15.29:0/481394686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac074fc0 0x7ffbac15cea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0747f0 tx=0x7ffba801ed10 comp rx=0 tx=0).stop 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 -- 172.21.15.29:0/481394686 shutdown_connections 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 --2- 172.21.15.29:0/481394686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac0753a0 0x7ffbac152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 --2- 172.21.15.29:0/481394686 >> v2:172.21.15.72:3300/0 conn(0x7ffbac15d3e0 0x7ffbac0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 --2- 172.21.15.29:0/481394686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac074fc0 0x7ffbac15cea0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 -- 172.21.15.29:0/481394686 >> 172.21.15.29:0/481394686 conn(0x7ffbac06b9e0 msgr2=0x7ffbac06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 -- 172.21.15.29:0/481394686 shutdown_connections 2024-04-23T10:16:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.986+0000 7ffbb446f640 1 -- 172.21.15.29:0/481394686 wait complete. 2024-04-23T10:16:21.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 Processor -- start 2024-04-23T10:16:21.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 -- start start 2024-04-23T10:16:21.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbac074fc0 0x7ffbac1e5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac0753a0 0x7ffbac14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac15d3e0 0x7ffbac1e3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac0ce3c0 con 0x7ffbac0753a0 2024-04-23T10:16:21.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac0ce0e0 con 0x7ffbac074fc0 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffbac15c6a0 con 0x7ffbac15d3e0 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac0753a0 0x7ffbac14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac0753a0 0x7ffbac14daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58936/0 (socket says 172.21.15.29:58936) 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 -- 172.21.15.29:0/85856914 learned_addr learned my addr 172.21.15.29:0/85856914 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb220b640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbac074fc0 0x7ffbac1e5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb2a0c640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac15d3e0 0x7ffbac1e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 -- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac15d3e0 msgr2=0x7ffbac1e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac15d3e0 0x7ffbac1e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 -- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbac074fc0 msgr2=0x7ffbac1e5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbac074fc0 0x7ffbac1e5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 -- 172.21.15.29:0/85856914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac1e4dd0 con 0x7ffbac0753a0 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb1a0a640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac0753a0 0x7ffbac14daf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00e900 tx=0x7ffb9c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffba2ffd640 1 -- 172.21.15.29:0/85856914 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c017070 con 0x7ffbac0753a0 2024-04-23T10:16:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffba2ffd640 1 -- 172.21.15.29:0/85856914 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9c00ca00 con 0x7ffbac0753a0 2024-04-23T10:16:21.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffba2ffd640 1 -- 172.21.15.29:0/85856914 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00cdf0 con 0x7ffbac0753a0 2024-04-23T10:16:21.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac1e4810 con 0x7ffbac0753a0 2024-04-23T10:16:21.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbac1e25a0 con 0x7ffbac0753a0 2024-04-23T10:16:21.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbac0693c0 con 0x7ffbac0753a0 2024-04-23T10:16:21.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.990+0000 7ffba2ffd640 1 -- 172.21.15.29:0/85856914 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb9c01a070 con 0x7ffbac0753a0 2024-04-23T10:16:21.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.994+0000 7ffba2ffd640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb900683b0 0x7ffb9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:21.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.994+0000 7ffba2ffd640 1 -- 172.21.15.29:0/85856914 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffb9c086bc0 con 0x7ffbac0753a0 2024-04-23T10:16:21.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.994+0000 7ffbb220b640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb900683b0 0x7ffb9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:21.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.994+0000 7ffbb220b640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb900683b0 0x7ffb9006a870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffba80b2000 tx=0x7ffba8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:21.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:21.998+0000 7ffba2ffd640 1 -- 172.21.15.29:0/85856914 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb9c0567f0 con 0x7ffbac0753a0 2024-04-23T10:16:22.056 INFO:tasks.ceph.mds.f.smithi072.stderr:2024-04-23T10:16:22.053+0000 7fe6e021a640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-23T10:16:22.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbac0cafa0 con 0x7ffbac0753a0 2024-04-23T10:16:22.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffba2ffd640 1 -- 172.21.15.29:0/85856914 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7ffb9c05aaf0 con 0x7ffbac0753a0 2024-04-23T10:16:22.203 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:22.203 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:16:22.204 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb900683b0 msgr2=0x7ffb9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb900683b0 0x7ffb9006a870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffba80b2000 tx=0x7ffba8009040 comp rx=0 tx=0).stop 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac0753a0 msgr2=0x7ffbac14daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac0753a0 0x7ffbac14daf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00e900 tx=0x7ffb9c00edc0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 shutdown_connections 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb900683b0 0x7ffb9006a870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbac15d3e0 0x7ffbac1e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbac0753a0 0x7ffbac14daf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 --2- 172.21.15.29:0/85856914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbac074fc0 0x7ffbac1e5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 >> 172.21.15.29:0/85856914 conn(0x7ffbac06b9e0 msgr2=0x7ffbac152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:22.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 shutdown_connections 2024-04-23T10:16:22.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.202+0000 7ffbb446f640 1 -- 172.21.15.29:0/85856914 wait complete. 2024-04-23T10:16:22.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b45fc640 1 Processor -- start 2024-04-23T10:16:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b45fc640 1 -- start start 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b45fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83ac152fd0 0x7f83ac0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b45fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac0ca120 0x7f83ac073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b45fc640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ac0744f0 con 0x7f83ac074070 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b45fc640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f83ac0c9620 con 0x7f83ac152fd0 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b45fc640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac0c7c60 con 0x7f83ac0ca120 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b1b97640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac0ca120 0x7f83ac073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b2398640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83ac152fd0 0x7f83ac0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b1b97640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac0ca120 0x7f83ac073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:52986/0 (socket says 172.21.15.29:52986) 2024-04-23T10:16:22.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b1b97640 1 -- 172.21.15.29:0/98735195 learned_addr learned my addr 172.21.15.29:0/98735195 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b1b97640 1 -- 172.21.15.29:0/98735195 >> v2:172.21.15.72:3300/0 conn(0x7f83ac152fd0 msgr2=0x7f83ac0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b1b97640 1 --2- 172.21.15.29:0/98735195 >> v2:172.21.15.72:3300/0 conn(0x7f83ac152fd0 0x7f83ac0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b1b97640 1 -- 172.21.15.29:0/98735195 >> v1:172.21.15.72:6789/0 conn(0x7f83ac074070 legacy=0x7f83ac06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b1b97640 1 -- 172.21.15.29:0/98735195 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0c8cf0 con 0x7f83ac0ca120 2024-04-23T10:16:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.334+0000 7f83b2398640 1 --2- 172.21.15.29:0/98735195 >> v2:172.21.15.72:3300/0 conn(0x7f83ac152fd0 0x7f83ac0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b1b97640 1 --2- 172.21.15.29:0/98735195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac0ca120 0x7f83ac073b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f839c009870 tx=0x7f839c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4073c2b9de1c7ed4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b1396640 1 -- 172.21.15.29:0/98735195 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0b2070 con 0x7f83ac0ca120 2024-04-23T10:16:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b1396640 1 -- 172.21.15.29:0/98735195 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c0a9070 con 0x7f83ac0ca120 2024-04-23T10:16:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b1396640 1 -- 172.21.15.29:0/98735195 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0ad880 con 0x7f83ac0ca120 2024-04-23T10:16:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- 172.21.15.29:0/98735195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac0ca120 msgr2=0x7f83ac073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 --2- 172.21.15.29:0/98735195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac0ca120 0x7f83ac073b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f839c009870 tx=0x7f839c01c560 comp rx=0 tx=0).stop 2024-04-23T10:16:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- 172.21.15.29:0/98735195 shutdown_connections 2024-04-23T10:16:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 --2- 172.21.15.29:0/98735195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac0ca120 0x7f83ac073b30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 --2- 172.21.15.29:0/98735195 >> v2:172.21.15.72:3300/0 conn(0x7f83ac152fd0 0x7f83ac0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- 172.21.15.29:0/98735195 >> 172.21.15.29:0/98735195 conn(0x7f83ac074f90 msgr2=0x7f83ac0753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- 172.21.15.29:0/98735195 shutdown_connections 2024-04-23T10:16:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- 172.21.15.29:0/98735195 wait complete. 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 Processor -- start 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- start start 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac074070 0x7f83ac0c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ac0ca120 0x7f83ac1539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83ac152fd0 0x7f83ac1f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac0c78b0 con 0x7f83ac152fd0 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1533b0 con 0x7f83ac0ca120 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac1f42c0 con 0x7f83ac074070 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83ac152fd0 0x7f83ac1f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83ac152fd0 0x7f83ac1f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58944/0 (socket says 172.21.15.29:58944) 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 -- 172.21.15.29:0/3031528881 learned_addr learned my addr 172.21.15.29:0/3031528881 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:22.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b1b97640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ac0ca120 0x7f83ac1539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2398640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac074070 0x7f83ac0c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 -- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac074070 msgr2=0x7f83ac0c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac074070 0x7f83ac0c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 -- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ac0ca120 msgr2=0x7f83ac1539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ac0ca120 0x7f83ac1539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 -- 172.21.15.29:0/3031528881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0757d0 con 0x7f83ac152fd0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b2b99640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83ac152fd0 0x7f83ac1f4750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c730 tx=0x7f83a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83a2ffd640 1 -- 172.21.15.29:0/3031528881 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4016020 con 0x7f83ac152fd0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83a2ffd640 1 -- 172.21.15.29:0/3031528881 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a4006d80 con 0x7f83ac152fd0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83a2ffd640 1 -- 172.21.15.29:0/3031528881 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4003bc0 con 0x7f83ac152fd0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.338+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac154430 con 0x7f83ac152fd0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.342+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac154990 con 0x7f83ac152fd0 2024-04-23T10:16:22.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.342+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ac0693c0 con 0x7f83ac152fd0 2024-04-23T10:16:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.342+0000 7f83a2ffd640 1 -- 172.21.15.29:0/3031528881 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f83a400a850 con 0x7f83ac152fd0 2024-04-23T10:16:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.342+0000 7f83a2ffd640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8390068380 0x7f839006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.342+0000 7f83a2ffd640 1 -- 172.21.15.29:0/3031528881 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f83a4086840 con 0x7f83ac152fd0 2024-04-23T10:16:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.342+0000 7f83b2398640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8390068380 0x7f839006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.342+0000 7f83b2398640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8390068380 0x7f839006a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009580 tx=0x7f83a8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.346+0000 7f83a2ffd640 1 -- 172.21.15.29:0/3031528881 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83a4020020 con 0x7f83ac152fd0 2024-04-23T10:16:22.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.506+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83ac068d70 con 0x7f83ac152fd0 2024-04-23T10:16:22.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83a2ffd640 1 -- 172.21.15.29:0/3031528881 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18442 (secure 0 0 0) 0x7f83ac0744f0 con 0x7f83ac152fd0 2024-04-23T10:16:22.512 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:22.512 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":24,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:15:42.438639+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8390068380 msgr2=0x7f839006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8390068380 0x7f839006a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009580 tx=0x7f83a8009190 comp rx=0 tx=0).stop 2024-04-23T10:16:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83ac152fd0 msgr2=0x7f83ac1f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83ac152fd0 0x7f83ac1f4750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c730 tx=0x7f83a400cbf0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 shutdown_connections 2024-04-23T10:16:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8390068380 0x7f839006a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83ac152fd0 0x7f83ac1f4750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83ac0ca120 0x7f83ac1539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 --2- 172.21.15.29:0/3031528881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83ac074070 0x7f83ac0c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.510+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 >> 172.21.15.29:0/3031528881 conn(0x7f83ac074f90 msgr2=0x7f83ac1587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.514+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 shutdown_connections 2024-04-23T10:16:22.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.514+0000 7f83b45fc640 1 -- 172.21.15.29:0/3031528881 wait complete. 2024-04-23T10:16:22.530 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:22.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.646+0000 7f8e63c83640 1 Processor -- start 2024-04-23T10:16:22.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.646+0000 7f8e63c83640 1 -- start start 2024-04-23T10:16:22.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e63c83640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 0x7f8e5c159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e63c83640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e5c0cd360 0x7f8e5c06f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e63c83640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c0c3fe0 con 0x7f8e5c06f150 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e63c83640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8e5c159380 con 0x7f8e5c0cd360 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e63c83640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c0c42c0 con 0x7f8e5c153190 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e6121e640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8e5c06f150 0x7f8e5c0ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:33576/0 (socket says 172.21.15.29:33576) 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e6121e640 1 -- 172.21.15.29:0/4078485239 learned_addr learned my addr 172.21.15.29:0/4078485239 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e62220640 1 --2- 172.21.15.29:0/4078485239 >> v2:172.21.15.72:3300/0 conn(0x7f8e5c0cd360 0x7f8e5c06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e61a1f640 1 --2- 172.21.15.29:0/4078485239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 0x7f8e5c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e60a1d640 1 -- 172.21.15.29:0/4078485239 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2197170018 0 0) 0x7f8e5c0c3fe0 con 0x7f8e5c06f150 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e60a1d640 1 -- 172.21.15.29:0/4078485239 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e48003530 con 0x7f8e5c06f150 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e62220640 1 -- 172.21.15.29:0/4078485239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 msgr2=0x7f8e5c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e62220640 1 --2- 172.21.15.29:0/4078485239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 0x7f8e5c159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e62220640 1 -- 172.21.15.29:0/4078485239 >> v1:172.21.15.72:6789/0 conn(0x7f8e5c06f150 legacy=0x7f8e5c0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e62220640 1 -- 172.21.15.29:0/4078485239 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c0c45a0 con 0x7f8e5c0cd360 2024-04-23T10:16:22.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.650+0000 7f8e62220640 1 --2- 172.21.15.29:0/4078485239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c06f550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009d90 tx=0x7f8e5401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca737ac59d4c300 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e60a1d640 1 -- 172.21.15.29:0/4078485239 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e540b4070 con 0x7f8e5c0cd360 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e60a1d640 1 -- 172.21.15.29:0/4078485239 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e540af600 con 0x7f8e5c0cd360 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e60a1d640 1 -- 172.21.15.29:0/4078485239 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e540af9b0 con 0x7f8e5c0cd360 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- 172.21.15.29:0/4078485239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c0cd360 msgr2=0x7f8e5c06f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 --2- 172.21.15.29:0/4078485239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c06f550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009d90 tx=0x7f8e5401f150 comp rx=0 tx=0).stop 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- 172.21.15.29:0/4078485239 shutdown_connections 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 --2- 172.21.15.29:0/4078485239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c06f550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 --2- 172.21.15.29:0/4078485239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 0x7f8e5c159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- 172.21.15.29:0/4078485239 >> 172.21.15.29:0/4078485239 conn(0x7f8e5c06cfb0 msgr2=0x7f8e5c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- 172.21.15.29:0/4078485239 shutdown_connections 2024-04-23T10:16:22.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- 172.21.15.29:0/4078485239 wait complete. 2024-04-23T10:16:22.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 Processor -- start 2024-04-23T10:16:22.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- start start 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c06f150 0x7f8e5c1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c1f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 0x7f8e5c1f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c0c4880 con 0x7f8e5c0cd360 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c153570 con 0x7f8e5c06f150 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c0c9070 con 0x7f8e5c153190 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c1f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c1f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58958/0 (socket says 172.21.15.29:58958) 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 -- 172.21.15.29:0/2303148275 learned_addr learned my addr 172.21.15.29:0/2303148275 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e62220640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 0x7f8e5c1f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e61a1f640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c06f150 0x7f8e5c1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 -- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 msgr2=0x7f8e5c1f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 0x7f8e5c1f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 -- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c06f150 msgr2=0x7f8e5c1f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c06f150 0x7f8e5c1f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 -- 172.21.15.29:0/2303148275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c1551e0 con 0x7f8e5c0cd360 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e61a1f640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c06f150 0x7f8e5c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e6121e640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c1f15e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00c3c0 tx=0x7f8e4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e527fc640 1 -- 172.21.15.29:0/2303148275 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c017070 con 0x7f8e5c0cd360 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e527fc640 1 -- 172.21.15.29:0/2303148275 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c005cf0 con 0x7f8e5c0cd360 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c1f40d0 con 0x7f8e5c0cd360 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e527fc640 1 -- 172.21.15.29:0/2303148275 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0072f0 con 0x7f8e5c0cd360 2024-04-23T10:16:22.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.654+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c155760 con 0x7f8e5c0cd360 2024-04-23T10:16:22.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.658+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5c15d3c0 con 0x7f8e5c0cd360 2024-04-23T10:16:22.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.658+0000 7f8e527fc640 1 -- 172.21.15.29:0/2303148275 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e4c01a070 con 0x7f8e5c0cd360 2024-04-23T10:16:22.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.658+0000 7f8e527fc640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e40068380 0x7f8e4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:22.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.658+0000 7f8e527fc640 1 -- 172.21.15.29:0/2303148275 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8e4c086000 con 0x7f8e5c0cd360 2024-04-23T10:16:22.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.658+0000 7f8e61a1f640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e40068380 0x7f8e4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:22.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.658+0000 7f8e61a1f640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e40068380 0x7f8e4006a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009bb0 tx=0x7f8e58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:22.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.662+0000 7f8e527fc640 1 -- 172.21.15.29:0/2303148275 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8e4c055c30 con 0x7f8e5c0cd360 2024-04-23T10:16:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.858+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e5c068d70 con 0x7f8e5c0cd360 2024-04-23T10:16:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e527fc640 1 -- 172.21.15.29:0/2303148275 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f8e4c059f30 con 0x7f8e5c0cd360 2024-04-23T10:16:22.862 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:22.863 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:16:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e40068380 msgr2=0x7f8e4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e40068380 0x7f8e4006a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009bb0 tx=0x7f8e58008040 comp rx=0 tx=0).stop 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e5c0cd360 msgr2=0x7f8e5c1f15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c1f15e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00c3c0 tx=0x7f8e4c00c880 comp rx=0 tx=0).stop 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 shutdown_connections 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e40068380 0x7f8e4006a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5c153190 0x7f8e5c1f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e5c0cd360 0x7f8e5c1f15e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 --2- 172.21.15.29:0/2303148275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e5c06f150 0x7f8e5c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 >> 172.21.15.29:0/2303148275 conn(0x7f8e5c06cfb0 msgr2=0x7f8e5c0c6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 shutdown_connections 2024-04-23T10:16:22.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:22.862+0000 7f8e63c83640 1 -- 172.21.15.29:0/2303148275 wait complete. 2024-04-23T10:16:23.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T10:15:37.368844+0000', 'modified': '2024-04-23T10:16:21.349356+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4288, 'mds_1': 4250, 'mds_2': 4230, 'mds_3': 4212, 'mds_4': 4209}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4209': {'gid': 4209, 'name': 'a', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.29:6836/3348855066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 3348855066}, {'type': 'v1', 'addr': '172.21.15.29:6836', 'nonce': 3348855066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4212': {'gid': 4212, 'name': 'e', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.29:6837/927431142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6835', 'nonce': 927431142}, {'type': 'v1', 'addr': '172.21.15.29:6837', 'nonce': 927431142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4230': {'gid': 4230, 'name': 'd', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.72:6835/1664530327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6834', 'nonce': 1664530327}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 1664530327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4250': {'gid': 4250, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.72:6839/41085720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6837', 'nonce': 41085720}, {'type': 'v1', 'addr': '172.21.15.72:6839', 'nonce': 41085720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4288': {'gid': 4288, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.72:6838/4284551087', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 4284551087}, {'type': 'v1', 'addr': '172.21.15.72:6838', 'nonce': 4284551087}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4288, 'qdb_cluster': [4209, 4212, 4230, 4250, 4288]} 2024-04-23T10:16:23.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T10:16:23.486 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-23T10:16:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d3c1b7640 1 Processor -- start 2024-04-23T10:16:23.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d3c1b7640 1 -- start start 2024-04-23T10:16:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d3c1b7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d3406f3b0 0x7f0d340c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d3c1b7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d340c8950 0x7f0d34154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d3c1b7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3415eae0 con 0x7f0d340c7600 2024-04-23T10:16:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d3c1b7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0d34073b70 con 0x7f0d3406f3b0 2024-04-23T10:16:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d3c1b7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3415edc0 con 0x7f0d340c8950 2024-04-23T10:16:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d39f53640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d3406f3b0 0x7f0d340c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d39f53640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d3406f3b0 0x7f0d340c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58972/0 (socket says 172.21.15.29:58972) 2024-04-23T10:16:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d39f53640 1 -- 172.21.15.29:0/2214271327 learned_addr learned my addr 172.21.15.29:0/2214271327 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d39752640 1 --2- 172.21.15.29:0/2214271327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d340c8950 0x7f0d34154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d39f53640 1 -- 172.21.15.29:0/2214271327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d340c8950 msgr2=0x7f0d34154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2214271327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d340c8950 0x7f0d34154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d39f53640 1 -- 172.21.15.29:0/2214271327 >> v1:172.21.15.72:6789/0 conn(0x7f0d340c7600 legacy=0x7f0d34071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:23.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.618+0000 7f0d39f53640 1 -- 172.21.15.29:0/2214271327 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3415f0a0 con 0x7f0d3406f3b0 2024-04-23T10:16:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2214271327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3406f3b0 0x7f0d340c70c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009870 tx=0x7f0d3001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea0abb33250fb0e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d38f51640 1 -- 172.21.15.29:0/2214271327 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d300b5070 con 0x7f0d3406f3b0 2024-04-23T10:16:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d38f51640 1 -- 172.21.15.29:0/2214271327 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d300a8a50 con 0x7f0d3406f3b0 2024-04-23T10:16:23.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d38f51640 1 -- 172.21.15.29:0/2214271327 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d300a8e20 con 0x7f0d3406f3b0 2024-04-23T10:16:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/2214271327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3406f3b0 msgr2=0x7f0d340c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/2214271327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3406f3b0 0x7f0d340c70c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009870 tx=0x7f0d3001ed50 comp rx=0 tx=0).stop 2024-04-23T10:16:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/2214271327 shutdown_connections 2024-04-23T10:16:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/2214271327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d340c8950 0x7f0d34154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/2214271327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d3406f3b0 0x7f0d340c70c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/2214271327 >> 172.21.15.29:0/2214271327 conn(0x7f0d3406cfb0 msgr2=0x7f0d3406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:23.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/2214271327 shutdown_connections 2024-04-23T10:16:23.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/2214271327 wait complete. 2024-04-23T10:16:23.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.622+0000 7f0d3c1b7640 1 Processor -- start 2024-04-23T10:16:23.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 -- start start 2024-04-23T10:16:23.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d3406f3b0 0x7f0d340cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d340c7600 0x7f0d341f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d340c8950 0x7f0d341f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0d34071960 con 0x7f0d340c7600 2024-04-23T10:16:23.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3415f660 con 0x7f0d340c8950 2024-04-23T10:16:23.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3415e780 con 0x7f0d3406f3b0 2024-04-23T10:16:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d340c7600 0x7f0d341f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d340c7600 0x7f0d341f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58990/0 (socket says 172.21.15.29:58990) 2024-04-23T10:16:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 -- 172.21.15.29:0/281275145 learned_addr learned my addr 172.21.15.29:0/281275145 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3a754640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d340c8950 0x7f0d341f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39f53640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d3406f3b0 0x7f0d340cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 -- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d3406f3b0 msgr2=0x7f0d340cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d3406f3b0 0x7f0d340cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 -- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d340c8950 msgr2=0x7f0d341f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d340c8950 0x7f0d341f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 -- 172.21.15.29:0/281275145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d340cc400 con 0x7f0d340c7600 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39f53640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d3406f3b0 0x7f0d340cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3a754640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d340c8950 0x7f0d341f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d39752640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d340c7600 0x7f0d341f4970 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400d620 tx=0x7f0d2400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d2a7fc640 1 -- 172.21.15.29:0/281275145 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400b620 con 0x7f0d340c7600 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d2a7fc640 1 -- 172.21.15.29:0/281275145 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d24019070 con 0x7f0d340c7600 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d2a7fc640 1 -- 172.21.15.29:0/281275145 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400b9e0 con 0x7f0d340c7600 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/281275145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d341f1400 con 0x7f0d340c7600 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/281275145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d341f16c0 con 0x7f0d340c7600 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d2a7fc640 1 -- 172.21.15.29:0/281275145 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0d2400bb80 con 0x7f0d340c7600 2024-04-23T10:16:23.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d2a7fc640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0d180683b0 0x7f0d1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.626+0000 7f0d2a7fc640 1 -- 172.21.15.29:0/281275145 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0d24087010 con 0x7f0d340c7600 2024-04-23T10:16:23.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39f53640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0d180683b0 0x7f0d1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 Processor -- start 2024-04-23T10:16:23.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- start start 2024-04-23T10:16:23.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39f53640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0d180683b0 0x7f0d1806a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0d300b2000 tx=0x7f0d30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:23.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c123d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c1278080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c12789a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5564c1086420 con 0x5564c123dab0 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5564c1020bf0 con 0x5564c12785c0 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5564c10823e0 con 0x5564c123d190 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c1278080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c1278080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59000/0 (socket says 172.21.15.29:59000) 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 -- 172.21.15.29:0/3340282606 learned_addr learned my addr 172.21.15.29:0/3340282606 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3a754640 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c12789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39f53640 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c123d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 -- 172.21.15.29:0/3340282606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 msgr2=0x5564c123d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c123d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 -- 172.21.15.29:0/3340282606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 msgr2=0x5564c12789a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c12789a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 -- 172.21.15.29:0/3340282606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c112e450 con 0x5564c123dab0 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d39752640 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c1278080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d2405f2d0 tx=0x7f0d24056640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11eba4b04364408e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d177fe640 1 -- 172.21.15.29:0/3340282606 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24083070 con 0x5564c123dab0 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d177fe640 1 -- 172.21.15.29:0/3340282606 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2405afd0 con 0x5564c123dab0 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d177fe640 1 -- 172.21.15.29:0/3340282606 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2406f070 con 0x5564c123dab0 2024-04-23T10:16:23.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- 172.21.15.29:0/3340282606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 msgr2=0x5564c1278080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c1278080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d2405f2d0 tx=0x7f0d24056640 comp rx=0 tx=0).stop 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- 172.21.15.29:0/3340282606 shutdown_connections 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c12789a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c1278080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 --2- 172.21.15.29:0/3340282606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c123d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- 172.21.15.29:0/3340282606 >> 172.21.15.29:0/3340282606 conn(0x5564c1274e40 msgr2=0x5564c1277260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- 172.21.15.29:0/3340282606 shutdown_connections 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- 172.21.15.29:0/3340282606 wait complete. 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 -- start start 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.630+0000 7f0d3f339000 1 Processor -- start 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c1239c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c123a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c123a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5564c1026ec0 con 0x5564c123dab0 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5564c1107120 con 0x5564c12785c0 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5564c1091350 con 0x5564c123d190 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 10 client.0 _ll_register_callbacks cb 0x5564c10634d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c123a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c123a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59002/0 (socket says 172.21.15.29:59002) 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 -- 172.21.15.29:0/2995772753 learned_addr learned my addr 172.21.15.29:0/2995772753 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:23.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c1239c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3a754640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c123a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 -- 172.21.15.29:0/2995772753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 msgr2=0x5564c1239c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c1239c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 -- 172.21.15.29:0/2995772753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 msgr2=0x5564c123a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c123a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 -- 172.21.15.29:0/2995772753 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564c10cbf80 con 0x5564c123dab0 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39752640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c123a160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d24056920 tx=0x7f0d24013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a669e5f6cb4c54a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2995772753 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24073070 con 0x5564c123dab0 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2995772753 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0d24056070 con 0x5564c123dab0 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 -- 172.21.15.29:0/2995772753 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d2405afd0 con 0x5564c123dab0 2024-04-23T10:16:23.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2995772753 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0d24083050 con 0x5564c123dab0 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 10 client.4806 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 -- 172.21.15.29:0/2995772753 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5564c105ff00 con 0x5564c123dab0 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2995772753 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2405afd0 con 0x5564c123dab0 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2995772753 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f0d24013070 con 0x5564c123dab0 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 10 client.4806 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 10 client.4806 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 20 client.4806 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 0x5564c128f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 4 client.4806 mds_command: new command op to 4209 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d3f339000 1 -- 172.21.15.29:0/2995772753 --> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564c101fbc0 con 0x5564c128cd90 2024-04-23T10:16:23.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 0x5564c128f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 0x5564c128f180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9d549869c474b991 server_cookie=e8afe8b346f09d8e in_seq=0 out_seq=0 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d14ff9640 10 client.4806 ms_handle_connect on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 -- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 msgr2=0x5564c128f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 -- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 msgr2=0x5564c128f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 0x5564c128f180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 0x5564c128f180 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 0x5564c128f180 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d14ff9640 10 client.4806 ms_handle_connect on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:23.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:23.634+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 0x5564c128f180 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9d549869c474b991 server_cookie=e8afe8b346f09d8e in_seq=0 out_seq=1 2024-04-23T10:16:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2995772753 <== mds.4 v2:172.21.15.29:6834/3348855066 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5564c101fbc0 con 0x5564c128cd90 2024-04-23T10:16:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d14ff9640 10 client.4806 handle_command_reply: tid=0 2024-04-23T10:16:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 client.4806 shutdown 2024-04-23T10:16:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 -- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 msgr2=0x5564c123a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c123a160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d24056920 tx=0x7f0d24013000 comp rx=0 tx=0).stop 2024-04-23T10:16:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 -- 172.21.15.29:0/2995772753 shutdown_connections 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c123a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c123a160 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c128cd90 0x5564c128f180 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2995772753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c1239c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d14ff9640 0 client.4806 ms_handle_reset on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 -- 172.21.15.29:0/2995772753 >> 172.21.15.29:0/2995772753 conn(0x5564c1274e40 msgr2=0x5564c12761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 -- 172.21.15.29:0/2995772753 shutdown_connections 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 1 -- 172.21.15.29:0/2995772753 wait complete. 2024-04-23T10:16:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.358+0000 7f0d3f339000 20 client.4806 trim_cache size 0 max 16384 2024-04-23T10:16:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 Processor -- start 2024-04-23T10:16:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- start start 2024-04-23T10:16:26.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c123d190 0x5564c1272e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c12785c0 0x5564c12e9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5564c10529e0 con 0x5564c123dab0 2024-04-23T10:16:26.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5564c1085730 con 0x5564c123d190 2024-04-23T10:16:26.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5564c108aa50 con 0x5564c12785c0 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41956/0 (socket says 172.21.15.29:41956) 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 -- 172.21.15.29:0/2644079375 learned_addr learned my addr 172.21.15.29:0/2644079375 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3a754640 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c12785c0 0x5564c12e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c123d190 0x5564c1272e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 -- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c12785c0 msgr2=0x5564c12e9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c12785c0 0x5564c12e9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 -- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c123d190 msgr2=0x5564c1272e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c123d190 0x5564c1272e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 -- 172.21.15.29:0/2644079375 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c123c940 con 0x5564c123dab0 2024-04-23T10:16:26.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c123d190 0x5564c1272e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d39752640 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12733d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0d2405f2d0 tx=0x7f0d2406d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee210651bbf1c5c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d16ffd640 1 -- 172.21.15.29:0/2644079375 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24073070 con 0x5564c123dab0 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d16ffd640 1 -- 172.21.15.29:0/2644079375 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2405afd0 con 0x5564c123dab0 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d16ffd640 1 -- 172.21.15.29:0/2644079375 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2406f040 con 0x5564c123dab0 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- 172.21.15.29:0/2644079375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 msgr2=0x5564c12733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12733d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0d2405f2d0 tx=0x7f0d2406d000 comp rx=0 tx=0).stop 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- 172.21.15.29:0/2644079375 shutdown_connections 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c12785c0 0x5564c12e9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12733d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2644079375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c123d190 0x5564c1272e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- 172.21.15.29:0/2644079375 >> 172.21.15.29:0/2644079375 conn(0x5564c1274e40 msgr2=0x5564c1236cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- 172.21.15.29:0/2644079375 shutdown_connections 2024-04-23T10:16:26.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- 172.21.15.29:0/2644079375 wait complete. 2024-04-23T10:16:26.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.382+0000 7f0d3f339000 1 -- start start 2024-04-23T10:16:26.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 Processor -- start 2024-04-23T10:16:26.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c12e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12e6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c12e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5564c1026a40 con 0x5564c123dab0 2024-04-23T10:16:26.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5564c1093630 con 0x5564c12785c0 2024-04-23T10:16:26.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5564c1026ec0 con 0x5564c123d190 2024-04-23T10:16:26.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 10 client.0 _ll_register_callbacks cb 0x7f0d24081070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:26.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12e6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41970/0 (socket says 172.21.15.29:41970) 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 -- 172.21.15.29:0/2258531183 learned_addr learned my addr 172.21.15.29:0/2258531183 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c12e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3a754640 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c12e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 -- 172.21.15.29:0/2258531183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 msgr2=0x5564c12e60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c12e60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 -- 172.21.15.29:0/2258531183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 msgr2=0x5564c12e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c12e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 -- 172.21.15.29:0/2258531183 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564c100ce80 con 0x5564c123dab0 2024-04-23T10:16:26.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39752640 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12e6600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d240852e0 tx=0x7f0d2400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d631c3f76463e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2258531183 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24073040 con 0x5564c123dab0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2258531183 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0d24078ba0 con 0x5564c123dab0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- 172.21.15.29:0/2258531183 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d2405afd0 con 0x5564c123dab0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2258531183 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0d2405f800 con 0x5564c123dab0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 10 client.4812 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- 172.21.15.29:0/2258531183 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5564c104eb30 con 0x5564c123dab0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2258531183 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2405afd0 con 0x5564c123dab0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2258531183 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f0d24067030 con 0x5564c123dab0 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 10 client.4812 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:26.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 10 client.4812 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 20 client.4812 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c12e7c40 0x5564c12e8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 4 client.4812 mds_command: new command op to 4209 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- 172.21.15.29:0/2258531183 --> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] -- command(tid 0: {"prefix": "status"}) -- 0x5564c1093e40 con 0x5564c12e7c40 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c12e7c40 0x5564c12e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d39f53640 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c12e7c40 0x5564c12e8020 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b0467c85861b1118 server_cookie=692d8ea2b72a169a in_seq=0 out_seq=0 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 10 client.4812 ms_handle_connect on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 1 -- 172.21.15.29:0/2258531183 <== mds.4 v2:172.21.15.29:6834/3348855066 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5564c1093e40 con 0x5564c12e7c40 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 10 client.4812 handle_command_reply: tid=0 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 client.4812 shutdown 2024-04-23T10:16:26.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- 172.21.15.29:0/2258531183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 msgr2=0x5564c12e6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12e6600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d240852e0 tx=0x7f0d2400bf20 comp rx=0 tx=0).stop 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- 172.21.15.29:0/2258531183 shutdown_connections 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5564c12785c0 0x5564c12e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5564c123dab0 0x5564c12e6600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x5564c12e7c40 0x5564c12e8020 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 --2- 172.21.15.29:0/2258531183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5564c123d190 0x5564c12e60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- 172.21.15.29:0/2258531183 >> 172.21.15.29:0/2258531183 conn(0x5564c1274e40 msgr2=0x5564c1235880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d14ff9640 0 client.4812 ms_handle_reset on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:26.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- 172.21.15.29:0/2258531183 shutdown_connections 2024-04-23T10:16:26.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 1 -- 172.21.15.29:0/2258531183 wait complete. 2024-04-23T10:16:26.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.386+0000 7f0d3f339000 20 client.4812 trim_cache size 0 max 16384 2024-04-23T10:16:26.399 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:26.399 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:26.491 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 4, 2024-04-23T10:16:26.491 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4209, 2024-04-23T10:16:26.491 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:26.491 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:26.491 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:26.491 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 11.101383535, 2024-04-23T10:16:26.491 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:26.491 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:26.492 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:26.492 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 55.373206097000001 2024-04-23T10:16:26.492 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:26.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0d180683b0 msgr2=0x7f0d1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0d180683b0 0x7f0d1806a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0d300b2000 tx=0x7f0d30008040 comp rx=0 tx=0).stop 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/281275145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d340c7600 msgr2=0x7f0d341f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d340c7600 0x7f0d341f4970 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400d620 tx=0x7f0d2400dae0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/281275145 shutdown_connections 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0d180683b0 0x7f0d1806a870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d340c8950 0x7f0d341f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d340c7600 0x7f0d341f4970 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 --2- 172.21.15.29:0/281275145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d3406f3b0 0x7f0d340cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/281275145 >> 172.21.15.29:0/281275145 conn(0x7f0d3406cfb0 msgr2=0x7f0d3406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/281275145 shutdown_connections 2024-04-23T10:16:26.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.390+0000 7f0d3c1b7640 1 -- 172.21.15.29:0/281275145 wait complete. 2024-04-23T10:16:26.495 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T10:16:26.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d6ea1640 1 Processor -- start 2024-04-23T10:16:26.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d6ea1640 1 -- start start 2024-04-23T10:16:26.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d6ea1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 0x7f48d00c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d6ea1640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d015eae0 con 0x7f48d00c8950 2024-04-23T10:16:26.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d6ea1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d015edc0 con 0x7f48d00c7600 2024-04-23T10:16:26.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d6ea1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48d0073b70 con 0x7f48d006f3b0 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f48d00c8950 0x7f48d0154f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44952/0 (socket says 172.21.15.29:44952) 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cffff640 1 -- 172.21.15.29:0/2345130983 learned_addr learned my addr 172.21.15.29:0/2345130983 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 0x7f48d00c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839758581 0 0) 0x7f48d015eae0 con 0x7f48d00c8950 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b8003530 con 0x7f48d00c8950 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 702907716 0 0) 0x7f48b8003530 con 0x7f48d00c8950 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 msgr2=0x7f48d00c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 0x7f48d00c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 >> v1:172.21.15.72:6789/0 conn(0x7f48d00c7600 legacy=0x7f48d0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d015f0a0 con 0x7f48d00c8950 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f48c4001680 con 0x7f48d00c8950 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 >> v1:172.21.15.29:6789/0 conn(0x7f48d00c8950 legacy=0x7f48d0154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80039f0 0x7f48b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 0x7f48b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0073b70 con 0x7f48b8004810 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f48b800bb10 con 0x7f48b80039f0 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48b800bd10 con 0x7f48d006f3b0 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cffff640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80039f0 0x7f48b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d543e640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 0x7f48b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cffff640 1 -- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 msgr2=0x7f48b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cffff640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 0x7f48b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cffff640 1 -- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80039f0 msgr2=0x7f48b8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cffff640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80039f0 0x7f48b8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48cffff640 1 -- 172.21.15.29:0/2345130983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b8003530 con 0x7f48b8004810 2024-04-23T10:16:26.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.634+0000 7f48d543e640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d006f3b0 0x7f48b80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:26.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48cffff640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48b8004c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c190 tx=0x7f48c401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4d609152cbdf62 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4007d00 con 0x7f48b8004810 2024-04-23T10:16:26.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c40a9020 con 0x7f48b8004810 2024-04-23T10:16:26.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48cf7fe640 1 -- 172.21.15.29:0/2345130983 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c40a5b40 con 0x7f48b8004810 2024-04-23T10:16:26.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d6ea1640 1 -- 172.21.15.29:0/2345130983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 msgr2=0x7f48b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d6ea1640 1 --2- 172.21.15.29:0/2345130983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48b8004c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c190 tx=0x7f48c401cc20 comp rx=0 tx=0).stop 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d543e640 1 -- 172.21.15.29:0/2345130983 reap_dead start 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d6ea1640 1 -- 172.21.15.29:0/2345130983 shutdown_connections 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d6ea1640 1 -- 172.21.15.29:0/2345130983 >> 172.21.15.29:0/2345130983 conn(0x7f48d006cfb0 msgr2=0x7f48d006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d6ea1640 1 -- 172.21.15.29:0/2345130983 shutdown_connections 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d6ea1640 1 -- 172.21.15.29:0/2345130983 wait complete. 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d6ea1640 1 Processor -- start 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.638+0000 7f48d6ea1640 1 -- start start 2024-04-23T10:16:26.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d6ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48d014d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d6ea1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d014c3f0 0x7f48d01f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d6ea1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48d01f4c50 0x7f48d0151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d6ea1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0071960 con 0x7f48b8004810 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d6ea1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f48d015f660 con 0x7f48d01f4c50 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d6ea1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48d015e780 con 0x7f48d014c3f0 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48d014d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48d014d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41990/0 (socket says 172.21.15.29:41990) 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 -- 172.21.15.29:0/3575968639 learned_addr learned my addr 172.21.15.29:0/3575968639 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d543e640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48d01f4c50 0x7f48d0151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48cffff640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d014c3f0 0x7f48d01f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 -- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d014c3f0 msgr2=0x7f48d01f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d014c3f0 0x7f48d01f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 -- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48d01f4c50 msgr2=0x7f48d0151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48d01f4c50 0x7f48d0151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 -- 172.21.15.29:0/3575968639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d014ca20 con 0x7f48b8004810 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48d014d390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007f30 tx=0x7f48c0011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48cd7fa640 1 -- 172.21.15.29:0/3575968639 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c001a020 con 0x7f48b8004810 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48cd7fa640 1 -- 172.21.15.29:0/3575968639 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c0016470 con 0x7f48b8004810 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d6ea1640 1 -- 172.21.15.29:0/3575968639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d01f0d20 con 0x7f48b8004810 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48cd7fa640 1 -- 172.21.15.29:0/3575968639 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0016860 con 0x7f48b8004810 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48d6ea1640 1 -- 172.21.15.29:0/3575968639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d014cfa0 con 0x7f48b8004810 2024-04-23T10:16:26.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48cd7fa640 1 -- 172.21.15.29:0/3575968639 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f48c001d020 con 0x7f48b8004810 2024-04-23T10:16:26.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48cd7fa640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48bc0683b0 0x7f48bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48cd7fa640 1 -- 172.21.15.29:0/3575968639 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f48c0087bf0 con 0x7f48b8004810 2024-04-23T10:16:26.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.642+0000 7f48cffff640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48bc0683b0 0x7f48bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 Processor -- start 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- start start 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48cffff640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48bc0683b0 0x7f48bc06a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f48c40aa000 tx=0x7f48d015ef90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2f190 0x562690e2f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2fab0 0x562690e6a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e6a5c0 0x562690e6a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562690c78420 con 0x562690e6a5c0 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562690c12bf0 con 0x562690e2f190 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x562690c743e0 con 0x562690e2fab0 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e6a5c0 0x562690e6a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e6a5c0 0x562690e6a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42004/0 (socket says 172.21.15.29:42004) 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 -- 172.21.15.29:0/1073360945 learned_addr learned my addr 172.21.15.29:0/1073360945 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2f190 0x562690e2f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48cffff640 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2fab0 0x562690e6a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 -- 172.21.15.29:0/1073360945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2fab0 msgr2=0x562690e6a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2fab0 0x562690e6a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 -- 172.21.15.29:0/1073360945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2f190 msgr2=0x562690e2f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2f190 0x562690e2f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 -- 172.21.15.29:0/1073360945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562690d20450 con 0x562690e6a5c0 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48d543e640 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e6a5c0 0x562690e6a9a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f48d00c8fa0 tx=0x7f48c8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b76be3ad3da485 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48b67fc640 1 -- 172.21.15.29:0/1073360945 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c80050d0 con 0x562690e6a5c0 2024-04-23T10:16:26.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48b67fc640 1 -- 172.21.15.29:0/1073360945 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8018070 con 0x562690e6a5c0 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48b67fc640 1 -- 172.21.15.29:0/1073360945 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8005490 con 0x562690e6a5c0 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- 172.21.15.29:0/1073360945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e6a5c0 msgr2=0x562690e6a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e6a5c0 0x562690e6a9a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f48d00c8fa0 tx=0x7f48c8001a80 comp rx=0 tx=0).stop 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- 172.21.15.29:0/1073360945 shutdown_connections 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e6a5c0 0x562690e6a9a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2fab0 0x562690e6a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 --2- 172.21.15.29:0/1073360945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2f190 0x562690e2f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- 172.21.15.29:0/1073360945 >> 172.21.15.29:0/1073360945 conn(0x562690e66e40 msgr2=0x562690e69260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- 172.21.15.29:0/1073360945 shutdown_connections 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- 172.21.15.29:0/1073360945 wait complete. 2024-04-23T10:16:26.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 -- start start 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.646+0000 7f48da023000 1 Processor -- start 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 0x562690e2bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e2c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 0x562690e2c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562690c18ec0 con 0x562690e2fab0 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562690cf9120 con 0x562690e6a5c0 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x562690c83350 con 0x562690e2f190 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 10 client.0 _ll_register_callbacks cb 0x562690c554d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e2c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e2c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42016/0 (socket says 172.21.15.29:42016) 2024-04-23T10:16:26.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 -- 172.21.15.29:0/2982968788 learned_addr learned my addr 172.21.15.29:0/2982968788 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48d543e640 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 0x562690e2c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 0x562690e2bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 -- 172.21.15.29:0/2982968788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 msgr2=0x562690e2bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 0x562690e2bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 -- 172.21.15.29:0/2982968788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 msgr2=0x562690e2c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 0x562690e2c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 -- 172.21.15.29:0/2982968788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562690cbdf80 con 0x562690e2fab0 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48cffff640 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e2c100 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ab040 tx=0x7f48c401b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45dadd703095a0a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 1 -- 172.21.15.29:0/2982968788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c40c9060 con 0x562690e2fab0 2024-04-23T10:16:26.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 1 -- 172.21.15.29:0/2982968788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f48c40047f0 con 0x562690e2fab0 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- 172.21.15.29:0/2982968788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48c8018070 con 0x562690e2fab0 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 1 -- 172.21.15.29:0/2982968788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f48c40cf050 con 0x562690e2fab0 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 10 client.4824 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- 172.21.15.29:0/2982968788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x562690c51f00 con 0x562690e2fab0 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 1 -- 172.21.15.29:0/2982968788 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8018070 con 0x562690e2fab0 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 1 -- 172.21.15.29:0/2982968788 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f48c40d2020 con 0x562690e2fab0 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 10 client.4824 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 10 client.4824 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 20 client.4824 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:26.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x562690e7ed90 0x562690e81180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 4 client.4824 mds_command: new command op to 4212 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- 172.21.15.29:0/2982968788 --> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562690c11bc0 con 0x562690e7ed90 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x562690e7ed90 0x562690e81180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 10 client.4824 ms_handle_connect on v2:172.21.15.29:6835/927431142 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x562690e7ed90 0x562690e81180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5ced3449be54614f server_cookie=8ac2f4c9dfa1c29 in_seq=0 out_seq=0 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 1 -- 172.21.15.29:0/2982968788 <== mds.3 v2:172.21.15.29:6835/927431142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562690c11bc0 con 0x562690e7ed90 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 10 client.4824 handle_command_reply: tid=0 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 client.4824 shutdown 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- 172.21.15.29:0/2982968788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 msgr2=0x562690e2c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e2c100 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ab040 tx=0x7f48c401b460 comp rx=0 tx=0).stop 2024-04-23T10:16:26.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- 172.21.15.29:0/2982968788 shutdown_connections 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x562690e7ed90 0x562690e81180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 0x562690e2c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e2c100 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 --2- 172.21.15.29:0/2982968788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 0x562690e2bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48af7fe640 0 client.4824 ms_handle_reset on v2:172.21.15.29:6835/927431142 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- 172.21.15.29:0/2982968788 >> 172.21.15.29:0/2982968788 conn(0x562690e66e40 msgr2=0x562690e681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- 172.21.15.29:0/2982968788 shutdown_connections 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 1 -- 172.21.15.29:0/2982968788 wait complete. 2024-04-23T10:16:26.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.650+0000 7f48da023000 20 client.4824 trim_cache size 0 max 16384 2024-04-23T10:16:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 Processor -- start 2024-04-23T10:16:26.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 -- start start 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 0x562690e28890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e28dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 0x562690e81180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01fef50 con 0x562690e2fab0 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f48d01ff620 con 0x562690e6a5c0 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48d0159c50 con 0x562690e2f190 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e28dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e28dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42032/0 (socket says 172.21.15.29:42032) 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 -- 172.21.15.29:0/1333234810 learned_addr learned my addr 172.21.15.29:0/1333234810 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 -- 172.21.15.29:0/1333234810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 msgr2=0x562690e28890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 --2- 172.21.15.29:0/1333234810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 0x562690e28890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 -- 172.21.15.29:0/1333234810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 msgr2=0x562690e81180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 --2- 172.21.15.29:0/1333234810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 0x562690e81180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 -- 172.21.15.29:0/1333234810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562690bfee80 con 0x562690e2fab0 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48cffff640 1 --2- 172.21.15.29:0/1333234810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e28dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f48c401c690 tx=0x7f48c40b3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9356c4e47dd83a3a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48b5ffb640 1 -- 172.21.15.29:0/1333234810 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4004d30 con 0x562690e2fab0 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48b5ffb640 1 -- 172.21.15.29:0/1333234810 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c40a9050 con 0x562690e2fab0 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48b5ffb640 1 -- 172.21.15.29:0/1333234810 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4007290 con 0x562690e2fab0 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.670+0000 7f48da023000 1 -- 172.21.15.29:0/1333234810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 msgr2=0x562690e28dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 --2- 172.21.15.29:0/1333234810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e28dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f48c401c690 tx=0x7f48c40b3000 comp rx=0 tx=0).stop 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- 172.21.15.29:0/1333234810 shutdown_connections 2024-04-23T10:16:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 --2- 172.21.15.29:0/1333234810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e6a5c0 0x562690e81180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 --2- 172.21.15.29:0/1333234810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2fab0 0x562690e28dd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 --2- 172.21.15.29:0/1333234810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e2f190 0x562690e28890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- 172.21.15.29:0/1333234810 >> 172.21.15.29:0/1333234810 conn(0x562690e66e40 msgr2=0x562690e64e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- 172.21.15.29:0/1333234810 shutdown_connections 2024-04-23T10:16:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- 172.21.15.29:0/1333234810 wait complete. 2024-04-23T10:16:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- start start 2024-04-23T10:16:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 Processor -- start 2024-04-23T10:16:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2f190 0x562690e9ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2fab0 0x562690e9f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e6a5c0 0x562690e9f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562690c77730 con 0x562690e2f190 2024-04-23T10:16:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x562690c449e0 con 0x562690e2fab0 2024-04-23T10:16:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x562690c7ca50 con 0x562690e6a5c0 2024-04-23T10:16:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 10 client.0 _ll_register_callbacks cb 0x7f48b8003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2f190 0x562690e9ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2f190 0x562690e9ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42044/0 (socket says 172.21.15.29:42044) 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 -- 172.21.15.29:0/3477772980 learned_addr learned my addr 172.21.15.29:0/3477772980 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48cffff640 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2fab0 0x562690e9f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d543e640 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e6a5c0 0x562690e9f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 -- 172.21.15.29:0/3477772980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e6a5c0 msgr2=0x562690e9f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e6a5c0 0x562690e9f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 -- 172.21.15.29:0/3477772980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2fab0 msgr2=0x562690e9f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2fab0 0x562690e9f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 -- 172.21.15.29:0/3477772980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562690c40b30 con 0x562690e2f190 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48d4c3d640 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2f190 0x562690e9ef40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f48c0057420 tx=0x7f48c005bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d018adc448112e3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48af7fe640 1 -- 172.21.15.29:0/3477772980 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0074060 con 0x562690e2f190 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48af7fe640 1 -- 172.21.15.29:0/3477772980 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f48c0053d90 con 0x562690e2f190 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- 172.21.15.29:0/3477772980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48c40a9050 con 0x562690e2f190 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48af7fe640 1 -- 172.21.15.29:0/3477772980 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f48c007b050 con 0x562690e2f190 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 10 client.4830 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- 172.21.15.29:0/3477772980 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x562690cf95b0 con 0x562690e2f190 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48af7fe640 1 -- 172.21.15.29:0/3477772980 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c40a9050 con 0x562690e2f190 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48af7fe640 1 -- 172.21.15.29:0/3477772980 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f48c005fe70 con 0x562690e2f190 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 10 client.4830 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:26.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 10 client.4830 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 20 client.4830 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x562690ee4be0 0x562690ee6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 4 client.4830 mds_command: new command op to 4212 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.674+0000 7f48da023000 1 -- 172.21.15.29:0/3477772980 --> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] -- command(tid 0: {"prefix": "status"}) -- 0x562690c85e40 con 0x562690ee4be0 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48cffff640 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x562690ee4be0 0x562690ee6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48cffff640 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x562690ee4be0 0x562690ee6fd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=220549598a10a691 server_cookie=5469a04a73aa3d in_seq=0 out_seq=0 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48af7fe640 10 client.4830 ms_handle_connect on v2:172.21.15.29:6835/927431142 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48af7fe640 1 -- 172.21.15.29:0/3477772980 <== mds.3 v2:172.21.15.29:6835/927431142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562690c85e40 con 0x562690ee4be0 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48af7fe640 10 client.4830 handle_command_reply: tid=0 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 client.4830 shutdown 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 -- 172.21.15.29:0/3477772980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2f190 msgr2=0x562690e9ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2f190 0x562690e9ef40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f48c0057420 tx=0x7f48c005bb90 comp rx=0 tx=0).stop 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 -- 172.21.15.29:0/3477772980 shutdown_connections 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x562690ee4be0 0x562690ee6fd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x562690e6a5c0 0x562690e9f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x562690e2fab0 0x562690e9f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 --2- 172.21.15.29:0/3477772980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562690e2f190 0x562690e9ef40 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f48c0057420 tx=0x7f48c005bb90 comp rx=0 tx=0).stop 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 -- 172.21.15.29:0/3477772980 >> 172.21.15.29:0/3477772980 conn(0x562690e66e40 msgr2=0x562690e655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48af7fe640 0 client.4830 ms_handle_reset on v2:172.21.15.29:6835/927431142 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 -- 172.21.15.29:0/3477772980 shutdown_connections 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 1 -- 172.21.15.29:0/3477772980 wait complete. 2024-04-23T10:16:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48da023000 20 client.4830 trim_cache size 0 max 16384 2024-04-23T10:16:26.686 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:26.686 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:26.686 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 3, 2024-04-23T10:16:26.686 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4212, 2024-04-23T10:16:26.686 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:26.686 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:26.686 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:26.686 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 17.409290799000001, 2024-04-23T10:16:26.687 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:26.687 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:26.687 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:26.687 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 55.662643752999998 2024-04-23T10:16:26.687 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 -- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48bc0683b0 msgr2=0x7f48bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48bc0683b0 0x7f48bc06a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f48c40aa000 tx=0x7f48d015ef90 comp rx=0 tx=0).stop 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 -- 172.21.15.29:0/3575968639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 msgr2=0x7f48d014d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48d014d390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007f30 tx=0x7f48c0011660 comp rx=0 tx=0).stop 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 -- 172.21.15.29:0/3575968639 shutdown_connections 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f48bc0683b0 0x7f48bc06a870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48d01f4c50 0x7f48d0151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48d014c3f0 0x7f48d01f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 --2- 172.21.15.29:0/3575968639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48b8004810 0x7f48d014d390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 -- 172.21.15.29:0/3575968639 >> 172.21.15.29:0/3575968639 conn(0x7f48d006cfb0 msgr2=0x7f48d01534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 -- 172.21.15.29:0/3575968639 shutdown_connections 2024-04-23T10:16:26.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.678+0000 7f48d6ea1640 1 -- 172.21.15.29:0/3575968639 wait complete. 2024-04-23T10:16:26.699 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-23T10:16:26.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c35508640 1 Processor -- start 2024-04-23T10:16:26.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c35508640 1 -- start start 2024-04-23T10:16:26.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c35508640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c30153190 0x7f7c30159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c35508640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c3006f150 0x7f7c3006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c35508640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c300ccc50 0x7f7c300cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c35508640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7c30159380 con 0x7f7c3006f150 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c35508640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7c300cd5c0 con 0x7f7c30153190 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c35508640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7c300c3fe0 con 0x7f7c300ccc50 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2e7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c3006f150 0x7f7c3006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2e7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c3006f150 0x7f7c3006f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42048/0 (socket says 172.21.15.29:42048) 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/1229359918 learned_addr learned my addr 172.21.15.29:0/1229359918 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2effd640 1 --2- 172.21.15.29:0/1229359918 >> v2:172.21.15.72:3300/0 conn(0x7f7c30153190 0x7f7c30159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/1229359918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c300ccc50 0x7f7c300cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/1229359918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c300ccc50 msgr2=0x7f7c300cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/1229359918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c300ccc50 0x7f7c300cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/1229359918 >> v2:172.21.15.72:3300/0 conn(0x7f7c30153190 msgr2=0x7f7c30159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/1229359918 >> v2:172.21.15.72:3300/0 conn(0x7f7c30153190 0x7f7c30159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/1229359918 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c300c42c0 con 0x7f7c3006f150 2024-04-23T10:16:26.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.814+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/1229359918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c300ccc50 0x7f7c300cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:26.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/1229359918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c3006f150 0x7f7c3006f580 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c300ca280 tx=0x7f7c2401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e276cb6640730d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c2dffb640 1 -- 172.21.15.29:0/1229359918 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c240b5070 con 0x7f7c3006f150 2024-04-23T10:16:26.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c2dffb640 1 -- 172.21.15.29:0/1229359918 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c240a89d0 con 0x7f7c3006f150 2024-04-23T10:16:26.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c2dffb640 1 -- 172.21.15.29:0/1229359918 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c240a8da0 con 0x7f7c3006f150 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- 172.21.15.29:0/1229359918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c3006f150 msgr2=0x7f7c3006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 --2- 172.21.15.29:0/1229359918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c3006f150 0x7f7c3006f580 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c300ca280 tx=0x7f7c2401ed10 comp rx=0 tx=0).stop 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- 172.21.15.29:0/1229359918 shutdown_connections 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 --2- 172.21.15.29:0/1229359918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c300ccc50 0x7f7c300cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 --2- 172.21.15.29:0/1229359918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c3006f150 0x7f7c3006f580 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 --2- 172.21.15.29:0/1229359918 >> v2:172.21.15.72:3300/0 conn(0x7f7c30153190 0x7f7c30159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- 172.21.15.29:0/1229359918 >> 172.21.15.29:0/1229359918 conn(0x7f7c3006cfb0 msgr2=0x7f7c3006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- 172.21.15.29:0/1229359918 shutdown_connections 2024-04-23T10:16:26.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- 172.21.15.29:0/1229359918 wait complete. 2024-04-23T10:16:26.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 Processor -- start 2024-04-23T10:16:26.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- start start 2024-04-23T10:16:26.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3006f150 0x7f7c30156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c300ccc50 0x7f7c30150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c30153190 0x7f7c300c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30153570 con 0x7f7c30153190 2024-04-23T10:16:26.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30159010 con 0x7f7c300ccc50 2024-04-23T10:16:26.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c35508640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7c300c4880 con 0x7f7c3006f150 2024-04-23T10:16:26.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c30153190 0x7f7c300c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c30153190 0x7f7c300c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42056/0 (socket says 172.21.15.29:42056) 2024-04-23T10:16:26.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.818+0000 7f7c2f7fe640 1 -- 172.21.15.29:0/383206243 learned_addr learned my addr 172.21.15.29:0/383206243 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c300ccc50 0x7f7c30150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2effd640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3006f150 0x7f7c30156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2f7fe640 1 -- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3006f150 msgr2=0x7f7c30156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3006f150 0x7f7c30156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2f7fe640 1 -- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c300ccc50 msgr2=0x7f7c30150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c300ccc50 0x7f7c30150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2f7fe640 1 -- 172.21.15.29:0/383206243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c301f1e90 con 0x7f7c30153190 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c30153190 0x7f7c300c8060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800cf20 tx=0x7f7c2800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c177fe640 1 -- 172.21.15.29:0/383206243 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2801a070 con 0x7f7c30153190 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c177fe640 1 -- 172.21.15.29:0/383206243 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2800d840 con 0x7f7c30153190 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c35508640 1 -- 172.21.15.29:0/383206243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3014f690 con 0x7f7c30153190 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c177fe640 1 -- 172.21.15.29:0/383206243 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800dc30 con 0x7f7c30153190 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c35508640 1 -- 172.21.15.29:0/383206243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c3014fc50 con 0x7f7c30153190 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c177fe640 1 -- 172.21.15.29:0/383206243 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c2801d070 con 0x7f7c30153190 2024-04-23T10:16:26.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c177fe640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7c1c068380 0x7f7c1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c177fe640 1 -- 172.21.15.29:0/383206243 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7c280875d0 con 0x7f7c30153190 2024-04-23T10:16:26.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2effd640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7c1c068380 0x7f7c1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c3868a000 1 Processor -- start 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c3868a000 1 -- start start 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.822+0000 7f7c2effd640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7c1c068380 0x7f7c1c06a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000b930 tx=0x7f7c20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a043182570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 0x55a0431bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a0431bd5c0 0x55a0431bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a042fcb420 con 0x55a0431bd5c0 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a042f65bf0 con 0x55a043182190 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a042fc73e0 con 0x55a043182ab0 2024-04-23T10:16:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a0431bd5c0 0x55a0431bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a0431bd5c0 0x55a0431bd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42062/0 (socket says 172.21.15.29:42062) 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 -- 172.21.15.29:0/1168988116 learned_addr learned my addr 172.21.15.29:0/1168988116 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2effd640 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a043182570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 -- 172.21.15.29:0/1168988116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 msgr2=0x55a0431bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 0x55a0431bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 -- 172.21.15.29:0/1168988116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 msgr2=0x55a043182570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a043182570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 -- 172.21.15.29:0/1168988116 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a043073450 con 0x55a0431bd5c0 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2effd640 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a043182570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a0431bd5c0 0x55a0431bd9a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7c28085770 tx=0x7f7c28053450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331fddc395b1dcc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c14ff9640 1 -- 172.21.15.29:0/1168988116 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2805b4b0 con 0x55a0431bd5c0 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c14ff9640 1 -- 172.21.15.29:0/1168988116 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2805fce0 con 0x55a0431bd5c0 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c14ff9640 1 -- 172.21.15.29:0/1168988116 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28055400 con 0x55a0431bd5c0 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- 172.21.15.29:0/1168988116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a0431bd5c0 msgr2=0x55a0431bd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a0431bd5c0 0x55a0431bd9a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7c28085770 tx=0x7f7c28053450 comp rx=0 tx=0).stop 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- 172.21.15.29:0/1168988116 shutdown_connections 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a0431bd5c0 0x55a0431bd9a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 0x55a0431bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1168988116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a043182570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- 172.21.15.29:0/1168988116 >> 172.21.15.29:0/1168988116 conn(0x55a0431b9e40 msgr2=0x55a0431bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- 172.21.15.29:0/1168988116 shutdown_connections 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- 172.21.15.29:0/1168988116 wait complete. 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- start start 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 Processor -- start 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182190 0x55a04317ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a04317f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a04317f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a042f6bec0 con 0x55a043182ab0 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a04304c120 con 0x55a0431bd5c0 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a042fd6350 con 0x55a043182190 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c3868a000 10 client.0 _ll_register_callbacks cb 0x55a042fa84d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:26.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a04317f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a04317f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42072/0 (socket says 172.21.15.29:42072) 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/1022828543 learned_addr learned my addr 172.21.15.29:0/1022828543 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a04317f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2effd640 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182190 0x55a04317ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182190 msgr2=0x55a04317ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182190 0x55a04317ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 msgr2=0x55a04317f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a04317f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.826+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/1022828543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a043010f80 con 0x55a043182ab0 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a04317f100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7c2401d3c0 tx=0x7f7c2401d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f9d99fec97d778 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:26.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 1 -- 172.21.15.29:0/1022828543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c240bf070 con 0x55a043182ab0 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 1 -- 172.21.15.29:0/1022828543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7c240b0440 con 0x55a043182ab0 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 -- 172.21.15.29:0/1022828543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c2805fce0 con 0x55a043182ab0 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 1 -- 172.21.15.29:0/1022828543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7c240c7050 con 0x55a043182ab0 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 10 client.4842 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 -- 172.21.15.29:0/1022828543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a042fa4f00 con 0x55a043182ab0 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 1 -- 172.21.15.29:0/1022828543 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2805fce0 con 0x55a043182ab0 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 1 -- 172.21.15.29:0/1022828543 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f7c240ca020 con 0x55a043182ab0 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 10 client.4842 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 10 client.4842 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 20 client.4842 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x55a0431d1d90 0x55a0431d4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 4 client.4842 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 -- 172.21.15.29:0/1022828543 --> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a042f64bc0 con 0x55a0431d1d90 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c2effd640 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x55a0431d1d90 0x55a0431d4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 10 client.4842 ms_handle_connect on v2:172.21.15.72:6834/1664530327 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c2effd640 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x55a0431d1d90 0x55a0431d4180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87adf50c3cb0502f server_cookie=aeeb312e6a29c38e in_seq=0 out_seq=0 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 1 -- 172.21.15.29:0/1022828543 <== mds.2 v2:172.21.15.72:6834/1664530327 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a042f64bc0 con 0x55a0431d1d90 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 10 client.4842 handle_command_reply: tid=0 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 client.4842 shutdown 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 -- 172.21.15.29:0/1022828543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 msgr2=0x55a04317f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a04317f100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7c2401d3c0 tx=0x7f7c2401d550 comp rx=0 tx=0).stop 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 -- 172.21.15.29:0/1022828543 shutdown_connections 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x55a0431d1d90 0x55a0431d4180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a04317f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a04317f100 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 --2- 172.21.15.29:0/1022828543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182190 0x55a04317ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c0dffb640 0 client.4842 ms_handle_reset on v2:172.21.15.72:6834/1664530327 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.830+0000 7f7c3868a000 1 -- 172.21.15.29:0/1022828543 >> 172.21.15.29:0/1022828543 conn(0x55a0431b9e40 msgr2=0x55a0431bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.834+0000 7f7c3868a000 1 -- 172.21.15.29:0/1022828543 shutdown_connections 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.834+0000 7f7c3868a000 1 -- 172.21.15.29:0/1022828543 wait complete. 2024-04-23T10:16:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.834+0000 7f7c3868a000 20 client.4842 trim_cache size 0 max 16384 2024-04-23T10:16:26.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c3868a000 1 Processor -- start 2024-04-23T10:16:26.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c3868a000 1 -- start start 2024-04-23T10:16:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a0431b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a0431b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a0431bd5c0 0x55a04322e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c3868a000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301fc4c0 con 0x55a043182ab0 2024-04-23T10:16:26.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c3868a000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301fcb90 con 0x55a043182190 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c3868a000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7c301fade0 con 0x55a0431bd5c0 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a0431b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a0431b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42078/0 (socket says 172.21.15.29:42078) 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/3257679943 learned_addr learned my addr 172.21.15.29:0/3257679943 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/3257679943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a0431bd5c0 msgr2=0x55a04322e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a0431bd5c0 0x55a04322e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a0431bd5c0 0x55a04322e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/3257679943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 msgr2=0x55a0431b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2effd640 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a0431b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a0431b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 -- 172.21.15.29:0/3257679943 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a042f51e80 con 0x55a043182ab0 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a0431b8a40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7c2401ed50 tx=0x7f7c240b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ce72cfd06f01d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c0ffff640 1 -- 172.21.15.29:0/3257679943 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c240bf070 con 0x55a043182ab0 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c0ffff640 1 -- 172.21.15.29:0/3257679943 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c24000e50 con 0x55a043182ab0 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.850+0000 7f7c0ffff640 1 -- 172.21.15.29:0/3257679943 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c240b5040 con 0x55a043182ab0 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- 172.21.15.29:0/3257679943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 msgr2=0x55a0431b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a0431b8a40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7c2401ed50 tx=0x7f7c240b7000 comp rx=0 tx=0).stop 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- 172.21.15.29:0/3257679943 shutdown_connections 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a0431bd5c0 0x55a04322e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182ab0 0x55a0431b8a40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 --2- 172.21.15.29:0/3257679943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a043182190 0x55a0431b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- 172.21.15.29:0/3257679943 >> 172.21.15.29:0/3257679943 conn(0x55a0431b9e40 msgr2=0x55a04317bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- 172.21.15.29:0/3257679943 shutdown_connections 2024-04-23T10:16:26.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- 172.21.15.29:0/3257679943 wait complete. 2024-04-23T10:16:26.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- start start 2024-04-23T10:16:26.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 Processor -- start 2024-04-23T10:16:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182190 0x55a0431d4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 0x55a0431d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a0431d5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a042fca730 con 0x55a043182190 2024-04-23T10:16:26.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a042f979e0 con 0x55a0431bd5c0 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a042fcfa50 con 0x55a043182ab0 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 10 client.0 _ll_register_callbacks cb 0x7f7c240b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182190 0x55a0431d4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182190 0x55a0431d4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42090/0 (socket says 172.21.15.29:42090) 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 -- 172.21.15.29:0/4019120051 learned_addr learned my addr 172.21.15.29:0/4019120051 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 0x55a0431d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a0431d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 -- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 msgr2=0x55a0431d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 0x55a0431d4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 -- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 msgr2=0x55a0431d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a0431d5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 -- 172.21.15.29:0/4019120051 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a042f93b30 con 0x55a043182190 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2f7fe640 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a0431d5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2effd640 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182190 0x55a0431d4880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000f9b0 tx=0x7f7c20004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a8f8c40825f076 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c0dffb640 1 -- 172.21.15.29:0/4019120051 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20014cc0 con 0x55a043182190 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c0dffb640 1 -- 172.21.15.29:0/4019120051 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7c20027150 con 0x55a043182190 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- 172.21.15.29:0/4019120051 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c24000e50 con 0x55a043182190 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c0dffb640 1 -- 172.21.15.29:0/4019120051 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7c20035050 con 0x55a043182190 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 10 client.4848 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- 172.21.15.29:0/4019120051 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a04304c5b0 con 0x55a043182190 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c0dffb640 1 -- 172.21.15.29:0/4019120051 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c24000e50 con 0x55a043182190 2024-04-23T10:16:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c0dffb640 1 -- 172.21.15.29:0/4019120051 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f7c20038020 con 0x55a043182190 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 10 client.4848 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 10 client.4848 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 20 client.4848 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x55a043238580 0x55a04323a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 4 client.4848 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c3868a000 1 -- 172.21.15.29:0/4019120051 --> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] -- command(tid 0: {"prefix": "status"}) -- 0x55a042fd8e40 con 0x55a043238580 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.854+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x55a043238580 0x55a04323a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c0dffb640 10 client.4848 ms_handle_connect on v2:172.21.15.72:6834/1664530327 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c2e7fc640 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x55a043238580 0x55a04323a970 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=135cb1338778e8e6 server_cookie=69af8726dee7baed in_seq=0 out_seq=0 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c0dffb640 1 -- 172.21.15.29:0/4019120051 <== mds.2 v2:172.21.15.72:6834/1664530327 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a042fd8e40 con 0x55a043238580 2024-04-23T10:16:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c0dffb640 10 client.4848 handle_command_reply: tid=0 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 client.4848 shutdown 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 -- 172.21.15.29:0/4019120051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182190 msgr2=0x55a0431d4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182190 0x55a0431d4880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000f9b0 tx=0x7f7c20004740 comp rx=0 tx=0).stop 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 -- 172.21.15.29:0/4019120051 shutdown_connections 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x55a043238580 0x55a04323a970 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a0431bd5c0 0x55a0431d5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a043182ab0 0x55a0431d4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c0dffb640 0 client.4848 ms_handle_reset on v2:172.21.15.72:6834/1664530327 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 --2- 172.21.15.29:0/4019120051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a043182190 0x55a0431d4880 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 -- 172.21.15.29:0/4019120051 >> 172.21.15.29:0/4019120051 conn(0x55a0431b9e40 msgr2=0x55a04322b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 -- 172.21.15.29:0/4019120051 shutdown_connections 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 1 -- 172.21.15.29:0/4019120051 wait complete. 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c3868a000 20 client.4848 trim_cache size 0 max 16384 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 2, 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4230, 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:26.867 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:26.868 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 23.526163472, 2024-04-23T10:16:26.868 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:26.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:26.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:26.868 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 55.822791676000001 2024-04-23T10:16:26.868 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 -- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7c1c068380 msgr2=0x7f7c1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7c1c068380 0x7f7c1c06a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000b930 tx=0x7f7c20008040 comp rx=0 tx=0).stop 2024-04-23T10:16:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 -- 172.21.15.29:0/383206243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c30153190 msgr2=0x7f7c300c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c30153190 0x7f7c300c8060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800cf20 tx=0x7f7c2800a710 comp rx=0 tx=0).stop 2024-04-23T10:16:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 -- 172.21.15.29:0/383206243 shutdown_connections 2024-04-23T10:16:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7c1c068380 0x7f7c1c06a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c30153190 0x7f7c300c8060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c300ccc50 0x7f7c30150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 --2- 172.21.15.29:0/383206243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3006f150 0x7f7c30156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 -- 172.21.15.29:0/383206243 >> 172.21.15.29:0/383206243 conn(0x7f7c3006cfb0 msgr2=0x7f7c3006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 -- 172.21.15.29:0/383206243 shutdown_connections 2024-04-23T10:16:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.858+0000 7f7c35508640 1 -- 172.21.15.29:0/383206243 wait complete. 2024-04-23T10:16:26.877 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-23T10:16:26.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.990+0000 7fd42350e640 1 Processor -- start 2024-04-23T10:16:26.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.990+0000 7fd42350e640 1 -- start start 2024-04-23T10:16:26.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd42350e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c1530a0 0x7fd41c0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd42350e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd41c0c9990 0x7fd41c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd42350e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd41c073a40 0x7fd41c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:26.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd42350e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c0c6650 con 0x7fd41c073a40 2024-04-23T10:16:26.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd42350e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c074560 con 0x7fd41c0c9990 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd42350e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c0c5a10 con 0x7fd41c1530a0 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd41c073a40 0x7fd41c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd41c073a40 0x7fd41c15c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42098/0 (socket says 172.21.15.29:42098) 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 -- 172.21.15.29:0/33414730 learned_addr learned my addr 172.21.15.29:0/33414730 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd4212aa640 1 --2- 172.21.15.29:0/33414730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c1530a0 0x7fd41c0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd420aa9640 1 --2- 172.21.15.29:0/33414730 >> v2:172.21.15.72:3300/0 conn(0x7fd41c0c9990 0x7fd41c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 -- 172.21.15.29:0/33414730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c1530a0 msgr2=0x7fd41c0c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 --2- 172.21.15.29:0/33414730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c1530a0 0x7fd41c0c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 -- 172.21.15.29:0/33414730 >> v2:172.21.15.72:3300/0 conn(0x7fd41c0c9990 msgr2=0x7fd41c15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 --2- 172.21.15.29:0/33414730 >> v2:172.21.15.72:3300/0 conn(0x7fd41c0c9990 0x7fd41c15c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:26.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 -- 172.21.15.29:0/33414730 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c0c6ae0 con 0x7fd41c073a40 2024-04-23T10:16:26.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd420aa9640 1 --2- 172.21.15.29:0/33414730 >> v2:172.21.15.72:3300/0 conn(0x7fd41c0c9990 0x7fd41c15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:26.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd421aab640 1 --2- 172.21.15.29:0/33414730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c15c9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0cc5d0 tx=0x7fd41401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6a5746176814b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:26.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd413fff640 1 -- 172.21.15.29:0/33414730 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a5840 con 0x7fd41c073a40 2024-04-23T10:16:26.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd413fff640 1 -- 172.21.15.29:0/33414730 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4140a59e0 con 0x7fd41c073a40 2024-04-23T10:16:26.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.994+0000 7fd413fff640 1 -- 172.21.15.29:0/33414730 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a5db0 con 0x7fd41c073a40 2024-04-23T10:16:26.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- 172.21.15.29:0/33414730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 msgr2=0x7fd41c15c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:26.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 --2- 172.21.15.29:0/33414730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c15c9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0cc5d0 tx=0x7fd41401c9c0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- 172.21.15.29:0/33414730 shutdown_connections 2024-04-23T10:16:27.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 --2- 172.21.15.29:0/33414730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c15c9c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 --2- 172.21.15.29:0/33414730 >> v2:172.21.15.72:3300/0 conn(0x7fd41c0c9990 0x7fd41c15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 --2- 172.21.15.29:0/33414730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c1530a0 0x7fd41c0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- 172.21.15.29:0/33414730 >> 172.21.15.29:0/33414730 conn(0x7fd41c06fbc0 msgr2=0x7fd41c074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- 172.21.15.29:0/33414730 shutdown_connections 2024-04-23T10:16:27.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- 172.21.15.29:0/33414730 wait complete. 2024-04-23T10:16:27.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 Processor -- start 2024-04-23T10:16:27.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- start start 2024-04-23T10:16:27.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c0c9990 0x7fd41c1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd41c1530a0 0x7fd41c1433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c153480 con 0x7fd41c073a40 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0c62e0 con 0x7fd41c1530a0 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c153600 con 0x7fd41c0c9990 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42112/0 (socket says 172.21.15.29:42112) 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 -- 172.21.15.29:0/583378585 learned_addr learned my addr 172.21.15.29:0/583378585 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd421aab640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd41c1530a0 0x7fd41c1433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd420aa9640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c0c9990 0x7fd41c1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 -- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c0c9990 msgr2=0x7fd41c1583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c0c9990 0x7fd41c1583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 -- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd41c1530a0 msgr2=0x7fd41c1433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd41c1530a0 0x7fd41c1433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 -- 172.21.15.29:0/583378585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c149170 con 0x7fd41c073a40 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd4212aa640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c149650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c820 tx=0x7fd41800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd411ffb640 1 -- 172.21.15.29:0/583378585 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418015070 con 0x7fd41c073a40 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd411ffb640 1 -- 172.21.15.29:0/583378585 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd418007a30 con 0x7fd41c073a40 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- 172.21.15.29:0/583378585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c149b90 con 0x7fd41c073a40 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd411ffb640 1 -- 172.21.15.29:0/583378585 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418007e20 con 0x7fd41c073a40 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:26.998+0000 7fd42350e640 1 -- 172.21.15.29:0/583378585 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c15a4d0 con 0x7fd41c073a40 2024-04-23T10:16:27.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd411ffb640 1 -- 172.21.15.29:0/583378585 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd418018070 con 0x7fd41c073a40 2024-04-23T10:16:27.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd411ffb640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd400068380 0x7fd40006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd411ffb640 1 -- 172.21.15.29:0/583378585 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd418086c70 con 0x7fd41c073a40 2024-04-23T10:16:27.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd420aa9640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd400068380 0x7fd40006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd426690000 1 Processor -- start 2024-04-23T10:16:27.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd426690000 1 -- start start 2024-04-23T10:16:27.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd420aa9640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd400068380 0x7fd40006a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd41c15bdc0 tx=0x7fd40c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd426690000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 0x55a8da5f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd426690000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3ab0 0x55a8da62e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd426690000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da62e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd426690000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a8da43c420 con 0x55a8da62e5c0 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd426690000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a8da3d6bf0 con 0x55a8da5f3ab0 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd426690000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a8da4383e0 con 0x55a8da5f3190 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd421aab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da62e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd421aab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da62e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42124/0 (socket says 172.21.15.29:42124) 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd421aab640 1 -- 172.21.15.29:0/1589259314 learned_addr learned my addr 172.21.15.29:0/1589259314 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd4212aa640 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 0x55a8da5f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd420aa9640 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3ab0 0x55a8da62e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd421aab640 1 -- 172.21.15.29:0/1589259314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 msgr2=0x55a8da5f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd421aab640 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 0x55a8da5f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd421aab640 1 -- 172.21.15.29:0/1589259314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3ab0 msgr2=0x55a8da62e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd421aab640 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3ab0 0x55a8da62e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.002+0000 7fd421aab640 1 -- 172.21.15.29:0/1589259314 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8da4e4450 con 0x55a8da62e5c0 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd421aab640 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da62e9a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd41401d260 tx=0x7fd414004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c243a0d2c2e0eec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd406ffd640 1 -- 172.21.15.29:0/1589259314 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140bd070 con 0x55a8da62e5c0 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd406ffd640 1 -- 172.21.15.29:0/1589259314 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4140a5a40 con 0x55a8da62e5c0 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd406ffd640 1 -- 172.21.15.29:0/1589259314 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a5e10 con 0x55a8da62e5c0 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- 172.21.15.29:0/1589259314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 msgr2=0x55a8da62e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da62e9a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd41401d260 tx=0x7fd414004ac0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- 172.21.15.29:0/1589259314 shutdown_connections 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da62e9a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3ab0 0x55a8da62e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 --2- 172.21.15.29:0/1589259314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 0x55a8da5f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- 172.21.15.29:0/1589259314 >> 172.21.15.29:0/1589259314 conn(0x55a8da62ae40 msgr2=0x55a8da62d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- 172.21.15.29:0/1589259314 shutdown_connections 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- 172.21.15.29:0/1589259314 wait complete. 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- start start 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 Processor -- start 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 0x55a8da5efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da5f3ab0 0x55a8da5f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da62e5c0 0x55a8da5f0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a8da3dcec0 con 0x55a8da5f3ab0 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a8da4bd120 con 0x55a8da62e5c0 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a8da447350 con 0x55a8da5f3190 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 10 client.0 _ll_register_callbacks cb 0x55a8da4194d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da5f3ab0 0x55a8da5f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da5f3ab0 0x55a8da5f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42130/0 (socket says 172.21.15.29:42130) 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 -- 172.21.15.29:0/2265027817 learned_addr learned my addr 172.21.15.29:0/2265027817 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd421aab640 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da62e5c0 0x55a8da5f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 -- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 msgr2=0x55a8da5efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd4212aa640 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 0x55a8da5efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 0x55a8da5efbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 -- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da62e5c0 msgr2=0x55a8da5f0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da62e5c0 0x55a8da5f0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 -- 172.21.15.29:0/2265027817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8da481f80 con 0x55a8da5f3ab0 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd420aa9640 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da5f3ab0 0x55a8da5f0100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0136d0 tx=0x7fd40c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21024411b3b77cf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd3fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd3fbfff640 1 -- 172.21.15.29:0/2265027817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c024020 con 0x55a8da5f3ab0 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- 172.21.15.29:0/2265027817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4140a5a40 con 0x55a8da5f3ab0 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd3fbfff640 1 -- 172.21.15.29:0/2265027817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd40c0147d0 con 0x55a8da5f3ab0 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd3fbfff640 1 -- 172.21.15.29:0/2265027817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd40c02e050 con 0x55a8da5f3ab0 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 10 client.4860 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:27.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- 172.21.15.29:0/2265027817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a8da415f00 con 0x55a8da5f3ab0 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd3fbfff640 1 -- 172.21.15.29:0/2265027817 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4140a5a40 con 0x55a8da5f3ab0 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd3fbfff640 1 -- 172.21.15.29:0/2265027817 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fd40c031020 con 0x55a8da5f3ab0 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 10 client.4860 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 10 client.4860 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 20 client.4860 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55a8da642d90 0x55a8da645180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 4 client.4860 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.006+0000 7fd426690000 1 -- 172.21.15.29:0/2265027817 --> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8da3d5bc0 con 0x55a8da642d90 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd4212aa640 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55a8da642d90 0x55a8da645180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd4212aa640 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55a8da642d90 0x55a8da645180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6aebac1e8135123c server_cookie=30b74f1462750eb2 in_seq=0 out_seq=0 2024-04-23T10:16:27.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd3fbfff640 10 client.4860 ms_handle_connect on v2:172.21.15.72:6837/41085720 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd3fbfff640 1 -- 172.21.15.29:0/2265027817 <== mds.1 v2:172.21.15.72:6837/41085720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a8da3d5bc0 con 0x55a8da642d90 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd3fbfff640 10 client.4860 handle_command_reply: tid=0 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 client.4860 shutdown 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 -- 172.21.15.29:0/2265027817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da5f3ab0 msgr2=0x55a8da5f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da5f3ab0 0x55a8da5f0100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0136d0 tx=0x7fd40c004740 comp rx=0 tx=0).stop 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 -- 172.21.15.29:0/2265027817 shutdown_connections 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da62e5c0 0x55a8da5f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55a8da642d90 0x55a8da645180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da5f3ab0 0x55a8da5f0100 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 --2- 172.21.15.29:0/2265027817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3190 0x55a8da5efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd3fbfff640 0 client.4860 ms_handle_reset on v2:172.21.15.72:6837/41085720 2024-04-23T10:16:27.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 -- 172.21.15.29:0/2265027817 >> 172.21.15.29:0/2265027817 conn(0x55a8da62ae40 msgr2=0x55a8da62c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 -- 172.21.15.29:0/2265027817 shutdown_connections 2024-04-23T10:16:27.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 1 -- 172.21.15.29:0/2265027817 wait complete. 2024-04-23T10:16:27.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.010+0000 7fd426690000 20 client.4860 trim_cache size 0 max 16384 2024-04-23T10:16:27.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 Processor -- start 2024-04-23T10:16:27.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- start start 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 0x55a8da629500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 0x55a8da629a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1ff500 con 0x55a8da62e5c0 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1ffbd0 con 0x55a8da5f3190 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c1fdc50 con 0x55a8da5f3ab0 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42140/0 (socket says 172.21.15.29:42140) 2024-04-23T10:16:27.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 -- 172.21.15.29:0/2137681930 learned_addr learned my addr 172.21.15.29:0/2137681930 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd420aa9640 1 --2- 172.21.15.29:0/2137681930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 0x55a8da629a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 -- 172.21.15.29:0/2137681930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 msgr2=0x55a8da629a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 --2- 172.21.15.29:0/2137681930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 0x55a8da629a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 -- 172.21.15.29:0/2137681930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 msgr2=0x55a8da629500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 --2- 172.21.15.29:0/2137681930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 0x55a8da629500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 -- 172.21.15.29:0/2137681930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8da3c2e80 con 0x55a8da62e5c0 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd421aab640 1 --2- 172.21.15.29:0/2137681930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69a4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd4140b9040 tx=0x7fd4140a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403ab56d1bd080fd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd4067fc640 1 -- 172.21.15.29:0/2137681930 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140ba040 con 0x55a8da62e5c0 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd4067fc640 1 -- 172.21.15.29:0/2137681930 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4140039a0 con 0x55a8da62e5c0 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd4067fc640 1 -- 172.21.15.29:0/2137681930 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140bd040 con 0x55a8da62e5c0 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- 172.21.15.29:0/2137681930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 msgr2=0x55a8da69a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 --2- 172.21.15.29:0/2137681930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69a4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd4140b9040 tx=0x7fd4140a7000 comp rx=0 tx=0).stop 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- 172.21.15.29:0/2137681930 shutdown_connections 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 --2- 172.21.15.29:0/2137681930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69a4c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 --2- 172.21.15.29:0/2137681930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 0x55a8da629a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 --2- 172.21.15.29:0/2137681930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 0x55a8da629500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- 172.21.15.29:0/2137681930 >> 172.21.15.29:0/2137681930 conn(0x55a8da62ae40 msgr2=0x55a8da5ecec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- 172.21.15.29:0/2137681930 shutdown_connections 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- 172.21.15.29:0/2137681930 wait complete. 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 -- start start 2024-04-23T10:16:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.030+0000 7fd426690000 1 Processor -- start 2024-04-23T10:16:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 0x55a8da647d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 0x55a8da69e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a8da43b730 con 0x55a8da62e5c0 2024-04-23T10:16:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a8da4089e0 con 0x55a8da5f3190 2024-04-23T10:16:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a8da440a50 con 0x55a8da5f3ab0 2024-04-23T10:16:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 10 client.0 _ll_register_callbacks cb 0x7fd40c00a6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42156/0 (socket says 172.21.15.29:42156) 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 -- 172.21.15.29:0/4154346921 learned_addr learned my addr 172.21.15.29:0/4154346921 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd4212aa640 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 0x55a8da647d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd420aa9640 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 0x55a8da69e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 -- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 msgr2=0x55a8da69e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 0x55a8da69e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 -- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 msgr2=0x55a8da647d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 0x55a8da647d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 -- 172.21.15.29:0/4154346921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8da404b30 con 0x55a8da62e5c0 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd421aab640 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69ea80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd4140099e0 tx=0x7fd41401b200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df088cea5898308d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 1 -- 172.21.15.29:0/4154346921 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140bd070 con 0x55a8da62e5c0 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 1 -- 172.21.15.29:0/4154346921 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd4140a5e00 con 0x55a8da62e5c0 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- 172.21.15.29:0/4154346921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4140039a0 con 0x55a8da62e5c0 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 1 -- 172.21.15.29:0/4154346921 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd4140ba040 con 0x55a8da62e5c0 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 10 client.4866 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- 172.21.15.29:0/4154346921 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a8da4bd5b0 con 0x55a8da62e5c0 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 1 -- 172.21.15.29:0/4154346921 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4140039a0 con 0x55a8da62e5c0 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 1 -- 172.21.15.29:0/4154346921 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fd414008050 con 0x55a8da62e5c0 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 10 client.4866 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 10 client.4866 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 20 client.4866 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:27.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55a8da69d110 0x55a8da69d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 4 client.4866 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- 172.21.15.29:0/4154346921 --> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] -- command(tid 0: {"prefix": "status"}) -- 0x55a8da449e40 con 0x55a8da69d110 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd4212aa640 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55a8da69d110 0x55a8da69d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd4212aa640 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55a8da69d110 0x55a8da69d4f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75cc42611304941d server_cookie=b1b25e60a3dd6cdb in_seq=0 out_seq=0 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 10 client.4866 ms_handle_connect on v2:172.21.15.72:6837/41085720 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 1 -- 172.21.15.29:0/4154346921 <== mds.1 v2:172.21.15.72:6837/41085720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a8da449e40 con 0x55a8da69d110 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 10 client.4866 handle_command_reply: tid=0 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 client.4866 shutdown 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- 172.21.15.29:0/4154346921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 msgr2=0x55a8da69ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69ea80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd4140099e0 tx=0x7fd41401b200 comp rx=0 tx=0).stop 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- 172.21.15.29:0/4154346921 shutdown_connections 2024-04-23T10:16:27.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55a8da69d110 0x55a8da69d4f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8da62e5c0 0x55a8da69ea80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a8da5f3ab0 0x55a8da69e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd3fbfff640 0 client.4866 ms_handle_reset on v2:172.21.15.72:6837/41085720 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 --2- 172.21.15.29:0/4154346921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8da5f3190 0x55a8da647d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- 172.21.15.29:0/4154346921 >> 172.21.15.29:0/4154346921 conn(0x55a8da62ae40 msgr2=0x55a8da628c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- 172.21.15.29:0/4154346921 shutdown_connections 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 1 -- 172.21.15.29:0/4154346921 wait complete. 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.034+0000 7fd426690000 20 client.4866 trim_cache size 0 max 16384 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:27.044 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 1, 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4250, 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 28.747790391999999, 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 55.999457345000003 2024-04-23T10:16:27.045 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 -- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd400068380 msgr2=0x7fd40006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd400068380 0x7fd40006a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd41c15bdc0 tx=0x7fd40c008040 comp rx=0 tx=0).stop 2024-04-23T10:16:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 -- 172.21.15.29:0/583378585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 msgr2=0x7fd41c149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c149650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c820 tx=0x7fd41800cce0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 -- 172.21.15.29:0/583378585 shutdown_connections 2024-04-23T10:16:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd400068380 0x7fd40006a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd41c1530a0 0x7fd41c1433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd41c0c9990 0x7fd41c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 --2- 172.21.15.29:0/583378585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd41c073a40 0x7fd41c149650 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 -- 172.21.15.29:0/583378585 >> 172.21.15.29:0/583378585 conn(0x7fd41c06fbc0 msgr2=0x7fd41c070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 -- 172.21.15.29:0/583378585 shutdown_connections 2024-04-23T10:16:27.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.038+0000 7fd42350e640 1 -- 172.21.15.29:0/583378585 wait complete. 2024-04-23T10:16:27.055 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-23T10:16:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb78cf640 1 Processor -- start 2024-04-23T10:16:27.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb78cf640 1 -- start start 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb78cf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bb0159840 0x7f6bb0072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb78cf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb00c70c0 0x7f6bb0162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb78cf640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb0071400 con 0x7f6bb01630b0 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb78cf640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb0160030 con 0x7f6bb00c70c0 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb78cf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb01604c0 con 0x7f6bb0159840 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb4e6a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb00c70c0 0x7f6bb0162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb4e6a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb00c70c0 0x7f6bb0162b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42168/0 (socket says 172.21.15.29:42168) 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb4e6a640 1 -- 172.21.15.29:0/584913864 learned_addr learned my addr 172.21.15.29:0/584913864 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.170+0000 7f6bb5e6c640 1 --1- 172.21.15.29:0/584913864 >> v1:172.21.15.29:6789/0 conn(0x7f6bb01630b0 0x7f6bb006f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44966/0 (socket says 172.21.15.29:44966) 2024-04-23T10:16:27.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb566b640 1 --2- 172.21.15.29:0/584913864 >> v2:172.21.15.72:3300/0 conn(0x7f6bb0159840 0x7f6bb0072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb4e6a640 1 -- 172.21.15.29:0/584913864 >> v2:172.21.15.72:3300/0 conn(0x7f6bb0159840 msgr2=0x7f6bb0072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/584913864 >> v2:172.21.15.72:3300/0 conn(0x7f6bb0159840 0x7f6bb0072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb4e6a640 1 -- 172.21.15.29:0/584913864 >> v1:172.21.15.29:6789/0 conn(0x7f6bb01630b0 legacy=0x7f6bb006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6ba7fff640 1 -- 172.21.15.29:0/584913864 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690405783 0 0) 0x7f6bb0071400 con 0x7f6bb01630b0 2024-04-23T10:16:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb4e6a640 1 -- 172.21.15.29:0/584913864 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb00c7890 con 0x7f6bb00c70c0 2024-04-23T10:16:27.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb566b640 1 --2- 172.21.15.29:0/584913864 >> v2:172.21.15.72:3300/0 conn(0x7f6bb0159840 0x7f6bb0072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/584913864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb0162b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00cce50 tx=0x7f6ba001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382ea5299c00b76c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6ba7fff640 1 -- 172.21.15.29:0/584913864 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00ab660 con 0x7f6bb00c70c0 2024-04-23T10:16:27.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6ba7fff640 1 -- 172.21.15.29:0/584913864 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00b0070 con 0x7f6bb00c70c0 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6ba7fff640 1 -- 172.21.15.29:0/584913864 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00aba20 con 0x7f6bb00c70c0 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb78cf640 1 -- 172.21.15.29:0/584913864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 msgr2=0x7f6bb0162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/584913864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb0162b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00cce50 tx=0x7f6ba001c460 comp rx=0 tx=0).stop 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb78cf640 1 -- 172.21.15.29:0/584913864 shutdown_connections 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/584913864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb0162b70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/584913864 >> v2:172.21.15.72:3300/0 conn(0x7f6bb0159840 0x7f6bb0072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb78cf640 1 -- 172.21.15.29:0/584913864 >> 172.21.15.29:0/584913864 conn(0x7f6bb006cfb0 msgr2=0x7f6bb006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb78cf640 1 -- 172.21.15.29:0/584913864 shutdown_connections 2024-04-23T10:16:27.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.174+0000 7f6bb78cf640 1 -- 172.21.15.29:0/584913864 wait complete. 2024-04-23T10:16:27.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 Processor -- start 2024-04-23T10:16:27.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 -- start start 2024-04-23T10:16:27.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb00c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb0159840 0x7f6bb00c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb01630b0 0x7f6bb01616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0159c20 con 0x7f6bb00c70c0 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb015fcc0 con 0x7f6bb0159840 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb006f860 con 0x7f6bb01630b0 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb00c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb00c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42178/0 (socket says 172.21.15.29:42178) 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 -- 172.21.15.29:0/2904263979 learned_addr learned my addr 172.21.15.29:0/2904263979 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb0159840 0x7f6bb00c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb01630b0 0x7f6bb01616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 -- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb01630b0 msgr2=0x7f6bb01616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb01630b0 0x7f6bb01616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 -- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb0159840 msgr2=0x7f6bb00c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb0159840 0x7f6bb00c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 -- 172.21.15.29:0/2904263979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb00c3df0 con 0x7f6bb00c70c0 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb0159840 0x7f6bb00c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb566b640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb00c4be0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c7c0 tx=0x7f6bac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6ba5ffb640 1 -- 172.21.15.29:0/2904263979 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac007a30 con 0x7f6bb00c70c0 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6ba5ffb640 1 -- 172.21.15.29:0/2904263979 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac007bd0 con 0x7f6bb00c70c0 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6ba5ffb640 1 -- 172.21.15.29:0/2904263979 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0113f0 con 0x7f6bb00c70c0 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 -- 172.21.15.29:0/2904263979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb00cc170 con 0x7f6bb00c70c0 2024-04-23T10:16:27.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6bb78cf640 1 -- 172.21.15.29:0/2904263979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb0160bc0 con 0x7f6bb00c70c0 2024-04-23T10:16:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.178+0000 7f6ba5ffb640 1 -- 172.21.15.29:0/2904263979 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6bac011590 con 0x7f6bb00c70c0 2024-04-23T10:16:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6ba5ffb640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b940683b0 0x7f6b9406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6ba5ffb640 1 -- 172.21.15.29:0/2904263979 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6bac086fe0 con 0x7f6bb00c70c0 2024-04-23T10:16:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b940683b0 0x7f6b9406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b940683b0 0x7f6b9406a870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00af000 tx=0x7f6ba0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 Processor -- start 2024-04-23T10:16:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- start start 2024-04-23T10:16:27.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 0x55742aa65570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aaa0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aaa09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55742a8ae420 con 0x55742aaa05c0 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55742a848bf0 con 0x55742aa65ab0 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55742a8aa3e0 con 0x55742aa65190 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aaa09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aaa09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42192/0 (socket says 172.21.15.29:42192) 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 -- 172.21.15.29:0/2626359458 learned_addr learned my addr 172.21.15.29:0/2626359458 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb566b640 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 0x55742aa65570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aaa0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 -- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 msgr2=0x55742aa65570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 0x55742aa65570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 -- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 msgr2=0x55742aaa0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aaa0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 -- 172.21.15.29:0/2626359458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55742a956450 con 0x55742aaa05c0 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aaa0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aaa09a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8001cb0 tx=0x7f6ba8002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd9155e22b0eda1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6b92ffd640 1 -- 172.21.15.29:0/2626359458 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800d8b0 con 0x55742aaa05c0 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6b92ffd640 1 -- 172.21.15.29:0/2626359458 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba800da50 con 0x55742aaa05c0 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6b92ffd640 1 -- 172.21.15.29:0/2626359458 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800de00 con 0x55742aaa05c0 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2626359458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 msgr2=0x55742aaa09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aaa09a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8001cb0 tx=0x7f6ba8002170 comp rx=0 tx=0).stop 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2626359458 shutdown_connections 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aaa09a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aaa0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2626359458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 0x55742aa65570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2626359458 >> 172.21.15.29:0/2626359458 conn(0x55742aa9ce40 msgr2=0x55742aa9f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2626359458 shutdown_connections 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2626359458 wait complete. 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.182+0000 7f6bbaa51000 1 -- start start 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 Processor -- start 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 0x55742aa61b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aa620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aa625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55742a84eec0 con 0x55742aaa05c0 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55742a92f120 con 0x55742aa65ab0 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55742a8b9350 con 0x55742aa65190 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 10 client.0 _ll_register_callbacks cb 0x55742a88b4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aa625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aa625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42200/0 (socket says 172.21.15.29:42200) 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 -- 172.21.15.29:0/4044975136 learned_addr learned my addr 172.21.15.29:0/4044975136 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aa620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb566b640 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 0x55742aa61b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 -- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 msgr2=0x55742aa61b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 0x55742aa61b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 -- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 msgr2=0x55742aa620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aa620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 -- 172.21.15.29:0/4044975136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55742a8f3f80 con 0x55742aaa05c0 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aa625e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80021b0 tx=0x7f6ba8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd04e2382351bb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6b8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6b8bfff640 1 -- 172.21.15.29:0/4044975136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8025060 con 0x55742aaa05c0 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6b8bfff640 1 -- 172.21.15.29:0/4044975136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6ba8007230 con 0x55742aaa05c0 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 -- 172.21.15.29:0/4044975136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba800da50 con 0x55742aaa05c0 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6b8bfff640 1 -- 172.21.15.29:0/4044975136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6ba80074b0 con 0x55742aaa05c0 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 10 client.4881 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 -- 172.21.15.29:0/4044975136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55742a887f00 con 0x55742aaa05c0 2024-04-23T10:16:27.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6b8bfff640 1 -- 172.21.15.29:0/4044975136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba800da50 con 0x55742aaa05c0 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6b8bfff640 1 -- 172.21.15.29:0/4044975136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f6ba8007650 con 0x55742aaa05c0 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 10 client.4881 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 10 client.4881 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 20 client.4881 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55742aab4d90 0x55742aab7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 4 client.4881 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bbaa51000 1 -- 172.21.15.29:0/4044975136 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55742a847bc0 con 0x55742aab4d90 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb566b640 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55742aab4d90 0x55742aab7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6bb566b640 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55742aab4d90 0x55742aab7180 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3a293d81ea909e3 server_cookie=fbb7dfbedaa93e8c in_seq=0 out_seq=0 2024-04-23T10:16:27.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.186+0000 7f6b8bfff640 10 client.4881 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6b8bfff640 1 -- 172.21.15.29:0/4044975136 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55742a847bc0 con 0x55742aab4d90 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6b8bfff640 10 client.4881 handle_command_reply: tid=0 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 client.4881 shutdown 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 -- 172.21.15.29:0/4044975136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 msgr2=0x55742aa625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aa625e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80021b0 tx=0x7f6ba8007bc0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 -- 172.21.15.29:0/4044975136 shutdown_connections 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55742aab4d90 0x55742aab7180 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aaa05c0 0x55742aa625e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742aa620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/4044975136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65190 0x55742aa61b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6b8bfff640 0 client.4881 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 -- 172.21.15.29:0/4044975136 >> 172.21.15.29:0/4044975136 conn(0x55742aa9ce40 msgr2=0x55742aa9e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 -- 172.21.15.29:0/4044975136 shutdown_connections 2024-04-23T10:16:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 1 -- 172.21.15.29:0/4044975136 wait complete. 2024-04-23T10:16:27.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.190+0000 7f6bbaa51000 20 client.4881 trim_cache size 0 max 16384 2024-04-23T10:16:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.206+0000 7f6bbaa51000 1 Processor -- start 2024-04-23T10:16:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.206+0000 7f6bbaa51000 1 -- start start 2024-04-23T10:16:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.206+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742aa9ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65ab0 0x55742aa9b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aaa05c0 0x55742ab11510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb02061f0 con 0x55742aa65190 2024-04-23T10:16:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb01fc470 con 0x55742aaa05c0 2024-04-23T10:16:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55742a87a9e0 con 0x55742aa65ab0 2024-04-23T10:16:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742aa9ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742aa9ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42202/0 (socket says 172.21.15.29:42202) 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 -- 172.21.15.29:0/1853999459 learned_addr learned my addr 172.21.15.29:0/1853999459 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aaa05c0 0x55742ab11510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 -- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65ab0 msgr2=0x55742aa9b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65ab0 0x55742aa9b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65ab0 0x55742aa9b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 -- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aaa05c0 msgr2=0x55742ab11510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aaa05c0 0x55742ab11510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 -- 172.21.15.29:0/1853999459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55742aa64940 con 0x55742aa65190 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aaa05c0 0x55742ab11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742aa9ae90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006fd0 tx=0x7f6bac013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776a0add48383f43 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6b927fc640 1 -- 172.21.15.29:0/1853999459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac01e040 con 0x55742aa65190 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6b927fc640 1 -- 172.21.15.29:0/1853999459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac054aa0 con 0x55742aa65190 2024-04-23T10:16:27.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6b927fc640 1 -- 172.21.15.29:0/1853999459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac053070 con 0x55742aa65190 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- 172.21.15.29:0/1853999459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 msgr2=0x55742aa9ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742aa9ae90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006fd0 tx=0x7f6bac013040 comp rx=0 tx=0).stop 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- 172.21.15.29:0/1853999459 shutdown_connections 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aaa05c0 0x55742ab11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aa65ab0 0x55742aa9b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/1853999459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742aa9ae90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- 172.21.15.29:0/1853999459 >> 172.21.15.29:0/1853999459 conn(0x55742aa9ce40 msgr2=0x55742aa5ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- 172.21.15.29:0/1853999459 shutdown_connections 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- 172.21.15.29:0/1853999459 wait complete. 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- start start 2024-04-23T10:16:27.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 Processor -- start 2024-04-23T10:16:27.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742ab0b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742ab0b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aaa05c0 0x55742aab78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55742a8b2a50 con 0x55742aa65190 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55742a8ad730 con 0x55742aa65ab0 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55742a8bb630 con 0x55742aaa05c0 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 10 client.0 _ll_register_callbacks cb 0x7f6ba8001b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742ab0b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742ab0b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42214/0 (socket says 172.21.15.29:42214) 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 -- 172.21.15.29:0/2342625795 learned_addr learned my addr 172.21.15.29:0/2342625795 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742ab0b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aaa05c0 0x55742aab78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 -- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aaa05c0 msgr2=0x55742aab78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aaa05c0 0x55742aab78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 -- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 msgr2=0x55742ab0b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742ab0b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 -- 172.21.15.29:0/2342625795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55742a834e80 con 0x55742aa65190 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742ab0b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb5e6c640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aaa05c0 0x55742aab78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bb566b640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742ab0b480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006fd0 tx=0x7f6ba8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3380d67350fbd004 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6b8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6b8bfff640 1 -- 172.21.15.29:0/2342625795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac01e050 con 0x55742aa65190 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6b8bfff640 1 -- 172.21.15.29:0/2342625795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6bac05f150 con 0x55742aa65190 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2342625795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bac054aa0 con 0x55742aa65190 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.210+0000 7f6b8bfff640 1 -- 172.21.15.29:0/2342625795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6bac05f390 con 0x55742aa65190 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 10 client.4887 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2342625795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55742a876b30 con 0x55742aa65190 2024-04-23T10:16:27.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6b8bfff640 1 -- 172.21.15.29:0/2342625795 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac054aa0 con 0x55742aa65190 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6b8bfff640 1 -- 172.21.15.29:0/2342625795 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f6bac07e4c0 con 0x55742aa65190 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 10 client.4887 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 10 client.4887 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 20 client.4887 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55742aab8250 0x55742aab8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 4 client.4887 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2342625795 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "status"}) -- 0x55742a8bbe40 con 0x55742aab8250 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55742aab8250 0x55742aab8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6b8bfff640 10 client.4887 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb4e6a640 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55742aab8250 0x55742aab8630 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4d25b33c97d743c server_cookie=4cdf502e7e964e64 in_seq=0 out_seq=0 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6b8bfff640 1 -- 172.21.15.29:0/2342625795 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55742a8bbe40 con 0x55742aab8250 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6b8bfff640 10 client.4887 handle_command_reply: tid=0 2024-04-23T10:16:27.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 client.4887 shutdown 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2342625795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 msgr2=0x55742ab0b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742ab0b480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006fd0 tx=0x7f6ba8006000 comp rx=0 tx=0).stop 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2342625795 shutdown_connections 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55742aab8250 0x55742aab8630 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55742aaa05c0 0x55742aab78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55742aa65ab0 0x55742ab0b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6b8bfff640 0 client.4887 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 --2- 172.21.15.29:0/2342625795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55742aa65190 0x55742ab0b480 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2342625795 >> 172.21.15.29:0/2342625795 conn(0x55742aa9ce40 msgr2=0x55742ab0e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2342625795 shutdown_connections 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 1 -- 172.21.15.29:0/2342625795 wait complete. 2024-04-23T10:16:27.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bbaa51000 20 client.4887 trim_cache size 0 max 16384 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4288, 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 49.187368577999997, 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:27.223 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:27.224 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:27.224 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 56.178815882999999 2024-04-23T10:16:27.224 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 -- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b940683b0 msgr2=0x7f6b9406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b940683b0 0x7f6b9406a870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00af000 tx=0x7f6ba0008040 comp rx=0 tx=0).stop 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 -- 172.21.15.29:0/2904263979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 msgr2=0x7f6bb00c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb00c4be0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c7c0 tx=0x7f6bac00cc80 comp rx=0 tx=0).stop 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 -- 172.21.15.29:0/2904263979 shutdown_connections 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6b940683b0 0x7f6b9406a870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb01630b0 0x7f6bb01616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb0159840 0x7f6bb00c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 --2- 172.21.15.29:0/2904263979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00c70c0 0x7f6bb00c4be0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 -- 172.21.15.29:0/2904263979 >> 172.21.15.29:0/2904263979 conn(0x7f6bb006cfb0 msgr2=0x7f6bb00ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 -- 172.21.15.29:0/2904263979 shutdown_connections 2024-04-23T10:16:27.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.214+0000 7f6bb78cf640 1 -- 172.21.15.29:0/2904263979 wait complete. 2024-04-23T10:16:27.234 INFO:teuthology.run_tasks:Running task sequential... 2024-04-23T10:16:27.244 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-23T10:16:27.244 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-23T10:16:27.244 INFO:teuthology.task.print:Enabling mgr modules 2024-04-23T10:16:27.244 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-23T10:16:27.306 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-23T10:16:27.307 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-23T10:16:27.307 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-23T10:16:27.307 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T10:16:27.307 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:27.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:27.307 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-23T10:16:27.313 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-23T10:16:27.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:27.314 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:16:27.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:27.368 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-04-23T10:16:27.552 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-23T10:16:27.553 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-23T10:16:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f2234318640 1 Processor -- start 2024-04-23T10:16:27.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f2234318640 1 -- start start 2024-04-23T10:16:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f2234318640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f222c0ce960 0x7f222c0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f2234318640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c152c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f2234318640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f222c073b70 con 0x7f222c0ced40 2024-04-23T10:16:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f2234318640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f222c0740f0 con 0x7f222c0ce960 2024-04-23T10:16:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f2234318640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f222c073e10 con 0x7f222c0cbaf0 2024-04-23T10:16:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22320b4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f222c0ce960 0x7f222c0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22320b4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f222c0ce960 0x7f222c0c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42222/0 (socket says 172.21.15.29:42222) 2024-04-23T10:16:27.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22320b4640 1 -- 172.21.15.29:0/1829659557 learned_addr learned my addr 172.21.15.29:0/1829659557 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22328b5640 1 --2- 172.21.15.29:0/1829659557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22320b4640 1 -- 172.21.15.29:0/1829659557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 msgr2=0x7f222c152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22320b4640 1 --2- 172.21.15.29:0/1829659557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22320b4640 1 -- 172.21.15.29:0/1829659557 >> v1:172.21.15.72:6789/0 conn(0x7f222c0ced40 legacy=0x7f222c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22320b4640 1 -- 172.21.15.29:0/1829659557 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c0ca8d0 con 0x7f222c0ce960 2024-04-23T10:16:27.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.682+0000 7f22328b5640 1 --2- 172.21.15.29:0/1829659557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f22320b4640 1 --2- 172.21.15.29:0/1829659557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c0c9b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f222c074270 tx=0x7f221c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa4eead6bd11ef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f22310b2640 1 -- 172.21.15.29:0/1829659557 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c0b1070 con 0x7f222c0ce960 2024-04-23T10:16:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f22310b2640 1 -- 172.21.15.29:0/1829659557 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c0ac410 con 0x7f222c0ce960 2024-04-23T10:16:27.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f22310b2640 1 -- 172.21.15.29:0/1829659557 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c0ac7e0 con 0x7f222c0ce960 2024-04-23T10:16:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- 172.21.15.29:0/1829659557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 msgr2=0x7f222c0c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 --2- 172.21.15.29:0/1829659557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c0c9b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f222c074270 tx=0x7f221c01c500 comp rx=0 tx=0).stop 2024-04-23T10:16:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- 172.21.15.29:0/1829659557 shutdown_connections 2024-04-23T10:16:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 --2- 172.21.15.29:0/1829659557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 --2- 172.21.15.29:0/1829659557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c0c9b00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- 172.21.15.29:0/1829659557 >> 172.21.15.29:0/1829659557 conn(0x7f222c070f60 msgr2=0x7f222c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- 172.21.15.29:0/1829659557 shutdown_connections 2024-04-23T10:16:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- 172.21.15.29:0/1829659557 wait complete. 2024-04-23T10:16:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 Processor -- start 2024-04-23T10:16:27.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- start start 2024-04-23T10:16:27.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c14d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f222c0ced40 0x7f222c14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f222c153510 con 0x7f222c0ce960 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f222c153390 con 0x7f222c0ced40 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.686+0000 7f2234318640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f222c153690 con 0x7f222c0cbaf0 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c14d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c14d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42236/0 (socket says 172.21.15.29:42236) 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 -- 172.21.15.29:0/1733858544 learned_addr learned my addr 172.21.15.29:0/1733858544 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22320b4640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22328b5640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f222c0ced40 0x7f222c14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 -- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 msgr2=0x7f222c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 -- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f222c0ced40 msgr2=0x7f222c14f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f222c0ced40 0x7f222c14f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 -- 172.21.15.29:0/1733858544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c153c10 con 0x7f222c0ce960 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22318b3640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c14d110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f222000c7d0 tx=0x7f222000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f222affd640 1 -- 172.21.15.29:0/1733858544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220017070 con 0x7f222c0ce960 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f222affd640 1 -- 172.21.15.29:0/1733858544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2220003db0 con 0x7f222c0ce960 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222c153ef0 con 0x7f222c0ce960 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f222affd640 1 -- 172.21.15.29:0/1733858544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22200052b0 con 0x7f222c0ce960 2024-04-23T10:16:27.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f222c1544b0 con 0x7f222c0ce960 2024-04-23T10:16:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f222c0693c0 con 0x7f222c0ce960 2024-04-23T10:16:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f222affd640 1 -- 172.21.15.29:0/1733858544 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f222001a070 con 0x7f222c0ce960 2024-04-23T10:16:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f222affd640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f22180683b0 0x7f221806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:27.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f222affd640 1 -- 172.21.15.29:0/1733858544 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2220086440 con 0x7f222c0ce960 2024-04-23T10:16:27.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22320b4640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f22180683b0 0x7f221806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:27.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.690+0000 7f22320b4640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f22180683b0 0x7f221806a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f221c0ae000 tx=0x7f221c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.694+0000 7f222affd640 1 -- 172.21.15.29:0/1733858544 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f22200565e0 con 0x7f222c0ce960 2024-04-23T10:16:27.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.898+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f222c0cc630 con 0x7f222c0ce960 2024-04-23T10:16:27.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.898+0000 7f222affd640 1 -- 172.21.15.29:0/1733858544 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+88 (secure 0 0 0) 0x7f2220055ee0 con 0x7f222c0ce960 2024-04-23T10:16:27.902 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-23T10:16:27.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f22180683b0 msgr2=0x7f221806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f22180683b0 0x7f221806a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f221c0ae000 tx=0x7f221c008040 comp rx=0 tx=0).stop 2024-04-23T10:16:27.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 msgr2=0x7f222c14d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c14d110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f222000c7d0 tx=0x7f222000cc90 comp rx=0 tx=0).stop 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 shutdown_connections 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f22180683b0 0x7f221806a870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f222c0ced40 0x7f222c14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0ce960 0x7f222c14d110 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 --2- 172.21.15.29:0/1733858544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f222c0cbaf0 0x7f222c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 >> 172.21.15.29:0/1733858544 conn(0x7f222c070f60 msgr2=0x7f222c0c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 shutdown_connections 2024-04-23T10:16:27.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:27.902+0000 7f2234318640 1 -- 172.21.15.29:0/1733858544 wait complete. 2024-04-23T10:16:27.921 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-23T10:16:27.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T10:16:27.921 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-04-23T10:16:27.921 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-23T10:16:27.921 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:27.921 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-23T10:16:27.921 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T10:16:27.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T10:16:27.922 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-23T10:16:27.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:27.922 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-04-23T10:16:27.928 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T10:16:27.928 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T10:16:27.928 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T10:16:27.928 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:16:27.928 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:16:27.929 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:16:27.930 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-04-23T10:16:27.930 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-04-23T10:16:27.930 INFO:teuthology.orchestra.run.smithi029.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-23T10:16:27.930 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 02:42:ea:d3:cc:a1 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:16:27.930 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-23T10:16:27.930 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:16:27.930 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T10:16:27.930 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:16:27.930 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:16:27.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-04-23T10:16:27.931 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-04-23T10:16:27.931 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-04-23T10:16:27.931 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T10:16:27.931 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:16:28.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:16:28.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:16:28.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:28.048 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T10:16:28.099 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-04-23T10:16:28.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:28.100 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-04-23T10:16:28.148 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-04-23T10:16:28.148 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T10:16:28.148 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-23T10:16:28.148 INFO:teuthology.orchestra.run.smithi029.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-23T10:16:28.148 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-23T10:16:28.148 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T10:16:28.148 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:16:28.149 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:16:28.149 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-23T10:16:28.149 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-23T10:16:28.149 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-23T10:16:28.149 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:16:28.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:16:28.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:16:28.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:28.275 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-23T10:16:28.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:28.281 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-04-23T10:16:28.331 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:16:28.331 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:16:28.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:16:28.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-23T10:16:28.331 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:16:28.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:16:28.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:16:28.452 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-23T10:16:28.452 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:16:28.452 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:16:28.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-23T10:16:28.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T10:16:28.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-23T10:16:28.453 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-23T10:16:28.453 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-23T10:16:28.453 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:16:28.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:16:28.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:16:28.550 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:16:28.550 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-23T10:16:28.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-04-23T10:16:28.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T10:16:28.550 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-23T10:16:28.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:16:28.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:16:28.611 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-23T10:16:28.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:16:28.611 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:28.659 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-23T10:16:28.659 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:16:28.659 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:28.707 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-23T10:16:28.764 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:16:28.812 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-23T10:16:28.812 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-23T10:16:28.812 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-23T10:16:28.812 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/run/lock 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-23T10:16:28.813 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/fs/nfsd 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:16:28.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/rpc_pipefs 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:16:28.815 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:16:28.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:28.816 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-23T10:16:28.859 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-23T10:16:28.859 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-23T10:16:28.904 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-23T10:16:28.920 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:16:28.968 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-23T10:16:28.968 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-23T10:16:28.968 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-23T10:16:28.968 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-23T10:16:28.968 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-23T10:16:28.968 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-23T10:16:28.968 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/run/lock 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-23T10:16:28.969 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/fs/nfsd 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/run/rpc_pipefs 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:16:28.970 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:16:28.971 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-23T10:16:28.971 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:16:28.971 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:16:28.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:28.971 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-23T10:16:28.988 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-04-23T10:16:28.986+0000 7f54ec225580 -1 init, newargv = 0x5563c8560f60 newargc=15 2024-04-23T10:16:28.988 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[35564]: starting ceph client 2024-04-23T10:16:29.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[35564]: starting fuse 2024-04-23T10:16:30.093 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-23T10:16:30.109 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:16:30.156 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-23T10:16:30.156 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-23T10:16:30.156 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-23T10:16:30.156 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-23T10:16:30.156 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-23T10:16:30.156 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-23T10:16:30.156 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-23T10:16:30.156 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/run/lock 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/fs/nfsd 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-23T10:16:30.157 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/run/rpc_pipefs 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:16:30.158 INFO:teuthology.orchestra.run.smithi029.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:30.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:30.161 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-23T10:16:30.215 INFO:teuthology.orchestra.run.smithi029.stdout:45 2024-04-23T10:16:30.215 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-23T10:16:30.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo stdin-killer -- python3 -c ' 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-04-23T10:16:30.216 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-04-23T10:16:30.217 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-04-23T10:16:30.342 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.35564.asok 2024-04-23T10:16:30.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:16:30.354 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35564.asok 2024-04-23T10:16:30.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:30.354 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35564.asok status 2024-04-23T10:16:30.512 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:30.512 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-04-23T10:16:30.512 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-23T10:16:30.512 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "35564", 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4902, 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4902 2024-04-23T10:16:30.513 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2212796322 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2212796322 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4902 192.168.0.1:0/2212796322", 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/2212796322", 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-04-23T10:16:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 18, 2024-04-23T10:16:30.515 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 26, 2024-04-23T10:16:30.515 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-04-23T10:16:30.515 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-04-23T10:16:30.515 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-04-23T10:16:30.515 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:30.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:30.526 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-04-23T10:16:30.527 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:30.532 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-04-23T10:16:30.533 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:30.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:16:30.533 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:30.586 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-23T10:16:30.597 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:30.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea2a670640 1 Processor -- start 2024-04-23T10:16:30.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea2a670640 1 -- start start 2024-04-23T10:16:30.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea2a670640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea241553f0 0x7fea240cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:30.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea2a670640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2415b670 con 0x7fea2406cdc0 2024-04-23T10:16:30.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea2a670640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2415b950 con 0x7fea241557d0 2024-04-23T10:16:30.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea2a670640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fea2415c1f0 con 0x7fea241553f0 2024-04-23T10:16:30.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea28c0d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fea2406cdc0 0x7fea24165b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44976/0 (socket says 172.21.15.29:44976) 2024-04-23T10:16:30.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea28c0d640 1 -- 172.21.15.29:0/3419601910 learned_addr learned my addr 172.21.15.29:0/3419601910 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea23fff640 1 --2- 172.21.15.29:0/3419601910 >> v2:172.21.15.72:3300/0 conn(0x7fea241553f0 0x7fea240cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851580979 0 0) 0x7fea2415b670 con 0x7fea2406cdc0 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.762+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea0c003530 con 0x7fea2406cdc0 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 298118417 0 0) 0x7fea0c003530 con 0x7fea2406cdc0 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 >> v2:172.21.15.72:3300/0 conn(0x7fea241553f0 msgr2=0x7fea240cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 --2- 172.21.15.29:0/3419601910 >> v2:172.21.15.72:3300/0 conn(0x7fea241553f0 0x7fea240cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 >> v1:172.21.15.72:6789/0 conn(0x7fea241557d0 legacy=0x7fea240cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2415bc30 con 0x7fea2406cdc0 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fea14001680 con 0x7fea2406cdc0 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 >> v1:172.21.15.29:6789/0 conn(0x7fea2406cdc0 legacy=0x7fea24165b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea0c004810 0x7fea0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea0c0051d0 0x7fea0c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fea2415c1f0 con 0x7fea0c0039c0 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c00c070 con 0x7fea0c0051d0 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fea0c00c270 con 0x7fea0c004810 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea23fff640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea237fe640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea0c004810 0x7fea0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea23fff640 1 -- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea0c004810 msgr2=0x7fea0c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea28c0d640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea0c0051d0 0x7fea0c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea23fff640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea0c004810 0x7fea0c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea23fff640 1 -- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea0c0051d0 msgr2=0x7fea0c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea23fff640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea0c0051d0 0x7fea0c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea23fff640 1 -- 172.21.15.29:0/3419601910 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0c003530 con 0x7fea0c0039c0 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea28c0d640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea0c0051d0 0x7fea0c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea28c0d640 1 -- 172.21.15.29:0/3419601910 reap_dead start 2024-04-23T10:16:30.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea23fff640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea0c003de0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009fc0 tx=0x7fea1c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53260b0880cfb29 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0b2070 con 0x7fea0c0039c0 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1c0a5b60 con 0x7fea0c0039c0 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea22ffd640 1 -- 172.21.15.29:0/3419601910 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c009c10 con 0x7fea0c0039c0 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea2a670640 1 -- 172.21.15.29:0/3419601910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 msgr2=0x7fea0c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea2a670640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea0c003de0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009fc0 tx=0x7fea1c01cc80 comp rx=0 tx=0).stop 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea2a670640 1 -- 172.21.15.29:0/3419601910 shutdown_connections 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea2a670640 1 --2- 172.21.15.29:0/3419601910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea0c003de0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea2a670640 1 -- 172.21.15.29:0/3419601910 >> 172.21.15.29:0/3419601910 conn(0x7fea240730d0 msgr2=0x7fea240734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea2a670640 1 -- 172.21.15.29:0/3419601910 shutdown_connections 2024-04-23T10:16:30.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.766+0000 7fea2a670640 1 -- 172.21.15.29:0/3419601910 wait complete. 2024-04-23T10:16:30.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 Processor -- start 2024-04-23T10:16:30.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 -- start start 2024-04-23T10:16:30.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea2415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:30.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea240c5210 0x7fea241494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:30.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea24149a30 0x7fea241f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fea2415b420 con 0x7fea0c0039c0 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fea2415b2a0 con 0x7fea240c5210 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fea240ccfe0 con 0x7fea24149a30 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea2415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea2415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42252/0 (socket says 172.21.15.29:42252) 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 -- 172.21.15.29:0/2818368179 learned_addr learned my addr 172.21.15.29:0/2818368179 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea28c0d640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea24149a30 0x7fea241f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea237fe640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea240c5210 0x7fea241494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 -- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea24149a30 msgr2=0x7fea241f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea24149a30 0x7fea241f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 -- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea240c5210 msgr2=0x7fea241494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea240c5210 0x7fea241494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 -- 172.21.15.29:0/2818368179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea24149ec0 con 0x7fea0c0039c0 2024-04-23T10:16:30.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea237fe640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea240c5210 0x7fea241494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:30.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea23fff640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea2415efa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0b0040 tx=0x7fea1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:30.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea20ff9640 1 -- 172.21.15.29:0/2818368179 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0ba070 con 0x7fea0c0039c0 2024-04-23T10:16:30.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea20ff9640 1 -- 172.21.15.29:0/2818368179 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1c0ada40 con 0x7fea0c0039c0 2024-04-23T10:16:30.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2414b450 con 0x7fea0c0039c0 2024-04-23T10:16:30.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea20ff9640 1 -- 172.21.15.29:0/2818368179 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0b2040 con 0x7fea0c0039c0 2024-04-23T10:16:30.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea24148a10 con 0x7fea0c0039c0 2024-04-23T10:16:30.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.770+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea24068d70 con 0x7fea0c0039c0 2024-04-23T10:16:30.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.774+0000 7fea20ff9640 1 -- 172.21.15.29:0/2818368179 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea1c0a5d10 con 0x7fea0c0039c0 2024-04-23T10:16:30.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.774+0000 7fea20ff9640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea10068380 0x7fea1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:30.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.774+0000 7fea20ff9640 1 -- 172.21.15.29:0/2818368179 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fea1c121150 con 0x7fea0c0039c0 2024-04-23T10:16:30.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.774+0000 7fea237fe640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea10068380 0x7fea1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:30.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.774+0000 7fea237fe640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea10068380 0x7fea1006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fea2414f550 tx=0x7fea18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:30.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.778+0000 7fea20ff9640 1 -- 172.21.15.29:0/2818368179 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea1c016990 con 0x7fea0c0039c0 2024-04-23T10:16:30.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.942+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea240b6440 con 0x7fea0c0039c0 2024-04-23T10:16:30.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea20ff9640 1 -- 172.21.15.29:0/2818368179 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18877 (secure 0 0 0) 0x7fea1c0f0c90 con 0x7fea0c0039c0 2024-04-23T10:16:30.947 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:30.947 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:16:26.277550+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea10068380 msgr2=0x7fea1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea10068380 0x7fea1006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fea2414f550 tx=0x7fea18009040 comp rx=0 tx=0).stop 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 msgr2=0x7fea2415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea2415efa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0b0040 tx=0x7fea1c009750 comp rx=0 tx=0).stop 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 shutdown_connections 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea10068380 0x7fea1006a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea24149a30 0x7fea241f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea240c5210 0x7fea241494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 --2- 172.21.15.29:0/2818368179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea0c0039c0 0x7fea2415efa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 >> 172.21.15.29:0/2818368179 conn(0x7fea240730d0 msgr2=0x7fea24159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 shutdown_connections 2024-04-23T10:16:30.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:30.946+0000 7fea2a670640 1 -- 172.21.15.29:0/2818368179 wait complete. 2024-04-23T10:16:30.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:16:30.966 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:16:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b3f82640 1 Processor -- start 2024-04-23T10:16:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b3f82640 1 -- start start 2024-04-23T10:16:31.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b3f82640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8ac153190 0x7fb8ac159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b3f82640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac06f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b3f82640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac0c3fe0 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b3f82640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ac159380 con 0x7fb8ac153190 2024-04-23T10:16:31.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b3f82640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ac0c42c0 con 0x7fb8ac06f150 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b1d1e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8ac153190 0x7fb8ac159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b151d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b1d1e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8ac153190 0x7fb8ac159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:53806/0 (socket says 172.21.15.29:53806) 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b1d1e640 1 -- 172.21.15.29:0/301860655 learned_addr learned my addr 172.21.15.29:0/301860655 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b251f640 1 --1- 172.21.15.29:0/301860655 >> v1:172.21.15.72:6789/0 conn(0x7fb8ac0ccc50 0x7fb8ac0cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:45966/0 (socket says 172.21.15.29:45966) 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b1d1e640 1 -- 172.21.15.29:0/301860655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 msgr2=0x7fb8ac06f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b1d1e640 1 --2- 172.21.15.29:0/301860655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac06f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b1d1e640 1 -- 172.21.15.29:0/301860655 >> v1:172.21.15.72:6789/0 conn(0x7fb8ac0ccc50 legacy=0x7fb8ac0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b1d1e640 1 -- 172.21.15.29:0/301860655 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac0c45a0 con 0x7fb8ac153190 2024-04-23T10:16:31.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.098+0000 7fb8b151d640 1 --2- 172.21.15.29:0/301860655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:31.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b1d1e640 1 --2- 172.21.15.29:0/301860655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 0x7fb8ac159810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009870 tx=0x7fb8a801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab3e08cc3e71abcf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b0d1c640 1 -- 172.21.15.29:0/301860655 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80b5070 con 0x7fb8ac153190 2024-04-23T10:16:31.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b0d1c640 1 -- 172.21.15.29:0/301860655 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a80a8a50 con 0x7fb8ac153190 2024-04-23T10:16:31.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b0d1c640 1 -- 172.21.15.29:0/301860655 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80a8e20 con 0x7fb8ac153190 2024-04-23T10:16:31.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 -- 172.21.15.29:0/301860655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 msgr2=0x7fb8ac159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/301860655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 0x7fb8ac159810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009870 tx=0x7fb8a801ed50 comp rx=0 tx=0).stop 2024-04-23T10:16:31.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 -- 172.21.15.29:0/301860655 shutdown_connections 2024-04-23T10:16:31.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/301860655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/301860655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 0x7fb8ac159810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 -- 172.21.15.29:0/301860655 >> 172.21.15.29:0/301860655 conn(0x7fb8ac06cfb0 msgr2=0x7fb8ac06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:31.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 -- 172.21.15.29:0/301860655 shutdown_connections 2024-04-23T10:16:31.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 -- 172.21.15.29:0/301860655 wait complete. 2024-04-23T10:16:31.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 Processor -- start 2024-04-23T10:16:31.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.102+0000 7fb8b3f82640 1 -- start start 2024-04-23T10:16:31.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac1e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0ccc50 0x7fb8ac1e3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 0x7fb8ac14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac0c4880 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac153570 con 0x7fb8ac153190 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ac0c9070 con 0x7fb8ac06f150 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0ccc50 0x7fb8ac1e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0ccc50 0x7fb8ac1e3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42260/0 (socket says 172.21.15.29:42260) 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 -- 172.21.15.29:0/1457778191 learned_addr learned my addr 172.21.15.29:0/1457778191 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b1d1e640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac1e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b251f640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 0x7fb8ac14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 -- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 msgr2=0x7fb8ac1e3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac1e3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 -- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 msgr2=0x7fb8ac14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 0x7fb8ac14aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 -- 172.21.15.29:0/1457778191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac1e23d0 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b1d1e640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac1e3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:31.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b151d640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0ccc50 0x7fb8ac1e3890 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00ec10 tx=0x7fb89c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8a27fc640 1 -- 172.21.15.29:0/1457778191 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c017070 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8a27fc640 1 -- 172.21.15.29:0/1457778191 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c00cc30 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ac1ef6d0 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8a27fc640 1 -- 172.21.15.29:0/1457778191 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c013470 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ac1e4eb0 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ac068d70 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8a27fc640 1 -- 172.21.15.29:0/1457778191 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb89c01a070 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8a27fc640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb890068380 0x7fb89006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8a27fc640 1 -- 172.21.15.29:0/1457778191 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb89c086e70 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.106+0000 7fb8b1d1e640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb890068380 0x7fb89006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.110+0000 7fb8b1d1e640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb890068380 0x7fb89006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80b2000 tx=0x7fb8a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.114+0000 7fb8a27fc640 1 -- 172.21.15.29:0/1457778191 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb89c056f00 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.274+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb8ac156920 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8a27fc640 1 -- 172.21.15.29:0/1457778191 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fb89c056800 con 0x7fb8ac0ccc50 2024-04-23T10:16:31.278 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:16:31.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb890068380 msgr2=0x7fb89006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb890068380 0x7fb89006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80b2000 tx=0x7fb8a8008040 comp rx=0 tx=0).stop 2024-04-23T10:16:31.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0ccc50 msgr2=0x7fb8ac1e3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0ccc50 0x7fb8ac1e3890 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00ec10 tx=0x7fb89c00c520 comp rx=0 tx=0).stop 2024-04-23T10:16:31.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 shutdown_connections 2024-04-23T10:16:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb890068380 0x7fb89006a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8ac153190 0x7fb8ac14aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8ac0ccc50 0x7fb8ac1e3890 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 --2- 172.21.15.29:0/1457778191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8ac06f150 0x7fb8ac1e3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 >> 172.21.15.29:0/1457778191 conn(0x7fb8ac06cfb0 msgr2=0x7fb8ac069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 shutdown_connections 2024-04-23T10:16:31.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.278+0000 7fb8b3f82640 1 -- 172.21.15.29:0/1457778191 wait complete. 2024-04-23T10:16:31.298 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:16:31.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8db2c2640 1 Processor -- start 2024-04-23T10:16:31.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8db2c2640 1 -- start start 2024-04-23T10:16:31.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8db2c2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd8d4154ed0 0x7fd8d4072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8db2c2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d41552b0 0x7fd8d40704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8db2c2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d415b1c0 con 0x7fd8d40709f0 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8db2c2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d415c020 con 0x7fd8d4154ed0 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8db2c2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d415b4a0 con 0x7fd8d41552b0 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8d905e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd8d4154ed0 0x7fd8d4072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8d905e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd8d4154ed0 0x7fd8d4072e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42274/0 (socket says 172.21.15.29:42274) 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8d905e640 1 -- 172.21.15.29:0/662888251 learned_addr learned my addr 172.21.15.29:0/662888251 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8d885d640 1 --2- 172.21.15.29:0/662888251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d41552b0 0x7fd8d40704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8d905e640 1 -- 172.21.15.29:0/662888251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d41552b0 msgr2=0x7fd8d40704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8d905e640 1 --2- 172.21.15.29:0/662888251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d41552b0 0x7fd8d40704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8d905e640 1 -- 172.21.15.29:0/662888251 >> v1:172.21.15.72:6789/0 conn(0x7fd8d40709f0 legacy=0x7fd8d4074d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.426+0000 7fd8d905e640 1 -- 172.21.15.29:0/662888251 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d415b780 con 0x7fd8d4154ed0 2024-04-23T10:16:31.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8d905e640 1 --2- 172.21.15.29:0/662888251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d4154ed0 0x7fd8d4072e90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009870 tx=0x7fd8d001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7ff9154374c319 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8cbfff640 1 -- 172.21.15.29:0/662888251 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00a9610 con 0x7fd8d4154ed0 2024-04-23T10:16:31.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8cbfff640 1 -- 172.21.15.29:0/662888251 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d00a97b0 con 0x7fd8d4154ed0 2024-04-23T10:16:31.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8cbfff640 1 -- 172.21.15.29:0/662888251 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00a9b80 con 0x7fd8d4154ed0 2024-04-23T10:16:31.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- 172.21.15.29:0/662888251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d4154ed0 msgr2=0x7fd8d4072e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/662888251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d4154ed0 0x7fd8d4072e90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009870 tx=0x7fd8d001c530 comp rx=0 tx=0).stop 2024-04-23T10:16:31.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- 172.21.15.29:0/662888251 shutdown_connections 2024-04-23T10:16:31.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/662888251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d41552b0 0x7fd8d40704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/662888251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d4154ed0 0x7fd8d4072e90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- 172.21.15.29:0/662888251 >> 172.21.15.29:0/662888251 conn(0x7fd8d406b9e0 msgr2=0x7fd8d406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:31.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- 172.21.15.29:0/662888251 shutdown_connections 2024-04-23T10:16:31.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- 172.21.15.29:0/662888251 wait complete. 2024-04-23T10:16:31.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 Processor -- start 2024-04-23T10:16:31.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- start start 2024-04-23T10:16:31.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d40709f0 0x7fd8d4149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d4154ed0 0x7fd8d41f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d41552b0 0x7fd8d40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d4075470 con 0x7fd8d41552b0 2024-04-23T10:16:31.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d415f3c0 con 0x7fd8d40709f0 2024-04-23T10:16:31.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8db2c2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d40755f0 con 0x7fd8d4154ed0 2024-04-23T10:16:31.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8d985f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d41552b0 0x7fd8d40cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8d985f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d41552b0 0x7fd8d40cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42276/0 (socket says 172.21.15.29:42276) 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.430+0000 7fd8d985f640 1 -- 172.21.15.29:0/4123391594 learned_addr learned my addr 172.21.15.29:0/4123391594 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d905e640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d40709f0 0x7fd8d4149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d885d640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d4154ed0 0x7fd8d41f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d985f640 1 -- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d4154ed0 msgr2=0x7fd8d41f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d985f640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d4154ed0 0x7fd8d41f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d985f640 1 -- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d40709f0 msgr2=0x7fd8d4149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d985f640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d40709f0 0x7fd8d4149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d985f640 1 -- 172.21.15.29:0/4123391594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d40cb620 con 0x7fd8d41552b0 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d905e640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d40709f0 0x7fd8d4149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d985f640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d41552b0 0x7fd8d40cc340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00c7a0 tx=0x7fd8cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8c9ffb640 1 -- 172.21.15.29:0/4123391594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc003b80 con 0x7fd8d41552b0 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8c9ffb640 1 -- 172.21.15.29:0/4123391594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8cc003d20 con 0x7fd8d41552b0 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d41494a0 con 0x7fd8d41552b0 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8c9ffb640 1 -- 172.21.15.29:0/4123391594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00aa90 con 0x7fd8d41552b0 2024-04-23T10:16:31.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d4147520 con 0x7fd8d41552b0 2024-04-23T10:16:31.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d406c970 con 0x7fd8d41552b0 2024-04-23T10:16:31.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8c9ffb640 1 -- 172.21.15.29:0/4123391594 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd8cc00ac30 con 0x7fd8d41552b0 2024-04-23T10:16:31.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8c9ffb640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8b80683b0 0x7fd8b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8c9ffb640 1 -- 172.21.15.29:0/4123391594 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd8cc086ca0 con 0x7fd8d41552b0 2024-04-23T10:16:31.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d905e640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8b80683b0 0x7fd8b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.434+0000 7fd8d905e640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8b80683b0 0x7fd8b806a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00ae000 tx=0x7fd8d00b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.438+0000 7fd8c9ffb640 1 -- 172.21.15.29:0/4123391594 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd8cc056ed0 con 0x7fd8d41552b0 2024-04-23T10:16:31.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.602+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd8d40693c0 con 0x7fd8d41552b0 2024-04-23T10:16:31.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8c9ffb640 1 -- 172.21.15.29:0/4123391594 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fd8cc0567d0 con 0x7fd8d41552b0 2024-04-23T10:16:31.606 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8b80683b0 msgr2=0x7fd8b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8b80683b0 0x7fd8b806a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00ae000 tx=0x7fd8d00b3040 comp rx=0 tx=0).stop 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d41552b0 msgr2=0x7fd8d40cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d41552b0 0x7fd8d40cc340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00c7a0 tx=0x7fd8cc00cc60 comp rx=0 tx=0).stop 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 shutdown_connections 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8b80683b0 0x7fd8b806a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8d41552b0 0x7fd8d40cc340 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8d4154ed0 0x7fd8d41f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 --2- 172.21.15.29:0/4123391594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8d40709f0 0x7fd8d4149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 >> 172.21.15.29:0/4123391594 conn(0x7fd8d406b9e0 msgr2=0x7fd8d414fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:31.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 shutdown_connections 2024-04-23T10:16:31.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.606+0000 7fd8db2c2640 1 -- 172.21.15.29:0/4123391594 wait complete. 2024-04-23T10:16:31.625 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:16:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f257a421640 1 Processor -- start 2024-04-23T10:16:31.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f257a421640 1 -- start start 2024-04-23T10:16:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f257a421640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2574153190 0x7f2574159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f257a421640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25740cd360 0x7f257406f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f257a421640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25740c3fe0 con 0x7f257406f150 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f257a421640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2574159380 con 0x7f25740cd360 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f257a421640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f25740c42c0 con 0x7f2574153190 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25789be640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25740cd360 0x7f257406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f256bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f257406f150 0x7f25740ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44984/0 (socket says 172.21.15.29:44984) 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f256bfff640 1 -- 172.21.15.29:0/3778987008 learned_addr learned my addr 172.21.15.29:0/3778987008 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f2573fff640 1 --2- 172.21.15.29:0/3778987008 >> v2:172.21.15.72:3300/0 conn(0x7f2574153190 0x7f2574159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25737fe640 1 -- 172.21.15.29:0/3778987008 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573222654 0 0) 0x7f25740c3fe0 con 0x7f257406f150 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25737fe640 1 -- 172.21.15.29:0/3778987008 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2560003530 con 0x7f257406f150 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25789be640 1 -- 172.21.15.29:0/3778987008 >> v2:172.21.15.72:3300/0 conn(0x7f2574153190 msgr2=0x7f2574159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25789be640 1 --2- 172.21.15.29:0/3778987008 >> v2:172.21.15.72:3300/0 conn(0x7f2574153190 0x7f2574159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25789be640 1 -- 172.21.15.29:0/3778987008 >> v1:172.21.15.29:6789/0 conn(0x7f257406f150 legacy=0x7f25740ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25789be640 1 -- 172.21.15.29:0/3778987008 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25740c45a0 con 0x7f25740cd360 2024-04-23T10:16:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25789be640 1 --2- 172.21.15.29:0/3778987008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25740cd360 0x7f257406f580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2574159500 tx=0x7f256c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbeb9b07229ce57 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25737fe640 1 -- 172.21.15.29:0/3778987008 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c0b4070 con 0x7f25740cd360 2024-04-23T10:16:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25737fe640 1 -- 172.21.15.29:0/3778987008 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256c0af600 con 0x7f25740cd360 2024-04-23T10:16:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.746+0000 7f25737fe640 1 -- 172.21.15.29:0/3778987008 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c0af9d0 con 0x7f25740cd360 2024-04-23T10:16:31.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- 172.21.15.29:0/3778987008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25740cd360 msgr2=0x7f257406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 --2- 172.21.15.29:0/3778987008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25740cd360 0x7f257406f580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2574159500 tx=0x7f256c01f110 comp rx=0 tx=0).stop 2024-04-23T10:16:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- 172.21.15.29:0/3778987008 shutdown_connections 2024-04-23T10:16:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 --2- 172.21.15.29:0/3778987008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25740cd360 0x7f257406f580 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 --2- 172.21.15.29:0/3778987008 >> v2:172.21.15.72:3300/0 conn(0x7f2574153190 0x7f2574159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- 172.21.15.29:0/3778987008 >> 172.21.15.29:0/3778987008 conn(0x7f257406cfb0 msgr2=0x7f257406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- 172.21.15.29:0/3778987008 shutdown_connections 2024-04-23T10:16:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- 172.21.15.29:0/3778987008 wait complete. 2024-04-23T10:16:31.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 Processor -- start 2024-04-23T10:16:31.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- start start 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f257406f150 0x7f257414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25740cd360 0x7f25740ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2574153190 0x7f25740cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f25740c4880 con 0x7f2574153190 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2574153570 con 0x7f25740cd360 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f25740c9070 con 0x7f257406f150 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2574153190 0x7f25740cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2574153190 0x7f25740cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42298/0 (socket says 172.21.15.29:42298) 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 -- 172.21.15.29:0/3138434297 learned_addr learned my addr 172.21.15.29:0/3138434297 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:31.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f256bfff640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25740cd360 0x7f25740ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f2573fff640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f257406f150 0x7f257414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 -- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f257406f150 msgr2=0x7f257414ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f257406f150 0x7f257414ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 -- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25740cd360 msgr2=0x7f25740ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25740cd360 0x7f25740ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 -- 172.21.15.29:0/3138434297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25740cc2f0 con 0x7f2574153190 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f2573fff640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f257406f150 0x7f257414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25789be640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2574153190 0x7f25740cac40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b2040 tx=0x7f256c01beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25717fa640 1 -- 172.21.15.29:0/3138434297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c0b4040 con 0x7f2574153190 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25717fa640 1 -- 172.21.15.29:0/3138434297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256c0c1070 con 0x7f2574153190 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2574155ce0 con 0x7f2574153190 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f25717fa640 1 -- 172.21.15.29:0/3138434297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c009450 con 0x7f2574153190 2024-04-23T10:16:31.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.750+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25741562a0 con 0x7f2574153190 2024-04-23T10:16:31.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.754+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2574068d70 con 0x7f2574153190 2024-04-23T10:16:31.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.754+0000 7f25717fa640 1 -- 172.21.15.29:0/3138434297 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f256c0ba6b0 con 0x7f2574153190 2024-04-23T10:16:31.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.754+0000 7f25717fa640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2554068380 0x7f255406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:31.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.754+0000 7f25717fa640 1 -- 172.21.15.29:0/3138434297 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f256c1256f0 con 0x7f2574153190 2024-04-23T10:16:31.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.754+0000 7f2573fff640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2554068380 0x7f255406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:31.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.754+0000 7f2573fff640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2554068380 0x7f255406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f256400b9f0 tx=0x7f2564008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:31.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.758+0000 7f25717fa640 1 -- 172.21.15.29:0/3138434297 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f256c018c70 con 0x7f2574153190 2024-04-23T10:16:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.922+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25740c7be0 con 0x7f2574153190 2024-04-23T10:16:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.922+0000 7f25717fa640 1 -- 172.21.15.29:0/3138434297 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f256c0f59a0 con 0x7f2574153190 2024-04-23T10:16:31.924 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:16:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.922+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2554068380 msgr2=0x7f255406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.922+0000 7f257a421640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2554068380 0x7f255406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f256400b9f0 tx=0x7f2564008040 comp rx=0 tx=0).stop 2024-04-23T10:16:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.922+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2574153190 msgr2=0x7f25740cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.922+0000 7f257a421640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2574153190 0x7f25740cac40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b2040 tx=0x7f256c01beb0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.926+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 shutdown_connections 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.926+0000 7f257a421640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2554068380 0x7f255406a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.926+0000 7f257a421640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2574153190 0x7f25740cac40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.926+0000 7f257a421640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25740cd360 0x7f25740ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.926+0000 7f257a421640 1 --2- 172.21.15.29:0/3138434297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f257406f150 0x7f257414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.926+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 >> 172.21.15.29:0/3138434297 conn(0x7f257406cfb0 msgr2=0x7f25741580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.926+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 shutdown_connections 2024-04-23T10:16:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:31.926+0000 7f257a421640 1 -- 172.21.15.29:0/3138434297 wait complete. 2024-04-23T10:16:31.943 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:16:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f143e0a7640 1 Processor -- start 2024-04-23T10:16:32.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f143e0a7640 1 -- start start 2024-04-23T10:16:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f143e0a7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1438152030 0x7f14380c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f143e0a7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14380c99f0 0x7f14380cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f143e0a7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1438157db0 con 0x7f14380cdaf0 2024-04-23T10:16:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f143e0a7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1438158070 con 0x7f14380c99f0 2024-04-23T10:16:32.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f143e0a7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1438158350 con 0x7f1438152030 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f1436ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14380c99f0 0x7f14380cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f14377fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1438152030 0x7f14380c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f1436ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14380c99f0 0x7f14380cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:53868/0 (socket says 172.21.15.29:53868) 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f1437fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14380cdaf0 0x7f143815b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:45982/0 (socket says 172.21.15.29:45982) 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f1436ffd640 1 -- 172.21.15.29:0/3414865566 learned_addr learned my addr 172.21.15.29:0/3414865566 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f1436ffd640 1 -- 172.21.15.29:0/3414865566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1438152030 msgr2=0x7f14380c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f1436ffd640 1 --2- 172.21.15.29:0/3414865566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1438152030 0x7f14380c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f1436ffd640 1 -- 172.21.15.29:0/3414865566 >> v1:172.21.15.72:6789/0 conn(0x7f14380cdaf0 legacy=0x7f143815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.074+0000 7f1436ffd640 1 -- 172.21.15.29:0/3414865566 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1438158630 con 0x7f14380c99f0 2024-04-23T10:16:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f1436ffd640 1 --2- 172.21.15.29:0/3414865566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14380c99f0 0x7f14380cd5b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1428009870 tx=0x7f142801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6779230965f3afa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f14367fc640 1 -- 172.21.15.29:0/3414865566 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14280b2070 con 0x7f14380c99f0 2024-04-23T10:16:32.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f14367fc640 1 -- 172.21.15.29:0/3414865566 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14280a9070 con 0x7f14380c99f0 2024-04-23T10:16:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f14367fc640 1 -- 172.21.15.29:0/3414865566 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14280ad880 con 0x7f14380c99f0 2024-04-23T10:16:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 -- 172.21.15.29:0/3414865566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14380c99f0 msgr2=0x7f14380cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 --2- 172.21.15.29:0/3414865566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14380c99f0 0x7f14380cd5b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1428009870 tx=0x7f142801c560 comp rx=0 tx=0).stop 2024-04-23T10:16:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 -- 172.21.15.29:0/3414865566 shutdown_connections 2024-04-23T10:16:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 --2- 172.21.15.29:0/3414865566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14380c99f0 0x7f14380cd5b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 --2- 172.21.15.29:0/3414865566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1438152030 0x7f14380c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 -- 172.21.15.29:0/3414865566 >> 172.21.15.29:0/3414865566 conn(0x7f143806b9e0 msgr2=0x7f143806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 -- 172.21.15.29:0/3414865566 shutdown_connections 2024-04-23T10:16:32.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 -- 172.21.15.29:0/3414865566 wait complete. 2024-04-23T10:16:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.078+0000 7f143e0a7640 1 Processor -- start 2024-04-23T10:16:32.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 -- start start 2024-04-23T10:16:32.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14380c99f0 0x7f1438141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14380cdaf0 0x7f143814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1438152030 0x7f1438148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1438165160 con 0x7f14380c99f0 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f14380ce460 con 0x7f1438152030 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f14381652e0 con 0x7f14380cdaf0 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14380c99f0 0x7f1438141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14380c99f0 0x7f1438141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42302/0 (socket says 172.21.15.29:42302) 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 -- 172.21.15.29:0/1430716206 learned_addr learned my addr 172.21.15.29:0/1430716206 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f1436ffd640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14380cdaf0 0x7f143814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f1437fff640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1438152030 0x7f1438148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 -- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14380cdaf0 msgr2=0x7f143814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14380cdaf0 0x7f143814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 -- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1438152030 msgr2=0x7f1438148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1438152030 0x7f1438148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 -- 172.21.15.29:0/1430716206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14380cd870 con 0x7f14380c99f0 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f1437fff640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1438152030 0x7f1438148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f14377fe640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14380c99f0 0x7f1438141590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f142c00e960 tx=0x7f142c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f141ffff640 1 -- 172.21.15.29:0/1430716206 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c017070 con 0x7f14380c99f0 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f141ffff640 1 -- 172.21.15.29:0/1430716206 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f142c00ca00 con 0x7f14380c99f0 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f141ffff640 1 -- 172.21.15.29:0/1430716206 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c00cdb0 con 0x7f14380c99f0 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14381f6310 con 0x7f14380c99f0 2024-04-23T10:16:32.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14380ccd90 con 0x7f14380c99f0 2024-04-23T10:16:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14380693c0 con 0x7f14380c99f0 2024-04-23T10:16:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.082+0000 7f141ffff640 1 -- 172.21.15.29:0/1430716206 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f142c01a070 con 0x7f14380c99f0 2024-04-23T10:16:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.086+0000 7f141ffff640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1424068380 0x7f142406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.086+0000 7f141ffff640 1 -- 172.21.15.29:0/1430716206 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f142c086de0 con 0x7f14380c99f0 2024-04-23T10:16:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.086+0000 7f1436ffd640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1424068380 0x7f142406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.086+0000 7f1436ffd640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1424068380 0x7f142406a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f14280af000 tx=0x7f1428008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.090+0000 7f141ffff640 1 -- 172.21.15.29:0/1430716206 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f142c056f80 con 0x7f14380c99f0 2024-04-23T10:16:32.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f14380c91c0 con 0x7f14380c99f0 2024-04-23T10:16:32.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f141ffff640 1 -- 172.21.15.29:0/1430716206 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f142c056880 con 0x7f14380c99f0 2024-04-23T10:16:32.258 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:32.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1424068380 msgr2=0x7f142406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1424068380 0x7f142406a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f14280af000 tx=0x7f1428008040 comp rx=0 tx=0).stop 2024-04-23T10:16:32.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14380c99f0 msgr2=0x7f1438141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14380c99f0 0x7f1438141590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f142c00e960 tx=0x7f142c00ee20 comp rx=0 tx=0).stop 2024-04-23T10:16:32.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 shutdown_connections 2024-04-23T10:16:32.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1424068380 0x7f142406a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1438152030 0x7f1438148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14380cdaf0 0x7f143814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 --2- 172.21.15.29:0/1430716206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14380c99f0 0x7f1438141590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.254+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 >> 172.21.15.29:0/1430716206 conn(0x7f143806b9e0 msgr2=0x7f143815b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:32.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.258+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 shutdown_connections 2024-04-23T10:16:32.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.258+0000 7f143e0a7640 1 -- 172.21.15.29:0/1430716206 wait complete. 2024-04-23T10:16:32.274 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:32.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.386+0000 7f36dfc1b640 1 Processor -- start 2024-04-23T10:16:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.386+0000 7f36dfc1b640 1 -- start start 2024-04-23T10:16:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dfc1b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806f3b0 0x7f36d80c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dfc1b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36d806f790 0x7f36d8073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dfc1b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d8072590 con 0x7f36d8071160 2024-04-23T10:16:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dfc1b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f36d8072fe0 con 0x7f36d806f790 2024-04-23T10:16:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dfc1b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f36d8158df0 con 0x7f36d806f3b0 2024-04-23T10:16:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36de1b8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f36d8071160 0x7f36d8157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44994/0 (socket says 172.21.15.29:44994) 2024-04-23T10:16:32.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36de1b8640 1 -- 172.21.15.29:0/1916387412 learned_addr learned my addr 172.21.15.29:0/1916387412 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd1b6640 1 --2- 172.21.15.29:0/1916387412 >> v2:172.21.15.72:3300/0 conn(0x7f36d806f790 0x7f36d8073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd9b7640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806f3b0 0x7f36d80c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378372031 0 0) 0x7f36d8072590 con 0x7f36d8071160 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c4003530 con 0x7f36d8071160 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 59827862 0 0) 0x7f36c4003530 con 0x7f36d8071160 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806f3b0 msgr2=0x7f36d80c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806f3b0 0x7f36d80c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 >> v2:172.21.15.72:3300/0 conn(0x7f36d806f790 msgr2=0x7f36d8073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 --2- 172.21.15.29:0/1916387412 >> v2:172.21.15.72:3300/0 conn(0x7f36d806f790 0x7f36d8073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d8158830 con 0x7f36d8071160 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f36d0001a00 con 0x7f36d8071160 2024-04-23T10:16:32.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd1b6640 1 --2- 172.21.15.29:0/1916387412 >> v2:172.21.15.72:3300/0 conn(0x7f36d806f790 0x7f36d8073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 >> v1:172.21.15.29:6789/0 conn(0x7f36d8071160 legacy=0x7f36d8157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40039c0 0x7f36c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36c4004810 0x7f36c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806f3b0 0x7f36c40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f36d8072fe0 con 0x7f36c4004810 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f36d8158df0 con 0x7f36c40039c0 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f36c400b9d0 con 0x7f36d806f3b0 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd1b6640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36c4004810 0x7f36c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd9b7640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40039c0 0x7f36c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36de1b8640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806f3b0 0x7f36c40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd1b6640 1 -- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806f3b0 msgr2=0x7f36c40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd1b6640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806f3b0 0x7f36c40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd1b6640 1 -- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40039c0 msgr2=0x7f36c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:32.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd1b6640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40039c0 0x7f36c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.390+0000 7f36dd1b6640 1 -- 172.21.15.29:0/1916387412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c4003530 con 0x7f36c4004810 2024-04-23T10:16:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dd1b6640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36c4004810 0x7f36c4004c90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009c80 tx=0x7f36c801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb896adf678521d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c80b2070 con 0x7f36c4004810 2024-04-23T10:16:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c80a5720 con 0x7f36c4004810 2024-04-23T10:16:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dc9b5640 1 -- 172.21.15.29:0/1916387412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8009880 con 0x7f36c4004810 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- 172.21.15.29:0/1916387412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36c4004810 msgr2=0x7f36c4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 --2- 172.21.15.29:0/1916387412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36c4004810 0x7f36c4004c90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009c80 tx=0x7f36c801cc50 comp rx=0 tx=0).stop 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 -- 172.21.15.29:0/1916387412 reap_dead start 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- 172.21.15.29:0/1916387412 shutdown_connections 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- 172.21.15.29:0/1916387412 >> 172.21.15.29:0/1916387412 conn(0x7f36d806cfb0 msgr2=0x7f36d806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- 172.21.15.29:0/1916387412 shutdown_connections 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- 172.21.15.29:0/1916387412 wait complete. 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 Processor -- start 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- start start 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4004810 0x7f36d81ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8071b30 0x7f36d814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d8148900 0x7f36d81f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f36d8072c70 con 0x7f36d8148900 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f36d8072990 con 0x7f36c4004810 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dfc1b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f36d8158500 con 0x7f36d8071b30 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d8148900 0x7f36d81f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d8148900 0x7f36d81f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42326/0 (socket says 172.21.15.29:42326) 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 -- 172.21.15.29:0/727379912 learned_addr learned my addr 172.21.15.29:0/727379912 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dd1b6640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8071b30 0x7f36d814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dd9b7640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4004810 0x7f36d81ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 -- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8071b30 msgr2=0x7f36d814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8071b30 0x7f36d814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 -- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4004810 msgr2=0x7f36d81ef7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4004810 0x7f36d81ef7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36de1b8640 1 -- 172.21.15.29:0/727379912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d81efd30 con 0x7f36d8148900 2024-04-23T10:16:32.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.394+0000 7f36dd9b7640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4004810 0x7f36d81ef7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36de1b8640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d8148900 0x7f36d81f18f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f36d00012f0 tx=0x7f36d0011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36ce7fc640 1 -- 172.21.15.29:0/727379912 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d0010040 con 0x7f36d8148900 2024-04-23T10:16:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36ce7fc640 1 -- 172.21.15.29:0/727379912 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d001a070 con 0x7f36d8148900 2024-04-23T10:16:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d8152a20 con 0x7f36d8148900 2024-04-23T10:16:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36ce7fc640 1 -- 172.21.15.29:0/727379912 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d000fb20 con 0x7f36d8148900 2024-04-23T10:16:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d814cc90 con 0x7f36d8148900 2024-04-23T10:16:32.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d8146ae0 con 0x7f36d8148900 2024-04-23T10:16:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36ce7fc640 1 -- 172.21.15.29:0/727379912 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36d000fcc0 con 0x7f36d8148900 2024-04-23T10:16:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36ce7fc640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f36bc068380 0x7f36bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36ce7fc640 1 -- 172.21.15.29:0/727379912 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f36d0089ec0 con 0x7f36d8148900 2024-04-23T10:16:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36dd9b7640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f36bc068380 0x7f36bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.398+0000 7f36dd9b7640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f36bc068380 0x7f36bc06a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36d4006d50 tx=0x7f36d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.402+0000 7f36ce7fc640 1 -- 172.21.15.29:0/727379912 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36d8146ae0 con 0x7f36d8148900 2024-04-23T10:16:32.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.566+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36d80c9a40 con 0x7f36d8148900 2024-04-23T10:16:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.566+0000 7f36ce7fc640 1 -- 172.21.15.29:0/727379912 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18877 (secure 0 0 0) 0x7f36d0059f30 con 0x7f36d8148900 2024-04-23T10:16:32.568 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:32.569 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:16:26.277550+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.566+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f36bc068380 msgr2=0x7f36bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f36bc068380 0x7f36bc06a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36d4006d50 tx=0x7f36d4008040 comp rx=0 tx=0).stop 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d8148900 msgr2=0x7f36d81f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d8148900 0x7f36d81f18f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f36d00012f0 tx=0x7f36d0011c20 comp rx=0 tx=0).stop 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 shutdown_connections 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f36bc068380 0x7f36bc06a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36d8148900 0x7f36d81f18f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8071b30 0x7f36d814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 --2- 172.21.15.29:0/727379912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4004810 0x7f36d81ef7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 >> 172.21.15.29:0/727379912 conn(0x7f36d806cfb0 msgr2=0x7f36d8150930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:32.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 shutdown_connections 2024-04-23T10:16:32.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.570+0000 7f36dfc1b640 1 -- 172.21.15.29:0/727379912 wait complete. 2024-04-23T10:16:32.586 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:16:32.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:16:32.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe312047640 1 Processor -- start 2024-04-23T10:16:32.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe312047640 1 -- start start 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe312047640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe30c0c8950 0x7fe30c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe312047640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe30c06f790 0x7fe30c155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe312047640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30c15eae0 con 0x7fe30c06f3b0 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe312047640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c073b70 con 0x7fe30c0c8950 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe312047640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c15edc0 con 0x7fe30c06f790 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe303fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe30c0c8950 0x7fe30c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe303fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe30c0c8950 0x7fe30c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42334/0 (socket says 172.21.15.29:42334) 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe303fff640 1 -- 172.21.15.29:0/517814538 learned_addr learned my addr 172.21.15.29:0/517814538 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:32.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe30bfff640 1 --2- 172.21.15.29:0/517814538 >> v2:172.21.15.72:3300/0 conn(0x7fe30c06f790 0x7fe30c155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe303fff640 1 -- 172.21.15.29:0/517814538 >> v2:172.21.15.72:3300/0 conn(0x7fe30c06f790 msgr2=0x7fe30c155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:32.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe303fff640 1 --2- 172.21.15.29:0/517814538 >> v2:172.21.15.72:3300/0 conn(0x7fe30c06f790 0x7fe30c155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe303fff640 1 -- 172.21.15.29:0/517814538 >> v1:172.21.15.72:6789/0 conn(0x7fe30c06f3b0 legacy=0x7fe30c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe303fff640 1 -- 172.21.15.29:0/517814538 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c15f0a0 con 0x7fe30c0c8950 2024-04-23T10:16:32.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.702+0000 7fe303fff640 1 --2- 172.21.15.29:0/517814538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c154f10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe30c073140 tx=0x7fe2fc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dffaf09828fdce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30affd640 1 -- 172.21.15.29:0/517814538 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0b5070 con 0x7fe30c0c8950 2024-04-23T10:16:32.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30affd640 1 -- 172.21.15.29:0/517814538 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0a8a10 con 0x7fe30c0c8950 2024-04-23T10:16:32.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30affd640 1 -- 172.21.15.29:0/517814538 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0a8de0 con 0x7fe30c0c8950 2024-04-23T10:16:32.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- 172.21.15.29:0/517814538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 msgr2=0x7fe30c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 --2- 172.21.15.29:0/517814538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c154f10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe30c073140 tx=0x7fe2fc01ed10 comp rx=0 tx=0).stop 2024-04-23T10:16:32.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- 172.21.15.29:0/517814538 shutdown_connections 2024-04-23T10:16:32.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 --2- 172.21.15.29:0/517814538 >> v2:172.21.15.72:3300/0 conn(0x7fe30c06f790 0x7fe30c155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 --2- 172.21.15.29:0/517814538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c154f10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- 172.21.15.29:0/517814538 >> 172.21.15.29:0/517814538 conn(0x7fe30c06cfb0 msgr2=0x7fe30c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:32.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- 172.21.15.29:0/517814538 shutdown_connections 2024-04-23T10:16:32.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- 172.21.15.29:0/517814538 wait complete. 2024-04-23T10:16:32.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 Processor -- start 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- start start 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c06f3b0 0x7fe30c1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c06f790 0x7fe30c0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c1f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c071960 con 0x7fe30c0c8950 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c15f660 con 0x7fe30c06f790 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c0c77d0 con 0x7fe30c06f3b0 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c1f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c1f0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42342/0 (socket says 172.21.15.29:42342) 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 -- 172.21.15.29:0/2816535686 learned_addr learned my addr 172.21.15.29:0/2816535686 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 -- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c06f3b0 msgr2=0x7fe30c1505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c06f3b0 0x7fe30c1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 -- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c06f790 msgr2=0x7fe30c0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c06f790 0x7fe30c0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 -- 172.21.15.29:0/2816535686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1f18c0 con 0x7fe30c0c8950 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe30bfff640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c1f0930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe304007e40 tx=0x7fe30400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe308ff9640 1 -- 172.21.15.29:0/2816535686 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304014620 con 0x7fe30c0c8950 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe308ff9640 1 -- 172.21.15.29:0/2816535686 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe304019070 con 0x7fe30c0c8950 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c1f15e0 con 0x7fe30c0c8950 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe308ff9640 1 -- 172.21.15.29:0/2816535686 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304014a20 con 0x7fe30c0c8950 2024-04-23T10:16:32.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.706+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c0c4390 con 0x7fe30c0c8950 2024-04-23T10:16:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.710+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c068d70 con 0x7fe30c0c8950 2024-04-23T10:16:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.710+0000 7fe308ff9640 1 -- 172.21.15.29:0/2816535686 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe304014bc0 con 0x7fe30c0c8950 2024-04-23T10:16:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.710+0000 7fe308ff9640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2ec068380 0x7fe2ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.710+0000 7fe308ff9640 1 -- 172.21.15.29:0/2816535686 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe304088590 con 0x7fe30c0c8950 2024-04-23T10:16:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.710+0000 7fe30b7fe640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2ec068380 0x7fe2ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.710+0000 7fe30b7fe640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2ec068380 0x7fe2ec06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4000f70 tx=0x7fe2f40079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:32.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.714+0000 7fe308ff9640 1 -- 172.21.15.29:0/2816535686 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe304058780 con 0x7fe30c0c8950 2024-04-23T10:16:32.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.870+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe30c0c3e80 con 0x7fe30c0c8950 2024-04-23T10:16:32.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.870+0000 7fe308ff9640 1 -- 172.21.15.29:0/2816535686 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fe304058080 con 0x7fe30c0c8950 2024-04-23T10:16:32.872 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:16:32.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.870+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2ec068380 msgr2=0x7fe2ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.870+0000 7fe312047640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2ec068380 0x7fe2ec06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4000f70 tx=0x7fe2f40079e0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.870+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 msgr2=0x7fe30c1f0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.870+0000 7fe312047640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c1f0930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe304007e40 tx=0x7fe30400e4b0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.874+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 shutdown_connections 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.874+0000 7fe312047640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe2ec068380 0x7fe2ec06a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.874+0000 7fe312047640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c0c8950 0x7fe30c1f0930 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.874+0000 7fe312047640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c06f790 0x7fe30c0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.874+0000 7fe312047640 1 --2- 172.21.15.29:0/2816535686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c06f3b0 0x7fe30c1505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.874+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 >> 172.21.15.29:0/2816535686 conn(0x7fe30c06cfb0 msgr2=0x7fe30c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.874+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 shutdown_connections 2024-04-23T10:16:32.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:32.874+0000 7fe312047640 1 -- 172.21.15.29:0/2816535686 wait complete. 2024-04-23T10:16:32.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:16:33.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c1dbaa640 1 Processor -- start 2024-04-23T10:16:33.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c1dbaa640 1 -- start start 2024-04-23T10:16:33.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c1dbaa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c1806f3b0 0x7f5c180c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c1dbaa640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f790 0x7f5c18073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c1dbaa640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c18071160 0x7f5c18157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c1dbaa640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5c18072fe0 con 0x7f5c1806f3b0 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c1dbaa640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5c18158df0 con 0x7f5c18071160 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c1dbaa640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5c18072590 con 0x7f5c1806f790 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c177fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c1806f3b0 0x7f5c180c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c177fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c1806f3b0 0x7f5c180c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42358/0 (socket says 172.21.15.29:42358) 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c177fe640 1 -- 172.21.15.29:0/2196327712 learned_addr learned my addr 172.21.15.29:0/2196327712 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c17fff640 1 --2- 172.21.15.29:0/2196327712 >> v2:172.21.15.72:3300/0 conn(0x7f5c18071160 0x7f5c18157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c16ffd640 1 --2- 172.21.15.29:0/2196327712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f790 0x7f5c18073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c177fe640 1 -- 172.21.15.29:0/2196327712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f790 msgr2=0x7f5c18073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c177fe640 1 --2- 172.21.15.29:0/2196327712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f790 0x7f5c18073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c177fe640 1 -- 172.21.15.29:0/2196327712 >> v2:172.21.15.72:3300/0 conn(0x7f5c18071160 msgr2=0x7f5c18157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c177fe640 1 --2- 172.21.15.29:0/2196327712 >> v2:172.21.15.72:3300/0 conn(0x7f5c18071160 0x7f5c18157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c177fe640 1 -- 172.21.15.29:0/2196327712 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c18158830 con 0x7f5c1806f3b0 2024-04-23T10:16:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c17fff640 1 --2- 172.21.15.29:0/2196327712 >> v2:172.21.15.72:3300/0 conn(0x7f5c18071160 0x7f5c18157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.010+0000 7f5c16ffd640 1 --2- 172.21.15.29:0/2196327712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f790 0x7f5c18073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c177fe640 1 --2- 172.21.15.29:0/2196327712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1806f3b0 0x7f5c180c4d70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5c1806dd50 tx=0x7f5c1001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6777ce86377dd10 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c167fc640 1 -- 172.21.15.29:0/2196327712 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100a5840 con 0x7f5c1806f3b0 2024-04-23T10:16:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c167fc640 1 -- 172.21.15.29:0/2196327712 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c100a59e0 con 0x7f5c1806f3b0 2024-04-23T10:16:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c167fc640 1 -- 172.21.15.29:0/2196327712 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100a5db0 con 0x7f5c1806f3b0 2024-04-23T10:16:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2196327712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1806f3b0 msgr2=0x7f5c180c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2196327712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1806f3b0 0x7f5c180c4d70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5c1806dd50 tx=0x7f5c1001c9c0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2196327712 shutdown_connections 2024-04-23T10:16:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2196327712 >> v2:172.21.15.72:3300/0 conn(0x7f5c18071160 0x7f5c18157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2196327712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f790 0x7f5c18073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2196327712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1806f3b0 0x7f5c180c4d70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2196327712 >> 172.21.15.29:0/2196327712 conn(0x7f5c1806cfb0 msgr2=0x7f5c1806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2196327712 shutdown_connections 2024-04-23T10:16:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2196327712 wait complete. 2024-04-23T10:16:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 Processor -- start 2024-04-23T10:16:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- start start 2024-04-23T10:16:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f3b0 0x7f5c18153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c1806f790 0x7f5c181579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c18071160 0x7f5c18154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181524b0 con 0x7f5c18071160 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18152330 con 0x7f5c1806f790 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c1dbaa640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1815b3e0 con 0x7f5c1806f3b0 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c18071160 0x7f5c18154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c18071160 0x7f5c18154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42372/0 (socket says 172.21.15.29:42372) 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c17fff640 1 -- 172.21.15.29:0/2491041534 learned_addr learned my addr 172.21.15.29:0/2491041534 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c16ffd640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c1806f790 0x7f5c181579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.014+0000 7f5c177fe640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f3b0 0x7f5c18153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c17fff640 1 -- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f3b0 msgr2=0x7f5c18153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c17fff640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f3b0 0x7f5c18153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c17fff640 1 -- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c1806f790 msgr2=0x7f5c181579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c17fff640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c1806f790 0x7f5c181579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c17fff640 1 -- 172.21.15.29:0/2491041534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c18153880 con 0x7f5c18071160 2024-04-23T10:16:33.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c17fff640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c18071160 0x7f5c18154040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800c820 tx=0x7f5c0800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5bfffff640 1 -- 172.21.15.29:0/2491041534 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08015020 con 0x7f5c18071160 2024-04-23T10:16:33.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5bfffff640 1 -- 172.21.15.29:0/2491041534 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c08004240 con 0x7f5c18071160 2024-04-23T10:16:33.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c18156c20 con 0x7f5c18071160 2024-04-23T10:16:33.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5bfffff640 1 -- 172.21.15.29:0/2491041534 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08003620 con 0x7f5c18071160 2024-04-23T10:16:33.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c181571c0 con 0x7f5c18071160 2024-04-23T10:16:33.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c18153d30 con 0x7f5c18071160 2024-04-23T10:16:33.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5bfffff640 1 -- 172.21.15.29:0/2491041534 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c08018020 con 0x7f5c18071160 2024-04-23T10:16:33.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5bfffff640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c040683b0 0x7f5c0406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5bfffff640 1 -- 172.21.15.29:0/2491041534 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5c08086d80 con 0x7f5c18071160 2024-04-23T10:16:33.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c177fe640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c040683b0 0x7f5c0406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.018+0000 7f5c177fe640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c040683b0 0x7f5c0406a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c100ae000 tx=0x7f5c100a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.022+0000 7f5bfffff640 1 -- 172.21.15.29:0/2491041534 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c0801f020 con 0x7f5c18071160 2024-04-23T10:16:33.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5c18068d70 con 0x7f5c18071160 2024-04-23T10:16:33.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5bfffff640 1 -- 172.21.15.29:0/2491041534 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f5c08056fb0 con 0x7f5c18071160 2024-04-23T10:16:33.188 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:33.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c040683b0 msgr2=0x7f5c0406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c040683b0 0x7f5c0406a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c100ae000 tx=0x7f5c100a7070 comp rx=0 tx=0).stop 2024-04-23T10:16:33.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c18071160 msgr2=0x7f5c18154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c18071160 0x7f5c18154040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800c820 tx=0x7f5c0800cce0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 shutdown_connections 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c040683b0 0x7f5c0406a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c18071160 0x7f5c18154040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c1806f790 0x7f5c181579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 --2- 172.21.15.29:0/2491041534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c1806f3b0 0x7f5c18153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 >> 172.21.15.29:0/2491041534 conn(0x7f5c1806cfb0 msgr2=0x7f5c1814f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 shutdown_connections 2024-04-23T10:16:33.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.186+0000 7f5c1dbaa640 1 -- 172.21.15.29:0/2491041534 wait complete. 2024-04-23T10:16:33.206 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:16:33.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.330+0000 7fea7dad0640 1 Processor -- start 2024-04-23T10:16:33.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.330+0000 7fea7dad0640 1 -- start start 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7dad0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea7815c1b0 0x7fea780c4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7dad0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea78158bc0 con 0x7fea78152d00 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7dad0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea780c6900 con 0x7fea780c8de0 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7dad0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fea7815c6f0 con 0x7fea7815c1b0 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7cace640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fea78152d00 0x7fea780c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45010/0 (socket says 172.21.15.29:45010) 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7cace640 1 -- 172.21.15.29:0/4173445306 learned_addr learned my addr 172.21.15.29:0/4173445306 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4248743261 0 0) 0x7fea78158bc0 con 0x7fea78152d00 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea60003530 con 0x7fea78152d00 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7d2cf640 1 --2- 172.21.15.29:0/4173445306 >> v2:172.21.15.72:3300/0 conn(0x7fea7815c1b0 0x7fea780c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 485456417 0 0) 0x7fea60003530 con 0x7fea78152d00 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 >> v2:172.21.15.72:3300/0 conn(0x7fea7815c1b0 msgr2=0x7fea780c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 --2- 172.21.15.29:0/4173445306 >> v2:172.21.15.72:3300/0 conn(0x7fea7815c1b0 0x7fea780c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 >> v1:172.21.15.72:6789/0 conn(0x7fea780c8de0 legacy=0x7fea781593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7815c9d0 con 0x7fea78152d00 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fea68001680 con 0x7fea78152d00 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 >> v1:172.21.15.29:6789/0 conn(0x7fea78152d00 legacy=0x7fea780c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600039c0 0x7fea60003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea60004810 0x7fea60004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea600051d0 0x7fea6000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fea7815c6f0 con 0x7fea600051d0 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fea6000c120 con 0x7fea600039c0 2024-04-23T10:16:33.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fea6000c320 con 0x7fea60004810 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7d2cf640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea600051d0 0x7fea6000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7cace640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600039c0 0x7fea60003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea77fff640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea60004810 0x7fea60004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7d2cf640 1 -- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea60004810 msgr2=0x7fea60004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7d2cf640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea60004810 0x7fea60004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7d2cf640 1 -- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600039c0 msgr2=0x7fea60003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7d2cf640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600039c0 0x7fea60003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7d2cf640 1 -- 172.21.15.29:0/4173445306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea60003530 con 0x7fea600051d0 2024-04-23T10:16:33.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7cace640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600039c0 0x7fea60003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.334+0000 7fea7d2cf640 1 -- 172.21.15.29:0/4173445306 reap_dead start 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7d2cf640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea600051d0 0x7fea6000b9d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea70007330 tx=0x7fea7001ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cc6bd580462298 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea70009be0 con 0x7fea600051d0 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea700a5d60 con 0x7fea600051d0 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea777fe640 1 -- 172.21.15.29:0/4173445306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea700ad660 con 0x7fea600051d0 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- 172.21.15.29:0/4173445306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea600051d0 msgr2=0x7fea6000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea600051d0 0x7fea6000b9d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea70007330 tx=0x7fea7001ce60 comp rx=0 tx=0).stop 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- 172.21.15.29:0/4173445306 shutdown_connections 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 --2- 172.21.15.29:0/4173445306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea600051d0 0x7fea6000b9d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- 172.21.15.29:0/4173445306 >> 172.21.15.29:0/4173445306 conn(0x7fea780c9f30 msgr2=0x7fea780ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- 172.21.15.29:0/4173445306 shutdown_connections 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- 172.21.15.29:0/4173445306 wait complete. 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 Processor -- start 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- start start 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600051d0 0x7fea781f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea78158960 0x7fea781f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea781574e0 0x7fea78151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fea78158e80 con 0x7fea78158960 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fea7815cf90 con 0x7fea600051d0 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fea781530e0 con 0x7fea781574e0 2024-04-23T10:16:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea78158960 0x7fea781f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea78158960 0x7fea781f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42382/0 (socket says 172.21.15.29:42382) 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 -- 172.21.15.29:0/661351111 learned_addr learned my addr 172.21.15.29:0/661351111 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7cace640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600051d0 0x7fea781f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7d2cf640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea781574e0 0x7fea78151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 -- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea781574e0 msgr2=0x7fea78151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea781574e0 0x7fea78151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 -- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600051d0 msgr2=0x7fea781f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600051d0 0x7fea781f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 -- 172.21.15.29:0/661351111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea78073680 con 0x7fea78158960 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea77fff640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea78158960 0x7fea781f0760 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00e3c0 tx=0x7fea6c00e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea757fa640 1 -- 172.21.15.29:0/661351111 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c019070 con 0x7fea78158960 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea757fa640 1 -- 172.21.15.29:0/661351111 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea6c0052e0 con 0x7fea78158960 2024-04-23T10:16:33.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea757fa640 1 -- 172.21.15.29:0/661351111 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c003820 con 0x7fea78158960 2024-04-23T10:16:33.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea78072d50 con 0x7fea78158960 2024-04-23T10:16:33.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.338+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea781f3fb0 con 0x7fea78158960 2024-04-23T10:16:33.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.342+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea78076260 con 0x7fea78158960 2024-04-23T10:16:33.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.342+0000 7fea757fa640 1 -- 172.21.15.29:0/661351111 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea6c01c070 con 0x7fea78158960 2024-04-23T10:16:33.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.342+0000 7fea757fa640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea640683b0 0x7fea6406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.342+0000 7fea757fa640 1 -- 172.21.15.29:0/661351111 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fea6c0861c0 con 0x7fea78158960 2024-04-23T10:16:33.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.342+0000 7fea7cace640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea640683b0 0x7fea6406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.342+0000 7fea7cace640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea640683b0 0x7fea6406a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea68000f70 tx=0x7fea68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.346+0000 7fea757fa640 1 -- 172.21.15.29:0/661351111 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea6c055da0 con 0x7fea78158960 2024-04-23T10:16:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.506+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fea78074290 con 0x7fea78158960 2024-04-23T10:16:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.506+0000 7fea757fa640 1 -- 172.21.15.29:0/661351111 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fea6c05a0a0 con 0x7fea78158960 2024-04-23T10:16:33.509 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:16:33.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea640683b0 msgr2=0x7fea6406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea640683b0 0x7fea6406a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea68000f70 tx=0x7fea68009040 comp rx=0 tx=0).stop 2024-04-23T10:16:33.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea78158960 msgr2=0x7fea781f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea78158960 0x7fea781f0760 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00e3c0 tx=0x7fea6c00e880 comp rx=0 tx=0).stop 2024-04-23T10:16:33.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 shutdown_connections 2024-04-23T10:16:33.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fea640683b0 0x7fea6406a870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea781574e0 0x7fea78151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea78158960 0x7fea781f0760 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 --2- 172.21.15.29:0/661351111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea600051d0 0x7fea781f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 >> 172.21.15.29:0/661351111 conn(0x7fea780c9f30 msgr2=0x7fea7806fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:33.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 shutdown_connections 2024-04-23T10:16:33.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.510+0000 7fea7dad0640 1 -- 172.21.15.29:0/661351111 wait complete. 2024-04-23T10:16:33.528 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:16:33.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd7a57640 1 Processor -- start 2024-04-23T10:16:33.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd7a57640 1 -- start start 2024-04-23T10:16:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd7a57640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dd006f150 0x7f8dd006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd7a57640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd00cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd7a57640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd00cd5c0 con 0x7f8dd0153190 2024-04-23T10:16:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd7a57640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8dd0159f20 con 0x7f8dd006f150 2024-04-23T10:16:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd7a57640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd0159380 con 0x7f8dd00ccc50 2024-04-23T10:16:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd4ff2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dd006f150 0x7f8dd006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd57f3640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8dd0153190 0x7f8dd0159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:45996/0 (socket says 172.21.15.29:45996) 2024-04-23T10:16:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd5ff4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd00cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd57f3640 1 -- 172.21.15.29:0/1359782092 learned_addr learned my addr 172.21.15.29:0/1359782092 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dc7fff640 1 -- 172.21.15.29:0/1359782092 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232242576 0 0) 0x7f8dcc001120 con 0x7f8dd0153190 2024-04-23T10:16:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dc7fff640 1 -- 172.21.15.29:0/1359782092 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dbc003530 con 0x7f8dd0153190 2024-04-23T10:16:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd4ff2640 1 -- 172.21.15.29:0/1359782092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 msgr2=0x7f8dd00cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd4ff2640 1 --2- 172.21.15.29:0/1359782092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd00cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd4ff2640 1 -- 172.21.15.29:0/1359782092 >> v1:172.21.15.72:6789/0 conn(0x7f8dd0153190 legacy=0x7f8dd0159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.654+0000 7f8dd4ff2640 1 -- 172.21.15.29:0/1359782092 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd00c3fe0 con 0x7f8dd006f150 2024-04-23T10:16:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd4ff2640 1 --2- 172.21.15.29:0/1359782092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd006f150 0x7f8dd006f580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00097c0 tx=0x7f8dc001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d558a5740852389 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dc7fff640 1 -- 172.21.15.29:0/1359782092 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00b5070 con 0x7f8dd006f150 2024-04-23T10:16:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dc7fff640 1 -- 172.21.15.29:0/1359782092 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc00a8990 con 0x7f8dd006f150 2024-04-23T10:16:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dc7fff640 1 -- 172.21.15.29:0/1359782092 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00a8d60 con 0x7f8dd006f150 2024-04-23T10:16:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 -- 172.21.15.29:0/1359782092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd006f150 msgr2=0x7f8dd006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/1359782092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd006f150 0x7f8dd006f580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00097c0 tx=0x7f8dc001ec90 comp rx=0 tx=0).stop 2024-04-23T10:16:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 -- 172.21.15.29:0/1359782092 shutdown_connections 2024-04-23T10:16:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/1359782092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd00cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/1359782092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd006f150 0x7f8dd006f580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 -- 172.21.15.29:0/1359782092 >> 172.21.15.29:0/1359782092 conn(0x7f8dd006cfb0 msgr2=0x7f8dd006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 -- 172.21.15.29:0/1359782092 shutdown_connections 2024-04-23T10:16:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 -- 172.21.15.29:0/1359782092 wait complete. 2024-04-23T10:16:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 Processor -- start 2024-04-23T10:16:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.658+0000 7f8dd7a57640 1 -- start start 2024-04-23T10:16:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dd006f150 0x7f8dd015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd014b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd0153190 0x7f8dd01423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd0159010 con 0x7f8dd006f150 2024-04-23T10:16:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd00c45a0 con 0x7f8dd0153190 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd0153570 con 0x7f8dd00ccc50 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dd006f150 0x7f8dd015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dd006f150 0x7f8dd015a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42398/0 (socket says 172.21.15.29:42398) 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 -- 172.21.15.29:0/2067317454 learned_addr learned my addr 172.21.15.29:0/2067317454 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd5ff4640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd0153190 0x7f8dd01423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd4ff2640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd014b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 -- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 msgr2=0x7f8dd014b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd014b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 -- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd0153190 msgr2=0x7f8dd01423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd0153190 0x7f8dd01423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 -- 172.21.15.29:0/2067317454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd0146cd0 con 0x7f8dd006f150 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd4ff2640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd014b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd57f3640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dd006f150 0x7f8dd015a0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00c730 tx=0x7f8dcc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dc5ffb640 1 -- 172.21.15.29:0/2067317454 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc017070 con 0x7f8dd006f150 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dc5ffb640 1 -- 172.21.15.29:0/2067317454 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dcc005ae0 con 0x7f8dd006f150 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dc5ffb640 1 -- 172.21.15.29:0/2067317454 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc007e30 con 0x7f8dd006f150 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd01583f0 con 0x7f8dd006f150 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd0158690 con 0x7f8dd006f150 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd0068d70 con 0x7f8dd006f150 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dc5ffb640 1 -- 172.21.15.29:0/2067317454 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8dcc01a070 con 0x7f8dd006f150 2024-04-23T10:16:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dc5ffb640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8db40683b0 0x7f8db406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.662+0000 7f8dc5ffb640 1 -- 172.21.15.29:0/2067317454 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8dcc086180 con 0x7f8dd006f150 2024-04-23T10:16:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.666+0000 7f8dd4ff2640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8db40683b0 0x7f8db406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.666+0000 7f8dd4ff2640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8db40683b0 0x7f8db406a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b2000 tx=0x7f8dc00aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.666+0000 7f8dc5ffb640 1 -- 172.21.15.29:0/2067317454 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8dd0146cd0 con 0x7f8dd006f150 2024-04-23T10:16:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.822+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8dd01eee10 con 0x7f8dd006f150 2024-04-23T10:16:33.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.822+0000 7f8dc5ffb640 1 -- 172.21.15.29:0/2067317454 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f8dd00cd5c0 con 0x7f8dd006f150 2024-04-23T10:16:33.825 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:33.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8db40683b0 msgr2=0x7f8db406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8db40683b0 0x7f8db406a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b2000 tx=0x7f8dc00aa070 comp rx=0 tx=0).stop 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dd006f150 msgr2=0x7f8dd015a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dd006f150 0x7f8dd015a0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00c730 tx=0x7f8dcc00cbf0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 shutdown_connections 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8db40683b0 0x7f8db406a870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd0153190 0x7f8dd01423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd00ccc50 0x7f8dd014b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 --2- 172.21.15.29:0/2067317454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8dd006f150 0x7f8dd015a0c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 >> 172.21.15.29:0/2067317454 conn(0x7f8dd006cfb0 msgr2=0x7f8dd00c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 shutdown_connections 2024-04-23T10:16:33.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.826+0000 7f8dd7a57640 1 -- 172.21.15.29:0/2067317454 wait complete. 2024-04-23T10:16:33.843 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-23T10:16:33.843 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:16:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ae0fec640 1 Processor -- start 2024-04-23T10:16:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ae0fec640 1 -- start start 2024-04-23T10:16:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ae0fec640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7adc15bd80 0x7f7adc0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ae0fec640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc06c910 con 0x7f7adc0cbcb0 2024-04-23T10:16:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ae0fec640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc06cbf0 con 0x7f7adc151bb0 2024-04-23T10:16:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ae0fec640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7adc06ced0 con 0x7f7adc15bd80 2024-04-23T10:16:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7adad9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7adc0cbcb0 0x7f7adc0c6840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45026/0 (socket says 172.21.15.29:45026) 2024-04-23T10:16:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7adad9d640 1 -- 172.21.15.29:0/1381846649 learned_addr learned my addr 172.21.15.29:0/1381846649 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1381846649 >> v2:172.21.15.72:3300/0 conn(0x7f7adc15bd80 0x7f7adc0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53939016 0 0) 0x7f7adc06c910 con 0x7f7adc0cbcb0 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.962+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ac8003530 con 0x7f7adc0cbcb0 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2169471371 0 0) 0x7f7ac8003530 con 0x7f7adc0cbcb0 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 >> v2:172.21.15.72:3300/0 conn(0x7f7adc15bd80 msgr2=0x7f7adc0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 --2- 172.21.15.29:0/1381846649 >> v2:172.21.15.72:3300/0 conn(0x7f7adc15bd80 0x7f7adc0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 >> v1:172.21.15.72:6789/0 conn(0x7f7adc151bb0 legacy=0x7f7adc0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc06d1b0 con 0x7f7adc0cbcb0 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f7acc001a00 con 0x7f7adc0cbcb0 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 >> v1:172.21.15.29:6789/0 conn(0x7f7adc0cbcb0 legacy=0x7f7adc0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ac80039c0 0x7f7ac8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac80051d0 0x7f7ac800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc06ced0 con 0x7f7ac8004810 2024-04-23T10:16:33.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac800c080 con 0x7f7ac80051d0 2024-04-23T10:16:33.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac800c280 con 0x7f7ac80039c0 2024-04-23T10:16:33.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7adad9d640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac80051d0 0x7f7ac800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ada59c640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ac80039c0 0x7f7ac8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad9d9b640 1 -- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ac80039c0 msgr2=0x7f7ac8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ac80039c0 0x7f7ac8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad9d9b640 1 -- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac80051d0 msgr2=0x7f7ac800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:33.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac80051d0 0x7f7ac800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7adad9d640 1 -- 172.21.15.29:0/1381846649 reap_dead start 2024-04-23T10:16:33.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad9d9b640 1 -- 172.21.15.29:0/1381846649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac8003530 con 0x7f7ac8004810 2024-04-23T10:16:33.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ada59c640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ac80039c0 0x7f7ac8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:33.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009ac0 tx=0x7f7ac401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2a00c0f688c472 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b2070 con 0x7f7ac8004810 2024-04-23T10:16:33.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac40a5640 con 0x7f7ac8004810 2024-04-23T10:16:33.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ad959a640 1 -- 172.21.15.29:0/1381846649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4009690 con 0x7f7ac8004810 2024-04-23T10:16:33.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1381846649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 msgr2=0x7f7ac8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ae0fec640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009ac0 tx=0x7f7ac401ca50 comp rx=0 tx=0).stop 2024-04-23T10:16:33.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1381846649 shutdown_connections 2024-04-23T10:16:33.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ae0fec640 1 --2- 172.21.15.29:0/1381846649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1381846649 >> 172.21.15.29:0/1381846649 conn(0x7f7adc0730f0 msgr2=0x7f7adc073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:33.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1381846649 shutdown_connections 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.966+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1381846649 wait complete. 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 Processor -- start 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 -- start start 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7adc1f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc0d1280 0x7f7adc1f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7adc14f0b0 0x7f7adc0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc0cb770 con 0x7f7ac8004810 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc151f90 con 0x7f7adc0d1280 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7adc0cb8f0 con 0x7f7adc14f0b0 2024-04-23T10:16:33.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7adc1f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7adc1f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42416/0 (socket says 172.21.15.29:42416) 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 -- 172.21.15.29:0/1425382360 learned_addr learned my addr 172.21.15.29:0/1425382360 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7adad9d640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7adc14f0b0 0x7f7adc0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc0d1280 0x7f7adc1f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 -- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7adc14f0b0 msgr2=0x7f7adc0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7adc14f0b0 0x7f7adc0cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 -- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc0d1280 msgr2=0x7f7adc1f1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc0d1280 0x7f7adc1f1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 -- 172.21.15.29:0/1425382360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc0d1730 con 0x7f7ac8004810 2024-04-23T10:16:33.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc0d1280 0x7f7adc1f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ada59c640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7adc1f5220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400d4a0 tx=0x7f7ad400d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ad2ffd640 1 -- 172.21.15.29:0/1425382360 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4005280 con 0x7f7ac8004810 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ad2ffd640 1 -- 172.21.15.29:0/1425382360 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad4005440 con 0x7f7ac8004810 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc15c370 con 0x7f7ac8004810 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ad2ffd640 1 -- 172.21.15.29:0/1425382360 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4007260 con 0x7f7ac8004810 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7adc1f13b0 con 0x7f7ac8004810 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7adc068d70 con 0x7f7ac8004810 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ad2ffd640 1 -- 172.21.15.29:0/1425382360 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ad4019020 con 0x7f7ac8004810 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ad2ffd640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7abc068380 0x7f7abc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:33.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.970+0000 7f7ad2ffd640 1 -- 172.21.15.29:0/1425382360 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7ad4086510 con 0x7f7ac8004810 2024-04-23T10:16:33.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.974+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7abc068380 0x7f7abc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:33.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.974+0000 7f7ad9d9b640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7abc068380 0x7f7abc06a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40af000 tx=0x7f7ac4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:33.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:33.978+0000 7f7ad2ffd640 1 -- 172.21.15.29:0/1425382360 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ad4056620 con 0x7f7ac8004810 2024-04-23T10:16:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.130+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7adc158e00 con 0x7f7abc068380 2024-04-23T10:16:34.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ad2ffd640 1 -- 172.21.15.29:0/1425382360 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332687 (secure 0 0 0) 0x7f7adc158e00 con 0x7f7abc068380 2024-04-23T10:16:34.161 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:34.164 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:16:34.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7abc068380 msgr2=0x7f7abc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7abc068380 0x7f7abc06a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40af000 tx=0x7f7ac4008040 comp rx=0 tx=0).stop 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 msgr2=0x7f7adc1f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7adc1f5220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400d4a0 tx=0x7f7ad400d960 comp rx=0 tx=0).stop 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 shutdown_connections 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7abc068380 0x7f7abc06a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7adc14f0b0 0x7f7adc0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7adc0d1280 0x7f7adc1f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 --2- 172.21.15.29:0/1425382360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ac8004810 0x7f7adc1f5220 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 >> 172.21.15.29:0/1425382360 conn(0x7f7adc0730f0 msgr2=0x7f7adc14fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:34.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 shutdown_connections 2024-04-23T10:16:34.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.158+0000 7f7ae0fec640 1 -- 172.21.15.29:0/1425382360 wait complete. 2024-04-23T10:16:34.177 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-23T10:16:33.209574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236396,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738324,"statfs":{"total":773094113280,"available":772852043776,"internally_reserved":0,"allocated":3678208,"data_stored":2120376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1764,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002865"},"pg_stats":[{"pgid":"2.1f","version":"24'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065972+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:16:27.065972+0000","last_peered":"2024-04-23T10:16:27.065972+0000","last_clean":"2024-04-23T10:16:27.065972+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:16:27.065972+0000","last_undegraded":"2024-04-23T10:16:27.065972+0000","last_fullsized":"2024-04-23T10:16:27.065972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286349+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:16:26.286349+0000","last_peered":"2024-04-23T10:16:26.286349+0000","last_clean":"2024-04-23T10:16:26.286349+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:16:26.286349+0000","last_undegraded":"2024-04-23T10:16:26.286349+0000","last_fullsized":"2024-04-23T10:16:26.286349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284564+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:16:26.284564+0000","last_peered":"2024-04-23T10:16:26.284564+0000","last_clean":"2024-04-23T10:16:26.284564+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:16:26.284564+0000","last_undegraded":"2024-04-23T10:16:26.284564+0000","last_fullsized":"2024-04-23T10:16:26.284564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286933+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:16:26.286933+0000","last_peered":"2024-04-23T10:16:26.286933+0000","last_clean":"2024-04-23T10:16:26.286933+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:16:26.286933+0000","last_undegraded":"2024-04-23T10:16:26.286933+0000","last_fullsized":"2024-04-23T10:16:26.286933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065876+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:16:27.065876+0000","last_peered":"2024-04-23T10:16:27.065876+0000","last_clean":"2024-04-23T10:16:27.065876+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:16:27.065876+0000","last_undegraded":"2024-04-23T10:16:27.065876+0000","last_fullsized":"2024-04-23T10:16:27.065876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.955819+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:16:26.955819+0000","last_peered":"2024-04-23T10:16:26.955819+0000","last_clean":"2024-04-23T10:16:26.955819+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:16:26.955819+0000","last_undegraded":"2024-04-23T10:16:26.955819+0000","last_fullsized":"2024-04-23T10:16:26.955819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364693+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:16:26.364693+0000","last_peered":"2024-04-23T10:16:26.364693+0000","last_clean":"2024-04-23T10:16:26.364693+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:16:26.364693+0000","last_undegraded":"2024-04-23T10:16:26.364693+0000","last_fullsized":"2024-04-23T10:16:26.364693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288230+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:16:26.288230+0000","last_peered":"2024-04-23T10:16:26.288230+0000","last_clean":"2024-04-23T10:16:26.288230+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:16:26.288230+0000","last_undegraded":"2024-04-23T10:16:26.288230+0000","last_fullsized":"2024-04-23T10:16:26.288230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956173+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:16:26.956173+0000","last_peered":"2024-04-23T10:16:26.956173+0000","last_clean":"2024-04-23T10:16:26.956173+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:16:26.956173+0000","last_undegraded":"2024-04-23T10:16:26.956173+0000","last_fullsized":"2024-04-23T10:16:26.956173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364930+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:16:26.364930+0000","last_peered":"2024-04-23T10:16:26.364930+0000","last_clean":"2024-04-23T10:16:26.364930+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:16:26.364930+0000","last_undegraded":"2024-04-23T10:16:26.364930+0000","last_fullsized":"2024-04-23T10:16:26.364930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288939+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:16:26.288939+0000","last_peered":"2024-04-23T10:16:26.288939+0000","last_clean":"2024-04-23T10:16:26.288939+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:16:26.288939+0000","last_undegraded":"2024-04-23T10:16:26.288939+0000","last_fullsized":"2024-04-23T10:16:26.288939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956461+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:16:26.956461+0000","last_peered":"2024-04-23T10:16:26.956461+0000","last_clean":"2024-04-23T10:16:26.956461+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:16:26.956461+0000","last_undegraded":"2024-04-23T10:16:26.956461+0000","last_fullsized":"2024-04-23T10:16:26.956461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286112+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:16:26.286112+0000","last_peered":"2024-04-23T10:16:26.286112+0000","last_clean":"2024-04-23T10:16:26.286112+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:16:26.286112+0000","last_undegraded":"2024-04-23T10:16:26.286112+0000","last_fullsized":"2024-04-23T10:16:26.286112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364798+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:16:26.364798+0000","last_peered":"2024-04-23T10:16:26.364798+0000","last_clean":"2024-04-23T10:16:26.364798+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:16:26.364798+0000","last_undegraded":"2024-04-23T10:16:26.364798+0000","last_fullsized":"2024-04-23T10:16:26.364798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957017+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:16:26.957017+0000","last_peered":"2024-04-23T10:16:26.957017+0000","last_clean":"2024-04-23T10:16:26.957017+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:16:26.957017+0000","last_undegraded":"2024-04-23T10:16:26.957017+0000","last_fullsized":"2024-04-23T10:16:26.957017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286885+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:16:26.286885+0000","last_peered":"2024-04-23T10:16:26.286885+0000","last_clean":"2024-04-23T10:16:26.286885+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:16:26.286885+0000","last_undegraded":"2024-04-23T10:16:26.286885+0000","last_fullsized":"2024-04-23T10:16:26.286885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681195+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:16:26.681195+0000","last_peered":"2024-04-23T10:16:26.681195+0000","last_clean":"2024-04-23T10:16:26.681195+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:16:26.681195+0000","last_undegraded":"2024-04-23T10:16:26.681195+0000","last_fullsized":"2024-04-23T10:16:26.681195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956651+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:16:26.956651+0000","last_peered":"2024-04-23T10:16:26.956651+0000","last_clean":"2024-04-23T10:16:26.956651+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:16:26.956651+0000","last_undegraded":"2024-04-23T10:16:26.956651+0000","last_fullsized":"2024-04-23T10:16:26.956651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285591+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:16:26.285591+0000","last_peered":"2024-04-23T10:16:26.285591+0000","last_clean":"2024-04-23T10:16:26.285591+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:16:26.285591+0000","last_undegraded":"2024-04-23T10:16:26.285591+0000","last_fullsized":"2024-04-23T10:16:26.285591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680761+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:16:26.680761+0000","last_peered":"2024-04-23T10:16:26.680761+0000","last_clean":"2024-04-23T10:16:26.680761+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:16:26.680761+0000","last_undegraded":"2024-04-23T10:16:26.680761+0000","last_fullsized":"2024-04-23T10:16:26.680761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682579+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:16:26.682579+0000","last_peered":"2024-04-23T10:16:26.682579+0000","last_clean":"2024-04-23T10:16:26.682579+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:16:26.682579+0000","last_undegraded":"2024-04-23T10:16:26.682579+0000","last_fullsized":"2024-04-23T10:16:26.682579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956337+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:16:26.956337+0000","last_peered":"2024-04-23T10:16:26.956337+0000","last_clean":"2024-04-23T10:16:26.956337+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:16:26.956337+0000","last_undegraded":"2024-04-23T10:16:26.956337+0000","last_fullsized":"2024-04-23T10:16:26.956337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364878+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:16:26.364878+0000","last_peered":"2024-04-23T10:16:26.364878+0000","last_clean":"2024-04-23T10:16:26.364878+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:16:26.364878+0000","last_undegraded":"2024-04-23T10:16:26.364878+0000","last_fullsized":"2024-04-23T10:16:26.364878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956974+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:16:26.956974+0000","last_peered":"2024-04-23T10:16:26.956974+0000","last_clean":"2024-04-23T10:16:26.956974+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:16:26.956974+0000","last_undegraded":"2024-04-23T10:16:26.956974+0000","last_fullsized":"2024-04-23T10:16:26.956974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065888+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:16:27.065888+0000","last_peered":"2024-04-23T10:16:27.065888+0000","last_clean":"2024-04-23T10:16:27.065888+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:16:27.065888+0000","last_undegraded":"2024-04-23T10:16:27.065888+0000","last_fullsized":"2024-04-23T10:16:27.065888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287225+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:16:26.287225+0000","last_peered":"2024-04-23T10:16:26.287225+0000","last_clean":"2024-04-23T10:16:26.287225+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:16:26.287225+0000","last_undegraded":"2024-04-23T10:16:26.287225+0000","last_fullsized":"2024-04-23T10:16:26.287225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956044+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:16:26.956044+0000","last_peered":"2024-04-23T10:16:26.956044+0000","last_clean":"2024-04-23T10:16:26.956044+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:16:26.956044+0000","last_undegraded":"2024-04-23T10:16:26.956044+0000","last_fullsized":"2024-04-23T10:16:26.956044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286999+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:16:26.286999+0000","last_peered":"2024-04-23T10:16:26.286999+0000","last_clean":"2024-04-23T10:16:26.286999+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:16:26.286999+0000","last_undegraded":"2024-04-23T10:16:26.286999+0000","last_fullsized":"2024-04-23T10:16:26.286999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681912+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:16:26.681912+0000","last_peered":"2024-04-23T10:16:26.681912+0000","last_clean":"2024-04-23T10:16:26.681912+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:16:26.681912+0000","last_undegraded":"2024-04-23T10:16:26.681912+0000","last_fullsized":"2024-04-23T10:16:26.681912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.066954+0000","last_change":"2024-04-23T10:16:27.066954+0000","last_active":"2024-04-23T10:16:27.066954+0000","last_peered":"2024-04-23T10:16:27.066954+0000","last_clean":"2024-04-23T10:16:27.066954+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:16:27.066954+0000","last_undegraded":"2024-04-23T10:16:27.066954+0000","last_fullsized":"2024-04-23T10:16:27.066954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:04:19.036666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682070+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:16:26.682070+0000","last_peered":"2024-04-23T10:16:26.682070+0000","last_clean":"2024-04-23T10:16:26.682070+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:16:26.682070+0000","last_undegraded":"2024-04-23T10:16:26.682070+0000","last_fullsized":"2024-04-23T10:16:26.682070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364912+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:16:26.364912+0000","last_peered":"2024-04-23T10:16:26.364912+0000","last_clean":"2024-04-23T10:16:26.364912+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:16:26.364912+0000","last_undegraded":"2024-04-23T10:16:26.364912+0000","last_fullsized":"2024-04-23T10:16:26.364912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065111+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:16:27.065111+0000","last_peered":"2024-04-23T10:16:27.065111+0000","last_clean":"2024-04-23T10:16:27.065111+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:16:27.065111+0000","last_undegraded":"2024-04-23T10:16:27.065111+0000","last_fullsized":"2024-04-23T10:16:27.065111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682509+0000","last_change":"2024-04-23T10:16:26.682509+0000","last_active":"2024-04-23T10:16:26.682509+0000","last_peered":"2024-04-23T10:16:26.682509+0000","last_clean":"2024-04-23T10:16:26.682509+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:16:26.682509+0000","last_undegraded":"2024-04-23T10:16:26.682509+0000","last_fullsized":"2024-04-23T10:16:26.682509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:03.876389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682129+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:16:26.682129+0000","last_peered":"2024-04-23T10:16:26.682129+0000","last_clean":"2024-04-23T10:16:26.682129+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:16:26.682129+0000","last_undegraded":"2024-04-23T10:16:26.682129+0000","last_fullsized":"2024-04-23T10:16:26.682129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680821+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:16:26.680821+0000","last_peered":"2024-04-23T10:16:26.680821+0000","last_clean":"2024-04-23T10:16:26.680821+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:16:26.680821+0000","last_undegraded":"2024-04-23T10:16:26.680821+0000","last_fullsized":"2024-04-23T10:16:26.680821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957374+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:16:26.957374+0000","last_peered":"2024-04-23T10:16:26.957374+0000","last_clean":"2024-04-23T10:16:26.957374+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:16:26.957374+0000","last_undegraded":"2024-04-23T10:16:26.957374+0000","last_fullsized":"2024-04-23T10:16:26.957374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285460+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:16:26.285460+0000","last_peered":"2024-04-23T10:16:26.285460+0000","last_clean":"2024-04-23T10:16:26.285460+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:16:26.285460+0000","last_undegraded":"2024-04-23T10:16:26.285460+0000","last_fullsized":"2024-04-23T10:16:26.285460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681967+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:16:26.681967+0000","last_peered":"2024-04-23T10:16:26.681967+0000","last_clean":"2024-04-23T10:16:26.681967+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:16:26.681967+0000","last_undegraded":"2024-04-23T10:16:26.681967+0000","last_fullsized":"2024-04-23T10:16:26.681967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680484+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:16:26.680484+0000","last_peered":"2024-04-23T10:16:26.680484+0000","last_clean":"2024-04-23T10:16:26.680484+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:16:26.680484+0000","last_undegraded":"2024-04-23T10:16:26.680484+0000","last_fullsized":"2024-04-23T10:16:26.680484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292541+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:16:26.292541+0000","last_peered":"2024-04-23T10:16:26.292541+0000","last_clean":"2024-04-23T10:16:26.292541+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:16:26.292541+0000","last_undegraded":"2024-04-23T10:16:26.292541+0000","last_fullsized":"2024-04-23T10:16:26.292541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681818+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:16:26.681818+0000","last_peered":"2024-04-23T10:16:26.681818+0000","last_clean":"2024-04-23T10:16:26.681818+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:16:26.681818+0000","last_undegraded":"2024-04-23T10:16:26.681818+0000","last_fullsized":"2024-04-23T10:16:26.681818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.064972+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:16:27.064972+0000","last_peered":"2024-04-23T10:16:27.064972+0000","last_clean":"2024-04-23T10:16:27.064972+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:16:27.064972+0000","last_undegraded":"2024-04-23T10:16:27.064972+0000","last_fullsized":"2024-04-23T10:16:27.064972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365145+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:16:26.365145+0000","last_peered":"2024-04-23T10:16:26.365145+0000","last_clean":"2024-04-23T10:16:26.365145+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:16:26.365145+0000","last_undegraded":"2024-04-23T10:16:26.365145+0000","last_fullsized":"2024-04-23T10:16:26.365145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065726+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:16:27.065726+0000","last_peered":"2024-04-23T10:16:27.065726+0000","last_clean":"2024-04-23T10:16:27.065726+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:16:27.065726+0000","last_undegraded":"2024-04-23T10:16:27.065726+0000","last_fullsized":"2024-04-23T10:16:27.065726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682268+0000","last_change":"2024-04-23T10:16:26.682268+0000","last_active":"2024-04-23T10:16:26.682268+0000","last_peered":"2024-04-23T10:16:26.682268+0000","last_clean":"2024-04-23T10:16:26.682268+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:16:26.682268+0000","last_undegraded":"2024-04-23T10:16:26.682268+0000","last_fullsized":"2024-04-23T10:16:26.682268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:30:42.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285559+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:16:26.285559+0000","last_peered":"2024-04-23T10:16:26.285559+0000","last_clean":"2024-04-23T10:16:26.285559+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:16:26.285559+0000","last_undegraded":"2024-04-23T10:16:26.285559+0000","last_fullsized":"2024-04-23T10:16:26.285559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365444+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:16:26.365444+0000","last_peered":"2024-04-23T10:16:26.365444+0000","last_clean":"2024-04-23T10:16:26.365444+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:16:26.365444+0000","last_undegraded":"2024-04-23T10:16:26.365444+0000","last_fullsized":"2024-04-23T10:16:26.365444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287178+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:16:26.287178+0000","last_peered":"2024-04-23T10:16:26.287178+0000","last_clean":"2024-04-23T10:16:26.287178+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:16:26.287178+0000","last_undegraded":"2024-04-23T10:16:26.287178+0000","last_fullsized":"2024-04-23T10:16:26.287178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364544+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:16:26.364544+0000","last_peered":"2024-04-23T10:16:26.364544+0000","last_clean":"2024-04-23T10:16:26.364544+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:16:26.364544+0000","last_undegraded":"2024-04-23T10:16:26.364544+0000","last_fullsized":"2024-04-23T10:16:26.364544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293576+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:16:26.293576+0000","last_peered":"2024-04-23T10:16:26.293576+0000","last_clean":"2024-04-23T10:16:26.293576+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:16:26.293576+0000","last_undegraded":"2024-04-23T10:16:26.293576+0000","last_fullsized":"2024-04-23T10:16:26.293576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287644+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:16:26.287644+0000","last_peered":"2024-04-23T10:16:26.287644+0000","last_clean":"2024-04-23T10:16:26.287644+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:16:26.287644+0000","last_undegraded":"2024-04-23T10:16:26.287644+0000","last_fullsized":"2024-04-23T10:16:26.287644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288439+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:16:26.288439+0000","last_peered":"2024-04-23T10:16:26.288439+0000","last_clean":"2024-04-23T10:16:26.288439+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:16:26.288439+0000","last_undegraded":"2024-04-23T10:16:26.288439+0000","last_fullsized":"2024-04-23T10:16:26.288439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682313+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:16:26.682313+0000","last_peered":"2024-04-23T10:16:26.682313+0000","last_clean":"2024-04-23T10:16:26.682313+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:16:26.682313+0000","last_undegraded":"2024-04-23T10:16:26.682313+0000","last_fullsized":"2024-04-23T10:16:26.682313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065532+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:16:27.065532+0000","last_peered":"2024-04-23T10:16:27.065532+0000","last_clean":"2024-04-23T10:16:27.065532+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:16:27.065532+0000","last_undegraded":"2024-04-23T10:16:27.065532+0000","last_fullsized":"2024-04-23T10:16:27.065532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365549+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:16:26.365549+0000","last_peered":"2024-04-23T10:16:26.365549+0000","last_clean":"2024-04-23T10:16:26.365549+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:16:26.365549+0000","last_undegraded":"2024-04-23T10:16:26.365549+0000","last_fullsized":"2024-04-23T10:16:26.365549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293976+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:16:26.293976+0000","last_peered":"2024-04-23T10:16:26.293976+0000","last_clean":"2024-04-23T10:16:26.293976+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:16:26.293976+0000","last_undegraded":"2024-04-23T10:16:26.293976+0000","last_fullsized":"2024-04-23T10:16:26.293976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284577+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:16:26.284577+0000","last_peered":"2024-04-23T10:16:26.284577+0000","last_clean":"2024-04-23T10:16:26.284577+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:16:26.284577+0000","last_undegraded":"2024-04-23T10:16:26.284577+0000","last_fullsized":"2024-04-23T10:16:26.284577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.366014+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:16:26.366014+0000","last_peered":"2024-04-23T10:16:26.366014+0000","last_clean":"2024-04-23T10:16:26.366014+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:16:26.366014+0000","last_undegraded":"2024-04-23T10:16:26.366014+0000","last_fullsized":"2024-04-23T10:16:26.366014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957706+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:16:26.957706+0000","last_peered":"2024-04-23T10:16:26.957706+0000","last_clean":"2024-04-23T10:16:26.957706+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:16:26.957706+0000","last_undegraded":"2024-04-23T10:16:26.957706+0000","last_fullsized":"2024-04-23T10:16:26.957706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.955616+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:16:26.955616+0000","last_peered":"2024-04-23T10:16:26.955616+0000","last_clean":"2024-04-23T10:16:26.955616+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:16:26.955616+0000","last_undegraded":"2024-04-23T10:16:26.955616+0000","last_fullsized":"2024-04-23T10:16:26.955616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365097+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:16:26.365097+0000","last_peered":"2024-04-23T10:16:26.365097+0000","last_clean":"2024-04-23T10:16:26.365097+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:16:26.365097+0000","last_undegraded":"2024-04-23T10:16:26.365097+0000","last_fullsized":"2024-04-23T10:16:26.365097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.291860+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:16:26.291860+0000","last_peered":"2024-04-23T10:16:26.291860+0000","last_clean":"2024-04-23T10:16:26.291860+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:16:26.291860+0000","last_undegraded":"2024-04-23T10:16:26.291860+0000","last_fullsized":"2024-04-23T10:16:26.291860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065720+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:16:27.065720+0000","last_peered":"2024-04-23T10:16:27.065720+0000","last_clean":"2024-04-23T10:16:27.065720+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:16:27.065720+0000","last_undegraded":"2024-04-23T10:16:27.065720+0000","last_fullsized":"2024-04-23T10:16:27.065720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285980+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:16:26.285980+0000","last_peered":"2024-04-23T10:16:26.285980+0000","last_clean":"2024-04-23T10:16:26.285980+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:16:26.285980+0000","last_undegraded":"2024-04-23T10:16:26.285980+0000","last_fullsized":"2024-04-23T10:16:26.285980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285959+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:16:26.285959+0000","last_peered":"2024-04-23T10:16:26.285959+0000","last_clean":"2024-04-23T10:16:26.285959+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:16:26.285959+0000","last_undegraded":"2024-04-23T10:16:26.285959+0000","last_fullsized":"2024-04-23T10:16:26.285959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286404+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:16:26.286404+0000","last_peered":"2024-04-23T10:16:26.286404+0000","last_clean":"2024-04-23T10:16:26.286404+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:16:26.286404+0000","last_undegraded":"2024-04-23T10:16:26.286404+0000","last_fullsized":"2024-04-23T10:16:26.286404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364717+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:16:26.364717+0000","last_peered":"2024-04-23T10:16:26.364717+0000","last_clean":"2024-04-23T10:16:26.364717+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:16:26.364717+0000","last_undegraded":"2024-04-23T10:16:26.364717+0000","last_fullsized":"2024-04-23T10:16:26.364717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285363+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:16:26.285363+0000","last_peered":"2024-04-23T10:16:26.285363+0000","last_clean":"2024-04-23T10:16:26.285363+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:16:26.285363+0000","last_undegraded":"2024-04-23T10:16:26.285363+0000","last_fullsized":"2024-04-23T10:16:26.285363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.368606+0000","last_change":"2024-04-23T10:16:26.368606+0000","last_active":"2024-04-23T10:16:26.368606+0000","last_peered":"2024-04-23T10:16:26.368606+0000","last_clean":"2024-04-23T10:16:26.368606+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:16:26.368606+0000","last_undegraded":"2024-04-23T10:16:26.368606+0000","last_fullsized":"2024-04-23T10:16:26.368606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:02.237968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065394+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:16:27.065394+0000","last_peered":"2024-04-23T10:16:27.065394+0000","last_clean":"2024-04-23T10:16:27.065394+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:16:27.065394+0000","last_undegraded":"2024-04-23T10:16:27.065394+0000","last_fullsized":"2024-04-23T10:16:27.065394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065697+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:16:27.065697+0000","last_peered":"2024-04-23T10:16:27.065697+0000","last_clean":"2024-04-23T10:16:27.065697+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:16:27.065697+0000","last_undegraded":"2024-04-23T10:16:27.065697+0000","last_fullsized":"2024-04-23T10:16:27.065697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288852+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:16:26.288852+0000","last_peered":"2024-04-23T10:16:26.288852+0000","last_clean":"2024-04-23T10:16:26.288852+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:16:26.288852+0000","last_undegraded":"2024-04-23T10:16:26.288852+0000","last_fullsized":"2024-04-23T10:16:26.288852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364443+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:16:26.364443+0000","last_peered":"2024-04-23T10:16:26.364443+0000","last_clean":"2024-04-23T10:16:26.364443+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:16:26.364443+0000","last_undegraded":"2024-04-23T10:16:26.364443+0000","last_fullsized":"2024-04-23T10:16:26.364443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:29.214318+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:16:29.214318+0000","last_peered":"2024-04-23T10:16:29.214318+0000","last_clean":"2024-04-23T10:16:29.214318+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:16:29.214318+0000","last_undegraded":"2024-04-23T10:16:29.214318+0000","last_fullsized":"2024-04-23T10:16:29.214318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681069+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:16:26.681069+0000","last_peered":"2024-04-23T10:16:26.681069+0000","last_clean":"2024-04-23T10:16:26.681069+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:16:26.681069+0000","last_undegraded":"2024-04-23T10:16:26.681069+0000","last_fullsized":"2024-04-23T10:16:26.681069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.366127+0000","last_change":"2024-04-23T10:16:26.366127+0000","last_active":"2024-04-23T10:16:26.366127+0000","last_peered":"2024-04-23T10:16:26.366127+0000","last_clean":"2024-04-23T10:16:26.366127+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:16:26.366127+0000","last_undegraded":"2024-04-23T10:16:26.366127+0000","last_fullsized":"2024-04-23T10:16:26.366127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:26.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682070+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:16:26.682070+0000","last_peered":"2024-04-23T10:16:26.682070+0000","last_clean":"2024-04-23T10:16:26.682070+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:16:26.682070+0000","last_undegraded":"2024-04-23T10:16:26.682070+0000","last_fullsized":"2024-04-23T10:16:26.682070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956738+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:16:26.956738+0000","last_peered":"2024-04-23T10:16:26.956738+0000","last_clean":"2024-04-23T10:16:26.956738+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:16:26.956738+0000","last_undegraded":"2024-04-23T10:16:26.956738+0000","last_fullsized":"2024-04-23T10:16:26.956738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065952+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:16:27.065952+0000","last_peered":"2024-04-23T10:16:27.065952+0000","last_clean":"2024-04-23T10:16:27.065952+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:16:27.065952+0000","last_undegraded":"2024-04-23T10:16:27.065952+0000","last_fullsized":"2024-04-23T10:16:27.065952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.289023+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:16:26.289023+0000","last_peered":"2024-04-23T10:16:26.289023+0000","last_clean":"2024-04-23T10:16:26.289023+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:16:26.289023+0000","last_undegraded":"2024-04-23T10:16:26.289023+0000","last_fullsized":"2024-04-23T10:16:26.289023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284889+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:16:26.284889+0000","last_peered":"2024-04-23T10:16:26.284889+0000","last_clean":"2024-04-23T10:16:26.284889+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:16:26.284889+0000","last_undegraded":"2024-04-23T10:16:26.284889+0000","last_fullsized":"2024-04-23T10:16:26.284889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288706+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:16:26.288706+0000","last_peered":"2024-04-23T10:16:26.288706+0000","last_clean":"2024-04-23T10:16:26.288706+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:16:26.288706+0000","last_undegraded":"2024-04-23T10:16:26.288706+0000","last_fullsized":"2024-04-23T10:16:26.288706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286945+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:16:26.286945+0000","last_peered":"2024-04-23T10:16:26.286945+0000","last_clean":"2024-04-23T10:16:26.286945+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:16:26.286945+0000","last_undegraded":"2024-04-23T10:16:26.286945+0000","last_fullsized":"2024-04-23T10:16:26.286945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284788+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:16:26.284788+0000","last_peered":"2024-04-23T10:16:26.284788+0000","last_clean":"2024-04-23T10:16:26.284788+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:16:26.284788+0000","last_undegraded":"2024-04-23T10:16:26.284788+0000","last_fullsized":"2024-04-23T10:16:26.284788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065291+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:16:27.065291+0000","last_peered":"2024-04-23T10:16:27.065291+0000","last_clean":"2024-04-23T10:16:27.065291+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:16:27.065291+0000","last_undegraded":"2024-04-23T10:16:27.065291+0000","last_fullsized":"2024-04-23T10:16:27.065291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680520+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:16:26.680520+0000","last_peered":"2024-04-23T10:16:26.680520+0000","last_clean":"2024-04-23T10:16:26.680520+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:16:26.680520+0000","last_undegraded":"2024-04-23T10:16:26.680520+0000","last_fullsized":"2024-04-23T10:16:26.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285492+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:16:26.285492+0000","last_peered":"2024-04-23T10:16:26.285492+0000","last_clean":"2024-04-23T10:16:26.285492+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:16:26.285492+0000","last_undegraded":"2024-04-23T10:16:26.285492+0000","last_fullsized":"2024-04-23T10:16:26.285492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286393+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:16:26.286393+0000","last_peered":"2024-04-23T10:16:26.286393+0000","last_clean":"2024-04-23T10:16:26.286393+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:16:26.286393+0000","last_undegraded":"2024-04-23T10:16:26.286393+0000","last_fullsized":"2024-04-23T10:16:26.286393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285162+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:16:26.285162+0000","last_peered":"2024-04-23T10:16:26.285162+0000","last_clean":"2024-04-23T10:16:26.285162+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:16:26.285162+0000","last_undegraded":"2024-04-23T10:16:26.285162+0000","last_fullsized":"2024-04-23T10:16:26.285162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285357+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:16:26.285357+0000","last_peered":"2024-04-23T10:16:26.285357+0000","last_clean":"2024-04-23T10:16:26.285357+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:16:26.285357+0000","last_undegraded":"2024-04-23T10:16:26.285357+0000","last_fullsized":"2024-04-23T10:16:26.285357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286560+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:16:26.286560+0000","last_peered":"2024-04-23T10:16:26.286560+0000","last_clean":"2024-04-23T10:16:26.286560+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:16:26.286560+0000","last_undegraded":"2024-04-23T10:16:26.286560+0000","last_fullsized":"2024-04-23T10:16:26.286560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065664+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:16:27.065664+0000","last_peered":"2024-04-23T10:16:27.065664+0000","last_clean":"2024-04-23T10:16:27.065664+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:16:27.065664+0000","last_undegraded":"2024-04-23T10:16:27.065664+0000","last_fullsized":"2024-04-23T10:16:27.065664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292933+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:16:26.292933+0000","last_peered":"2024-04-23T10:16:26.292933+0000","last_clean":"2024-04-23T10:16:26.292933+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:16:26.292933+0000","last_undegraded":"2024-04-23T10:16:26.292933+0000","last_fullsized":"2024-04-23T10:16:26.292933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287295+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:16:26.287295+0000","last_peered":"2024-04-23T10:16:26.287295+0000","last_clean":"2024-04-23T10:16:26.287295+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:16:26.287295+0000","last_undegraded":"2024-04-23T10:16:26.287295+0000","last_fullsized":"2024-04-23T10:16:26.287295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956508+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:16:26.956508+0000","last_peered":"2024-04-23T10:16:26.956508+0000","last_clean":"2024-04-23T10:16:26.956508+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:16:26.956508+0000","last_undegraded":"2024-04-23T10:16:26.956508+0000","last_fullsized":"2024-04-23T10:16:26.956508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.958520+0000","last_change":"2024-04-23T10:16:26.958520+0000","last_active":"2024-04-23T10:16:26.958520+0000","last_peered":"2024-04-23T10:16:26.958520+0000","last_clean":"2024-04-23T10:16:26.958520+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:16:26.958520+0000","last_undegraded":"2024-04-23T10:16:26.958520+0000","last_fullsized":"2024-04-23T10:16:26.958520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.464656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285739+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:16:26.285739+0000","last_peered":"2024-04-23T10:16:26.285739+0000","last_clean":"2024-04-23T10:16:26.285739+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:16:26.285739+0000","last_undegraded":"2024-04-23T10:16:26.285739+0000","last_fullsized":"2024-04-23T10:16:26.285739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292023+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:16:26.292023+0000","last_peered":"2024-04-23T10:16:26.292023+0000","last_clean":"2024-04-23T10:16:26.292023+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:16:26.292023+0000","last_undegraded":"2024-04-23T10:16:26.292023+0000","last_fullsized":"2024-04-23T10:16:26.292023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.296860+0000","last_change":"2024-04-23T10:16:26.295163+0000","last_active":"2024-04-23T10:16:26.296860+0000","last_peered":"2024-04-23T10:16:26.296860+0000","last_clean":"2024-04-23T10:16:26.296860+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:16:26.296860+0000","last_undegraded":"2024-04-23T10:16:26.296860+0000","last_fullsized":"2024-04-23T10:16:26.296860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:23.533100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065598+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:16:27.065598+0000","last_peered":"2024-04-23T10:16:27.065598+0000","last_clean":"2024-04-23T10:16:27.065598+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:16:27.065598+0000","last_undegraded":"2024-04-23T10:16:27.065598+0000","last_fullsized":"2024-04-23T10:16:27.065598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286564+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:16:26.286564+0000","last_peered":"2024-04-23T10:16:26.286564+0000","last_clean":"2024-04-23T10:16:26.286564+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:16:26.286564+0000","last_undegraded":"2024-04-23T10:16:26.286564+0000","last_fullsized":"2024-04-23T10:16:26.286564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681536+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:16:26.681536+0000","last_peered":"2024-04-23T10:16:26.681536+0000","last_clean":"2024-04-23T10:16:26.681536+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:16:26.681536+0000","last_undegraded":"2024-04-23T10:16:26.681536+0000","last_fullsized":"2024-04-23T10:16:26.681536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.295515+0000","last_change":"2024-04-23T10:16:26.295515+0000","last_active":"2024-04-23T10:16:26.295515+0000","last_peered":"2024-04-23T10:16:26.295515+0000","last_clean":"2024-04-23T10:16:26.295515+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:16:26.295515+0000","last_undegraded":"2024-04-23T10:16:26.295515+0000","last_fullsized":"2024-04-23T10:16:26.295515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:44:48.448837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286724+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:16:26.286724+0000","last_peered":"2024-04-23T10:16:26.286724+0000","last_clean":"2024-04-23T10:16:26.286724+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:16:26.286724+0000","last_undegraded":"2024-04-23T10:16:26.286724+0000","last_fullsized":"2024-04-23T10:16:26.286724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285261+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:16:26.285261+0000","last_peered":"2024-04-23T10:16:26.285261+0000","last_clean":"2024-04-23T10:16:26.285261+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:16:26.285261+0000","last_undegraded":"2024-04-23T10:16:26.285261+0000","last_fullsized":"2024-04-23T10:16:26.285261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285134+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:16:26.285134+0000","last_peered":"2024-04-23T10:16:26.285134+0000","last_clean":"2024-04-23T10:16:26.285134+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:16:26.285134+0000","last_undegraded":"2024-04-23T10:16:26.285134+0000","last_fullsized":"2024-04-23T10:16:26.285134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285185+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:16:26.285185+0000","last_peered":"2024-04-23T10:16:26.285185+0000","last_clean":"2024-04-23T10:16:26.285185+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:16:26.285185+0000","last_undegraded":"2024-04-23T10:16:26.285185+0000","last_fullsized":"2024-04-23T10:16:26.285185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065134+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:16:27.065134+0000","last_peered":"2024-04-23T10:16:27.065134+0000","last_clean":"2024-04-23T10:16:27.065134+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:16:27.065134+0000","last_undegraded":"2024-04-23T10:16:27.065134+0000","last_fullsized":"2024-04-23T10:16:27.065134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286913+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:16:26.286913+0000","last_peered":"2024-04-23T10:16:26.286913+0000","last_clean":"2024-04-23T10:16:26.286913+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:16:26.286913+0000","last_undegraded":"2024-04-23T10:16:26.286913+0000","last_fullsized":"2024-04-23T10:16:26.286913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364790+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:16:26.364790+0000","last_peered":"2024-04-23T10:16:26.364790+0000","last_clean":"2024-04-23T10:16:26.364790+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:16:26.364790+0000","last_undegraded":"2024-04-23T10:16:26.364790+0000","last_fullsized":"2024-04-23T10:16:26.364790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293921+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:16:26.293921+0000","last_peered":"2024-04-23T10:16:26.293921+0000","last_clean":"2024-04-23T10:16:26.293921+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:16:26.293921+0000","last_undegraded":"2024-04-23T10:16:26.293921+0000","last_fullsized":"2024-04-23T10:16:26.293921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.289673+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:16:26.289673+0000","last_peered":"2024-04-23T10:16:26.289673+0000","last_clean":"2024-04-23T10:16:26.289673+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:16:26.289673+0000","last_undegraded":"2024-04-23T10:16:26.289673+0000","last_fullsized":"2024-04-23T10:16:26.289673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285039+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:16:26.285039+0000","last_peered":"2024-04-23T10:16:26.285039+0000","last_clean":"2024-04-23T10:16:26.285039+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:16:26.285039+0000","last_undegraded":"2024-04-23T10:16:26.285039+0000","last_fullsized":"2024-04-23T10:16:26.285039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680656+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:16:26.680656+0000","last_peered":"2024-04-23T10:16:26.680656+0000","last_clean":"2024-04-23T10:16:26.680656+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:16:26.680656+0000","last_undegraded":"2024-04-23T10:16:26.680656+0000","last_fullsized":"2024-04-23T10:16:26.680656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065286+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:16:27.065286+0000","last_peered":"2024-04-23T10:16:27.065286+0000","last_clean":"2024-04-23T10:16:27.065286+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:16:27.065286+0000","last_undegraded":"2024-04-23T10:16:27.065286+0000","last_fullsized":"2024-04-23T10:16:27.065286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286603+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:16:26.286603+0000","last_peered":"2024-04-23T10:16:26.286603+0000","last_clean":"2024-04-23T10:16:26.286603+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:16:26.286603+0000","last_undegraded":"2024-04-23T10:16:26.286603+0000","last_fullsized":"2024-04-23T10:16:26.286603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957679+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:16:26.957679+0000","last_peered":"2024-04-23T10:16:26.957679+0000","last_clean":"2024-04-23T10:16:26.957679+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:16:26.957679+0000","last_undegraded":"2024-04-23T10:16:26.957679+0000","last_fullsized":"2024-04-23T10:16:26.957679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287420+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:16:26.287420+0000","last_peered":"2024-04-23T10:16:26.287420+0000","last_clean":"2024-04-23T10:16:26.287420+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:16:26.287420+0000","last_undegraded":"2024-04-23T10:16:26.287420+0000","last_fullsized":"2024-04-23T10:16:26.287420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286271+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:16:26.286271+0000","last_peered":"2024-04-23T10:16:26.286271+0000","last_clean":"2024-04-23T10:16:26.286271+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:16:26.286271+0000","last_undegraded":"2024-04-23T10:16:26.286271+0000","last_fullsized":"2024-04-23T10:16:26.286271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365499+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:16:26.365499+0000","last_peered":"2024-04-23T10:16:26.365499+0000","last_clean":"2024-04-23T10:16:26.365499+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:16:26.365499+0000","last_undegraded":"2024-04-23T10:16:26.365499+0000","last_fullsized":"2024-04-23T10:16:26.365499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284622+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:16:26.284622+0000","last_peered":"2024-04-23T10:16:26.284622+0000","last_clean":"2024-04-23T10:16:26.284622+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:16:26.284622+0000","last_undegraded":"2024-04-23T10:16:26.284622+0000","last_fullsized":"2024-04-23T10:16:26.284622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364850+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:16:26.364850+0000","last_peered":"2024-04-23T10:16:26.364850+0000","last_clean":"2024-04-23T10:16:26.364850+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:16:26.364850+0000","last_undegraded":"2024-04-23T10:16:26.364850+0000","last_fullsized":"2024-04-23T10:16:26.364850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285091+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:16:26.285091+0000","last_peered":"2024-04-23T10:16:26.285091+0000","last_clean":"2024-04-23T10:16:26.285091+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:16:26.285091+0000","last_undegraded":"2024-04-23T10:16:26.285091+0000","last_fullsized":"2024-04-23T10:16:26.285091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364583+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:16:26.364583+0000","last_peered":"2024-04-23T10:16:26.364583+0000","last_clean":"2024-04-23T10:16:26.364583+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:16:26.364583+0000","last_undegraded":"2024-04-23T10:16:26.364583+0000","last_fullsized":"2024-04-23T10:16:26.364583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288130+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:16:26.288130+0000","last_peered":"2024-04-23T10:16:26.288130+0000","last_clean":"2024-04-23T10:16:26.288130+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:16:26.288130+0000","last_undegraded":"2024-04-23T10:16:26.288130+0000","last_fullsized":"2024-04-23T10:16:26.288130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065434+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:16:27.065434+0000","last_peered":"2024-04-23T10:16:27.065434+0000","last_clean":"2024-04-23T10:16:27.065434+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:16:27.065434+0000","last_undegraded":"2024-04-23T10:16:27.065434+0000","last_fullsized":"2024-04-23T10:16:27.065434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681826+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:16:26.681826+0000","last_peered":"2024-04-23T10:16:26.681826+0000","last_clean":"2024-04-23T10:16:26.681826+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:16:26.681826+0000","last_undegraded":"2024-04-23T10:16:26.681826+0000","last_fullsized":"2024-04-23T10:16:26.681826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365398+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:16:26.365398+0000","last_peered":"2024-04-23T10:16:26.365398+0000","last_clean":"2024-04-23T10:16:26.365398+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:16:26.365398+0000","last_undegraded":"2024-04-23T10:16:26.365398+0000","last_fullsized":"2024-04-23T10:16:26.365398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":707357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":119962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":118821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":116219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":119996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":307200,"data_stored":115980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":901120,"data_stored":705690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:16:34.182 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:16:34.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.334+0000 7f29c846b640 1 Processor -- start 2024-04-23T10:16:34.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.334+0000 7f29c846b640 1 -- start start 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c846b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c0155460 0x7f29c00c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c846b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f29c00c5a40 0x7f29c015bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c846b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c00cb9d0 con 0x7f29c00ccf30 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c846b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f29c00cc380 con 0x7f29c00c5a40 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c846b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f29c00cbf50 con 0x7f29c0155460 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6a08640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f29c00c5a40 0x7f29c015bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6a08640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f29c00c5a40 0x7f29c015bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42432/0 (socket says 172.21.15.29:42432) 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c5a06640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f29c00ccf30 0x7f29c015eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45034/0 (socket says 172.21.15.29:45034) 2024-04-23T10:16:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6a08640 1 -- 172.21.15.29:0/3152385710 learned_addr learned my addr 172.21.15.29:0/3152385710 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6207640 1 --2- 172.21.15.29:0/3152385710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c0155460 0x7f29c00c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6a08640 1 -- 172.21.15.29:0/3152385710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c0155460 msgr2=0x7f29c00c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6a08640 1 --2- 172.21.15.29:0/3152385710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c0155460 0x7f29c00c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6a08640 1 -- 172.21.15.29:0/3152385710 >> v1:172.21.15.29:6789/0 conn(0x7f29c00ccf30 legacy=0x7f29c015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6a08640 1 -- 172.21.15.29:0/3152385710 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c0155840 con 0x7f29c00c5a40 2024-04-23T10:16:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c5205640 1 -- 172.21.15.29:0/3152385710 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470281685 0 0) 0x7f29c00cb9d0 con 0x7f29c00ccf30 2024-04-23T10:16:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c6a08640 1 --2- 172.21.15.29:0/3152385710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c00c5a40 0x7f29c015bb70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009e50 tx=0x7f29b801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7885a9b93c7ebffe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c5205640 1 -- 172.21.15.29:0/3152385710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b80a5700 con 0x7f29c00c5a40 2024-04-23T10:16:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c5205640 1 -- 172.21.15.29:0/3152385710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b80a58a0 con 0x7f29c00c5a40 2024-04-23T10:16:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.338+0000 7f29c5205640 1 -- 172.21.15.29:0/3152385710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b80a5c70 con 0x7f29c00c5a40 2024-04-23T10:16:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- 172.21.15.29:0/3152385710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c00c5a40 msgr2=0x7f29c015bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 --2- 172.21.15.29:0/3152385710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c00c5a40 0x7f29c015bb70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009e50 tx=0x7f29b801ca30 comp rx=0 tx=0).stop 2024-04-23T10:16:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- 172.21.15.29:0/3152385710 shutdown_connections 2024-04-23T10:16:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 --2- 172.21.15.29:0/3152385710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c00c5a40 0x7f29c015bb70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 --2- 172.21.15.29:0/3152385710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c0155460 0x7f29c00c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- 172.21.15.29:0/3152385710 >> 172.21.15.29:0/3152385710 conn(0x7f29c0074d60 msgr2=0x7f29c0075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- 172.21.15.29:0/3152385710 shutdown_connections 2024-04-23T10:16:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- 172.21.15.29:0/3152385710 wait complete. 2024-04-23T10:16:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 Processor -- start 2024-04-23T10:16:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- start start 2024-04-23T10:16:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c00c5a40 0x7f29c015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c00ccf30 0x7f29c00cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c0155460 0x7f29c015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0167be0 con 0x7f29c0155460 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0167a60 con 0x7f29c00ccf30 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f29c0167d60 con 0x7f29c00c5a40 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c0155460 0x7f29c015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c0155460 0x7f29c015dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42448/0 (socket says 172.21.15.29:42448) 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 -- 172.21.15.29:0/1666254124 learned_addr learned my addr 172.21.15.29:0/1666254124 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c5a06640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c00ccf30 0x7f29c00cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6207640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c00c5a40 0x7f29c015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 -- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c00c5a40 msgr2=0x7f29c015a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c00c5a40 0x7f29c015a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 -- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c00ccf30 msgr2=0x7f29c00cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c00ccf30 0x7f29c00cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 -- 172.21.15.29:0/1666254124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c00cf950 con 0x7f29c0155460 2024-04-23T10:16:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c6a08640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c0155460 0x7f29c015dcf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f29b801a660 tx=0x7f29b80197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29b6ffd640 1 -- 172.21.15.29:0/1666254124 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b80bc020 con 0x7f29c0155460 2024-04-23T10:16:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29b6ffd640 1 -- 172.21.15.29:0/1666254124 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b80b8670 con 0x7f29c0155460 2024-04-23T10:16:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c00cfd30 con 0x7f29c0155460 2024-04-23T10:16:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29b6ffd640 1 -- 172.21.15.29:0/1666254124 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b80b8a20 con 0x7f29c0155460 2024-04-23T10:16:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.342+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c00ce930 con 0x7f29c0155460 2024-04-23T10:16:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.346+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c00693c0 con 0x7f29c0155460 2024-04-23T10:16:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.346+0000 7f29b6ffd640 1 -- 172.21.15.29:0/1666254124 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f29b80bf020 con 0x7f29c0155460 2024-04-23T10:16:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.346+0000 7f29b6ffd640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f29a4068380 0x7f29a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.346+0000 7f29b6ffd640 1 -- 172.21.15.29:0/1666254124 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f29b8121c50 con 0x7f29c0155460 2024-04-23T10:16:34.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.346+0000 7f29c6207640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f29a4068380 0x7f29a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.346+0000 7f29c6207640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f29a4068380 0x7f29a406a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009af0 tx=0x7f29bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.350+0000 7f29b6ffd640 1 -- 172.21.15.29:0/1666254124 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f29b8127020 con 0x7f29c0155460 2024-04-23T10:16:34.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.506+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29c00c7730 con 0x7f29a4068380 2024-04-23T10:16:34.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.530+0000 7f29b6ffd640 1 -- 172.21.15.29:0/1666254124 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332687 (secure 0 0 0) 0x7f29c00c7730 con 0x7f29a4068380 2024-04-23T10:16:34.536 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:34.539 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:16:34.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f29a4068380 msgr2=0x7f29a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f29a4068380 0x7f29a406a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009af0 tx=0x7f29bc008040 comp rx=0 tx=0).stop 2024-04-23T10:16:34.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c0155460 msgr2=0x7f29c015dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c0155460 0x7f29c015dcf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f29b801a660 tx=0x7f29b80197d0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 shutdown_connections 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f29a4068380 0x7f29a406a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29c0155460 0x7f29c015dcf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29c00ccf30 0x7f29c00cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 --2- 172.21.15.29:0/1666254124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29c00c5a40 0x7f29c015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 >> 172.21.15.29:0/1666254124 conn(0x7f29c0074d60 msgr2=0x7f29c015b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 shutdown_connections 2024-04-23T10:16:34.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.534+0000 7f29c846b640 1 -- 172.21.15.29:0/1666254124 wait complete. 2024-04-23T10:16:34.554 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-23T10:16:33.209574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236396,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738324,"statfs":{"total":773094113280,"available":772852043776,"internally_reserved":0,"allocated":3678208,"data_stored":2120376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1764,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002865"},"pg_stats":[{"pgid":"2.1f","version":"24'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065972+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:16:27.065972+0000","last_peered":"2024-04-23T10:16:27.065972+0000","last_clean":"2024-04-23T10:16:27.065972+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:16:27.065972+0000","last_undegraded":"2024-04-23T10:16:27.065972+0000","last_fullsized":"2024-04-23T10:16:27.065972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286349+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:16:26.286349+0000","last_peered":"2024-04-23T10:16:26.286349+0000","last_clean":"2024-04-23T10:16:26.286349+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:16:26.286349+0000","last_undegraded":"2024-04-23T10:16:26.286349+0000","last_fullsized":"2024-04-23T10:16:26.286349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284564+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:16:26.284564+0000","last_peered":"2024-04-23T10:16:26.284564+0000","last_clean":"2024-04-23T10:16:26.284564+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:16:26.284564+0000","last_undegraded":"2024-04-23T10:16:26.284564+0000","last_fullsized":"2024-04-23T10:16:26.284564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286933+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:16:26.286933+0000","last_peered":"2024-04-23T10:16:26.286933+0000","last_clean":"2024-04-23T10:16:26.286933+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:16:26.286933+0000","last_undegraded":"2024-04-23T10:16:26.286933+0000","last_fullsized":"2024-04-23T10:16:26.286933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065876+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:16:27.065876+0000","last_peered":"2024-04-23T10:16:27.065876+0000","last_clean":"2024-04-23T10:16:27.065876+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:16:27.065876+0000","last_undegraded":"2024-04-23T10:16:27.065876+0000","last_fullsized":"2024-04-23T10:16:27.065876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.955819+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:16:26.955819+0000","last_peered":"2024-04-23T10:16:26.955819+0000","last_clean":"2024-04-23T10:16:26.955819+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:16:26.955819+0000","last_undegraded":"2024-04-23T10:16:26.955819+0000","last_fullsized":"2024-04-23T10:16:26.955819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364693+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:16:26.364693+0000","last_peered":"2024-04-23T10:16:26.364693+0000","last_clean":"2024-04-23T10:16:26.364693+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:16:26.364693+0000","last_undegraded":"2024-04-23T10:16:26.364693+0000","last_fullsized":"2024-04-23T10:16:26.364693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288230+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:16:26.288230+0000","last_peered":"2024-04-23T10:16:26.288230+0000","last_clean":"2024-04-23T10:16:26.288230+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:16:26.288230+0000","last_undegraded":"2024-04-23T10:16:26.288230+0000","last_fullsized":"2024-04-23T10:16:26.288230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956173+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:16:26.956173+0000","last_peered":"2024-04-23T10:16:26.956173+0000","last_clean":"2024-04-23T10:16:26.956173+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:16:26.956173+0000","last_undegraded":"2024-04-23T10:16:26.956173+0000","last_fullsized":"2024-04-23T10:16:26.956173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364930+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:16:26.364930+0000","last_peered":"2024-04-23T10:16:26.364930+0000","last_clean":"2024-04-23T10:16:26.364930+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:16:26.364930+0000","last_undegraded":"2024-04-23T10:16:26.364930+0000","last_fullsized":"2024-04-23T10:16:26.364930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288939+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:16:26.288939+0000","last_peered":"2024-04-23T10:16:26.288939+0000","last_clean":"2024-04-23T10:16:26.288939+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:16:26.288939+0000","last_undegraded":"2024-04-23T10:16:26.288939+0000","last_fullsized":"2024-04-23T10:16:26.288939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956461+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:16:26.956461+0000","last_peered":"2024-04-23T10:16:26.956461+0000","last_clean":"2024-04-23T10:16:26.956461+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:16:26.956461+0000","last_undegraded":"2024-04-23T10:16:26.956461+0000","last_fullsized":"2024-04-23T10:16:26.956461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286112+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:16:26.286112+0000","last_peered":"2024-04-23T10:16:26.286112+0000","last_clean":"2024-04-23T10:16:26.286112+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:16:26.286112+0000","last_undegraded":"2024-04-23T10:16:26.286112+0000","last_fullsized":"2024-04-23T10:16:26.286112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364798+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:16:26.364798+0000","last_peered":"2024-04-23T10:16:26.364798+0000","last_clean":"2024-04-23T10:16:26.364798+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:16:26.364798+0000","last_undegraded":"2024-04-23T10:16:26.364798+0000","last_fullsized":"2024-04-23T10:16:26.364798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957017+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:16:26.957017+0000","last_peered":"2024-04-23T10:16:26.957017+0000","last_clean":"2024-04-23T10:16:26.957017+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:16:26.957017+0000","last_undegraded":"2024-04-23T10:16:26.957017+0000","last_fullsized":"2024-04-23T10:16:26.957017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286885+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:16:26.286885+0000","last_peered":"2024-04-23T10:16:26.286885+0000","last_clean":"2024-04-23T10:16:26.286885+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:16:26.286885+0000","last_undegraded":"2024-04-23T10:16:26.286885+0000","last_fullsized":"2024-04-23T10:16:26.286885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681195+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:16:26.681195+0000","last_peered":"2024-04-23T10:16:26.681195+0000","last_clean":"2024-04-23T10:16:26.681195+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:16:26.681195+0000","last_undegraded":"2024-04-23T10:16:26.681195+0000","last_fullsized":"2024-04-23T10:16:26.681195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956651+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:16:26.956651+0000","last_peered":"2024-04-23T10:16:26.956651+0000","last_clean":"2024-04-23T10:16:26.956651+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:16:26.956651+0000","last_undegraded":"2024-04-23T10:16:26.956651+0000","last_fullsized":"2024-04-23T10:16:26.956651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285591+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:16:26.285591+0000","last_peered":"2024-04-23T10:16:26.285591+0000","last_clean":"2024-04-23T10:16:26.285591+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:16:26.285591+0000","last_undegraded":"2024-04-23T10:16:26.285591+0000","last_fullsized":"2024-04-23T10:16:26.285591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680761+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:16:26.680761+0000","last_peered":"2024-04-23T10:16:26.680761+0000","last_clean":"2024-04-23T10:16:26.680761+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:16:26.680761+0000","last_undegraded":"2024-04-23T10:16:26.680761+0000","last_fullsized":"2024-04-23T10:16:26.680761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682579+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:16:26.682579+0000","last_peered":"2024-04-23T10:16:26.682579+0000","last_clean":"2024-04-23T10:16:26.682579+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:16:26.682579+0000","last_undegraded":"2024-04-23T10:16:26.682579+0000","last_fullsized":"2024-04-23T10:16:26.682579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956337+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:16:26.956337+0000","last_peered":"2024-04-23T10:16:26.956337+0000","last_clean":"2024-04-23T10:16:26.956337+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:16:26.956337+0000","last_undegraded":"2024-04-23T10:16:26.956337+0000","last_fullsized":"2024-04-23T10:16:26.956337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364878+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:16:26.364878+0000","last_peered":"2024-04-23T10:16:26.364878+0000","last_clean":"2024-04-23T10:16:26.364878+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:16:26.364878+0000","last_undegraded":"2024-04-23T10:16:26.364878+0000","last_fullsized":"2024-04-23T10:16:26.364878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956974+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:16:26.956974+0000","last_peered":"2024-04-23T10:16:26.956974+0000","last_clean":"2024-04-23T10:16:26.956974+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:16:26.956974+0000","last_undegraded":"2024-04-23T10:16:26.956974+0000","last_fullsized":"2024-04-23T10:16:26.956974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065888+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:16:27.065888+0000","last_peered":"2024-04-23T10:16:27.065888+0000","last_clean":"2024-04-23T10:16:27.065888+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:16:27.065888+0000","last_undegraded":"2024-04-23T10:16:27.065888+0000","last_fullsized":"2024-04-23T10:16:27.065888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287225+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:16:26.287225+0000","last_peered":"2024-04-23T10:16:26.287225+0000","last_clean":"2024-04-23T10:16:26.287225+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:16:26.287225+0000","last_undegraded":"2024-04-23T10:16:26.287225+0000","last_fullsized":"2024-04-23T10:16:26.287225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956044+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:16:26.956044+0000","last_peered":"2024-04-23T10:16:26.956044+0000","last_clean":"2024-04-23T10:16:26.956044+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:16:26.956044+0000","last_undegraded":"2024-04-23T10:16:26.956044+0000","last_fullsized":"2024-04-23T10:16:26.956044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286999+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:16:26.286999+0000","last_peered":"2024-04-23T10:16:26.286999+0000","last_clean":"2024-04-23T10:16:26.286999+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:16:26.286999+0000","last_undegraded":"2024-04-23T10:16:26.286999+0000","last_fullsized":"2024-04-23T10:16:26.286999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681912+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:16:26.681912+0000","last_peered":"2024-04-23T10:16:26.681912+0000","last_clean":"2024-04-23T10:16:26.681912+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:16:26.681912+0000","last_undegraded":"2024-04-23T10:16:26.681912+0000","last_fullsized":"2024-04-23T10:16:26.681912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.066954+0000","last_change":"2024-04-23T10:16:27.066954+0000","last_active":"2024-04-23T10:16:27.066954+0000","last_peered":"2024-04-23T10:16:27.066954+0000","last_clean":"2024-04-23T10:16:27.066954+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:16:27.066954+0000","last_undegraded":"2024-04-23T10:16:27.066954+0000","last_fullsized":"2024-04-23T10:16:27.066954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:04:19.036666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682070+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:16:26.682070+0000","last_peered":"2024-04-23T10:16:26.682070+0000","last_clean":"2024-04-23T10:16:26.682070+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:16:26.682070+0000","last_undegraded":"2024-04-23T10:16:26.682070+0000","last_fullsized":"2024-04-23T10:16:26.682070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364912+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:16:26.364912+0000","last_peered":"2024-04-23T10:16:26.364912+0000","last_clean":"2024-04-23T10:16:26.364912+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:16:26.364912+0000","last_undegraded":"2024-04-23T10:16:26.364912+0000","last_fullsized":"2024-04-23T10:16:26.364912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065111+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:16:27.065111+0000","last_peered":"2024-04-23T10:16:27.065111+0000","last_clean":"2024-04-23T10:16:27.065111+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:16:27.065111+0000","last_undegraded":"2024-04-23T10:16:27.065111+0000","last_fullsized":"2024-04-23T10:16:27.065111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682509+0000","last_change":"2024-04-23T10:16:26.682509+0000","last_active":"2024-04-23T10:16:26.682509+0000","last_peered":"2024-04-23T10:16:26.682509+0000","last_clean":"2024-04-23T10:16:26.682509+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:16:26.682509+0000","last_undegraded":"2024-04-23T10:16:26.682509+0000","last_fullsized":"2024-04-23T10:16:26.682509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:03.876389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682129+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:16:26.682129+0000","last_peered":"2024-04-23T10:16:26.682129+0000","last_clean":"2024-04-23T10:16:26.682129+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:16:26.682129+0000","last_undegraded":"2024-04-23T10:16:26.682129+0000","last_fullsized":"2024-04-23T10:16:26.682129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680821+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:16:26.680821+0000","last_peered":"2024-04-23T10:16:26.680821+0000","last_clean":"2024-04-23T10:16:26.680821+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:16:26.680821+0000","last_undegraded":"2024-04-23T10:16:26.680821+0000","last_fullsized":"2024-04-23T10:16:26.680821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957374+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:16:26.957374+0000","last_peered":"2024-04-23T10:16:26.957374+0000","last_clean":"2024-04-23T10:16:26.957374+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:16:26.957374+0000","last_undegraded":"2024-04-23T10:16:26.957374+0000","last_fullsized":"2024-04-23T10:16:26.957374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285460+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:16:26.285460+0000","last_peered":"2024-04-23T10:16:26.285460+0000","last_clean":"2024-04-23T10:16:26.285460+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:16:26.285460+0000","last_undegraded":"2024-04-23T10:16:26.285460+0000","last_fullsized":"2024-04-23T10:16:26.285460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681967+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:16:26.681967+0000","last_peered":"2024-04-23T10:16:26.681967+0000","last_clean":"2024-04-23T10:16:26.681967+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:16:26.681967+0000","last_undegraded":"2024-04-23T10:16:26.681967+0000","last_fullsized":"2024-04-23T10:16:26.681967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680484+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:16:26.680484+0000","last_peered":"2024-04-23T10:16:26.680484+0000","last_clean":"2024-04-23T10:16:26.680484+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:16:26.680484+0000","last_undegraded":"2024-04-23T10:16:26.680484+0000","last_fullsized":"2024-04-23T10:16:26.680484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292541+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:16:26.292541+0000","last_peered":"2024-04-23T10:16:26.292541+0000","last_clean":"2024-04-23T10:16:26.292541+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:16:26.292541+0000","last_undegraded":"2024-04-23T10:16:26.292541+0000","last_fullsized":"2024-04-23T10:16:26.292541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681818+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:16:26.681818+0000","last_peered":"2024-04-23T10:16:26.681818+0000","last_clean":"2024-04-23T10:16:26.681818+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:16:26.681818+0000","last_undegraded":"2024-04-23T10:16:26.681818+0000","last_fullsized":"2024-04-23T10:16:26.681818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.064972+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:16:27.064972+0000","last_peered":"2024-04-23T10:16:27.064972+0000","last_clean":"2024-04-23T10:16:27.064972+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:16:27.064972+0000","last_undegraded":"2024-04-23T10:16:27.064972+0000","last_fullsized":"2024-04-23T10:16:27.064972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365145+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:16:26.365145+0000","last_peered":"2024-04-23T10:16:26.365145+0000","last_clean":"2024-04-23T10:16:26.365145+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:16:26.365145+0000","last_undegraded":"2024-04-23T10:16:26.365145+0000","last_fullsized":"2024-04-23T10:16:26.365145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065726+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:16:27.065726+0000","last_peered":"2024-04-23T10:16:27.065726+0000","last_clean":"2024-04-23T10:16:27.065726+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:16:27.065726+0000","last_undegraded":"2024-04-23T10:16:27.065726+0000","last_fullsized":"2024-04-23T10:16:27.065726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682268+0000","last_change":"2024-04-23T10:16:26.682268+0000","last_active":"2024-04-23T10:16:26.682268+0000","last_peered":"2024-04-23T10:16:26.682268+0000","last_clean":"2024-04-23T10:16:26.682268+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:16:26.682268+0000","last_undegraded":"2024-04-23T10:16:26.682268+0000","last_fullsized":"2024-04-23T10:16:26.682268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:30:42.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285559+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:16:26.285559+0000","last_peered":"2024-04-23T10:16:26.285559+0000","last_clean":"2024-04-23T10:16:26.285559+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:16:26.285559+0000","last_undegraded":"2024-04-23T10:16:26.285559+0000","last_fullsized":"2024-04-23T10:16:26.285559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365444+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:16:26.365444+0000","last_peered":"2024-04-23T10:16:26.365444+0000","last_clean":"2024-04-23T10:16:26.365444+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:16:26.365444+0000","last_undegraded":"2024-04-23T10:16:26.365444+0000","last_fullsized":"2024-04-23T10:16:26.365444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287178+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:16:26.287178+0000","last_peered":"2024-04-23T10:16:26.287178+0000","last_clean":"2024-04-23T10:16:26.287178+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:16:26.287178+0000","last_undegraded":"2024-04-23T10:16:26.287178+0000","last_fullsized":"2024-04-23T10:16:26.287178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364544+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:16:26.364544+0000","last_peered":"2024-04-23T10:16:26.364544+0000","last_clean":"2024-04-23T10:16:26.364544+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:16:26.364544+0000","last_undegraded":"2024-04-23T10:16:26.364544+0000","last_fullsized":"2024-04-23T10:16:26.364544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293576+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:16:26.293576+0000","last_peered":"2024-04-23T10:16:26.293576+0000","last_clean":"2024-04-23T10:16:26.293576+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:16:26.293576+0000","last_undegraded":"2024-04-23T10:16:26.293576+0000","last_fullsized":"2024-04-23T10:16:26.293576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287644+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:16:26.287644+0000","last_peered":"2024-04-23T10:16:26.287644+0000","last_clean":"2024-04-23T10:16:26.287644+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:16:26.287644+0000","last_undegraded":"2024-04-23T10:16:26.287644+0000","last_fullsized":"2024-04-23T10:16:26.287644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288439+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:16:26.288439+0000","last_peered":"2024-04-23T10:16:26.288439+0000","last_clean":"2024-04-23T10:16:26.288439+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:16:26.288439+0000","last_undegraded":"2024-04-23T10:16:26.288439+0000","last_fullsized":"2024-04-23T10:16:26.288439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682313+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:16:26.682313+0000","last_peered":"2024-04-23T10:16:26.682313+0000","last_clean":"2024-04-23T10:16:26.682313+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:16:26.682313+0000","last_undegraded":"2024-04-23T10:16:26.682313+0000","last_fullsized":"2024-04-23T10:16:26.682313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065532+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:16:27.065532+0000","last_peered":"2024-04-23T10:16:27.065532+0000","last_clean":"2024-04-23T10:16:27.065532+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:16:27.065532+0000","last_undegraded":"2024-04-23T10:16:27.065532+0000","last_fullsized":"2024-04-23T10:16:27.065532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365549+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:16:26.365549+0000","last_peered":"2024-04-23T10:16:26.365549+0000","last_clean":"2024-04-23T10:16:26.365549+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:16:26.365549+0000","last_undegraded":"2024-04-23T10:16:26.365549+0000","last_fullsized":"2024-04-23T10:16:26.365549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293976+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:16:26.293976+0000","last_peered":"2024-04-23T10:16:26.293976+0000","last_clean":"2024-04-23T10:16:26.293976+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:16:26.293976+0000","last_undegraded":"2024-04-23T10:16:26.293976+0000","last_fullsized":"2024-04-23T10:16:26.293976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284577+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:16:26.284577+0000","last_peered":"2024-04-23T10:16:26.284577+0000","last_clean":"2024-04-23T10:16:26.284577+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:16:26.284577+0000","last_undegraded":"2024-04-23T10:16:26.284577+0000","last_fullsized":"2024-04-23T10:16:26.284577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.366014+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:16:26.366014+0000","last_peered":"2024-04-23T10:16:26.366014+0000","last_clean":"2024-04-23T10:16:26.366014+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:16:26.366014+0000","last_undegraded":"2024-04-23T10:16:26.366014+0000","last_fullsized":"2024-04-23T10:16:26.366014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957706+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:16:26.957706+0000","last_peered":"2024-04-23T10:16:26.957706+0000","last_clean":"2024-04-23T10:16:26.957706+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:16:26.957706+0000","last_undegraded":"2024-04-23T10:16:26.957706+0000","last_fullsized":"2024-04-23T10:16:26.957706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.955616+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:16:26.955616+0000","last_peered":"2024-04-23T10:16:26.955616+0000","last_clean":"2024-04-23T10:16:26.955616+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:16:26.955616+0000","last_undegraded":"2024-04-23T10:16:26.955616+0000","last_fullsized":"2024-04-23T10:16:26.955616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365097+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:16:26.365097+0000","last_peered":"2024-04-23T10:16:26.365097+0000","last_clean":"2024-04-23T10:16:26.365097+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:16:26.365097+0000","last_undegraded":"2024-04-23T10:16:26.365097+0000","last_fullsized":"2024-04-23T10:16:26.365097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.291860+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:16:26.291860+0000","last_peered":"2024-04-23T10:16:26.291860+0000","last_clean":"2024-04-23T10:16:26.291860+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:16:26.291860+0000","last_undegraded":"2024-04-23T10:16:26.291860+0000","last_fullsized":"2024-04-23T10:16:26.291860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065720+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:16:27.065720+0000","last_peered":"2024-04-23T10:16:27.065720+0000","last_clean":"2024-04-23T10:16:27.065720+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:16:27.065720+0000","last_undegraded":"2024-04-23T10:16:27.065720+0000","last_fullsized":"2024-04-23T10:16:27.065720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285980+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:16:26.285980+0000","last_peered":"2024-04-23T10:16:26.285980+0000","last_clean":"2024-04-23T10:16:26.285980+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:16:26.285980+0000","last_undegraded":"2024-04-23T10:16:26.285980+0000","last_fullsized":"2024-04-23T10:16:26.285980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285959+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:16:26.285959+0000","last_peered":"2024-04-23T10:16:26.285959+0000","last_clean":"2024-04-23T10:16:26.285959+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:16:26.285959+0000","last_undegraded":"2024-04-23T10:16:26.285959+0000","last_fullsized":"2024-04-23T10:16:26.285959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286404+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:16:26.286404+0000","last_peered":"2024-04-23T10:16:26.286404+0000","last_clean":"2024-04-23T10:16:26.286404+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:16:26.286404+0000","last_undegraded":"2024-04-23T10:16:26.286404+0000","last_fullsized":"2024-04-23T10:16:26.286404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364717+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:16:26.364717+0000","last_peered":"2024-04-23T10:16:26.364717+0000","last_clean":"2024-04-23T10:16:26.364717+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:16:26.364717+0000","last_undegraded":"2024-04-23T10:16:26.364717+0000","last_fullsized":"2024-04-23T10:16:26.364717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285363+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:16:26.285363+0000","last_peered":"2024-04-23T10:16:26.285363+0000","last_clean":"2024-04-23T10:16:26.285363+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:16:26.285363+0000","last_undegraded":"2024-04-23T10:16:26.285363+0000","last_fullsized":"2024-04-23T10:16:26.285363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.368606+0000","last_change":"2024-04-23T10:16:26.368606+0000","last_active":"2024-04-23T10:16:26.368606+0000","last_peered":"2024-04-23T10:16:26.368606+0000","last_clean":"2024-04-23T10:16:26.368606+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:16:26.368606+0000","last_undegraded":"2024-04-23T10:16:26.368606+0000","last_fullsized":"2024-04-23T10:16:26.368606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:02.237968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065394+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:16:27.065394+0000","last_peered":"2024-04-23T10:16:27.065394+0000","last_clean":"2024-04-23T10:16:27.065394+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:16:27.065394+0000","last_undegraded":"2024-04-23T10:16:27.065394+0000","last_fullsized":"2024-04-23T10:16:27.065394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065697+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:16:27.065697+0000","last_peered":"2024-04-23T10:16:27.065697+0000","last_clean":"2024-04-23T10:16:27.065697+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:16:27.065697+0000","last_undegraded":"2024-04-23T10:16:27.065697+0000","last_fullsized":"2024-04-23T10:16:27.065697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288852+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:16:26.288852+0000","last_peered":"2024-04-23T10:16:26.288852+0000","last_clean":"2024-04-23T10:16:26.288852+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:16:26.288852+0000","last_undegraded":"2024-04-23T10:16:26.288852+0000","last_fullsized":"2024-04-23T10:16:26.288852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364443+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:16:26.364443+0000","last_peered":"2024-04-23T10:16:26.364443+0000","last_clean":"2024-04-23T10:16:26.364443+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:16:26.364443+0000","last_undegraded":"2024-04-23T10:16:26.364443+0000","last_fullsized":"2024-04-23T10:16:26.364443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:29.214318+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:16:29.214318+0000","last_peered":"2024-04-23T10:16:29.214318+0000","last_clean":"2024-04-23T10:16:29.214318+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:16:29.214318+0000","last_undegraded":"2024-04-23T10:16:29.214318+0000","last_fullsized":"2024-04-23T10:16:29.214318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681069+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:16:26.681069+0000","last_peered":"2024-04-23T10:16:26.681069+0000","last_clean":"2024-04-23T10:16:26.681069+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:16:26.681069+0000","last_undegraded":"2024-04-23T10:16:26.681069+0000","last_fullsized":"2024-04-23T10:16:26.681069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.366127+0000","last_change":"2024-04-23T10:16:26.366127+0000","last_active":"2024-04-23T10:16:26.366127+0000","last_peered":"2024-04-23T10:16:26.366127+0000","last_clean":"2024-04-23T10:16:26.366127+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:16:26.366127+0000","last_undegraded":"2024-04-23T10:16:26.366127+0000","last_fullsized":"2024-04-23T10:16:26.366127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:26.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682070+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:16:26.682070+0000","last_peered":"2024-04-23T10:16:26.682070+0000","last_clean":"2024-04-23T10:16:26.682070+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:16:26.682070+0000","last_undegraded":"2024-04-23T10:16:26.682070+0000","last_fullsized":"2024-04-23T10:16:26.682070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956738+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:16:26.956738+0000","last_peered":"2024-04-23T10:16:26.956738+0000","last_clean":"2024-04-23T10:16:26.956738+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:16:26.956738+0000","last_undegraded":"2024-04-23T10:16:26.956738+0000","last_fullsized":"2024-04-23T10:16:26.956738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065952+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:16:27.065952+0000","last_peered":"2024-04-23T10:16:27.065952+0000","last_clean":"2024-04-23T10:16:27.065952+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:16:27.065952+0000","last_undegraded":"2024-04-23T10:16:27.065952+0000","last_fullsized":"2024-04-23T10:16:27.065952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.289023+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:16:26.289023+0000","last_peered":"2024-04-23T10:16:26.289023+0000","last_clean":"2024-04-23T10:16:26.289023+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:16:26.289023+0000","last_undegraded":"2024-04-23T10:16:26.289023+0000","last_fullsized":"2024-04-23T10:16:26.289023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284889+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:16:26.284889+0000","last_peered":"2024-04-23T10:16:26.284889+0000","last_clean":"2024-04-23T10:16:26.284889+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:16:26.284889+0000","last_undegraded":"2024-04-23T10:16:26.284889+0000","last_fullsized":"2024-04-23T10:16:26.284889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288706+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:16:26.288706+0000","last_peered":"2024-04-23T10:16:26.288706+0000","last_clean":"2024-04-23T10:16:26.288706+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:16:26.288706+0000","last_undegraded":"2024-04-23T10:16:26.288706+0000","last_fullsized":"2024-04-23T10:16:26.288706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286945+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:16:26.286945+0000","last_peered":"2024-04-23T10:16:26.286945+0000","last_clean":"2024-04-23T10:16:26.286945+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:16:26.286945+0000","last_undegraded":"2024-04-23T10:16:26.286945+0000","last_fullsized":"2024-04-23T10:16:26.286945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284788+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:16:26.284788+0000","last_peered":"2024-04-23T10:16:26.284788+0000","last_clean":"2024-04-23T10:16:26.284788+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:16:26.284788+0000","last_undegraded":"2024-04-23T10:16:26.284788+0000","last_fullsized":"2024-04-23T10:16:26.284788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065291+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:16:27.065291+0000","last_peered":"2024-04-23T10:16:27.065291+0000","last_clean":"2024-04-23T10:16:27.065291+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:16:27.065291+0000","last_undegraded":"2024-04-23T10:16:27.065291+0000","last_fullsized":"2024-04-23T10:16:27.065291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680520+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:16:26.680520+0000","last_peered":"2024-04-23T10:16:26.680520+0000","last_clean":"2024-04-23T10:16:26.680520+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:16:26.680520+0000","last_undegraded":"2024-04-23T10:16:26.680520+0000","last_fullsized":"2024-04-23T10:16:26.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285492+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:16:26.285492+0000","last_peered":"2024-04-23T10:16:26.285492+0000","last_clean":"2024-04-23T10:16:26.285492+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:16:26.285492+0000","last_undegraded":"2024-04-23T10:16:26.285492+0000","last_fullsized":"2024-04-23T10:16:26.285492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286393+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:16:26.286393+0000","last_peered":"2024-04-23T10:16:26.286393+0000","last_clean":"2024-04-23T10:16:26.286393+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:16:26.286393+0000","last_undegraded":"2024-04-23T10:16:26.286393+0000","last_fullsized":"2024-04-23T10:16:26.286393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285162+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:16:26.285162+0000","last_peered":"2024-04-23T10:16:26.285162+0000","last_clean":"2024-04-23T10:16:26.285162+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:16:26.285162+0000","last_undegraded":"2024-04-23T10:16:26.285162+0000","last_fullsized":"2024-04-23T10:16:26.285162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285357+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:16:26.285357+0000","last_peered":"2024-04-23T10:16:26.285357+0000","last_clean":"2024-04-23T10:16:26.285357+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:16:26.285357+0000","last_undegraded":"2024-04-23T10:16:26.285357+0000","last_fullsized":"2024-04-23T10:16:26.285357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286560+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:16:26.286560+0000","last_peered":"2024-04-23T10:16:26.286560+0000","last_clean":"2024-04-23T10:16:26.286560+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:16:26.286560+0000","last_undegraded":"2024-04-23T10:16:26.286560+0000","last_fullsized":"2024-04-23T10:16:26.286560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065664+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:16:27.065664+0000","last_peered":"2024-04-23T10:16:27.065664+0000","last_clean":"2024-04-23T10:16:27.065664+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:16:27.065664+0000","last_undegraded":"2024-04-23T10:16:27.065664+0000","last_fullsized":"2024-04-23T10:16:27.065664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292933+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:16:26.292933+0000","last_peered":"2024-04-23T10:16:26.292933+0000","last_clean":"2024-04-23T10:16:26.292933+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:16:26.292933+0000","last_undegraded":"2024-04-23T10:16:26.292933+0000","last_fullsized":"2024-04-23T10:16:26.292933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287295+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:16:26.287295+0000","last_peered":"2024-04-23T10:16:26.287295+0000","last_clean":"2024-04-23T10:16:26.287295+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:16:26.287295+0000","last_undegraded":"2024-04-23T10:16:26.287295+0000","last_fullsized":"2024-04-23T10:16:26.287295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956508+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:16:26.956508+0000","last_peered":"2024-04-23T10:16:26.956508+0000","last_clean":"2024-04-23T10:16:26.956508+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:16:26.956508+0000","last_undegraded":"2024-04-23T10:16:26.956508+0000","last_fullsized":"2024-04-23T10:16:26.956508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.958520+0000","last_change":"2024-04-23T10:16:26.958520+0000","last_active":"2024-04-23T10:16:26.958520+0000","last_peered":"2024-04-23T10:16:26.958520+0000","last_clean":"2024-04-23T10:16:26.958520+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:16:26.958520+0000","last_undegraded":"2024-04-23T10:16:26.958520+0000","last_fullsized":"2024-04-23T10:16:26.958520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.464656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285739+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:16:26.285739+0000","last_peered":"2024-04-23T10:16:26.285739+0000","last_clean":"2024-04-23T10:16:26.285739+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:16:26.285739+0000","last_undegraded":"2024-04-23T10:16:26.285739+0000","last_fullsized":"2024-04-23T10:16:26.285739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292023+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:16:26.292023+0000","last_peered":"2024-04-23T10:16:26.292023+0000","last_clean":"2024-04-23T10:16:26.292023+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:16:26.292023+0000","last_undegraded":"2024-04-23T10:16:26.292023+0000","last_fullsized":"2024-04-23T10:16:26.292023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.296860+0000","last_change":"2024-04-23T10:16:26.295163+0000","last_active":"2024-04-23T10:16:26.296860+0000","last_peered":"2024-04-23T10:16:26.296860+0000","last_clean":"2024-04-23T10:16:26.296860+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:16:26.296860+0000","last_undegraded":"2024-04-23T10:16:26.296860+0000","last_fullsized":"2024-04-23T10:16:26.296860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:23.533100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065598+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:16:27.065598+0000","last_peered":"2024-04-23T10:16:27.065598+0000","last_clean":"2024-04-23T10:16:27.065598+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:16:27.065598+0000","last_undegraded":"2024-04-23T10:16:27.065598+0000","last_fullsized":"2024-04-23T10:16:27.065598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286564+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:16:26.286564+0000","last_peered":"2024-04-23T10:16:26.286564+0000","last_clean":"2024-04-23T10:16:26.286564+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:16:26.286564+0000","last_undegraded":"2024-04-23T10:16:26.286564+0000","last_fullsized":"2024-04-23T10:16:26.286564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681536+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:16:26.681536+0000","last_peered":"2024-04-23T10:16:26.681536+0000","last_clean":"2024-04-23T10:16:26.681536+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:16:26.681536+0000","last_undegraded":"2024-04-23T10:16:26.681536+0000","last_fullsized":"2024-04-23T10:16:26.681536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.295515+0000","last_change":"2024-04-23T10:16:26.295515+0000","last_active":"2024-04-23T10:16:26.295515+0000","last_peered":"2024-04-23T10:16:26.295515+0000","last_clean":"2024-04-23T10:16:26.295515+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:16:26.295515+0000","last_undegraded":"2024-04-23T10:16:26.295515+0000","last_fullsized":"2024-04-23T10:16:26.295515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:44:48.448837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286724+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:16:26.286724+0000","last_peered":"2024-04-23T10:16:26.286724+0000","last_clean":"2024-04-23T10:16:26.286724+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:16:26.286724+0000","last_undegraded":"2024-04-23T10:16:26.286724+0000","last_fullsized":"2024-04-23T10:16:26.286724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285261+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:16:26.285261+0000","last_peered":"2024-04-23T10:16:26.285261+0000","last_clean":"2024-04-23T10:16:26.285261+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:16:26.285261+0000","last_undegraded":"2024-04-23T10:16:26.285261+0000","last_fullsized":"2024-04-23T10:16:26.285261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285134+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:16:26.285134+0000","last_peered":"2024-04-23T10:16:26.285134+0000","last_clean":"2024-04-23T10:16:26.285134+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:16:26.285134+0000","last_undegraded":"2024-04-23T10:16:26.285134+0000","last_fullsized":"2024-04-23T10:16:26.285134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285185+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:16:26.285185+0000","last_peered":"2024-04-23T10:16:26.285185+0000","last_clean":"2024-04-23T10:16:26.285185+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:16:26.285185+0000","last_undegraded":"2024-04-23T10:16:26.285185+0000","last_fullsized":"2024-04-23T10:16:26.285185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065134+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:16:27.065134+0000","last_peered":"2024-04-23T10:16:27.065134+0000","last_clean":"2024-04-23T10:16:27.065134+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:16:27.065134+0000","last_undegraded":"2024-04-23T10:16:27.065134+0000","last_fullsized":"2024-04-23T10:16:27.065134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286913+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:16:26.286913+0000","last_peered":"2024-04-23T10:16:26.286913+0000","last_clean":"2024-04-23T10:16:26.286913+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:16:26.286913+0000","last_undegraded":"2024-04-23T10:16:26.286913+0000","last_fullsized":"2024-04-23T10:16:26.286913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364790+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:16:26.364790+0000","last_peered":"2024-04-23T10:16:26.364790+0000","last_clean":"2024-04-23T10:16:26.364790+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:16:26.364790+0000","last_undegraded":"2024-04-23T10:16:26.364790+0000","last_fullsized":"2024-04-23T10:16:26.364790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293921+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:16:26.293921+0000","last_peered":"2024-04-23T10:16:26.293921+0000","last_clean":"2024-04-23T10:16:26.293921+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:16:26.293921+0000","last_undegraded":"2024-04-23T10:16:26.293921+0000","last_fullsized":"2024-04-23T10:16:26.293921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.289673+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:16:26.289673+0000","last_peered":"2024-04-23T10:16:26.289673+0000","last_clean":"2024-04-23T10:16:26.289673+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:16:26.289673+0000","last_undegraded":"2024-04-23T10:16:26.289673+0000","last_fullsized":"2024-04-23T10:16:26.289673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285039+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:16:26.285039+0000","last_peered":"2024-04-23T10:16:26.285039+0000","last_clean":"2024-04-23T10:16:26.285039+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:16:26.285039+0000","last_undegraded":"2024-04-23T10:16:26.285039+0000","last_fullsized":"2024-04-23T10:16:26.285039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680656+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:16:26.680656+0000","last_peered":"2024-04-23T10:16:26.680656+0000","last_clean":"2024-04-23T10:16:26.680656+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:16:26.680656+0000","last_undegraded":"2024-04-23T10:16:26.680656+0000","last_fullsized":"2024-04-23T10:16:26.680656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065286+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:16:27.065286+0000","last_peered":"2024-04-23T10:16:27.065286+0000","last_clean":"2024-04-23T10:16:27.065286+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:16:27.065286+0000","last_undegraded":"2024-04-23T10:16:27.065286+0000","last_fullsized":"2024-04-23T10:16:27.065286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286603+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:16:26.286603+0000","last_peered":"2024-04-23T10:16:26.286603+0000","last_clean":"2024-04-23T10:16:26.286603+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:16:26.286603+0000","last_undegraded":"2024-04-23T10:16:26.286603+0000","last_fullsized":"2024-04-23T10:16:26.286603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957679+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:16:26.957679+0000","last_peered":"2024-04-23T10:16:26.957679+0000","last_clean":"2024-04-23T10:16:26.957679+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:16:26.957679+0000","last_undegraded":"2024-04-23T10:16:26.957679+0000","last_fullsized":"2024-04-23T10:16:26.957679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287420+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:16:26.287420+0000","last_peered":"2024-04-23T10:16:26.287420+0000","last_clean":"2024-04-23T10:16:26.287420+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:16:26.287420+0000","last_undegraded":"2024-04-23T10:16:26.287420+0000","last_fullsized":"2024-04-23T10:16:26.287420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286271+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:16:26.286271+0000","last_peered":"2024-04-23T10:16:26.286271+0000","last_clean":"2024-04-23T10:16:26.286271+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:16:26.286271+0000","last_undegraded":"2024-04-23T10:16:26.286271+0000","last_fullsized":"2024-04-23T10:16:26.286271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365499+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:16:26.365499+0000","last_peered":"2024-04-23T10:16:26.365499+0000","last_clean":"2024-04-23T10:16:26.365499+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:16:26.365499+0000","last_undegraded":"2024-04-23T10:16:26.365499+0000","last_fullsized":"2024-04-23T10:16:26.365499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284622+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:16:26.284622+0000","last_peered":"2024-04-23T10:16:26.284622+0000","last_clean":"2024-04-23T10:16:26.284622+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:16:26.284622+0000","last_undegraded":"2024-04-23T10:16:26.284622+0000","last_fullsized":"2024-04-23T10:16:26.284622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364850+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:16:26.364850+0000","last_peered":"2024-04-23T10:16:26.364850+0000","last_clean":"2024-04-23T10:16:26.364850+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:16:26.364850+0000","last_undegraded":"2024-04-23T10:16:26.364850+0000","last_fullsized":"2024-04-23T10:16:26.364850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285091+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:16:26.285091+0000","last_peered":"2024-04-23T10:16:26.285091+0000","last_clean":"2024-04-23T10:16:26.285091+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:16:26.285091+0000","last_undegraded":"2024-04-23T10:16:26.285091+0000","last_fullsized":"2024-04-23T10:16:26.285091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364583+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:16:26.364583+0000","last_peered":"2024-04-23T10:16:26.364583+0000","last_clean":"2024-04-23T10:16:26.364583+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:16:26.364583+0000","last_undegraded":"2024-04-23T10:16:26.364583+0000","last_fullsized":"2024-04-23T10:16:26.364583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288130+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:16:26.288130+0000","last_peered":"2024-04-23T10:16:26.288130+0000","last_clean":"2024-04-23T10:16:26.288130+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:16:26.288130+0000","last_undegraded":"2024-04-23T10:16:26.288130+0000","last_fullsized":"2024-04-23T10:16:26.288130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065434+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:16:27.065434+0000","last_peered":"2024-04-23T10:16:27.065434+0000","last_clean":"2024-04-23T10:16:27.065434+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:16:27.065434+0000","last_undegraded":"2024-04-23T10:16:27.065434+0000","last_fullsized":"2024-04-23T10:16:27.065434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681826+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:16:26.681826+0000","last_peered":"2024-04-23T10:16:26.681826+0000","last_clean":"2024-04-23T10:16:26.681826+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:16:26.681826+0000","last_undegraded":"2024-04-23T10:16:26.681826+0000","last_fullsized":"2024-04-23T10:16:26.681826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365398+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:16:26.365398+0000","last_peered":"2024-04-23T10:16:26.365398+0000","last_clean":"2024-04-23T10:16:26.365398+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:16:26.365398+0000","last_undegraded":"2024-04-23T10:16:26.365398+0000","last_fullsized":"2024-04-23T10:16:26.365398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":707357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":119962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":118821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":116219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":119996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":307200,"data_stored":115980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":901120,"data_stored":705690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:16:34.559 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-23T10:16:34.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:16:34.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09bb0e3640 1 Processor -- start 2024-04-23T10:16:34.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09bb0e3640 1 -- start start 2024-04-23T10:16:34.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09bb0e3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09b406f3b0 0x7f09b40c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09bb0e3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b406f790 0x7f09b4073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09bb0e3640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b4072590 con 0x7f09b4071160 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09bb0e3640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f09b4072fe0 con 0x7f09b406f3b0 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09bb0e3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f09b4158df0 con 0x7f09b406f790 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b8e7f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09b406f3b0 0x7f09b40c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b3fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b406f790 0x7f09b4073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b9680640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f09b4071160 0x7f09b4157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:51900/0 (socket says 172.21.15.29:51900) 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b9680640 1 -- 172.21.15.29:0/3751405209 learned_addr learned my addr 172.21.15.29:0/3751405209 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b3fff640 1 -- 172.21.15.29:0/3751405209 >> v2:172.21.15.72:3300/0 conn(0x7f09b406f3b0 msgr2=0x7f09b40c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b3fff640 1 --2- 172.21.15.29:0/3751405209 >> v2:172.21.15.72:3300/0 conn(0x7f09b406f3b0 0x7f09b40c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b3fff640 1 -- 172.21.15.29:0/3751405209 >> v1:172.21.15.72:6789/0 conn(0x7f09b4071160 legacy=0x7f09b4157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b3fff640 1 -- 172.21.15.29:0/3751405209 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b4158830 con 0x7f09b406f790 2024-04-23T10:16:34.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.722+0000 7f09b8e7f640 1 --2- 172.21.15.29:0/3751405209 >> v2:172.21.15.72:3300/0 conn(0x7f09b406f3b0 0x7f09b40c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:16:34.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 --2- 172.21.15.29:0/3751405209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b406f790 0x7f09b4073470 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f09a80097c0 tx=0x7f09a801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71856d0d1760e972 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:34.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b37fe640 1 -- 172.21.15.29:0/3751405209 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a80a7070 con 0x7f09b406f790 2024-04-23T10:16:34.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b37fe640 1 -- 172.21.15.29:0/3751405209 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a80b0070 con 0x7f09b406f790 2024-04-23T10:16:34.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b37fe640 1 -- 172.21.15.29:0/3751405209 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a80ab890 con 0x7f09b406f790 2024-04-23T10:16:34.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- 172.21.15.29:0/3751405209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b406f790 msgr2=0x7f09b4073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/3751405209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b406f790 0x7f09b4073470 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f09a80097c0 tx=0x7f09a801c470 comp rx=0 tx=0).stop 2024-04-23T10:16:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- 172.21.15.29:0/3751405209 shutdown_connections 2024-04-23T10:16:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/3751405209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b406f790 0x7f09b4073470 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/3751405209 >> v2:172.21.15.72:3300/0 conn(0x7f09b406f3b0 0x7f09b40c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- 172.21.15.29:0/3751405209 >> 172.21.15.29:0/3751405209 conn(0x7f09b406cfb0 msgr2=0x7f09b406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- 172.21.15.29:0/3751405209 shutdown_connections 2024-04-23T10:16:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- 172.21.15.29:0/3751405209 wait complete. 2024-04-23T10:16:34.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 Processor -- start 2024-04-23T10:16:34.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- start start 2024-04-23T10:16:34.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406f3b0 0x7f09b414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b406f790 0x7f09b4140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4071160 0x7f09b4156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f09b4152330 con 0x7f09b406f790 2024-04-23T10:16:34.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f09b4158500 con 0x7f09b406f3b0 2024-04-23T10:16:34.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09bb0e3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f09b41524b0 con 0x7f09b4071160 2024-04-23T10:16:34.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b406f790 0x7f09b4140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b406f790 0x7f09b4140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56430/0 (socket says 172.21.15.29:56430) 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 -- 172.21.15.29:0/1305991481 learned_addr learned my addr 172.21.15.29:0/1305991481 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b9680640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4071160 0x7f09b4156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b8e7f640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406f3b0 0x7f09b414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 -- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4071160 msgr2=0x7f09b4156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4071160 0x7f09b4156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 -- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406f3b0 msgr2=0x7f09b414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406f3b0 0x7f09b414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b3fff640 1 -- 172.21.15.29:0/1305991481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b4157e60 con 0x7f09b406f790 2024-04-23T10:16:34.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.726+0000 7f09b8e7f640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406f3b0 0x7f09b414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b3fff640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b406f790 0x7f09b4140290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09a801a0a0 tx=0x7f09a801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b17fa640 1 -- 172.21.15.29:0/1305991481 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a80bf610 con 0x7f09b406f790 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b17fa640 1 -- 172.21.15.29:0/1305991481 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a80bf7d0 con 0x7f09b406f790 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b41f43a0 con 0x7f09b406f790 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b17fa640 1 -- 172.21.15.29:0/1305991481 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a80bfbc0 con 0x7f09b406f790 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b41f4640 con 0x7f09b406f790 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b4068d70 con 0x7f09b406f790 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b17fa640 1 -- 172.21.15.29:0/1305991481 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09a80bd020 con 0x7f09b406f790 2024-04-23T10:16:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b17fa640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f09a0068380 0x7f09a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:34.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b17fa640 1 -- 172.21.15.29:0/1305991481 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f09a81214a0 con 0x7f09b406f790 2024-04-23T10:16:34.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b8e7f640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f09a0068380 0x7f09a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:34.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.730+0000 7f09b8e7f640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f09a0068380 0x7f09a006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009bc0 tx=0x7f09a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:34.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.734+0000 7f09b17fa640 1 -- 172.21.15.29:0/1305991481 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09a8016090 con 0x7f09b406f790 2024-04-23T10:16:34.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.886+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09b406d390 con 0x7f09a0068380 2024-04-23T10:16:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.910+0000 7f09b17fa640 1 -- 172.21.15.29:0/1305991481 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332687 (secure 0 0 0) 0x7f09b406d390 con 0x7f09a0068380 2024-04-23T10:16:34.916 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:34.918 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:16:34.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f09a0068380 msgr2=0x7f09a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f09a0068380 0x7f09a006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009bc0 tx=0x7f09a4008040 comp rx=0 tx=0).stop 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b406f790 msgr2=0x7f09b4140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b406f790 0x7f09b4140290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09a801a0a0 tx=0x7f09a801acb0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 shutdown_connections 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f09a0068380 0x7f09a006a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4071160 0x7f09b4156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b406f790 0x7f09b4140290 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 --2- 172.21.15.29:0/1305991481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406f3b0 0x7f09b414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 >> 172.21.15.29:0/1305991481 conn(0x7f09b406cfb0 msgr2=0x7f09b40c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 shutdown_connections 2024-04-23T10:16:34.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:34.914+0000 7f09bb0e3640 1 -- 172.21.15.29:0/1305991481 wait complete. 2024-04-23T10:16:34.933 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-23T10:16:33.209574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236396,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738324,"statfs":{"total":773094113280,"available":772852043776,"internally_reserved":0,"allocated":3678208,"data_stored":2120376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1764,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002865"},"pg_stats":[{"pgid":"2.1f","version":"24'13","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065972+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:16:27.065972+0000","last_peered":"2024-04-23T10:16:27.065972+0000","last_clean":"2024-04-23T10:16:27.065972+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:16:27.065972+0000","last_undegraded":"2024-04-23T10:16:27.065972+0000","last_fullsized":"2024-04-23T10:16:27.065972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286349+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:16:26.286349+0000","last_peered":"2024-04-23T10:16:26.286349+0000","last_clean":"2024-04-23T10:16:26.286349+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:16:26.286349+0000","last_undegraded":"2024-04-23T10:16:26.286349+0000","last_fullsized":"2024-04-23T10:16:26.286349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284564+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:16:26.284564+0000","last_peered":"2024-04-23T10:16:26.284564+0000","last_clean":"2024-04-23T10:16:26.284564+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:16:26.284564+0000","last_undegraded":"2024-04-23T10:16:26.284564+0000","last_fullsized":"2024-04-23T10:16:26.284564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286933+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:16:26.286933+0000","last_peered":"2024-04-23T10:16:26.286933+0000","last_clean":"2024-04-23T10:16:26.286933+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:16:26.286933+0000","last_undegraded":"2024-04-23T10:16:26.286933+0000","last_fullsized":"2024-04-23T10:16:26.286933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065876+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:16:27.065876+0000","last_peered":"2024-04-23T10:16:27.065876+0000","last_clean":"2024-04-23T10:16:27.065876+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:16:27.065876+0000","last_undegraded":"2024-04-23T10:16:27.065876+0000","last_fullsized":"2024-04-23T10:16:27.065876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.955819+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:16:26.955819+0000","last_peered":"2024-04-23T10:16:26.955819+0000","last_clean":"2024-04-23T10:16:26.955819+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:16:26.955819+0000","last_undegraded":"2024-04-23T10:16:26.955819+0000","last_fullsized":"2024-04-23T10:16:26.955819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364693+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:16:26.364693+0000","last_peered":"2024-04-23T10:16:26.364693+0000","last_clean":"2024-04-23T10:16:26.364693+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:16:26.364693+0000","last_undegraded":"2024-04-23T10:16:26.364693+0000","last_fullsized":"2024-04-23T10:16:26.364693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288230+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:16:26.288230+0000","last_peered":"2024-04-23T10:16:26.288230+0000","last_clean":"2024-04-23T10:16:26.288230+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:16:26.288230+0000","last_undegraded":"2024-04-23T10:16:26.288230+0000","last_fullsized":"2024-04-23T10:16:26.288230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956173+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:16:26.956173+0000","last_peered":"2024-04-23T10:16:26.956173+0000","last_clean":"2024-04-23T10:16:26.956173+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:16:26.956173+0000","last_undegraded":"2024-04-23T10:16:26.956173+0000","last_fullsized":"2024-04-23T10:16:26.956173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364930+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:16:26.364930+0000","last_peered":"2024-04-23T10:16:26.364930+0000","last_clean":"2024-04-23T10:16:26.364930+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:16:26.364930+0000","last_undegraded":"2024-04-23T10:16:26.364930+0000","last_fullsized":"2024-04-23T10:16:26.364930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288939+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:16:26.288939+0000","last_peered":"2024-04-23T10:16:26.288939+0000","last_clean":"2024-04-23T10:16:26.288939+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:16:26.288939+0000","last_undegraded":"2024-04-23T10:16:26.288939+0000","last_fullsized":"2024-04-23T10:16:26.288939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956461+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:16:26.956461+0000","last_peered":"2024-04-23T10:16:26.956461+0000","last_clean":"2024-04-23T10:16:26.956461+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:16:26.956461+0000","last_undegraded":"2024-04-23T10:16:26.956461+0000","last_fullsized":"2024-04-23T10:16:26.956461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286112+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:16:26.286112+0000","last_peered":"2024-04-23T10:16:26.286112+0000","last_clean":"2024-04-23T10:16:26.286112+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:16:26.286112+0000","last_undegraded":"2024-04-23T10:16:26.286112+0000","last_fullsized":"2024-04-23T10:16:26.286112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364798+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:16:26.364798+0000","last_peered":"2024-04-23T10:16:26.364798+0000","last_clean":"2024-04-23T10:16:26.364798+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:16:26.364798+0000","last_undegraded":"2024-04-23T10:16:26.364798+0000","last_fullsized":"2024-04-23T10:16:26.364798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957017+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:16:26.957017+0000","last_peered":"2024-04-23T10:16:26.957017+0000","last_clean":"2024-04-23T10:16:26.957017+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:16:26.957017+0000","last_undegraded":"2024-04-23T10:16:26.957017+0000","last_fullsized":"2024-04-23T10:16:26.957017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286885+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:16:26.286885+0000","last_peered":"2024-04-23T10:16:26.286885+0000","last_clean":"2024-04-23T10:16:26.286885+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:16:26.286885+0000","last_undegraded":"2024-04-23T10:16:26.286885+0000","last_fullsized":"2024-04-23T10:16:26.286885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681195+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:16:26.681195+0000","last_peered":"2024-04-23T10:16:26.681195+0000","last_clean":"2024-04-23T10:16:26.681195+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:16:26.681195+0000","last_undegraded":"2024-04-23T10:16:26.681195+0000","last_fullsized":"2024-04-23T10:16:26.681195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956651+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:16:26.956651+0000","last_peered":"2024-04-23T10:16:26.956651+0000","last_clean":"2024-04-23T10:16:26.956651+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:16:26.956651+0000","last_undegraded":"2024-04-23T10:16:26.956651+0000","last_fullsized":"2024-04-23T10:16:26.956651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285591+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:16:26.285591+0000","last_peered":"2024-04-23T10:16:26.285591+0000","last_clean":"2024-04-23T10:16:26.285591+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:16:26.285591+0000","last_undegraded":"2024-04-23T10:16:26.285591+0000","last_fullsized":"2024-04-23T10:16:26.285591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680761+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:16:26.680761+0000","last_peered":"2024-04-23T10:16:26.680761+0000","last_clean":"2024-04-23T10:16:26.680761+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:16:26.680761+0000","last_undegraded":"2024-04-23T10:16:26.680761+0000","last_fullsized":"2024-04-23T10:16:26.680761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682579+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:16:26.682579+0000","last_peered":"2024-04-23T10:16:26.682579+0000","last_clean":"2024-04-23T10:16:26.682579+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:16:26.682579+0000","last_undegraded":"2024-04-23T10:16:26.682579+0000","last_fullsized":"2024-04-23T10:16:26.682579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956337+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:16:26.956337+0000","last_peered":"2024-04-23T10:16:26.956337+0000","last_clean":"2024-04-23T10:16:26.956337+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:16:26.956337+0000","last_undegraded":"2024-04-23T10:16:26.956337+0000","last_fullsized":"2024-04-23T10:16:26.956337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364878+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:16:26.364878+0000","last_peered":"2024-04-23T10:16:26.364878+0000","last_clean":"2024-04-23T10:16:26.364878+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:16:26.364878+0000","last_undegraded":"2024-04-23T10:16:26.364878+0000","last_fullsized":"2024-04-23T10:16:26.364878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956974+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:16:26.956974+0000","last_peered":"2024-04-23T10:16:26.956974+0000","last_clean":"2024-04-23T10:16:26.956974+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:16:26.956974+0000","last_undegraded":"2024-04-23T10:16:26.956974+0000","last_fullsized":"2024-04-23T10:16:26.956974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065888+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:16:27.065888+0000","last_peered":"2024-04-23T10:16:27.065888+0000","last_clean":"2024-04-23T10:16:27.065888+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:16:27.065888+0000","last_undegraded":"2024-04-23T10:16:27.065888+0000","last_fullsized":"2024-04-23T10:16:27.065888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287225+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:16:26.287225+0000","last_peered":"2024-04-23T10:16:26.287225+0000","last_clean":"2024-04-23T10:16:26.287225+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:16:26.287225+0000","last_undegraded":"2024-04-23T10:16:26.287225+0000","last_fullsized":"2024-04-23T10:16:26.287225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956044+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:16:26.956044+0000","last_peered":"2024-04-23T10:16:26.956044+0000","last_clean":"2024-04-23T10:16:26.956044+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:16:26.956044+0000","last_undegraded":"2024-04-23T10:16:26.956044+0000","last_fullsized":"2024-04-23T10:16:26.956044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286999+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:16:26.286999+0000","last_peered":"2024-04-23T10:16:26.286999+0000","last_clean":"2024-04-23T10:16:26.286999+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:16:26.286999+0000","last_undegraded":"2024-04-23T10:16:26.286999+0000","last_fullsized":"2024-04-23T10:16:26.286999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681912+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:16:26.681912+0000","last_peered":"2024-04-23T10:16:26.681912+0000","last_clean":"2024-04-23T10:16:26.681912+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:16:26.681912+0000","last_undegraded":"2024-04-23T10:16:26.681912+0000","last_fullsized":"2024-04-23T10:16:26.681912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.066954+0000","last_change":"2024-04-23T10:16:27.066954+0000","last_active":"2024-04-23T10:16:27.066954+0000","last_peered":"2024-04-23T10:16:27.066954+0000","last_clean":"2024-04-23T10:16:27.066954+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:16:27.066954+0000","last_undegraded":"2024-04-23T10:16:27.066954+0000","last_fullsized":"2024-04-23T10:16:27.066954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:04:19.036666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682070+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:16:26.682070+0000","last_peered":"2024-04-23T10:16:26.682070+0000","last_clean":"2024-04-23T10:16:26.682070+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:16:26.682070+0000","last_undegraded":"2024-04-23T10:16:26.682070+0000","last_fullsized":"2024-04-23T10:16:26.682070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364912+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:16:26.364912+0000","last_peered":"2024-04-23T10:16:26.364912+0000","last_clean":"2024-04-23T10:16:26.364912+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:16:26.364912+0000","last_undegraded":"2024-04-23T10:16:26.364912+0000","last_fullsized":"2024-04-23T10:16:26.364912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065111+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:16:27.065111+0000","last_peered":"2024-04-23T10:16:27.065111+0000","last_clean":"2024-04-23T10:16:27.065111+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:16:27.065111+0000","last_undegraded":"2024-04-23T10:16:27.065111+0000","last_fullsized":"2024-04-23T10:16:27.065111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682509+0000","last_change":"2024-04-23T10:16:26.682509+0000","last_active":"2024-04-23T10:16:26.682509+0000","last_peered":"2024-04-23T10:16:26.682509+0000","last_clean":"2024-04-23T10:16:26.682509+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:16:26.682509+0000","last_undegraded":"2024-04-23T10:16:26.682509+0000","last_fullsized":"2024-04-23T10:16:26.682509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:03.876389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682129+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:16:26.682129+0000","last_peered":"2024-04-23T10:16:26.682129+0000","last_clean":"2024-04-23T10:16:26.682129+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:16:26.682129+0000","last_undegraded":"2024-04-23T10:16:26.682129+0000","last_fullsized":"2024-04-23T10:16:26.682129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680821+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:16:26.680821+0000","last_peered":"2024-04-23T10:16:26.680821+0000","last_clean":"2024-04-23T10:16:26.680821+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:16:26.680821+0000","last_undegraded":"2024-04-23T10:16:26.680821+0000","last_fullsized":"2024-04-23T10:16:26.680821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957374+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:16:26.957374+0000","last_peered":"2024-04-23T10:16:26.957374+0000","last_clean":"2024-04-23T10:16:26.957374+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:16:26.957374+0000","last_undegraded":"2024-04-23T10:16:26.957374+0000","last_fullsized":"2024-04-23T10:16:26.957374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285460+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:16:26.285460+0000","last_peered":"2024-04-23T10:16:26.285460+0000","last_clean":"2024-04-23T10:16:26.285460+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:16:26.285460+0000","last_undegraded":"2024-04-23T10:16:26.285460+0000","last_fullsized":"2024-04-23T10:16:26.285460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681967+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:16:26.681967+0000","last_peered":"2024-04-23T10:16:26.681967+0000","last_clean":"2024-04-23T10:16:26.681967+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:16:26.681967+0000","last_undegraded":"2024-04-23T10:16:26.681967+0000","last_fullsized":"2024-04-23T10:16:26.681967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680484+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:16:26.680484+0000","last_peered":"2024-04-23T10:16:26.680484+0000","last_clean":"2024-04-23T10:16:26.680484+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:16:26.680484+0000","last_undegraded":"2024-04-23T10:16:26.680484+0000","last_fullsized":"2024-04-23T10:16:26.680484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292541+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:16:26.292541+0000","last_peered":"2024-04-23T10:16:26.292541+0000","last_clean":"2024-04-23T10:16:26.292541+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:16:26.292541+0000","last_undegraded":"2024-04-23T10:16:26.292541+0000","last_fullsized":"2024-04-23T10:16:26.292541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681818+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:16:26.681818+0000","last_peered":"2024-04-23T10:16:26.681818+0000","last_clean":"2024-04-23T10:16:26.681818+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:16:26.681818+0000","last_undegraded":"2024-04-23T10:16:26.681818+0000","last_fullsized":"2024-04-23T10:16:26.681818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.064972+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:16:27.064972+0000","last_peered":"2024-04-23T10:16:27.064972+0000","last_clean":"2024-04-23T10:16:27.064972+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:16:27.064972+0000","last_undegraded":"2024-04-23T10:16:27.064972+0000","last_fullsized":"2024-04-23T10:16:27.064972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365145+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:16:26.365145+0000","last_peered":"2024-04-23T10:16:26.365145+0000","last_clean":"2024-04-23T10:16:26.365145+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:16:26.365145+0000","last_undegraded":"2024-04-23T10:16:26.365145+0000","last_fullsized":"2024-04-23T10:16:26.365145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065726+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:16:27.065726+0000","last_peered":"2024-04-23T10:16:27.065726+0000","last_clean":"2024-04-23T10:16:27.065726+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:16:27.065726+0000","last_undegraded":"2024-04-23T10:16:27.065726+0000","last_fullsized":"2024-04-23T10:16:27.065726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682268+0000","last_change":"2024-04-23T10:16:26.682268+0000","last_active":"2024-04-23T10:16:26.682268+0000","last_peered":"2024-04-23T10:16:26.682268+0000","last_clean":"2024-04-23T10:16:26.682268+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:16:26.682268+0000","last_undegraded":"2024-04-23T10:16:26.682268+0000","last_fullsized":"2024-04-23T10:16:26.682268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:30:42.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285559+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:16:26.285559+0000","last_peered":"2024-04-23T10:16:26.285559+0000","last_clean":"2024-04-23T10:16:26.285559+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:16:26.285559+0000","last_undegraded":"2024-04-23T10:16:26.285559+0000","last_fullsized":"2024-04-23T10:16:26.285559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365444+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:16:26.365444+0000","last_peered":"2024-04-23T10:16:26.365444+0000","last_clean":"2024-04-23T10:16:26.365444+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:16:26.365444+0000","last_undegraded":"2024-04-23T10:16:26.365444+0000","last_fullsized":"2024-04-23T10:16:26.365444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287178+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:16:26.287178+0000","last_peered":"2024-04-23T10:16:26.287178+0000","last_clean":"2024-04-23T10:16:26.287178+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:16:26.287178+0000","last_undegraded":"2024-04-23T10:16:26.287178+0000","last_fullsized":"2024-04-23T10:16:26.287178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364544+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:16:26.364544+0000","last_peered":"2024-04-23T10:16:26.364544+0000","last_clean":"2024-04-23T10:16:26.364544+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:16:26.364544+0000","last_undegraded":"2024-04-23T10:16:26.364544+0000","last_fullsized":"2024-04-23T10:16:26.364544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293576+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:16:26.293576+0000","last_peered":"2024-04-23T10:16:26.293576+0000","last_clean":"2024-04-23T10:16:26.293576+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:16:26.293576+0000","last_undegraded":"2024-04-23T10:16:26.293576+0000","last_fullsized":"2024-04-23T10:16:26.293576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287644+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:16:26.287644+0000","last_peered":"2024-04-23T10:16:26.287644+0000","last_clean":"2024-04-23T10:16:26.287644+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:16:26.287644+0000","last_undegraded":"2024-04-23T10:16:26.287644+0000","last_fullsized":"2024-04-23T10:16:26.287644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288439+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:16:26.288439+0000","last_peered":"2024-04-23T10:16:26.288439+0000","last_clean":"2024-04-23T10:16:26.288439+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:16:26.288439+0000","last_undegraded":"2024-04-23T10:16:26.288439+0000","last_fullsized":"2024-04-23T10:16:26.288439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682313+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:16:26.682313+0000","last_peered":"2024-04-23T10:16:26.682313+0000","last_clean":"2024-04-23T10:16:26.682313+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:16:26.682313+0000","last_undegraded":"2024-04-23T10:16:26.682313+0000","last_fullsized":"2024-04-23T10:16:26.682313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065532+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:16:27.065532+0000","last_peered":"2024-04-23T10:16:27.065532+0000","last_clean":"2024-04-23T10:16:27.065532+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:16:27.065532+0000","last_undegraded":"2024-04-23T10:16:27.065532+0000","last_fullsized":"2024-04-23T10:16:27.065532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365549+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:16:26.365549+0000","last_peered":"2024-04-23T10:16:26.365549+0000","last_clean":"2024-04-23T10:16:26.365549+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:16:26.365549+0000","last_undegraded":"2024-04-23T10:16:26.365549+0000","last_fullsized":"2024-04-23T10:16:26.365549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293976+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:16:26.293976+0000","last_peered":"2024-04-23T10:16:26.293976+0000","last_clean":"2024-04-23T10:16:26.293976+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:16:26.293976+0000","last_undegraded":"2024-04-23T10:16:26.293976+0000","last_fullsized":"2024-04-23T10:16:26.293976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284577+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:16:26.284577+0000","last_peered":"2024-04-23T10:16:26.284577+0000","last_clean":"2024-04-23T10:16:26.284577+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:16:26.284577+0000","last_undegraded":"2024-04-23T10:16:26.284577+0000","last_fullsized":"2024-04-23T10:16:26.284577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.366014+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:16:26.366014+0000","last_peered":"2024-04-23T10:16:26.366014+0000","last_clean":"2024-04-23T10:16:26.366014+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:16:26.366014+0000","last_undegraded":"2024-04-23T10:16:26.366014+0000","last_fullsized":"2024-04-23T10:16:26.366014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957706+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:16:26.957706+0000","last_peered":"2024-04-23T10:16:26.957706+0000","last_clean":"2024-04-23T10:16:26.957706+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:16:26.957706+0000","last_undegraded":"2024-04-23T10:16:26.957706+0000","last_fullsized":"2024-04-23T10:16:26.957706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.955616+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:16:26.955616+0000","last_peered":"2024-04-23T10:16:26.955616+0000","last_clean":"2024-04-23T10:16:26.955616+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:16:26.955616+0000","last_undegraded":"2024-04-23T10:16:26.955616+0000","last_fullsized":"2024-04-23T10:16:26.955616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365097+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:16:26.365097+0000","last_peered":"2024-04-23T10:16:26.365097+0000","last_clean":"2024-04-23T10:16:26.365097+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:16:26.365097+0000","last_undegraded":"2024-04-23T10:16:26.365097+0000","last_fullsized":"2024-04-23T10:16:26.365097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'17","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.291860+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:16:26.291860+0000","last_peered":"2024-04-23T10:16:26.291860+0000","last_clean":"2024-04-23T10:16:26.291860+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:16:26.291860+0000","last_undegraded":"2024-04-23T10:16:26.291860+0000","last_fullsized":"2024-04-23T10:16:26.291860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065720+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:16:27.065720+0000","last_peered":"2024-04-23T10:16:27.065720+0000","last_clean":"2024-04-23T10:16:27.065720+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:16:27.065720+0000","last_undegraded":"2024-04-23T10:16:27.065720+0000","last_fullsized":"2024-04-23T10:16:27.065720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285980+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:16:26.285980+0000","last_peered":"2024-04-23T10:16:26.285980+0000","last_clean":"2024-04-23T10:16:26.285980+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:16:26.285980+0000","last_undegraded":"2024-04-23T10:16:26.285980+0000","last_fullsized":"2024-04-23T10:16:26.285980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285959+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:16:26.285959+0000","last_peered":"2024-04-23T10:16:26.285959+0000","last_clean":"2024-04-23T10:16:26.285959+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:16:26.285959+0000","last_undegraded":"2024-04-23T10:16:26.285959+0000","last_fullsized":"2024-04-23T10:16:26.285959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286404+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:16:26.286404+0000","last_peered":"2024-04-23T10:16:26.286404+0000","last_clean":"2024-04-23T10:16:26.286404+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:16:26.286404+0000","last_undegraded":"2024-04-23T10:16:26.286404+0000","last_fullsized":"2024-04-23T10:16:26.286404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364717+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:16:26.364717+0000","last_peered":"2024-04-23T10:16:26.364717+0000","last_clean":"2024-04-23T10:16:26.364717+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:16:26.364717+0000","last_undegraded":"2024-04-23T10:16:26.364717+0000","last_fullsized":"2024-04-23T10:16:26.364717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285363+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:16:26.285363+0000","last_peered":"2024-04-23T10:16:26.285363+0000","last_clean":"2024-04-23T10:16:26.285363+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:16:26.285363+0000","last_undegraded":"2024-04-23T10:16:26.285363+0000","last_fullsized":"2024-04-23T10:16:26.285363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.368606+0000","last_change":"2024-04-23T10:16:26.368606+0000","last_active":"2024-04-23T10:16:26.368606+0000","last_peered":"2024-04-23T10:16:26.368606+0000","last_clean":"2024-04-23T10:16:26.368606+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:16:26.368606+0000","last_undegraded":"2024-04-23T10:16:26.368606+0000","last_fullsized":"2024-04-23T10:16:26.368606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:02.237968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065394+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:16:27.065394+0000","last_peered":"2024-04-23T10:16:27.065394+0000","last_clean":"2024-04-23T10:16:27.065394+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:16:27.065394+0000","last_undegraded":"2024-04-23T10:16:27.065394+0000","last_fullsized":"2024-04-23T10:16:27.065394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065697+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:16:27.065697+0000","last_peered":"2024-04-23T10:16:27.065697+0000","last_clean":"2024-04-23T10:16:27.065697+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:16:27.065697+0000","last_undegraded":"2024-04-23T10:16:27.065697+0000","last_fullsized":"2024-04-23T10:16:27.065697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288852+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:16:26.288852+0000","last_peered":"2024-04-23T10:16:26.288852+0000","last_clean":"2024-04-23T10:16:26.288852+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:16:26.288852+0000","last_undegraded":"2024-04-23T10:16:26.288852+0000","last_fullsized":"2024-04-23T10:16:26.288852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364443+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:16:26.364443+0000","last_peered":"2024-04-23T10:16:26.364443+0000","last_clean":"2024-04-23T10:16:26.364443+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:16:26.364443+0000","last_undegraded":"2024-04-23T10:16:26.364443+0000","last_fullsized":"2024-04-23T10:16:26.364443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:29.214318+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:16:29.214318+0000","last_peered":"2024-04-23T10:16:29.214318+0000","last_clean":"2024-04-23T10:16:29.214318+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:16:29.214318+0000","last_undegraded":"2024-04-23T10:16:29.214318+0000","last_fullsized":"2024-04-23T10:16:29.214318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681069+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:16:26.681069+0000","last_peered":"2024-04-23T10:16:26.681069+0000","last_clean":"2024-04-23T10:16:26.681069+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:16:26.681069+0000","last_undegraded":"2024-04-23T10:16:26.681069+0000","last_fullsized":"2024-04-23T10:16:26.681069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.366127+0000","last_change":"2024-04-23T10:16:26.366127+0000","last_active":"2024-04-23T10:16:26.366127+0000","last_peered":"2024-04-23T10:16:26.366127+0000","last_clean":"2024-04-23T10:16:26.366127+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:16:26.366127+0000","last_undegraded":"2024-04-23T10:16:26.366127+0000","last_fullsized":"2024-04-23T10:16:26.366127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:26.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.682070+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:16:26.682070+0000","last_peered":"2024-04-23T10:16:26.682070+0000","last_clean":"2024-04-23T10:16:26.682070+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:16:26.682070+0000","last_undegraded":"2024-04-23T10:16:26.682070+0000","last_fullsized":"2024-04-23T10:16:26.682070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956738+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:16:26.956738+0000","last_peered":"2024-04-23T10:16:26.956738+0000","last_clean":"2024-04-23T10:16:26.956738+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:16:26.956738+0000","last_undegraded":"2024-04-23T10:16:26.956738+0000","last_fullsized":"2024-04-23T10:16:26.956738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065952+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:16:27.065952+0000","last_peered":"2024-04-23T10:16:27.065952+0000","last_clean":"2024-04-23T10:16:27.065952+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:16:27.065952+0000","last_undegraded":"2024-04-23T10:16:27.065952+0000","last_fullsized":"2024-04-23T10:16:27.065952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.289023+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:16:26.289023+0000","last_peered":"2024-04-23T10:16:26.289023+0000","last_clean":"2024-04-23T10:16:26.289023+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:16:26.289023+0000","last_undegraded":"2024-04-23T10:16:26.289023+0000","last_fullsized":"2024-04-23T10:16:26.289023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284889+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:16:26.284889+0000","last_peered":"2024-04-23T10:16:26.284889+0000","last_clean":"2024-04-23T10:16:26.284889+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:16:26.284889+0000","last_undegraded":"2024-04-23T10:16:26.284889+0000","last_fullsized":"2024-04-23T10:16:26.284889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288706+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:16:26.288706+0000","last_peered":"2024-04-23T10:16:26.288706+0000","last_clean":"2024-04-23T10:16:26.288706+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:16:26.288706+0000","last_undegraded":"2024-04-23T10:16:26.288706+0000","last_fullsized":"2024-04-23T10:16:26.288706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286945+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:16:26.286945+0000","last_peered":"2024-04-23T10:16:26.286945+0000","last_clean":"2024-04-23T10:16:26.286945+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:16:26.286945+0000","last_undegraded":"2024-04-23T10:16:26.286945+0000","last_fullsized":"2024-04-23T10:16:26.286945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284788+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:16:26.284788+0000","last_peered":"2024-04-23T10:16:26.284788+0000","last_clean":"2024-04-23T10:16:26.284788+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:16:26.284788+0000","last_undegraded":"2024-04-23T10:16:26.284788+0000","last_fullsized":"2024-04-23T10:16:26.284788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065291+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:16:27.065291+0000","last_peered":"2024-04-23T10:16:27.065291+0000","last_clean":"2024-04-23T10:16:27.065291+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:16:27.065291+0000","last_undegraded":"2024-04-23T10:16:27.065291+0000","last_fullsized":"2024-04-23T10:16:27.065291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680520+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:16:26.680520+0000","last_peered":"2024-04-23T10:16:26.680520+0000","last_clean":"2024-04-23T10:16:26.680520+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:16:26.680520+0000","last_undegraded":"2024-04-23T10:16:26.680520+0000","last_fullsized":"2024-04-23T10:16:26.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285492+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:16:26.285492+0000","last_peered":"2024-04-23T10:16:26.285492+0000","last_clean":"2024-04-23T10:16:26.285492+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:16:26.285492+0000","last_undegraded":"2024-04-23T10:16:26.285492+0000","last_fullsized":"2024-04-23T10:16:26.285492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286393+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:16:26.286393+0000","last_peered":"2024-04-23T10:16:26.286393+0000","last_clean":"2024-04-23T10:16:26.286393+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:16:26.286393+0000","last_undegraded":"2024-04-23T10:16:26.286393+0000","last_fullsized":"2024-04-23T10:16:26.286393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285162+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:16:26.285162+0000","last_peered":"2024-04-23T10:16:26.285162+0000","last_clean":"2024-04-23T10:16:26.285162+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:16:26.285162+0000","last_undegraded":"2024-04-23T10:16:26.285162+0000","last_fullsized":"2024-04-23T10:16:26.285162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285357+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:16:26.285357+0000","last_peered":"2024-04-23T10:16:26.285357+0000","last_clean":"2024-04-23T10:16:26.285357+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:16:26.285357+0000","last_undegraded":"2024-04-23T10:16:26.285357+0000","last_fullsized":"2024-04-23T10:16:26.285357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286560+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:16:26.286560+0000","last_peered":"2024-04-23T10:16:26.286560+0000","last_clean":"2024-04-23T10:16:26.286560+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:16:26.286560+0000","last_undegraded":"2024-04-23T10:16:26.286560+0000","last_fullsized":"2024-04-23T10:16:26.286560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065664+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:16:27.065664+0000","last_peered":"2024-04-23T10:16:27.065664+0000","last_clean":"2024-04-23T10:16:27.065664+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:16:27.065664+0000","last_undegraded":"2024-04-23T10:16:27.065664+0000","last_fullsized":"2024-04-23T10:16:27.065664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292933+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:16:26.292933+0000","last_peered":"2024-04-23T10:16:26.292933+0000","last_clean":"2024-04-23T10:16:26.292933+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:16:26.292933+0000","last_undegraded":"2024-04-23T10:16:26.292933+0000","last_fullsized":"2024-04-23T10:16:26.292933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287295+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:16:26.287295+0000","last_peered":"2024-04-23T10:16:26.287295+0000","last_clean":"2024-04-23T10:16:26.287295+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:16:26.287295+0000","last_undegraded":"2024-04-23T10:16:26.287295+0000","last_fullsized":"2024-04-23T10:16:26.287295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.956508+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:16:26.956508+0000","last_peered":"2024-04-23T10:16:26.956508+0000","last_clean":"2024-04-23T10:16:26.956508+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:16:26.956508+0000","last_undegraded":"2024-04-23T10:16:26.956508+0000","last_fullsized":"2024-04-23T10:16:26.956508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.958520+0000","last_change":"2024-04-23T10:16:26.958520+0000","last_active":"2024-04-23T10:16:26.958520+0000","last_peered":"2024-04-23T10:16:26.958520+0000","last_clean":"2024-04-23T10:16:26.958520+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:16:26.958520+0000","last_undegraded":"2024-04-23T10:16:26.958520+0000","last_fullsized":"2024-04-23T10:16:26.958520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.464656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285739+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:16:26.285739+0000","last_peered":"2024-04-23T10:16:26.285739+0000","last_clean":"2024-04-23T10:16:26.285739+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:16:26.285739+0000","last_undegraded":"2024-04-23T10:16:26.285739+0000","last_fullsized":"2024-04-23T10:16:26.285739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.292023+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:16:26.292023+0000","last_peered":"2024-04-23T10:16:26.292023+0000","last_clean":"2024-04-23T10:16:26.292023+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:16:26.292023+0000","last_undegraded":"2024-04-23T10:16:26.292023+0000","last_fullsized":"2024-04-23T10:16:26.292023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.296860+0000","last_change":"2024-04-23T10:16:26.295163+0000","last_active":"2024-04-23T10:16:26.296860+0000","last_peered":"2024-04-23T10:16:26.296860+0000","last_clean":"2024-04-23T10:16:26.296860+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:16:26.296860+0000","last_undegraded":"2024-04-23T10:16:26.296860+0000","last_fullsized":"2024-04-23T10:16:26.296860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:23.533100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065598+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:16:27.065598+0000","last_peered":"2024-04-23T10:16:27.065598+0000","last_clean":"2024-04-23T10:16:27.065598+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:16:27.065598+0000","last_undegraded":"2024-04-23T10:16:27.065598+0000","last_fullsized":"2024-04-23T10:16:27.065598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286564+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:16:26.286564+0000","last_peered":"2024-04-23T10:16:26.286564+0000","last_clean":"2024-04-23T10:16:26.286564+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:16:26.286564+0000","last_undegraded":"2024-04-23T10:16:26.286564+0000","last_fullsized":"2024-04-23T10:16:26.286564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681536+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:16:26.681536+0000","last_peered":"2024-04-23T10:16:26.681536+0000","last_clean":"2024-04-23T10:16:26.681536+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:16:26.681536+0000","last_undegraded":"2024-04-23T10:16:26.681536+0000","last_fullsized":"2024-04-23T10:16:26.681536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.295515+0000","last_change":"2024-04-23T10:16:26.295515+0000","last_active":"2024-04-23T10:16:26.295515+0000","last_peered":"2024-04-23T10:16:26.295515+0000","last_clean":"2024-04-23T10:16:26.295515+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:16:26.295515+0000","last_undegraded":"2024-04-23T10:16:26.295515+0000","last_fullsized":"2024-04-23T10:16:26.295515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:44:48.448837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286724+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:16:26.286724+0000","last_peered":"2024-04-23T10:16:26.286724+0000","last_clean":"2024-04-23T10:16:26.286724+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:16:26.286724+0000","last_undegraded":"2024-04-23T10:16:26.286724+0000","last_fullsized":"2024-04-23T10:16:26.286724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285261+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:16:26.285261+0000","last_peered":"2024-04-23T10:16:26.285261+0000","last_clean":"2024-04-23T10:16:26.285261+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:16:26.285261+0000","last_undegraded":"2024-04-23T10:16:26.285261+0000","last_fullsized":"2024-04-23T10:16:26.285261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285134+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:16:26.285134+0000","last_peered":"2024-04-23T10:16:26.285134+0000","last_clean":"2024-04-23T10:16:26.285134+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:16:26.285134+0000","last_undegraded":"2024-04-23T10:16:26.285134+0000","last_fullsized":"2024-04-23T10:16:26.285134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285185+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:16:26.285185+0000","last_peered":"2024-04-23T10:16:26.285185+0000","last_clean":"2024-04-23T10:16:26.285185+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:16:26.285185+0000","last_undegraded":"2024-04-23T10:16:26.285185+0000","last_fullsized":"2024-04-23T10:16:26.285185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065134+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:16:27.065134+0000","last_peered":"2024-04-23T10:16:27.065134+0000","last_clean":"2024-04-23T10:16:27.065134+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:16:27.065134+0000","last_undegraded":"2024-04-23T10:16:27.065134+0000","last_fullsized":"2024-04-23T10:16:27.065134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286913+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:16:26.286913+0000","last_peered":"2024-04-23T10:16:26.286913+0000","last_clean":"2024-04-23T10:16:26.286913+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:16:26.286913+0000","last_undegraded":"2024-04-23T10:16:26.286913+0000","last_fullsized":"2024-04-23T10:16:26.286913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364790+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:16:26.364790+0000","last_peered":"2024-04-23T10:16:26.364790+0000","last_clean":"2024-04-23T10:16:26.364790+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:16:26.364790+0000","last_undegraded":"2024-04-23T10:16:26.364790+0000","last_fullsized":"2024-04-23T10:16:26.364790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.293921+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:16:26.293921+0000","last_peered":"2024-04-23T10:16:26.293921+0000","last_clean":"2024-04-23T10:16:26.293921+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:16:26.293921+0000","last_undegraded":"2024-04-23T10:16:26.293921+0000","last_fullsized":"2024-04-23T10:16:26.293921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.289673+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:16:26.289673+0000","last_peered":"2024-04-23T10:16:26.289673+0000","last_clean":"2024-04-23T10:16:26.289673+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:16:26.289673+0000","last_undegraded":"2024-04-23T10:16:26.289673+0000","last_fullsized":"2024-04-23T10:16:26.289673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285039+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:16:26.285039+0000","last_peered":"2024-04-23T10:16:26.285039+0000","last_clean":"2024-04-23T10:16:26.285039+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:16:26.285039+0000","last_undegraded":"2024-04-23T10:16:26.285039+0000","last_fullsized":"2024-04-23T10:16:26.285039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.680656+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:16:26.680656+0000","last_peered":"2024-04-23T10:16:26.680656+0000","last_clean":"2024-04-23T10:16:26.680656+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:16:26.680656+0000","last_undegraded":"2024-04-23T10:16:26.680656+0000","last_fullsized":"2024-04-23T10:16:26.680656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065286+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:16:27.065286+0000","last_peered":"2024-04-23T10:16:27.065286+0000","last_clean":"2024-04-23T10:16:27.065286+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:16:27.065286+0000","last_undegraded":"2024-04-23T10:16:27.065286+0000","last_fullsized":"2024-04-23T10:16:27.065286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286603+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:16:26.286603+0000","last_peered":"2024-04-23T10:16:26.286603+0000","last_clean":"2024-04-23T10:16:26.286603+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:16:26.286603+0000","last_undegraded":"2024-04-23T10:16:26.286603+0000","last_fullsized":"2024-04-23T10:16:26.286603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.957679+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:16:26.957679+0000","last_peered":"2024-04-23T10:16:26.957679+0000","last_clean":"2024-04-23T10:16:26.957679+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:16:26.957679+0000","last_undegraded":"2024-04-23T10:16:26.957679+0000","last_fullsized":"2024-04-23T10:16:26.957679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.287420+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:16:26.287420+0000","last_peered":"2024-04-23T10:16:26.287420+0000","last_clean":"2024-04-23T10:16:26.287420+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:16:26.287420+0000","last_undegraded":"2024-04-23T10:16:26.287420+0000","last_fullsized":"2024-04-23T10:16:26.287420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.286271+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:16:26.286271+0000","last_peered":"2024-04-23T10:16:26.286271+0000","last_clean":"2024-04-23T10:16:26.286271+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:16:26.286271+0000","last_undegraded":"2024-04-23T10:16:26.286271+0000","last_fullsized":"2024-04-23T10:16:26.286271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365499+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:16:26.365499+0000","last_peered":"2024-04-23T10:16:26.365499+0000","last_clean":"2024-04-23T10:16:26.365499+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:16:26.365499+0000","last_undegraded":"2024-04-23T10:16:26.365499+0000","last_fullsized":"2024-04-23T10:16:26.365499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.284622+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:16:26.284622+0000","last_peered":"2024-04-23T10:16:26.284622+0000","last_clean":"2024-04-23T10:16:26.284622+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:16:26.284622+0000","last_undegraded":"2024-04-23T10:16:26.284622+0000","last_fullsized":"2024-04-23T10:16:26.284622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364850+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:16:26.364850+0000","last_peered":"2024-04-23T10:16:26.364850+0000","last_clean":"2024-04-23T10:16:26.364850+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:16:26.364850+0000","last_undegraded":"2024-04-23T10:16:26.364850+0000","last_fullsized":"2024-04-23T10:16:26.364850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.285091+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:16:26.285091+0000","last_peered":"2024-04-23T10:16:26.285091+0000","last_clean":"2024-04-23T10:16:26.285091+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:16:26.285091+0000","last_undegraded":"2024-04-23T10:16:26.285091+0000","last_fullsized":"2024-04-23T10:16:26.285091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.364583+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:16:26.364583+0000","last_peered":"2024-04-23T10:16:26.364583+0000","last_clean":"2024-04-23T10:16:26.364583+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:16:26.364583+0000","last_undegraded":"2024-04-23T10:16:26.364583+0000","last_fullsized":"2024-04-23T10:16:26.364583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.288130+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:16:26.288130+0000","last_peered":"2024-04-23T10:16:26.288130+0000","last_clean":"2024-04-23T10:16:26.288130+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:16:26.288130+0000","last_undegraded":"2024-04-23T10:16:26.288130+0000","last_fullsized":"2024-04-23T10:16:26.288130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:27.065434+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:16:27.065434+0000","last_peered":"2024-04-23T10:16:27.065434+0000","last_clean":"2024-04-23T10:16:27.065434+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:16:27.065434+0000","last_undegraded":"2024-04-23T10:16:27.065434+0000","last_fullsized":"2024-04-23T10:16:27.065434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.681826+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:16:26.681826+0000","last_peered":"2024-04-23T10:16:26.681826+0000","last_clean":"2024-04-23T10:16:26.681826+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:16:26.681826+0000","last_undegraded":"2024-04-23T10:16:26.681826+0000","last_fullsized":"2024-04-23T10:16:26.681826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:16:26.365398+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:16:26.365398+0000","last_peered":"2024-04-23T10:16:26.365398+0000","last_clean":"2024-04-23T10:16:26.365398+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:16:26.365398+0000","last_undegraded":"2024-04-23T10:16:26.365398+0000","last_fullsized":"2024-04-23T10:16:26.365398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":707357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":119962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":118821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":116219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":119996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":307200,"data_stored":115980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":901120,"data_stored":705690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:16:34.938 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:35.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56ccd2640 1 Processor -- start 2024-04-23T10:16:35.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56ccd2640 1 -- start start 2024-04-23T10:16:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56ccd2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5681443c0 0x7ff568074d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56ccd2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff56815b200 con 0x7ff568072f20 2024-04-23T10:16:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56ccd2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff56815b4c0 con 0x7ff568070b80 2024-04-23T10:16:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56ccd2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff56815b7a0 con 0x7ff5681443c0 2024-04-23T10:16:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff565d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff568072f20 0x7ff568070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56952/0 (socket says 172.21.15.29:56952) 2024-04-23T10:16:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff565d9b640 1 -- 172.21.15.29:0/1966607408 learned_addr learned my addr 172.21.15.29:0/1966607408 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56659c640 1 --2- 172.21.15.29:0/1966607408 >> v2:172.21.15.72:3300/0 conn(0x7ff5681443c0 0x7ff568074d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262395276 0 0) 0x7ff56815b200 con 0x7ff568072f20 2024-04-23T10:16:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff550003530 con 0x7ff568072f20 2024-04-23T10:16:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2038031800 0 0) 0x7ff550003530 con 0x7ff568072f20 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 >> v2:172.21.15.72:3300/0 conn(0x7ff5681443c0 msgr2=0x7ff568074d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 --2- 172.21.15.29:0/1966607408 >> v2:172.21.15.72:3300/0 conn(0x7ff5681443c0 0x7ff568074d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 >> v1:172.21.15.72:6789/0 conn(0x7ff568070b80 legacy=0x7ff56815e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56815ba80 con 0x7ff568072f20 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7ff55c001680 con 0x7ff568072f20 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 >> v1:172.21.15.29:6789/0 conn(0x7ff568072f20 legacy=0x7ff568070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5500039c0 0x7ff550003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff550004810 0x7ff550004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5500051d0 0x7ff55000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff56815b7a0 con 0x7ff550004810 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff55000c080 con 0x7ff5500051d0 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff55000c280 con 0x7ff5500039c0 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff565d9b640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff550004810 0x7ff550004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff566d9d640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5500051d0 0x7ff55000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff56659c640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5500039c0 0x7ff550003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff565d9b640 1 -- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5500039c0 msgr2=0x7ff550003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff565d9b640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5500039c0 0x7ff550003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff565d9b640 1 -- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5500051d0 msgr2=0x7ff55000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff565d9b640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5500051d0 0x7ff55000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff565d9b640 1 -- 172.21.15.29:0/1966607408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff550003530 con 0x7ff550004810 2024-04-23T10:16:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff566d9d640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5500051d0 0x7ff55000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.098+0000 7ff566d9d640 1 -- 172.21.15.29:0/1966607408 reap_dead start 2024-04-23T10:16:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff565d9b640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff550004810 0x7ff550004c90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00c240 tx=0x7ff55c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb56fae0a9897bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c007d20 con 0x7ff550004810 2024-04-23T10:16:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55c0a9070 con 0x7ff550004810 2024-04-23T10:16:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56559a640 1 -- 172.21.15.29:0/1966607408 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0a5e40 con 0x7ff550004810 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1966607408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff550004810 msgr2=0x7ff550004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff550004810 0x7ff550004c90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00c240 tx=0x7ff55c01cc80 comp rx=0 tx=0).stop 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1966607408 shutdown_connections 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 --2- 172.21.15.29:0/1966607408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff550004810 0x7ff550004c90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1966607408 >> 172.21.15.29:0/1966607408 conn(0x7ff56806b9e0 msgr2=0x7ff56806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1966607408 shutdown_connections 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1966607408 wait complete. 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 Processor -- start 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 -- start start 2024-04-23T10:16:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.102+0000 7ff56ccd2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff550004810 0x7ff568140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56ccd2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5680cd620 0x7ff5681f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56ccd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5680cdc70 0x7ff56813aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56ccd2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff568070470 con 0x7ff5680cdc70 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56ccd2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff5681447a0 con 0x7ff550004810 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56ccd2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff5680705f0 con 0x7ff5680cd620 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5680cdc70 0x7ff56813aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5680cdc70 0x7ff56813aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56440/0 (socket says 172.21.15.29:56440) 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 -- 172.21.15.29:0/1281888712 learned_addr learned my addr 172.21.15.29:0/1281888712 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff565d9b640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5680cd620 0x7ff5681f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56659c640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff550004810 0x7ff568140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 -- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5680cd620 msgr2=0x7ff5681f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5680cd620 0x7ff5681f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 -- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff550004810 msgr2=0x7ff568140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff550004810 0x7ff568140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 -- 172.21.15.29:0/1281888712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5680ce400 con 0x7ff5680cdc70 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff565d9b640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5680cd620 0x7ff5681f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff566d9d640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5680cdc70 0x7ff56813aea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff568075e20 tx=0x7ff56000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff556ffd640 1 -- 172.21.15.29:0/1281888712 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560003980 con 0x7ff5680cdc70 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff556ffd640 1 -- 172.21.15.29:0/1281888712 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff560018070 con 0x7ff5680cdc70 2024-04-23T10:16:35.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5681f4190 con 0x7ff5680cdc70 2024-04-23T10:16:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff556ffd640 1 -- 172.21.15.29:0/1281888712 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560003d40 con 0x7ff5680cdc70 2024-04-23T10:16:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5681f4f10 con 0x7ff5680cdc70 2024-04-23T10:16:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5680693c0 con 0x7ff5680cdc70 2024-04-23T10:16:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff556ffd640 1 -- 172.21.15.29:0/1281888712 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5600050d0 con 0x7ff5680cdc70 2024-04-23T10:16:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff556ffd640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff548068380 0x7ff54806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff556ffd640 1 -- 172.21.15.29:0/1281888712 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff560086a00 con 0x7ff5680cdc70 2024-04-23T10:16:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.106+0000 7ff56659c640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff548068380 0x7ff54806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.110+0000 7ff56659c640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff548068380 0x7ff54806a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff558009ab0 tx=0x7ff558008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.110+0000 7ff556ffd640 1 -- 172.21.15.29:0/1281888712 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff560056ba0 con 0x7ff5680cdc70 2024-04-23T10:16:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.310+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff56813f030 con 0x7ff5680cdc70 2024-04-23T10:16:35.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.310+0000 7ff556ffd640 1 -- 172.21.15.29:0/1281888712 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7ff56001be40 con 0x7ff5680cdc70 2024-04-23T10:16:35.312 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:35.313 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:16:35.313 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:16:35.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff548068380 msgr2=0x7ff54806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff548068380 0x7ff54806a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff558009ab0 tx=0x7ff558008040 comp rx=0 tx=0).stop 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5680cdc70 msgr2=0x7ff56813aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5680cdc70 0x7ff56813aea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff568075e20 tx=0x7ff56000eb90 comp rx=0 tx=0).stop 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 shutdown_connections 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff548068380 0x7ff54806a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5680cdc70 0x7ff56813aea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5680cd620 0x7ff5681f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 --2- 172.21.15.29:0/1281888712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff550004810 0x7ff568140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 >> 172.21.15.29:0/1281888712 conn(0x7ff56806b9e0 msgr2=0x7ff56815a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 shutdown_connections 2024-04-23T10:16:35.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.314+0000 7ff56ccd2640 1 -- 172.21.15.29:0/1281888712 wait complete. 2024-04-23T10:16:35.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:35.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c648f9640 1 Processor -- start 2024-04-23T10:16:35.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c648f9640 1 -- start start 2024-04-23T10:16:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c648f9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c600cf0a0 0x7f9c60154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c648f9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c600ca880 0x7f9c60155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c648f9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c60155750 con 0x7f9c600cecc0 2024-04-23T10:16:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c648f9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f9c6015bff0 con 0x7f9c600ca880 2024-04-23T10:16:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c648f9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9c6015b470 con 0x7f9c600cf0a0 2024-04-23T10:16:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5e59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9c600cecc0 0x7f9c600ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56954/0 (socket says 172.21.15.29:56954) 2024-04-23T10:16:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5e59c640 1 -- 172.21.15.29:0/3368906118 learned_addr learned my addr 172.21.15.29:0/3368906118 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:35.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5ed9d640 1 --2- 172.21.15.29:0/3368906118 >> v2:172.21.15.29:3300/0 conn(0x7f9c600ca880 0x7f9c60155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5d59a640 1 -- 172.21.15.29:0/3368906118 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877154645 0 0) 0x7f9c60155750 con 0x7f9c600cecc0 2024-04-23T10:16:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5dd9b640 1 --2- 172.21.15.29:0/3368906118 >> v2:172.21.15.72:3300/0 conn(0x7f9c600cf0a0 0x7f9c60154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5d59a640 1 -- 172.21.15.29:0/3368906118 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c48003530 con 0x7f9c600cecc0 2024-04-23T10:16:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5ed9d640 1 -- 172.21.15.29:0/3368906118 >> v2:172.21.15.72:3300/0 conn(0x7f9c600cf0a0 msgr2=0x7f9c60154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5ed9d640 1 --2- 172.21.15.29:0/3368906118 >> v2:172.21.15.72:3300/0 conn(0x7f9c600cf0a0 0x7f9c60154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5ed9d640 1 -- 172.21.15.29:0/3368906118 >> v1:172.21.15.29:6789/0 conn(0x7f9c600cecc0 legacy=0x7f9c600ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.446+0000 7f9c5ed9d640 1 -- 172.21.15.29:0/3368906118 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6015b750 con 0x7f9c600ca880 2024-04-23T10:16:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5ed9d640 1 --2- 172.21.15.29:0/3368906118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60155210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9c600759e0 tx=0x7f9c5801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2319af794a384b47 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5d59a640 1 -- 172.21.15.29:0/3368906118 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c580ab650 con 0x7f9c600ca880 2024-04-23T10:16:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5d59a640 1 -- 172.21.15.29:0/3368906118 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c580b0070 con 0x7f9c600ca880 2024-04-23T10:16:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5d59a640 1 -- 172.21.15.29:0/3368906118 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c580ab9f0 con 0x7f9c600ca880 2024-04-23T10:16:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- 172.21.15.29:0/3368906118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 msgr2=0x7f9c60155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 --2- 172.21.15.29:0/3368906118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60155210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9c600759e0 tx=0x7f9c5801c450 comp rx=0 tx=0).stop 2024-04-23T10:16:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- 172.21.15.29:0/3368906118 shutdown_connections 2024-04-23T10:16:35.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 --2- 172.21.15.29:0/3368906118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60155210 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 --2- 172.21.15.29:0/3368906118 >> v2:172.21.15.72:3300/0 conn(0x7f9c600cf0a0 0x7f9c60154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- 172.21.15.29:0/3368906118 >> 172.21.15.29:0/3368906118 conn(0x7f9c6006fbc0 msgr2=0x7f9c60074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- 172.21.15.29:0/3368906118 shutdown_connections 2024-04-23T10:16:35.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- 172.21.15.29:0/3368906118 wait complete. 2024-04-23T10:16:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 Processor -- start 2024-04-23T10:16:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- start start 2024-04-23T10:16:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c600cecc0 0x7f9c60157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c600cf0a0 0x7f9c60157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6015b1d0 con 0x7f9c600ca880 2024-04-23T10:16:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6015b050 con 0x7f9c600cecc0 2024-04-23T10:16:35.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c648f9640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9c60074250 con 0x7f9c600cf0a0 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56458/0 (socket says 172.21.15.29:56458) 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5e59c640 1 -- 172.21.15.29:0/2582513795 learned_addr learned my addr 172.21.15.29:0/2582513795 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5ed9d640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c600cf0a0 0x7f9c60157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5e59c640 1 -- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c600cf0a0 msgr2=0x7f9c60157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5dd9b640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c600cecc0 0x7f9c60157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5e59c640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c600cf0a0 0x7f9c60157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5e59c640 1 -- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c600cecc0 msgr2=0x7f9c60157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.450+0000 7f9c5e59c640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c600cecc0 0x7f9c60157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c5e59c640 1 -- 172.21.15.29:0/2582513795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c60150c90 con 0x7f9c600ca880 2024-04-23T10:16:35.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c5dd9b640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c600cecc0 0x7f9c60157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c5e59c640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60153f80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000cb40 tx=0x7f9c5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c4effd640 1 -- 172.21.15.29:0/2582513795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50017070 con 0x7f9c600ca880 2024-04-23T10:16:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c4effd640 1 -- 172.21.15.29:0/2582513795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5000aca0 con 0x7f9c600ca880 2024-04-23T10:16:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c60150f70 con 0x7f9c600ca880 2024-04-23T10:16:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c4effd640 1 -- 172.21.15.29:0/2582513795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50012620 con 0x7f9c600ca880 2024-04-23T10:16:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c60157120 con 0x7f9c600ca880 2024-04-23T10:16:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c600693c0 con 0x7f9c600ca880 2024-04-23T10:16:35.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c4effd640 1 -- 172.21.15.29:0/2582513795 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c5001a070 con 0x7f9c600ca880 2024-04-23T10:16:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c4effd640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c400683b0 0x7f9c4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c4effd640 1 -- 172.21.15.29:0/2582513795 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9c50086b30 con 0x7f9c600ca880 2024-04-23T10:16:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c5dd9b640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c400683b0 0x7f9c4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.454+0000 7f9c5dd9b640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c400683b0 0x7f9c4006a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9c600720b0 tx=0x7f9c54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.458+0000 7f9c4effd640 1 -- 172.21.15.29:0/2582513795 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c50056d60 con 0x7f9c600ca880 2024-04-23T10:16:35.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.614+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c60158ca0 con 0x7f9c600ca880 2024-04-23T10:16:35.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c4effd640 1 -- 172.21.15.29:0/2582513795 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18877 (secure 0 0 0) 0x7f9c50056660 con 0x7f9c600ca880 2024-04-23T10:16:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:35.620 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:16:26.277550+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c400683b0 msgr2=0x7f9c4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c400683b0 0x7f9c4006a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9c600720b0 tx=0x7f9c54008040 comp rx=0 tx=0).stop 2024-04-23T10:16:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 msgr2=0x7f9c60153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60153f80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000cb40 tx=0x7f9c5000a060 comp rx=0 tx=0).stop 2024-04-23T10:16:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 shutdown_connections 2024-04-23T10:16:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c400683b0 0x7f9c4006a870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c600cf0a0 0x7f9c60157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c600cecc0 0x7f9c60157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 --2- 172.21.15.29:0/2582513795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c600ca880 0x7f9c60153f80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 >> 172.21.15.29:0/2582513795 conn(0x7f9c6006fbc0 msgr2=0x7f9c60158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:35.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 shutdown_connections 2024-04-23T10:16:35.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.618+0000 7f9c648f9640 1 -- 172.21.15.29:0/2582513795 wait complete. 2024-04-23T10:16:35.637 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:16:35.638 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:16:35.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca9dd46640 1 Processor -- start 2024-04-23T10:16:35.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca9dd46640 1 -- start start 2024-04-23T10:16:35.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca9dd46640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca98153190 0x7fca98159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca9dd46640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca9806f150 0x7fca9806f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca9dd46640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca980c3fe0 con 0x7fca980ccc50 2024-04-23T10:16:35.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca9dd46640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fca98159380 con 0x7fca98153190 2024-04-23T10:16:35.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca9dd46640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fca980c42c0 con 0x7fca9806f150 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca97fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fca980ccc50 0x7fca980cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56962/0 (socket says 172.21.15.29:56962) 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca97fff640 1 -- 172.21.15.29:0/2862434989 learned_addr learned my addr 172.21.15.29:0/2862434989 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca977fe640 1 --2- 172.21.15.29:0/2862434989 >> v2:172.21.15.29:3300/0 conn(0x7fca98153190 0x7fca98159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.762+0000 7fca96ffd640 1 --2- 172.21.15.29:0/2862434989 >> v2:172.21.15.72:3300/0 conn(0x7fca9806f150 0x7fca9806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca967fc640 1 -- 172.21.15.29:0/2862434989 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719859425 0 0) 0x7fca980c3fe0 con 0x7fca980ccc50 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca967fc640 1 -- 172.21.15.29:0/2862434989 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca80003530 con 0x7fca980ccc50 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca977fe640 1 -- 172.21.15.29:0/2862434989 >> v2:172.21.15.72:3300/0 conn(0x7fca9806f150 msgr2=0x7fca9806f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca977fe640 1 --2- 172.21.15.29:0/2862434989 >> v2:172.21.15.72:3300/0 conn(0x7fca9806f150 0x7fca9806f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca977fe640 1 -- 172.21.15.29:0/2862434989 >> v1:172.21.15.29:6789/0 conn(0x7fca980ccc50 legacy=0x7fca980cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca977fe640 1 -- 172.21.15.29:0/2862434989 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca980c45a0 con 0x7fca98153190 2024-04-23T10:16:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca977fe640 1 --2- 172.21.15.29:0/2862434989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98159810 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fca98159500 tx=0x7fca8801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66e8d030e20b84f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca967fc640 1 -- 172.21.15.29:0/2862434989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca880b5070 con 0x7fca98153190 2024-04-23T10:16:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca967fc640 1 -- 172.21.15.29:0/2862434989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca880a8950 con 0x7fca98153190 2024-04-23T10:16:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca967fc640 1 -- 172.21.15.29:0/2862434989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca880a8d00 con 0x7fca98153190 2024-04-23T10:16:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca9dd46640 1 -- 172.21.15.29:0/2862434989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 msgr2=0x7fca98159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca9dd46640 1 --2- 172.21.15.29:0/2862434989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98159810 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fca98159500 tx=0x7fca8801ec50 comp rx=0 tx=0).stop 2024-04-23T10:16:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca9dd46640 1 -- 172.21.15.29:0/2862434989 shutdown_connections 2024-04-23T10:16:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca9dd46640 1 --2- 172.21.15.29:0/2862434989 >> v2:172.21.15.72:3300/0 conn(0x7fca9806f150 0x7fca9806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca9dd46640 1 --2- 172.21.15.29:0/2862434989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98159810 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca9dd46640 1 -- 172.21.15.29:0/2862434989 >> 172.21.15.29:0/2862434989 conn(0x7fca9806cfb0 msgr2=0x7fca9806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:35.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca9dd46640 1 -- 172.21.15.29:0/2862434989 shutdown_connections 2024-04-23T10:16:35.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.766+0000 7fca9dd46640 1 -- 172.21.15.29:0/2862434989 wait complete. 2024-04-23T10:16:35.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 Processor -- start 2024-04-23T10:16:35.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 -- start start 2024-04-23T10:16:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca9806f150 0x7fca9814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca980ccc50 0x7fca9814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fca980c4880 con 0x7fca98153190 2024-04-23T10:16:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca98153570 con 0x7fca980ccc50 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fca980c9070 con 0x7fca9806f150 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56474/0 (socket says 172.21.15.29:56474) 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 -- 172.21.15.29:0/1699951412 learned_addr learned my addr 172.21.15.29:0/1699951412 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca977fe640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca9806f150 0x7fca9814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca96ffd640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca980ccc50 0x7fca9814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 -- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca9806f150 msgr2=0x7fca9814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca9806f150 0x7fca9814b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 -- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca980ccc50 msgr2=0x7fca9814d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca980ccc50 0x7fca9814d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 -- 172.21.15.29:0/1699951412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca981f28d0 con 0x7fca98153190 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca96ffd640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca980ccc50 0x7fca9814d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca97fff640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98155580 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca9000cb40 tx=0x7fca9000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca7ffff640 1 -- 172.21.15.29:0/1699951412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90017070 con 0x7fca98153190 2024-04-23T10:16:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca7ffff640 1 -- 172.21.15.29:0/1699951412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9000aca0 con 0x7fca98153190 2024-04-23T10:16:35.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca7ffff640 1 -- 172.21.15.29:0/1699951412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90012620 con 0x7fca98153190 2024-04-23T10:16:35.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca981f1dd0 con 0x7fca98153190 2024-04-23T10:16:35.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca981f2310 con 0x7fca98153190 2024-04-23T10:16:35.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca98068d70 con 0x7fca98153190 2024-04-23T10:16:35.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.770+0000 7fca7ffff640 1 -- 172.21.15.29:0/1699951412 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca9001a070 con 0x7fca98153190 2024-04-23T10:16:35.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.774+0000 7fca7ffff640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca84068380 0x7fca8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:35.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.774+0000 7fca7ffff640 1 -- 172.21.15.29:0/1699951412 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fca90086c70 con 0x7fca98153190 2024-04-23T10:16:35.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.774+0000 7fca977fe640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca84068380 0x7fca8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:35.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.774+0000 7fca977fe640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca84068380 0x7fca8406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca880b2000 tx=0x7fca880aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:35.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.778+0000 7fca7ffff640 1 -- 172.21.15.29:0/1699951412 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca90056d80 con 0x7fca98153190 2024-04-23T10:16:35.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.938+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fca98156920 con 0x7fca98153190 2024-04-23T10:16:35.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.938+0000 7fca7ffff640 1 -- 172.21.15.29:0/1699951412 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fca90056680 con 0x7fca98153190 2024-04-23T10:16:35.941 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca84068380 msgr2=0x7fca8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca84068380 0x7fca8406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca880b2000 tx=0x7fca880aa070 comp rx=0 tx=0).stop 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 msgr2=0x7fca98155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98155580 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca9000cb40 tx=0x7fca9000a060 comp rx=0 tx=0).stop 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 shutdown_connections 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca84068380 0x7fca8406a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca98153190 0x7fca98155580 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca980ccc50 0x7fca9814d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 --2- 172.21.15.29:0/1699951412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca9806f150 0x7fca9814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 >> 172.21.15.29:0/1699951412 conn(0x7fca9806cfb0 msgr2=0x7fca98156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 shutdown_connections 2024-04-23T10:16:35.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:35.942+0000 7fca9dd46640 1 -- 172.21.15.29:0/1699951412 wait complete. 2024-04-23T10:16:35.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:16:36.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b49bdf640 1 Processor -- start 2024-04-23T10:16:36.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b49bdf640 1 -- start start 2024-04-23T10:16:36.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b49bdf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b440c83c0 0x7f2b440757c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b49bdf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b440c87a0 0x7f2b440c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b49bdf640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b440c6f20 con 0x7f2b44158e30 2024-04-23T10:16:36.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b49bdf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2b440c77e0 con 0x7f2b440c83c0 2024-04-23T10:16:36.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b49bdf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2b440c7c70 con 0x7f2b440c87a0 2024-04-23T10:16:36.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b43fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2b44158e30 0x7f2b44152b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56966/0 (socket says 172.21.15.29:56966) 2024-04-23T10:16:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b43fff640 1 -- 172.21.15.29:0/2555382696 learned_addr learned my addr 172.21.15.29:0/2555382696 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b42ffd640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b440c87a0 0x7f2b440c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b437fe640 1 --2- 172.21.15.29:0/2555382696 >> v2:172.21.15.72:3300/0 conn(0x7f2b440c83c0 0x7f2b440757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769503559 0 0) 0x7f2b440c6f20 con 0x7f2b44158e30 2024-04-23T10:16:36.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2c003530 con 0x7f2b44158e30 2024-04-23T10:16:36.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4207155492 0 0) 0x7f2b2c003530 con 0x7f2b44158e30 2024-04-23T10:16:36.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b440c87a0 msgr2=0x7f2b440c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:36.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b440c87a0 0x7f2b440c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 >> v2:172.21.15.72:3300/0 conn(0x7f2b440c83c0 msgr2=0x7f2b440757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:36.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 --2- 172.21.15.29:0/2555382696 >> v2:172.21.15.72:3300/0 conn(0x7f2b440c83c0 0x7f2b440757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b440c54a0 con 0x7f2b44158e30 2024-04-23T10:16:36.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f2b3c001a00 con 0x7f2b44158e30 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 >> v1:172.21.15.29:6789/0 conn(0x7f2b44158e30 legacy=0x7f2b44152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b440c87a0 0x7f2b2c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2c003f40 0x7f2b2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c004d50 0x7f2b2c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440c77e0 con 0x7f2b2c003f40 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440c7c70 con 0x7f2b2c004d50 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c00b9d0 con 0x7f2b440c87a0 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b42ffd640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2c003f40 0x7f2b2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b42ffd640 1 -- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b440c87a0 msgr2=0x7f2b2c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b42ffd640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b440c87a0 0x7f2b2c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b42ffd640 1 -- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c004d50 msgr2=0x7f2b2c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b43fff640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c004d50 0x7f2b2c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b42ffd640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c004d50 0x7f2b2c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.086+0000 7f2b42ffd640 1 -- 172.21.15.29:0/2555382696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c003530 con 0x7f2b2c003f40 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b42ffd640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2c003f40 0x7f2b2c004810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009ae0 tx=0x7f2b3801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94910bc52af599e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b380b2070 con 0x7f2b2c003f40 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b380a56a0 con 0x7f2b2c003f40 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b427fc640 1 -- 172.21.15.29:0/2555382696 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b380096b0 con 0x7f2b2c003f40 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- 172.21.15.29:0/2555382696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2c003f40 msgr2=0x7f2b2c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 --2- 172.21.15.29:0/2555382696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b2c003f40 0x7f2b2c004810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009ae0 tx=0x7f2b3801ca50 comp rx=0 tx=0).stop 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b43fff640 1 -- 172.21.15.29:0/2555382696 reap_dead start 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- 172.21.15.29:0/2555382696 shutdown_connections 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- 172.21.15.29:0/2555382696 >> 172.21.15.29:0/2555382696 conn(0x7f2b44068180 msgr2=0x7f2b4406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- 172.21.15.29:0/2555382696 shutdown_connections 2024-04-23T10:16:36.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- 172.21.15.29:0/2555382696 wait complete. 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 Processor -- start 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- start start 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2c003f40 0x7f2b441ee740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b441f1cb0 0x7f2b44153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b440ca0a0 0x7f2b4414d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440c7470 con 0x7f2b440ca0a0 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440c7190 con 0x7f2b441f1cb0 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.090+0000 7f2b49bdf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2b440753b0 con 0x7f2b2c003f40 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b440ca0a0 0x7f2b4414d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b440ca0a0 0x7f2b4414d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56500/0 (socket says 172.21.15.29:56500) 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 -- 172.21.15.29:0/114794587 learned_addr learned my addr 172.21.15.29:0/114794587 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b42ffd640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b441f1cb0 0x7f2b44153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b437fe640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2c003f40 0x7f2b441ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 -- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2c003f40 msgr2=0x7f2b441ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2c003f40 0x7f2b441ee740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 -- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b441f1cb0 msgr2=0x7f2b44153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b441f1cb0 0x7f2b44153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 -- 172.21.15.29:0/114794587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4414d0c0 con 0x7f2b440ca0a0 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b437fe640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2c003f40 0x7f2b441ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b43fff640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b440ca0a0 0x7f2b4414d880 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b440c8d00 tx=0x7f2b3c005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b2bfff640 1 -- 172.21.15.29:0/114794587 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c01a070 con 0x7f2b440ca0a0 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b2bfff640 1 -- 172.21.15.29:0/114794587 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c011040 con 0x7f2b440ca0a0 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b441eed80 con 0x7f2b440ca0a0 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b2bfff640 1 -- 172.21.15.29:0/114794587 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00ed60 con 0x7f2b440ca0a0 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b441ef340 con 0x7f2b440ca0a0 2024-04-23T10:16:36.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b440693c0 con 0x7f2b440ca0a0 2024-04-23T10:16:36.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b2bfff640 1 -- 172.21.15.29:0/114794587 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2b3c01d070 con 0x7f2b440ca0a0 2024-04-23T10:16:36.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b2bfff640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2b300683b0 0x7f2b3006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b2bfff640 1 -- 172.21.15.29:0/114794587 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2b3c0894d0 con 0x7f2b440ca0a0 2024-04-23T10:16:36.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b437fe640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2b300683b0 0x7f2b3006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.094+0000 7f2b437fe640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2b300683b0 0x7f2b3006a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2b340047c0 tx=0x7f2b34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.098+0000 7f2b2bfff640 1 -- 172.21.15.29:0/114794587 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2b3c0595e0 con 0x7f2b440ca0a0 2024-04-23T10:16:36.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2b440cc150 con 0x7f2b440ca0a0 2024-04-23T10:16:36.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b2bfff640 1 -- 172.21.15.29:0/114794587 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2b3c058ee0 con 0x7f2b440ca0a0 2024-04-23T10:16:36.260 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:36.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2b300683b0 msgr2=0x7f2b3006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2b300683b0 0x7f2b3006a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2b340047c0 tx=0x7f2b34008040 comp rx=0 tx=0).stop 2024-04-23T10:16:36.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b440ca0a0 msgr2=0x7f2b4414d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b440ca0a0 0x7f2b4414d880 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b440c8d00 tx=0x7f2b3c005b20 comp rx=0 tx=0).stop 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 shutdown_connections 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2b300683b0 0x7f2b3006a870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b440ca0a0 0x7f2b4414d880 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b441f1cb0 0x7f2b44153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 --2- 172.21.15.29:0/114794587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2c003f40 0x7f2b441ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 >> 172.21.15.29:0/114794587 conn(0x7f2b44068180 msgr2=0x7f2b441592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 shutdown_connections 2024-04-23T10:16:36.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.258+0000 7f2b49bdf640 1 -- 172.21.15.29:0/114794587 wait complete. 2024-04-23T10:16:36.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:16:36.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a323a640 1 Processor -- start 2024-04-23T10:16:36.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a323a640 1 -- start start 2024-04-23T10:16:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a323a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 0x7f839c0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a323a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f839c06f790 0x7f839c073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a323a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839c072590 con 0x7f839c071160 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a323a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f839c072fe0 con 0x7f839c06f790 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a323a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f839c158df0 con 0x7f839c06f3b0 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f839bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f839c06f790 0x7f839c073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a17d7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f839c071160 0x7f839c157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56970/0 (socket says 172.21.15.29:56970) 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a17d7640 1 -- 172.21.15.29:0/374474499 learned_addr learned my addr 172.21.15.29:0/374474499 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f839bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f839c06f790 0x7f839c073470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56502/0 (socket says 172.21.15.29:56502) 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f83a0fd6640 1 --2- 172.21.15.29:0/374474499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 0x7f839c0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f839bfff640 1 -- 172.21.15.29:0/374474499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 msgr2=0x7f839c0c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f839bfff640 1 --2- 172.21.15.29:0/374474499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 0x7f839c0c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f839bfff640 1 -- 172.21.15.29:0/374474499 >> v1:172.21.15.29:6789/0 conn(0x7f839c071160 legacy=0x7f839c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f839bfff640 1 -- 172.21.15.29:0/374474499 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c158830 con 0x7f839c06f790 2024-04-23T10:16:36.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.402+0000 7f839b7fe640 1 -- 172.21.15.29:0/374474499 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720033182 0 0) 0x7f839c072590 con 0x7f839c071160 2024-04-23T10:16:36.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f839bfff640 1 --2- 172.21.15.29:0/374474499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c073470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f838c0097c0 tx=0x7f838c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34cc3317c167c19 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f839b7fe640 1 -- 172.21.15.29:0/374474499 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c0a7070 con 0x7f839c06f790 2024-04-23T10:16:36.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f839b7fe640 1 -- 172.21.15.29:0/374474499 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c0b0070 con 0x7f839c06f790 2024-04-23T10:16:36.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f839b7fe640 1 -- 172.21.15.29:0/374474499 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c0ab890 con 0x7f839c06f790 2024-04-23T10:16:36.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- 172.21.15.29:0/374474499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 msgr2=0x7f839c073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 --2- 172.21.15.29:0/374474499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c073470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f838c0097c0 tx=0x7f838c01c470 comp rx=0 tx=0).stop 2024-04-23T10:16:36.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- 172.21.15.29:0/374474499 shutdown_connections 2024-04-23T10:16:36.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 --2- 172.21.15.29:0/374474499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c073470 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 --2- 172.21.15.29:0/374474499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 0x7f839c0c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- 172.21.15.29:0/374474499 >> 172.21.15.29:0/374474499 conn(0x7f839c06cfb0 msgr2=0x7f839c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:36.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- 172.21.15.29:0/374474499 shutdown_connections 2024-04-23T10:16:36.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- 172.21.15.29:0/374474499 wait complete. 2024-04-23T10:16:36.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 Processor -- start 2024-04-23T10:16:36.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- start start 2024-04-23T10:16:36.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 0x7f839c1410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c14d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f839c071160 0x7f839c1f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f839c152330 con 0x7f839c06f790 2024-04-23T10:16:36.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f839c158500 con 0x7f839c071160 2024-04-23T10:16:36.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f83a323a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f839c1524b0 con 0x7f839c06f3b0 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f839bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c14d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f839bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c14d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56508/0 (socket says 172.21.15.29:56508) 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.406+0000 7f839bfff640 1 -- 172.21.15.29:0/3586879129 learned_addr learned my addr 172.21.15.29:0/3586879129 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83a0fd6640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 0x7f839c1410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83a17d7640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f839c071160 0x7f839c1f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f839bfff640 1 -- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 msgr2=0x7f839c1410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f839bfff640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 0x7f839c1410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f839bfff640 1 -- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f839c071160 msgr2=0x7f839c1f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f839bfff640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f839c071160 0x7f839c1f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f839bfff640 1 -- 172.21.15.29:0/3586879129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c1567c0 con 0x7f839c06f790 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83a17d7640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f839c071160 0x7f839c1f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f839bfff640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c14d5a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f838c01a0a0 tx=0x7f838c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83997fa640 1 -- 172.21.15.29:0/3586879129 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c006e20 con 0x7f839c06f790 2024-04-23T10:16:36.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83997fa640 1 -- 172.21.15.29:0/3586879129 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c004230 con 0x7f839c06f790 2024-04-23T10:16:36.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c156aa0 con 0x7f839c06f790 2024-04-23T10:16:36.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83997fa640 1 -- 172.21.15.29:0/3586879129 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c003620 con 0x7f839c06f790 2024-04-23T10:16:36.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c14cda0 con 0x7f839c06f790 2024-04-23T10:16:36.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c14cb90 con 0x7f839c06f790 2024-04-23T10:16:36.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83997fa640 1 -- 172.21.15.29:0/3586879129 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f838c0037c0 con 0x7f839c06f790 2024-04-23T10:16:36.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83997fa640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f83880683b0 0x7f838806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83997fa640 1 -- 172.21.15.29:0/3586879129 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f838c121900 con 0x7f839c06f790 2024-04-23T10:16:36.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83a0fd6640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f83880683b0 0x7f838806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.410+0000 7f83a0fd6640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f83880683b0 0x7f838806a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f839000b9d0 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.414+0000 7f83997fa640 1 -- 172.21.15.29:0/3586879129 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f838c016090 con 0x7f839c06f790 2024-04-23T10:16:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.574+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f839c068d70 con 0x7f839c06f790 2024-04-23T10:16:36.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.574+0000 7f83997fa640 1 -- 172.21.15.29:0/3586879129 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f838c0f1aa0 con 0x7f839c06f790 2024-04-23T10:16:36.577 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:16:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f83880683b0 msgr2=0x7f838806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f83880683b0 0x7f838806a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f839000b9d0 tx=0x7f8390008040 comp rx=0 tx=0).stop 2024-04-23T10:16:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 msgr2=0x7f839c14d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c14d5a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f838c01a0a0 tx=0x7f838c01acb0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 shutdown_connections 2024-04-23T10:16:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f83880683b0 0x7f838806a870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f839c071160 0x7f839c1f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f839c06f790 0x7f839c14d5a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 --2- 172.21.15.29:0/3586879129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f839c06f3b0 0x7f839c1410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 >> 172.21.15.29:0/3586879129 conn(0x7f839c06cfb0 msgr2=0x7f839c14f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 shutdown_connections 2024-04-23T10:16:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.578+0000 7f83a323a640 1 -- 172.21.15.29:0/3586879129 wait complete. 2024-04-23T10:16:36.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:16:36.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.718+0000 7f55ad6e8640 1 Processor -- start 2024-04-23T10:16:36.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.718+0000 7f55ad6e8640 1 -- start start 2024-04-23T10:16:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55ad6e8640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55a80cd360 0x7f55a806f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55ad6e8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a80c3fe0 con 0x7f55a8153190 2024-04-23T10:16:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55ad6e8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a80c42c0 con 0x7f55a806f150 2024-04-23T10:16:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55ad6e8640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f55a8159f20 con 0x7f55a80cd360 2024-04-23T10:16:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a6ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f55a8153190 0x7f55a8159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56976/0 (socket says 172.21.15.29:56976) 2024-04-23T10:16:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a6ffd640 1 -- 172.21.15.29:0/2027976370 learned_addr learned my addr 172.21.15.29:0/2027976370 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a77fe640 1 --2- 172.21.15.29:0/2027976370 >> v2:172.21.15.72:3300/0 conn(0x7f55a80cd360 0x7f55a806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654325275 0 0) 0x7f55a80c3fe0 con 0x7f55a8153190 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5590003530 con 0x7f55a8153190 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2793308945 0 0) 0x7f5590003530 con 0x7f55a8153190 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 >> v2:172.21.15.72:3300/0 conn(0x7f55a80cd360 msgr2=0x7f55a806f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 --2- 172.21.15.29:0/2027976370 >> v2:172.21.15.72:3300/0 conn(0x7f55a80cd360 0x7f55a806f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 >> v1:172.21.15.72:6789/0 conn(0x7f55a806f150 legacy=0x7f55a80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a80c45a0 con 0x7f55a8153190 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f5598001680 con 0x7f55a8153190 2024-04-23T10:16:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 >> v1:172.21.15.29:6789/0 conn(0x7f55a8153190 legacy=0x7f55a8159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55900039c0 0x7f5590003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5590004810 0x7f5590004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900051d0 0x7f559000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8159f20 con 0x7f55900039c0 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f559000c080 con 0x7f55900051d0 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f559000c280 con 0x7f5590004810 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a6ffd640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55900039c0 0x7f5590003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a67fc640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5590004810 0x7f5590004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a77fe640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900051d0 0x7f559000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a6ffd640 1 -- 172.21.15.29:0/2027976370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5590004810 msgr2=0x7f5590004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:36.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a6ffd640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5590004810 0x7f5590004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a6ffd640 1 -- 172.21.15.29:0/2027976370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900051d0 msgr2=0x7f559000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a6ffd640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900051d0 0x7f559000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a77fe640 1 -- 172.21.15.29:0/2027976370 reap_dead start 2024-04-23T10:16:36.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.722+0000 7f55a6ffd640 1 -- 172.21.15.29:0/2027976370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5590003530 con 0x7f55900039c0 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55a6ffd640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55900039c0 0x7f5590003de0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f559800c1c0 tx=0x7f559801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd54c5865bb13fd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598007d00 con 0x7f55900039c0 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598005ae0 con 0x7f55900039c0 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55a5ffb640 1 -- 172.21.15.29:0/2027976370 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598007070 con 0x7f55900039c0 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2027976370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55900039c0 msgr2=0x7f5590003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55900039c0 0x7f5590003de0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f559800c1c0 tx=0x7f559801f390 comp rx=0 tx=0).stop 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2027976370 shutdown_connections 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 --2- 172.21.15.29:0/2027976370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55900039c0 0x7f5590003de0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2027976370 >> 172.21.15.29:0/2027976370 conn(0x7f55a806cfb0 msgr2=0x7f55a806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2027976370 shutdown_connections 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2027976370 wait complete. 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 Processor -- start 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- start start 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900039c0 0x7f55a80cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a814df60 0x7f55a814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a814adf0 0x7f55a81f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8153570 con 0x7f55a814adf0 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8159380 con 0x7f55900039c0 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.726+0000 7f55ad6e8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f55a80c4880 con 0x7f55a814df60 2024-04-23T10:16:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a814adf0 0x7f55a81f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a814adf0 0x7f55a81f1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56522/0 (socket says 172.21.15.29:56522) 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 -- 172.21.15.29:0/2838156307 learned_addr learned my addr 172.21.15.29:0/2838156307 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a6ffd640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900039c0 0x7f55a80cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a67fc640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a814df60 0x7f55a814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 -- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a814df60 msgr2=0x7f55a814a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a814df60 0x7f55a814a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 -- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900039c0 msgr2=0x7f55a80cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900039c0 0x7f55a80cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 -- 172.21.15.29:0/2838156307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a806f950 con 0x7f55a814adf0 2024-04-23T10:16:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a77fe640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a814adf0 0x7f55a81f1b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f55a8073400 tx=0x7f55a00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f558f7fe640 1 -- 172.21.15.29:0/2838156307 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0011db0 con 0x7f55a814adf0 2024-04-23T10:16:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f558f7fe640 1 -- 172.21.15.29:0/2838156307 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a001b070 con 0x7f55a814adf0 2024-04-23T10:16:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f558f7fe640 1 -- 172.21.15.29:0/2838156307 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a00039a0 con 0x7f55a814adf0 2024-04-23T10:16:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a814b3a0 con 0x7f55a814adf0 2024-04-23T10:16:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a80cb200 con 0x7f55a814adf0 2024-04-23T10:16:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a8068d70 con 0x7f55a814adf0 2024-04-23T10:16:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f558f7fe640 1 -- 172.21.15.29:0/2838156307 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55a0003b40 con 0x7f55a814adf0 2024-04-23T10:16:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f558f7fe640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55940683b0 0x7f559406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f558f7fe640 1 -- 172.21.15.29:0/2838156307 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f55a00875b0 con 0x7f55a814adf0 2024-04-23T10:16:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a6ffd640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55940683b0 0x7f559406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.730+0000 7f55a6ffd640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55940683b0 0x7f559406a870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55980ae000 tx=0x7f5598007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.734+0000 7f558f7fe640 1 -- 172.21.15.29:0/2838156307 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f55a0057750 con 0x7f55a814adf0 2024-04-23T10:16:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.890+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f55a8156920 con 0x7f55a814adf0 2024-04-23T10:16:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f558f7fe640 1 -- 172.21.15.29:0/2838156307 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f55a0057050 con 0x7f55a814adf0 2024-04-23T10:16:36.895 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:16:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55940683b0 msgr2=0x7f559406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55940683b0 0x7f559406a870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55980ae000 tx=0x7f5598007040 comp rx=0 tx=0).stop 2024-04-23T10:16:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a814adf0 msgr2=0x7f55a81f1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a814adf0 0x7f55a81f1b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f55a8073400 tx=0x7f55a00115a0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 shutdown_connections 2024-04-23T10:16:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f55940683b0 0x7f559406a870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a814adf0 0x7f55a81f1b70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a814df60 0x7f55a814a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 --2- 172.21.15.29:0/2838156307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55900039c0 0x7f55a80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:36.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 >> 172.21.15.29:0/2838156307 conn(0x7f55a806cfb0 msgr2=0x7f55a8158230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:36.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 shutdown_connections 2024-04-23T10:16:36.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:36.894+0000 7f55ad6e8640 1 -- 172.21.15.29:0/2838156307 wait complete. 2024-04-23T10:16:36.912 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:37.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c34ea640 1 Processor -- start 2024-04-23T10:16:37.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c34ea640 1 -- start start 2024-04-23T10:16:37.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c34ea640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94bc0c9170 0x7f94bc0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c34ea640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f94bc0c9550 0x7f94bc0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c34ea640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc15b4d0 con 0x7f94bc06e950 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c34ea640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f94bc0ca7d0 con 0x7f94bc0c9550 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c34ea640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f94bc0c7990 con 0x7f94bc0c9170 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c0a85640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f94bc0c9550 0x7f94bc0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c0a85640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f94bc0c9550 0x7f94bc0c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56536/0 (socket says 172.21.15.29:56536) 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c0a85640 1 -- 172.21.15.29:0/4202140452 learned_addr learned my addr 172.21.15.29:0/4202140452 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c0a85640 1 -- 172.21.15.29:0/4202140452 >> v2:172.21.15.72:3300/0 conn(0x7f94bc0c9170 msgr2=0x7f94bc0c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c1286640 1 --2- 172.21.15.29:0/4202140452 >> v2:172.21.15.72:3300/0 conn(0x7f94bc0c9170 0x7f94bc0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c0a85640 1 --2- 172.21.15.29:0/4202140452 >> v2:172.21.15.72:3300/0 conn(0x7f94bc0c9170 0x7f94bc0c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c0a85640 1 -- 172.21.15.29:0/4202140452 >> v1:172.21.15.72:6789/0 conn(0x7f94bc06e950 legacy=0x7f94bc155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:37.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.026+0000 7f94c0a85640 1 -- 172.21.15.29:0/4202140452 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc15b7b0 con 0x7f94bc0c9550 2024-04-23T10:16:37.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c0a85640 1 --2- 172.21.15.29:0/4202140452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc0c9550 0x7f94bc0c8360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009870 tx=0x7f94b801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb09ce8295ad477 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94affff640 1 -- 172.21.15.29:0/4202140452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b80ab5f0 con 0x7f94bc0c9550 2024-04-23T10:16:37.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94affff640 1 -- 172.21.15.29:0/4202140452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b80b0070 con 0x7f94bc0c9550 2024-04-23T10:16:37.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94affff640 1 -- 172.21.15.29:0/4202140452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b80ab9b0 con 0x7f94bc0c9550 2024-04-23T10:16:37.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 -- 172.21.15.29:0/4202140452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc0c9550 msgr2=0x7f94bc0c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 --2- 172.21.15.29:0/4202140452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc0c9550 0x7f94bc0c8360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009870 tx=0x7f94b801c4e0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 -- 172.21.15.29:0/4202140452 shutdown_connections 2024-04-23T10:16:37.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 --2- 172.21.15.29:0/4202140452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc0c9550 0x7f94bc0c8360 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 --2- 172.21.15.29:0/4202140452 >> v2:172.21.15.72:3300/0 conn(0x7f94bc0c9170 0x7f94bc0c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 -- 172.21.15.29:0/4202140452 >> 172.21.15.29:0/4202140452 conn(0x7f94bc0c9a90 msgr2=0x7f94bc0c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 -- 172.21.15.29:0/4202140452 shutdown_connections 2024-04-23T10:16:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 -- 172.21.15.29:0/4202140452 wait complete. 2024-04-23T10:16:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 Processor -- start 2024-04-23T10:16:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.030+0000 7f94c34ea640 1 -- start start 2024-04-23T10:16:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc06e950 0x7f94bc148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94bc0c9170 0x7f94bc14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94bc0c9550 0x7f94bc14b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc06e460 con 0x7f94bc06e950 2024-04-23T10:16:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc06e2e0 con 0x7f94bc0c9550 2024-04-23T10:16:37.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc168380 con 0x7f94bc0c9170 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc06e950 0x7f94bc148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc06e950 0x7f94bc148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56550/0 (socket says 172.21.15.29:56550) 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 -- 172.21.15.29:0/1800569515 learned_addr learned my addr 172.21.15.29:0/1800569515 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c0a85640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94bc0c9170 0x7f94bc14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1a87640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94bc0c9550 0x7f94bc14b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 -- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94bc0c9170 msgr2=0x7f94bc14ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94bc0c9170 0x7f94bc14ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 -- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94bc0c9550 msgr2=0x7f94bc14b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94bc0c9550 0x7f94bc14b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 -- 172.21.15.29:0/1800569515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc072dd0 con 0x7f94bc06e950 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c0a85640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94bc0c9170 0x7f94bc14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1a87640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94bc0c9550 0x7f94bc14b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c1286640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc06e950 0x7f94bc148b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c820 tx=0x7f94b000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94adffb640 1 -- 172.21.15.29:0/1800569515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0015070 con 0x7f94bc06e950 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94adffb640 1 -- 172.21.15.29:0/1800569515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b0007a30 con 0x7f94bc06e950 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc1f3ba0 con 0x7f94bc06e950 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94adffb640 1 -- 172.21.15.29:0/1800569515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0007e20 con 0x7f94bc06e950 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc1f4140 con 0x7f94bc06e950 2024-04-23T10:16:37.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc1f4b20 con 0x7f94bc06e950 2024-04-23T10:16:37.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94adffb640 1 -- 172.21.15.29:0/1800569515 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f94b0018070 con 0x7f94bc06e950 2024-04-23T10:16:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94adffb640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f94a0068380 0x7f94a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94adffb640 1 -- 172.21.15.29:0/1800569515 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f94b0086d80 con 0x7f94bc06e950 2024-04-23T10:16:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.034+0000 7f94c0a85640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f94a0068380 0x7f94a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.038+0000 7f94c0a85640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f94a0068380 0x7f94a006a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94b80af000 tx=0x7f94b80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.042+0000 7f94adffb640 1 -- 172.21.15.29:0/1800569515 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f94bc1f4b20 con 0x7f94bc06e950 2024-04-23T10:16:37.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94bc15ad80 con 0x7f94bc06e950 2024-04-23T10:16:37.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94adffb640 1 -- 172.21.15.29:0/1800569515 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f94b0056e90 con 0x7f94bc06e950 2024-04-23T10:16:37.244 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:37.244 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:16:37.244 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:16:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f94a0068380 msgr2=0x7f94a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f94a0068380 0x7f94a006a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94b80af000 tx=0x7f94b80a7000 comp rx=0 tx=0).stop 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc06e950 msgr2=0x7f94bc148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc06e950 0x7f94bc148b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c820 tx=0x7f94b000cce0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 shutdown_connections 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f94a0068380 0x7f94a006a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94bc0c9550 0x7f94bc14b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94bc0c9170 0x7f94bc14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 --2- 172.21.15.29:0/1800569515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94bc06e950 0x7f94bc148b80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.242+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 >> 172.21.15.29:0/1800569515 conn(0x7f94bc0c9a90 msgr2=0x7f94bc14ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.246+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 shutdown_connections 2024-04-23T10:16:37.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.246+0000 7f94c34ea640 1 -- 172.21.15.29:0/1800569515 wait complete. 2024-04-23T10:16:37.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:16:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.378+0000 7f895db91640 1 Processor -- start 2024-04-23T10:16:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.378+0000 7f895db91640 1 -- start start 2024-04-23T10:16:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f895806f3b0 0x7f89580c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f790 0x7f8958073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8958072590 con 0x7f8958071160 2024-04-23T10:16:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8958072fe0 con 0x7f895806f3b0 2024-04-23T10:16:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8958158df0 con 0x7f895806f790 2024-04-23T10:16:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89577fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f895806f3b0 0x7f89580c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f8957fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8958071160 0x7f8958157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56990/0 (socket says 172.21.15.29:56990) 2024-04-23T10:16:37.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f8957fff640 1 -- 172.21.15.29:0/865763124 learned_addr learned my addr 172.21.15.29:0/865763124 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89577fe640 1 -- 172.21.15.29:0/865763124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f790 msgr2=0x7f8958073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89577fe640 1 --2- 172.21.15.29:0/865763124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f790 0x7f8958073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89577fe640 1 -- 172.21.15.29:0/865763124 >> v1:172.21.15.29:6789/0 conn(0x7f8958071160 legacy=0x7f8958157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89577fe640 1 -- 172.21.15.29:0/865763124 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8958158830 con 0x7f895806f3b0 2024-04-23T10:16:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89567fc640 1 -- 172.21.15.29:0/865763124 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870449912 0 0) 0x7f8958072590 con 0x7f8958071160 2024-04-23T10:16:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89577fe640 1 --2- 172.21.15.29:0/865763124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f3b0 0x7f89580c4d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f89480097c0 tx=0x7f894801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bda6fbab4531668 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89567fc640 1 -- 172.21.15.29:0/865763124 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89480a7070 con 0x7f895806f3b0 2024-04-23T10:16:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89567fc640 1 -- 172.21.15.29:0/865763124 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89480b0070 con 0x7f895806f3b0 2024-04-23T10:16:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f89567fc640 1 -- 172.21.15.29:0/865763124 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89480ab890 con 0x7f895806f3b0 2024-04-23T10:16:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 -- 172.21.15.29:0/865763124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f3b0 msgr2=0x7f89580c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 --2- 172.21.15.29:0/865763124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f3b0 0x7f89580c4d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f89480097c0 tx=0x7f894801c470 comp rx=0 tx=0).stop 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 -- 172.21.15.29:0/865763124 shutdown_connections 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 --2- 172.21.15.29:0/865763124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f790 0x7f8958073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 --2- 172.21.15.29:0/865763124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f3b0 0x7f89580c4d70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 -- 172.21.15.29:0/865763124 >> 172.21.15.29:0/865763124 conn(0x7f895806cfb0 msgr2=0x7f895806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 -- 172.21.15.29:0/865763124 shutdown_connections 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.382+0000 7f895db91640 1 -- 172.21.15.29:0/865763124 wait complete. 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 Processor -- start 2024-04-23T10:16:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 -- start start 2024-04-23T10:16:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f3b0 0x7f89580cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f790 0x7f89580cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8958071160 0x7f8958157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8958152330 con 0x7f895806f790 2024-04-23T10:16:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8958158500 con 0x7f8958071160 2024-04-23T10:16:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f89581524b0 con 0x7f895806f3b0 2024-04-23T10:16:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f790 0x7f89580cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f790 0x7f89580cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56568/0 (socket says 172.21.15.29:56568) 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 -- 172.21.15.29:0/1548263927 learned_addr learned my addr 172.21.15.29:0/1548263927 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f89577fe640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f3b0 0x7f89580cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 -- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f3b0 msgr2=0x7f89580cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f3b0 0x7f89580cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 -- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8958071160 msgr2=0x7f8958157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8957fff640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8958071160 0x7f8958157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8958071160 0x7f8958157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 -- 172.21.15.29:0/1548263927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8958155cd0 con 0x7f895806f790 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8957fff640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8958071160 0x7f8958157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f8956ffd640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f790 0x7f89580cccd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f894c00b480 tx=0x7f894c00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f893ffff640 1 -- 172.21.15.29:0/1548263927 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c014070 con 0x7f895806f790 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f893ffff640 1 -- 172.21.15.29:0/1548263927 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c010870 con 0x7f895806f790 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8958155f70 con 0x7f895806f790 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f893ffff640 1 -- 172.21.15.29:0/1548263927 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c010c60 con 0x7f895806f790 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89581f57b0 con 0x7f895806f790 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8958068d70 con 0x7f895806f790 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.386+0000 7f893ffff640 1 -- 172.21.15.29:0/1548263927 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f894c017070 con 0x7f895806f790 2024-04-23T10:16:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.390+0000 7f893ffff640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8944068380 0x7f894406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.390+0000 7f893ffff640 1 -- 172.21.15.29:0/1548263927 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f894c086c50 con 0x7f895806f790 2024-04-23T10:16:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.390+0000 7f89577fe640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8944068380 0x7f894406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.390+0000 7f89577fe640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8944068380 0x7f894406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f89480af000 tx=0x7f8948008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.394+0000 7f893ffff640 1 -- 172.21.15.29:0/1548263927 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f894c08c020 con 0x7f895806f790 2024-04-23T10:16:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.550+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89580c68c0 con 0x7f895806f790 2024-04-23T10:16:37.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.550+0000 7f893ffff640 1 -- 172.21.15.29:0/1548263927 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18877 (secure 0 0 0) 0x7f894c056df0 con 0x7f895806f790 2024-04-23T10:16:37.554 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:37.554 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:16:26.277550+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:16:37.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8944068380 msgr2=0x7f894406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8944068380 0x7f894406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f89480af000 tx=0x7f8948008040 comp rx=0 tx=0).stop 2024-04-23T10:16:37.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f790 msgr2=0x7f89580cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f790 0x7f89580cccd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f894c00b480 tx=0x7f894c00b940 comp rx=0 tx=0).stop 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 shutdown_connections 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8944068380 0x7f894406a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8958071160 0x7f8958157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f895806f790 0x7f89580cccd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 --2- 172.21.15.29:0/1548263927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895806f3b0 0x7f89580cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 >> 172.21.15.29:0/1548263927 conn(0x7f895806cfb0 msgr2=0x7f8958150980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 shutdown_connections 2024-04-23T10:16:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.554+0000 7f895db91640 1 -- 172.21.15.29:0/1548263927 wait complete. 2024-04-23T10:16:37.572 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 748439 2024-04-23T10:16:37.572 DEBUG:tasks.quiescer:Yielding 2024-04-23T10:16:37.572 INFO:teuthology.run_tasks:Running task workunit... 2024-04-23T10:16:37.586 INFO:tasks.workunit:Pulling workunits from ref 0a6c3ed699031b80a2b419e7e795368719871394 2024-04-23T10:16:37.586 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-23T10:16:37.586 INFO:tasks.workunit:timeout=6h 2024-04-23T10:16:37.586 INFO:tasks.workunit:cleanup=True 2024-04-23T10:16:37.587 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:37.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:37.594 INFO:teuthology.orchestra.run.smithi029.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:37.594 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-23T10:16:37.594 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-23T10:16:37.594 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:16:37.594 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-23T10:16:37.594 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-23 10:15:43.032420258 +0000 2024-04-23T10:16:37.594 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-23 10:15:51.361410866 +0000 2024-04-23T10:16:37.594 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-23T10:16:37.595 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-23T10:16:37.595 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-23T10:16:37.658 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a6c3ed699031b80a2b419e7e795368719871394 2024-04-23T10:16:37.703 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-23T10:16:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3fa01640 1 Processor -- start 2024-04-23T10:16:37.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3fa01640 1 -- start start 2024-04-23T10:16:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3fa01640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8f38155410 0x7f8f3815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3fa01640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f3815e7e0 0x7f8f380cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3fa01640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3815f1e0 con 0x7f8f3815bee0 2024-04-23T10:16:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3fa01640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8f3815cc20 con 0x7f8f38155410 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3fa01640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8f3815ba50 con 0x7f8f3815e7e0 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3d79d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8f38155410 0x7f8f3815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3cf9c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8f3815bee0 0x7f8f380756e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56994/0 (socket says 172.21.15.29:56994) 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3cf9c640 1 -- 172.21.15.29:0/1397535648 learned_addr learned my addr 172.21.15.29:0/1397535648 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3df9e640 1 --2- 172.21.15.29:0/1397535648 >> v2:172.21.15.72:3300/0 conn(0x7f8f3815e7e0 0x7f8f380cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3d79d640 1 -- 172.21.15.29:0/1397535648 >> v2:172.21.15.72:3300/0 conn(0x7f8f3815e7e0 msgr2=0x7f8f380cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3d79d640 1 --2- 172.21.15.29:0/1397535648 >> v2:172.21.15.72:3300/0 conn(0x7f8f3815e7e0 0x7f8f380cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3d79d640 1 -- 172.21.15.29:0/1397535648 >> v1:172.21.15.29:6789/0 conn(0x7f8f3815bee0 legacy=0x7f8f380756e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.706+0000 7f8f3d79d640 1 -- 172.21.15.29:0/1397535648 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3815f4c0 con 0x7f8f38155410 2024-04-23T10:16:37.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3d79d640 1 --2- 172.21.15.29:0/1397535648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f38155410 0x7f8f3815c6e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8f380c8a30 tx=0x7f8f3401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ae433926c5f057 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f2ffff640 1 -- 172.21.15.29:0/1397535648 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340b0070 con 0x7f8f38155410 2024-04-23T10:16:37.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f2ffff640 1 -- 172.21.15.29:0/1397535648 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f340ab600 con 0x7f8f38155410 2024-04-23T10:16:37.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f2ffff640 1 -- 172.21.15.29:0/1397535648 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340ab9d0 con 0x7f8f38155410 2024-04-23T10:16:37.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- 172.21.15.29:0/1397535648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f38155410 msgr2=0x7f8f3815c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/1397535648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f38155410 0x7f8f3815c6e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8f380c8a30 tx=0x7f8f3401c3f0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- 172.21.15.29:0/1397535648 shutdown_connections 2024-04-23T10:16:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/1397535648 >> v2:172.21.15.72:3300/0 conn(0x7f8f3815e7e0 0x7f8f380cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/1397535648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f38155410 0x7f8f3815c6e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- 172.21.15.29:0/1397535648 >> 172.21.15.29:0/1397535648 conn(0x7f8f38068180 msgr2=0x7f8f3806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- 172.21.15.29:0/1397535648 shutdown_connections 2024-04-23T10:16:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- 172.21.15.29:0/1397535648 wait complete. 2024-04-23T10:16:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 Processor -- start 2024-04-23T10:16:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- start start 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f38155410 0x7f8f380c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f3815bee0 0x7f8f380701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f3815e7e0 0x7f8f381f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38168510 con 0x7f8f3815bee0 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38168390 con 0x7f8f3815e7e0 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3fa01640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8f38168690 con 0x7f8f38155410 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3cf9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f3815bee0 0x7f8f380701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3cf9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f3815bee0 0x7f8f380701c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56590/0 (socket says 172.21.15.29:56590) 2024-04-23T10:16:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.710+0000 7f8f3cf9c640 1 -- 172.21.15.29:0/112641137 learned_addr learned my addr 172.21.15.29:0/112641137 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3df9e640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f3815e7e0 0x7f8f381f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3d79d640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f38155410 0x7f8f380c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3cf9c640 1 -- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f38155410 msgr2=0x7f8f380c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3cf9c640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f38155410 0x7f8f380c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3cf9c640 1 -- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f3815e7e0 msgr2=0x7f8f381f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3cf9c640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f3815e7e0 0x7f8f381f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3cf9c640 1 -- 172.21.15.29:0/112641137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f38144510 con 0x7f8f3815bee0 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3d79d640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f38155410 0x7f8f380c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3cf9c640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f3815bee0 0x7f8f380701c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c420 tx=0x7f8f2800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f2dffb640 1 -- 172.21.15.29:0/112641137 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28017070 con 0x7f8f3815bee0 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f2dffb640 1 -- 172.21.15.29:0/112641137 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f28005cf0 con 0x7f8f3815bee0 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f2dffb640 1 -- 172.21.15.29:0/112641137 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f280072f0 con 0x7f8f3815bee0 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f38154ea0 con 0x7f8f3815bee0 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f381f7840 con 0x7f8f3815bee0 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f380693c0 con 0x7f8f3815bee0 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f2dffb640 1 -- 172.21.15.29:0/112641137 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8f2801a070 con 0x7f8f3815bee0 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f2dffb640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8f1c0683b0 0x7f8f1c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f2dffb640 1 -- 172.21.15.29:0/112641137 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8f28086200 con 0x7f8f3815bee0 2024-04-23T10:16:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3d79d640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8f1c0683b0 0x7f8f1c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:37.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.714+0000 7f8f3d79d640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8f1c0683b0 0x7f8f1c06a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8f340ad000 tx=0x7f8f34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:37.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.718+0000 7f8f2dffb640 1 -- 172.21.15.29:0/112641137 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f28056310 con 0x7f8f3815bee0 2024-04-23T10:16:37.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.918+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f380c82a0 con 0x7f8f3815bee0 2024-04-23T10:16:37.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f2dffb640 1 -- 172.21.15.29:0/112641137 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f8f28055c10 con 0x7f8f3815bee0 2024-04-23T10:16:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:37.923 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:16:37.924 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:16:37.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8f1c0683b0 msgr2=0x7f8f1c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8f1c0683b0 0x7f8f1c06a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8f340ad000 tx=0x7f8f34008040 comp rx=0 tx=0).stop 2024-04-23T10:16:37.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f3815bee0 msgr2=0x7f8f380701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f3815bee0 0x7f8f380701c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c420 tx=0x7f8f2800c8e0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 shutdown_connections 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8f1c0683b0 0x7f8f1c06a870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f3815e7e0 0x7f8f381f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f3815bee0 0x7f8f380701c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 --2- 172.21.15.29:0/112641137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f38155410 0x7f8f380c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 >> 172.21.15.29:0/112641137 conn(0x7f8f38068180 msgr2=0x7f8f3815a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 shutdown_connections 2024-04-23T10:16:37.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:37.922+0000 7f8f3fa01640 1 -- 172.21.15.29:0/112641137 wait complete. 2024-04-23T10:16:38.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T10:15:37.368844+0000', 'modified': '2024-04-23T10:16:21.349356+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4288, 'mds_1': 4250, 'mds_2': 4230, 'mds_3': 4212, 'mds_4': 4209}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4209': {'gid': 4209, 'name': 'a', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.29:6836/3348855066', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 3348855066}, {'type': 'v1', 'addr': '172.21.15.29:6836', 'nonce': 3348855066}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4212': {'gid': 4212, 'name': 'e', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.29:6837/927431142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6835', 'nonce': 927431142}, {'type': 'v1', 'addr': '172.21.15.29:6837', 'nonce': 927431142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4230': {'gid': 4230, 'name': 'd', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.72:6835/1664530327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6834', 'nonce': 1664530327}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 1664530327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4250': {'gid': 4250, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.72:6839/41085720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6837', 'nonce': 41085720}, {'type': 'v1', 'addr': '172.21.15.72:6839', 'nonce': 41085720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4288': {'gid': 4288, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.72:6838/4284551087', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 4284551087}, {'type': 'v1', 'addr': '172.21.15.72:6838', 'nonce': 4284551087}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4288, 'qdb_cluster': [4209, 4212, 4230, 4250, 4288]} 2024-04-23T10:16:38.545 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T10:16:38.545 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-23T10:16:38.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8ab156b640 1 Processor -- start 2024-04-23T10:16:38.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8ab156b640 1 -- start start 2024-04-23T10:16:38.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8ab156b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8aac0cb790 0x7f8aac0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8ab156b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8aac073e50 0x7f8aac152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8ab156b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac0c5c30 con 0x7f8aac0cbb70 2024-04-23T10:16:38.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8ab156b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0c6800 con 0x7f8aac073e50 2024-04-23T10:16:38.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8ab156b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0c5ed0 con 0x7f8aac0cb790 2024-04-23T10:16:38.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8aaa7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8aac0cbb70 0x7f8aac073740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56998/0 (socket says 172.21.15.29:56998) 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8aaa7fc640 1 -- 172.21.15.29:0/2818218608 learned_addr learned my addr 172.21.15.29:0/2818218608 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2818218608 >> v2:172.21.15.29:3300/0 conn(0x7f8aac073e50 0x7f8aac152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.682+0000 7f8aaaffd640 1 --2- 172.21.15.29:0/2818218608 >> v2:172.21.15.72:3300/0 conn(0x7f8aac0cb790 0x7f8aac0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aa9ffb640 1 -- 172.21.15.29:0/2818218608 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125863523 0 0) 0x7f8aac0c5c30 con 0x7f8aac0cbb70 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aa9ffb640 1 -- 172.21.15.29:0/2818218608 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a94003530 con 0x7f8aac0cbb70 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aab7fe640 1 -- 172.21.15.29:0/2818218608 >> v2:172.21.15.72:3300/0 conn(0x7f8aac0cb790 msgr2=0x7f8aac0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2818218608 >> v2:172.21.15.72:3300/0 conn(0x7f8aac0cb790 0x7f8aac0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aab7fe640 1 -- 172.21.15.29:0/2818218608 >> v1:172.21.15.29:6789/0 conn(0x7f8aac0cbb70 legacy=0x7f8aac073740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aab7fe640 1 -- 172.21.15.29:0/2818218608 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0c61b0 con 0x7f8aac073e50 2024-04-23T10:16:38.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aaaffd640 1 --2- 172.21.15.29:0/2818218608 >> v2:172.21.15.72:3300/0 conn(0x7f8aac0cb790 0x7f8aac0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:16:38.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2818218608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac152ca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0cf7c0 tx=0x7f8aa401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9775a52e7b8af1d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aa9ffb640 1 -- 172.21.15.29:0/2818218608 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40b4070 con 0x7f8aac073e50 2024-04-23T10:16:38.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aa9ffb640 1 -- 172.21.15.29:0/2818218608 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40af600 con 0x7f8aac073e50 2024-04-23T10:16:38.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8aa9ffb640 1 -- 172.21.15.29:0/2818218608 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40af9d0 con 0x7f8aac073e50 2024-04-23T10:16:38.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8ab156b640 1 -- 172.21.15.29:0/2818218608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 msgr2=0x7f8aac152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8ab156b640 1 --2- 172.21.15.29:0/2818218608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac152ca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0cf7c0 tx=0x7f8aa401f110 comp rx=0 tx=0).stop 2024-04-23T10:16:38.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8ab156b640 1 -- 172.21.15.29:0/2818218608 shutdown_connections 2024-04-23T10:16:38.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8ab156b640 1 --2- 172.21.15.29:0/2818218608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac152ca0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8ab156b640 1 --2- 172.21.15.29:0/2818218608 >> v2:172.21.15.72:3300/0 conn(0x7f8aac0cb790 0x7f8aac0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8ab156b640 1 -- 172.21.15.29:0/2818218608 >> 172.21.15.29:0/2818218608 conn(0x7f8aac074f30 msgr2=0x7f8aac075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8ab156b640 1 -- 172.21.15.29:0/2818218608 shutdown_connections 2024-04-23T10:16:38.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.686+0000 7f8ab156b640 1 -- 172.21.15.29:0/2818218608 wait complete. 2024-04-23T10:16:38.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 Processor -- start 2024-04-23T10:16:38.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 -- start start 2024-04-23T10:16:38.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0cb790 0x7f8aac14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac0cbb70 0x7f8aac145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac071a70 con 0x7f8aac073e50 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0717f0 con 0x7f8aac0cbb70 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac071bf0 con 0x7f8aac0cb790 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56612/0 (socket says 172.21.15.29:56612) 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 -- 172.21.15.29:0/481450576 learned_addr learned my addr 172.21.15.29:0/481450576 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 -- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0cb790 msgr2=0x7f8aac14fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0cb790 0x7f8aac14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac0cbb70 0x7f8aac145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0cb790 0x7f8aac14fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 -- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac0cbb70 msgr2=0x7f8aac145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac0cbb70 0x7f8aac145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 -- 172.21.15.29:0/481450576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0c9c90 con 0x7f8aac073e50 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8aaaffd640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac156db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00e810 tx=0x7f8a9c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8a937fe640 1 -- 172.21.15.29:0/481450576 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c017070 con 0x7f8aac073e50 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8a937fe640 1 -- 172.21.15.29:0/481450576 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00c8d0 con 0x7f8aac073e50 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 -- 172.21.15.29:0/481450576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac1ee7f0 con 0x7f8aac073e50 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8a937fe640 1 -- 172.21.15.29:0/481450576 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00f040 con 0x7f8aac073e50 2024-04-23T10:16:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.690+0000 7f8ab156b640 1 -- 172.21.15.29:0/481450576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac1eedb0 con 0x7f8aac073e50 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 Processor -- start 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- start start 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8a937fe640 1 -- 172.21.15.29:0/481450576 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a9c01a070 con 0x7f8aac073e50 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc11570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc4c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 0x555befc4c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555befa5a420 con 0x555befc11190 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555bef9f4bf0 con 0x555befc4c5c0 2024-04-23T10:16:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x555befa563e0 con 0x555befc11ab0 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc11570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc11570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56626/0 (socket says 172.21.15.29:56626) 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 -- 172.21.15.29:0/2702392291 learned_addr learned my addr 172.21.15.29:0/2702392291 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aaaffd640 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc4c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 0x555befc4c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 -- 172.21.15.29:0/2702392291 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 msgr2=0x555befc4c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc4c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 -- 172.21.15.29:0/2702392291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 msgr2=0x555befc4c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 0x555befc4c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8a937fe640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8a980683b0 0x7f8a9806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 -- 172.21.15.29:0/2702392291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555befb02450 con 0x555befc11190 2024-04-23T10:16:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8a937fe640 1 -- 172.21.15.29:0/481450576 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8a9c0869e0 con 0x7f8aac073e50 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc11570 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8aa401bd20 tx=0x7f8aa4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ab3c234f45e297 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aaaffd640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8a980683b0 0x7f8a9806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8a90ff9640 1 -- 172.21.15.29:0/2702392291 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40b4040 con 0x555befc11190 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8a90ff9640 1 -- 172.21.15.29:0/2702392291 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40ba640 con 0x555befc11190 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8a90ff9640 1 -- 172.21.15.29:0/2702392291 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40baa30 con 0x555befc11190 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2702392291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 msgr2=0x555befc11570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc11570 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8aa401bd20 tx=0x7f8aa4004ac0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2702392291 shutdown_connections 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 0x555befc4c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc4c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2702392291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc11570 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2702392291 >> 172.21.15.29:0/2702392291 conn(0x555befc48e40 msgr2=0x555befc4b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2702392291 shutdown_connections 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2702392291 wait complete. 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8aaaffd640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8a980683b0 0x7f8a9806a870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c052840 tx=0x7f8a9c08c340 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.694+0000 7f8ab46ed000 1 -- start start 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 Processor -- start 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc0e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 0x555befc0e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555bef9faec0 con 0x555befc11190 2024-04-23T10:16:38.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555befadb120 con 0x555befc4c5c0 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x555befa65350 con 0x555befc11ab0 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 10 client.0 _ll_register_callbacks cb 0x555befa374d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56642/0 (socket says 172.21.15.29:56642) 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 -- 172.21.15.29:0/3063966214 learned_addr learned my addr 172.21.15.29:0/3063966214 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc0e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 -- 172.21.15.29:0/3063966214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 msgr2=0x555befc0e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc0e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 -- 172.21.15.29:0/3063966214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 msgr2=0x555befc0e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 0x555befc0e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 -- 172.21.15.29:0/3063966214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555befa9ff80 con 0x555befc11190 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc0e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0dba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8aa401bd20 tx=0x7f8aa401beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2426ec825e93f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 1 -- 172.21.15.29:0/3063966214 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40b4050 con 0x555befc11190 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3063966214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8aa40ba640 con 0x555befc11190 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 1 -- 172.21.15.29:0/3063966214 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8aa40ba7f0 con 0x555befc11190 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 1 -- 172.21.15.29:0/3063966214 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8aa40d2050 con 0x555befc11190 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 10 client.5058 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3063966214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555befa33f00 con 0x555befc11190 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 1 -- 172.21.15.29:0/3063966214 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40ba640 con 0x555befc11190 2024-04-23T10:16:38.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 1 -- 172.21.15.29:0/3063966214 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f8aa40d5020 con 0x555befc11190 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 10 client.5058 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 10 client.5058 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 20 client.5058 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x555befc60d90 0x555befc63180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 4 client.5058 mds_command: new command op to 4209 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3063966214 --> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bef9f3bc0 con 0x555befc60d90 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x555befc60d90 0x555befc63180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 10 client.5058 ms_handle_connect on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x555befc60d90 0x555befc63180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d586e91c424c6341 server_cookie=eae0ddfb769ba043 in_seq=0 out_seq=0 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 1 -- 172.21.15.29:0/3063966214 <== mds.4 v2:172.21.15.29:6834/3348855066 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555bef9f3bc0 con 0x555befc60d90 2024-04-23T10:16:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 10 client.5058 handle_command_reply: tid=0 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 client.5058 shutdown 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3063966214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 msgr2=0x555befc0dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0dba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8aa401bd20 tx=0x7f8aa401beb0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3063966214 shutdown_connections 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc4c5c0 0x555befc0e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x555befc60d90 0x555befc63180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc11ab0 0x555befc0e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3063966214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0dba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8a89ffb640 0 client.5058 ms_handle_reset on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3063966214 >> 172.21.15.29:0/3063966214 conn(0x555befc48e40 msgr2=0x555befc4a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3063966214 shutdown_connections 2024-04-23T10:16:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3063966214 wait complete. 2024-04-23T10:16:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.698+0000 7f8ab46ed000 20 client.5058 trim_cache size 0 max 16384 2024-04-23T10:16:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 Processor -- start 2024-04-23T10:16:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- start start 2024-04-23T10:16:38.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11ab0 0x555befc0add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc4c5c0 0x555befcbd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1fc510 con 0x555befc11190 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1fcbe0 con 0x555befc11ab0 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac1facb0 con 0x555befc4c5c0 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56646/0 (socket says 172.21.15.29:56646) 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 -- 172.21.15.29:0/3796993565 learned_addr learned my addr 172.21.15.29:0/3796993565 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 -- 172.21.15.29:0/3796993565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc4c5c0 msgr2=0x555befcbd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/3796993565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc4c5c0 0x555befcbd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 -- 172.21.15.29:0/3796993565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11ab0 msgr2=0x555befc0add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/3796993565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11ab0 0x555befc0add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 -- 172.21.15.29:0/3796993565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bef9e0e80 con 0x555befc11190 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/3796993565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0a890 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009790 tx=0x7f8aa40c4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897bf7e92db43ceb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8a8bfff640 1 -- 172.21.15.29:0/3796993565 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40b4040 con 0x555befc11190 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8a8bfff640 1 -- 172.21.15.29:0/3796993565 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40ca070 con 0x555befc11190 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8a8bfff640 1 -- 172.21.15.29:0/3796993565 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40ba680 con 0x555befc11190 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3796993565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 msgr2=0x555befc0a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3796993565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0a890 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009790 tx=0x7f8aa40c4000 comp rx=0 tx=0).stop 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3796993565 shutdown_connections 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3796993565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc4c5c0 0x555befcbd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3796993565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11ab0 0x555befc0add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/3796993565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11190 0x555befc0a890 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3796993565 >> 172.21.15.29:0/3796993565 conn(0x555befc48e40 msgr2=0x555befc46e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3796993565 shutdown_connections 2024-04-23T10:16:38.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.718+0000 7f8ab46ed000 1 -- 172.21.15.29:0/3796993565 wait complete. 2024-04-23T10:16:38.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- start start 2024-04-23T10:16:38.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 Processor -- start 2024-04-23T10:16:38.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11190 0x555befcbb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11ab0 0x555befcbb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc4c5c0 0x555befcbbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555befa59730 con 0x555befc11ab0 2024-04-23T10:16:38.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555befa269e0 con 0x555befc11190 2024-04-23T10:16:38.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x555befa5ea50 con 0x555befc4c5c0 2024-04-23T10:16:38.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 10 client.0 _ll_register_callbacks cb 0x7f8a94003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:38.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11ab0 0x555befcbb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11ab0 0x555befcbb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56658/0 (socket says 172.21.15.29:56658) 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 -- 172.21.15.29:0/2071479228 learned_addr learned my addr 172.21.15.29:0/2071479228 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11190 0x555befcbb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 -- 172.21.15.29:0/2071479228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc4c5c0 msgr2=0x555befcbbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc4c5c0 0x555befcbbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 -- 172.21.15.29:0/2071479228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11190 msgr2=0x555befcbb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11190 0x555befcbb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 -- 172.21.15.29:0/2071479228 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555befa22b30 con 0x555befc11ab0 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aaa7fc640 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11ab0 0x555befcbb610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0006df0 tx=0x7f8aa00074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43769b73b1d655af server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:38.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 1 -- 172.21.15.29:0/2071479228 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0019370 con 0x555befc11ab0 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 1 -- 172.21.15.29:0/2071479228 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8aa0019510 con 0x555befc11ab0 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2071479228 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8aa40ca070 con 0x555befc11ab0 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 1 -- 172.21.15.29:0/2071479228 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8aa002a050 con 0x555befc11ab0 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 10 client.5064 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2071479228 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555befadb5b0 con 0x555befc11ab0 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 1 -- 172.21.15.29:0/2071479228 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40ca070 con 0x555befc11ab0 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 1 -- 172.21.15.29:0/2071479228 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f8aa002d020 con 0x555befc11ab0 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 10 client.5064 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 10 client.5064 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 20 client.5064 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:38.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x555befcc8220 0x555befcbcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 4 client.5064 mds_command: new command op to 4209 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2071479228 --> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] -- command(tid 0: {"prefix": "status"}) -- 0x555befa67e40 con 0x555befcc8220 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x555befcc8220 0x555befcbcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8aab7fe640 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x555befcc8220 0x555befcbcbb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a699d049de0e89d3 server_cookie=71f58c0197a0fa12 in_seq=0 out_seq=0 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 10 client.5064 ms_handle_connect on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 1 -- 172.21.15.29:0/2071479228 <== mds.4 v2:172.21.15.29:6834/3348855066 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x555befa67e40 con 0x555befcc8220 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 10 client.5064 handle_command_reply: tid=0 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 client.5064 shutdown 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2071479228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11ab0 msgr2=0x555befcbb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11ab0 0x555befcbb610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0006df0 tx=0x7f8aa00074a0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2071479228 shutdown_connections 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.29:6834/3348855066,v1:172.21.15.29:6836/3348855066] conn(0x555befcc8220 0x555befcbcbb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555befc4c5c0 0x555befcbbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555befc11ab0 0x555befcbb610 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8a89ffb640 0 client.5064 ms_handle_reset on v2:172.21.15.29:6834/3348855066 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 --2- 172.21.15.29:0/2071479228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555befc11190 0x555befcbb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2071479228 >> 172.21.15.29:0/2071479228 conn(0x555befc48e40 msgr2=0x555befc09880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2071479228 shutdown_connections 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 1 -- 172.21.15.29:0/2071479228 wait complete. 2024-04-23T10:16:38.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.722+0000 7f8ab46ed000 20 client.5064 trim_cache size 0 max 16384 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 4, 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4209, 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 23.437401096999999, 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:38.734 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:38.735 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 67.709223097999995 2024-04-23T10:16:38.735 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:38.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 -- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8a980683b0 msgr2=0x7f8a9806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8a980683b0 0x7f8a9806a870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c052840 tx=0x7f8a9c08c340 comp rx=0 tx=0).stop 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 -- 172.21.15.29:0/481450576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 msgr2=0x7f8aac156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac156db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00e810 tx=0x7f8a9c00ecd0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 -- 172.21.15.29:0/481450576 shutdown_connections 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8a980683b0 0x7f8a9806a870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aac0cbb70 0x7f8aac145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8aac0cb790 0x7f8aac14fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 --2- 172.21.15.29:0/481450576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8aac073e50 0x7f8aac156db0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 -- 172.21.15.29:0/481450576 >> 172.21.15.29:0/481450576 conn(0x7f8aac074f30 msgr2=0x7f8aac150f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 -- 172.21.15.29:0/481450576 shutdown_connections 2024-04-23T10:16:38.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.726+0000 7f8ab156b640 1 -- 172.21.15.29:0/481450576 wait complete. 2024-04-23T10:16:38.742 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T10:16:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e638a640 1 Processor -- start 2024-04-23T10:16:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e638a640 1 -- start start 2024-04-23T10:16:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e638a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0e006f150 0x7fc0e006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e638a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc0e00ccc50 0x7fc0e00cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e638a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e00cd5a0 con 0x7fc0e0153190 2024-04-23T10:16:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e638a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e0159f20 con 0x7fc0e00ccc50 2024-04-23T10:16:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e638a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e0159380 con 0x7fc0e006f150 2024-04-23T10:16:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e4927640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc0e00ccc50 0x7fc0e00cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e4927640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc0e00ccc50 0x7fc0e00cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56670/0 (socket says 172.21.15.29:56670) 2024-04-23T10:16:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e4927640 1 -- 172.21.15.29:0/3630968343 learned_addr learned my addr 172.21.15.29:0/3630968343 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3630968343 >> v2:172.21.15.72:3300/0 conn(0x7fc0e006f150 0x7fc0e006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e4927640 1 -- 172.21.15.29:0/3630968343 >> v2:172.21.15.72:3300/0 conn(0x7fc0e006f150 msgr2=0x7fc0e006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e4927640 1 --2- 172.21.15.29:0/3630968343 >> v2:172.21.15.72:3300/0 conn(0x7fc0e006f150 0x7fc0e006f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e4927640 1 -- 172.21.15.29:0/3630968343 >> v1:172.21.15.72:6789/0 conn(0x7fc0e0153190 legacy=0x7fc0e0159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.858+0000 7fc0e4927640 1 -- 172.21.15.29:0/3630968343 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e00c3fe0 con 0x7fc0e00ccc50 2024-04-23T10:16:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e4927640 1 --2- 172.21.15.29:0/3630968343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e00cd060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0159500 tx=0x7fc0d801f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1304f4950897473b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0deffd640 1 -- 172.21.15.29:0/3630968343 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80b4070 con 0x7fc0e00ccc50 2024-04-23T10:16:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0deffd640 1 -- 172.21.15.29:0/3630968343 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d80af400 con 0x7fc0e00ccc50 2024-04-23T10:16:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0deffd640 1 -- 172.21.15.29:0/3630968343 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80af7d0 con 0x7fc0e00ccc50 2024-04-23T10:16:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- 172.21.15.29:0/3630968343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 msgr2=0x7fc0e00cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3630968343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e00cd060 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0159500 tx=0x7fc0d801f1a0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- 172.21.15.29:0/3630968343 shutdown_connections 2024-04-23T10:16:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3630968343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e00cd060 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3630968343 >> v2:172.21.15.72:3300/0 conn(0x7fc0e006f150 0x7fc0e006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- 172.21.15.29:0/3630968343 >> 172.21.15.29:0/3630968343 conn(0x7fc0e006cfb0 msgr2=0x7fc0e006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- 172.21.15.29:0/3630968343 shutdown_connections 2024-04-23T10:16:38.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- 172.21.15.29:0/3630968343 wait complete. 2024-04-23T10:16:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 Processor -- start 2024-04-23T10:16:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- start start 2024-04-23T10:16:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e006f150 0x7fc0e01f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0e0153190 0x7fc0e015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e0159010 con 0x7fc0e00ccc50 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e00c45a0 con 0x7fc0e006f150 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e0153570 con 0x7fc0e0153190 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e015cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56684/0 (socket says 172.21.15.29:56684) 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 -- 172.21.15.29:0/3225050199 learned_addr learned my addr 172.21.15.29:0/3225050199 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e4927640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0e0153190 0x7fc0e015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 -- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0e0153190 msgr2=0x7fc0e015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e006f150 0x7fc0e01f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0e0153190 0x7fc0e015a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 -- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e006f150 msgr2=0x7fc0e01f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e006f150 0x7fc0e01f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 -- 172.21.15.29:0/3225050199 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e0154ac0 con 0x7fc0e00ccc50 2024-04-23T10:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e006f150 0x7fc0e01f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:38.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e015cd90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400d5f0 tx=0x7fc0d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0dcff9640 1 -- 172.21.15.29:0/3225050199 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40125f0 con 0x7fc0e00ccc50 2024-04-23T10:16:38.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0dcff9640 1 -- 172.21.15.29:0/3225050199 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4019070 con 0x7fc0e00ccc50 2024-04-23T10:16:38.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0dcff9640 1 -- 172.21.15.29:0/3225050199 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40129d0 con 0x7fc0e00ccc50 2024-04-23T10:16:38.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.862+0000 7fc0e638a640 1 -- 172.21.15.29:0/3225050199 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e015b3f0 con 0x7fc0e00ccc50 2024-04-23T10:16:38.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e638a640 1 -- 172.21.15.29:0/3225050199 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e015ba00 con 0x7fc0e00ccc50 2024-04-23T10:16:38.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dcff9640 1 -- 172.21.15.29:0/3225050199 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0d4012b70 con 0x7fc0e00ccc50 2024-04-23T10:16:38.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dcff9640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc0cc068380 0x7fc0cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dcff9640 1 -- 172.21.15.29:0/3225050199 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc0d4087300 con 0x7fc0e00ccc50 2024-04-23T10:16:38.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc0cc068380 0x7fc0cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e950c000 1 Processor -- start 2024-04-23T10:16:38.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e950c000 1 -- start start 2024-04-23T10:16:38.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc0cc068380 0x7fc0cc06a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0003e40 tx=0x7fc0d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a013b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a05460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 0x560850a05d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e950c000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560850813420 con 0x560850a00fd0 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e950c000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5608507adbf0 con 0x560850a05080 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e950c000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x56085080f3e0 con 0x560850a059a0 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56690/0 (socket says 172.21.15.29:56690) 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dffff640 1 -- 172.21.15.29:0/3944776763 learned_addr learned my addr 172.21.15.29:0/3944776763 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0e4927640 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 0x560850a05d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a05460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.866+0000 7fc0dffff640 1 -- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 msgr2=0x560850a05d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 0x560850a05d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0dffff640 1 -- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 msgr2=0x560850a05460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a05460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0dffff640 1 -- 172.21.15.29:0/3944776763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608508bb450 con 0x560850a00fd0 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a05460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 0x560850a05d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a013b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0003c20 tx=0x7fc0d0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbca7105605e5080 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0c5ffb640 1 -- 172.21.15.29:0/3944776763 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0024070 con 0x560850a00fd0 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0c5ffb640 1 -- 172.21.15.29:0/3944776763 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d0014db0 con 0x560850a00fd0 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0c5ffb640 1 -- 172.21.15.29:0/3944776763 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d001f620 con 0x560850a00fd0 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- 172.21.15.29:0/3944776763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 msgr2=0x560850a013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a013b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0003c20 tx=0x7fc0d0010000 comp rx=0 tx=0).stop 2024-04-23T10:16:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- 172.21.15.29:0/3944776763 shutdown_connections 2024-04-23T10:16:38.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 0x560850a05d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a05460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3944776763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a013b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- 172.21.15.29:0/3944776763 >> 172.21.15.29:0/3944776763 conn(0x560850a01e40 msgr2=0x560850a04260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- 172.21.15.29:0/3944776763 shutdown_connections 2024-04-23T10:16:38.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- 172.21.15.29:0/3944776763 wait complete. 2024-04-23T10:16:38.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- start start 2024-04-23T10:16:38.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 Processor -- start 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a00fd0 0x560850a082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a05080 0x560850a08810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a059a0 0x560850a08d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5608507b3ec0 con 0x560850a059a0 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560850894120 con 0x560850a00fd0 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x56085081e350 con 0x560850a05080 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 10 client.0 _ll_register_callbacks cb 0x5608507f04d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a059a0 0x560850a08d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a059a0 0x560850a08d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56706/0 (socket says 172.21.15.29:56706) 2024-04-23T10:16:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 -- 172.21.15.29:0/2943748649 learned_addr learned my addr 172.21.15.29:0/2943748649 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a05080 0x560850a08810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0dffff640 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a00fd0 0x560850a082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 -- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a05080 msgr2=0x560850a08810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a05080 0x560850a08810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 -- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a00fd0 msgr2=0x560850a082d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a00fd0 0x560850a082d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 -- 172.21.15.29:0/2943748649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560850858f80 con 0x560850a059a0 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0dffff640 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a00fd0 0x560850a082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e4927640 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a059a0 0x560850a08d50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80b2040 tx=0x7fc0d801d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd17e08f20dbbe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0beffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0beffd640 1 -- 172.21.15.29:0/2943748649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80bf070 con 0x560850a059a0 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0beffd640 1 -- 172.21.15.29:0/2943748649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc0d80af680 con 0x560850a059a0 2024-04-23T10:16:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- 172.21.15.29:0/2943748649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0d0014db0 con 0x560850a059a0 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0beffd640 1 -- 172.21.15.29:0/2943748649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc0d80ca050 con 0x560850a059a0 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 10 client.5076 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- 172.21.15.29:0/2943748649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5608507ecf00 con 0x560850a059a0 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0beffd640 1 -- 172.21.15.29:0/2943748649 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d0014db0 con 0x560850a059a0 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0beffd640 1 -- 172.21.15.29:0/2943748649 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc0d80cd020 con 0x560850a059a0 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 10 client.5076 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 10 client.5076 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 20 client.5076 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x560850a09760 0x560850a205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 4 client.5076 mds_command: new command op to 4212 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.870+0000 7fc0e950c000 1 -- 172.21.15.29:0/2943748649 --> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608507acbc0 con 0x560850a09760 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0dffff640 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x560850a09760 0x560850a205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0dffff640 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x560850a09760 0x560850a205e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e8dc9d18342c71ee server_cookie=ffa8f45edbe718d7 in_seq=0 out_seq=0 2024-04-23T10:16:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0beffd640 10 client.5076 ms_handle_connect on v2:172.21.15.29:6835/927431142 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0beffd640 1 -- 172.21.15.29:0/2943748649 <== mds.3 v2:172.21.15.29:6835/927431142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5608507acbc0 con 0x560850a09760 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0beffd640 10 client.5076 handle_command_reply: tid=0 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 client.5076 shutdown 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 -- 172.21.15.29:0/2943748649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a059a0 msgr2=0x560850a08d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a059a0 0x560850a08d50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80b2040 tx=0x7fc0d801d9e0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 -- 172.21.15.29:0/2943748649 shutdown_connections 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x560850a09760 0x560850a205e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a059a0 0x560850a08d50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a05080 0x560850a08810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 --2- 172.21.15.29:0/2943748649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a00fd0 0x560850a082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 -- 172.21.15.29:0/2943748649 >> 172.21.15.29:0/2943748649 conn(0x560850a01e40 msgr2=0x560850a04230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0beffd640 0 client.5076 ms_handle_reset on v2:172.21.15.29:6835/927431142 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 -- 172.21.15.29:0/2943748649 shutdown_connections 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 1 -- 172.21.15.29:0/2943748649 wait complete. 2024-04-23T10:16:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.874+0000 7fc0e950c000 20 client.5076 trim_cache size 0 max 16384 2024-04-23T10:16:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.890+0000 7fc0e950c000 1 Processor -- start 2024-04-23T10:16:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.890+0000 7fc0e950c000 1 -- start start 2024-04-23T10:16:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a00fd0 0x5608509ea770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a05080 0x5608509e9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a059a0 0x5608509e9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01fa2d0 con 0x560850a05080 2024-04-23T10:16:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01fa9a0 con 0x560850a059a0 2024-04-23T10:16:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e0072c80 con 0x560850a00fd0 2024-04-23T10:16:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a05080 0x5608509e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a05080 0x5608509e9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56718/0 (socket says 172.21.15.29:56718) 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 -- 172.21.15.29:0/1836542727 learned_addr learned my addr 172.21.15.29:0/1836542727 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a00fd0 0x5608509ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e4927640 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a059a0 0x5608509e9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 -- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a00fd0 msgr2=0x5608509ea770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a00fd0 0x5608509ea770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 -- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a059a0 msgr2=0x5608509e9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a059a0 0x5608509e9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 -- 172.21.15.29:0/1836542727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560850799e80 con 0x560850a05080 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e4927640 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a059a0 0x5608509e9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a05080 0x5608509e9550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4006cf0 tx=0x7fc0d4087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e29bb1d53091b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0c57fa640 1 -- 172.21.15.29:0/1836542727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4082020 con 0x560850a05080 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0c57fa640 1 -- 172.21.15.29:0/1836542727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d405f980 con 0x560850a05080 2024-04-23T10:16:38.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0c57fa640 1 -- 172.21.15.29:0/1836542727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4055010 con 0x560850a05080 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- 172.21.15.29:0/1836542727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a05080 msgr2=0x5608509e9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a05080 0x5608509e9550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4006cf0 tx=0x7fc0d4087040 comp rx=0 tx=0).stop 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- 172.21.15.29:0/1836542727 shutdown_connections 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a059a0 0x5608509e9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a05080 0x5608509e9550 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- 172.21.15.29:0/1836542727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a00fd0 0x5608509ea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- 172.21.15.29:0/1836542727 >> 172.21.15.29:0/1836542727 conn(0x560850a01e40 msgr2=0x560850a00390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- 172.21.15.29:0/1836542727 shutdown_connections 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- 172.21.15.29:0/1836542727 wait complete. 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- start start 2024-04-23T10:16:38.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 Processor -- start 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a08610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 0x560850a21630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560850812730 con 0x560850a00fd0 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5608507df9e0 con 0x560850a05080 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x560850817a50 con 0x560850a059a0 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 10 client.0 _ll_register_callbacks cb 0x7fc0d80b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56726/0 (socket says 172.21.15.29:56726) 2024-04-23T10:16:38.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 -- 172.21.15.29:0/3491164416 learned_addr learned my addr 172.21.15.29:0/3491164416 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a08610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 -- 172.21.15.29:0/3491164416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 msgr2=0x560850a21630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 0x560850a21630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 -- 172.21.15.29:0/3491164416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 msgr2=0x560850a08610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a08610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 -- 172.21.15.29:0/3491164416 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608507dbb30 con 0x560850a00fd0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0dffff640 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a080d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009010 tx=0x7fc0d0003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d398c2b657606a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0beffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0beffd640 1 -- 172.21.15.29:0/3491164416 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0035070 con 0x560850a00fd0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0beffd640 1 -- 172.21.15.29:0/3491164416 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc0d00304c0 con 0x560850a00fd0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.894+0000 7fc0e950c000 1 -- 172.21.15.29:0/3491164416 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0d405f980 con 0x560850a00fd0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0beffd640 1 -- 172.21.15.29:0/3491164416 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc0d003c050 con 0x560850a00fd0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 10 client.5082 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 -- 172.21.15.29:0/3491164416 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5608508945b0 con 0x560850a00fd0 2024-04-23T10:16:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0beffd640 1 -- 172.21.15.29:0/3491164416 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d405f980 con 0x560850a00fd0 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0beffd640 1 -- 172.21.15.29:0/3491164416 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc0d003f020 con 0x560850a00fd0 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 10 client.5082 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 10 client.5082 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 20 client.5082 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x560850a21f60 0x560850a7e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 4 client.5082 mds_command: new command op to 4212 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 -- 172.21.15.29:0/3491164416 --> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] -- command(tid 0: {"prefix": "status"}) -- 0x560850820e40 con 0x560850a21f60 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x560850a21f60 0x560850a7e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0beffd640 10 client.5082 ms_handle_connect on v2:172.21.15.29:6835/927431142 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0df7fe640 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x560850a21f60 0x560850a7e580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=47b6e89cd3e8a2e5 server_cookie=df6fc340473be7d3 in_seq=0 out_seq=0 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0beffd640 1 -- 172.21.15.29:0/3491164416 <== mds.3 v2:172.21.15.29:6835/927431142 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560850820e40 con 0x560850a21f60 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0beffd640 10 client.5082 handle_command_reply: tid=0 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 client.5082 shutdown 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 -- 172.21.15.29:0/3491164416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 msgr2=0x560850a080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a080d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009010 tx=0x7fc0d0003700 comp rx=0 tx=0).stop 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 -- 172.21.15.29:0/3491164416 shutdown_connections 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.29:6835/927431142,v1:172.21.15.29:6837/927431142] conn(0x560850a21f60 0x560850a7e580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560850a059a0 0x560850a21630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560850a05080 0x560850a08610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 --2- 172.21.15.29:0/3491164416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560850a00fd0 0x560850a080d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0beffd640 0 client.5082 ms_handle_reset on v2:172.21.15.29:6835/927431142 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 -- 172.21.15.29:0/3491164416 >> 172.21.15.29:0/3491164416 conn(0x560850a01e40 msgr2=0x5608509ea770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 -- 172.21.15.29:0/3491164416 shutdown_connections 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 1 -- 172.21.15.29:0/3491164416 wait complete. 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e950c000 20 client.5082 trim_cache size 0 max 16384 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:38.905 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 3, 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4212, 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 29.629370120000001, 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 67.882720156000005 2024-04-23T10:16:38.906 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 -- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc0cc068380 msgr2=0x7fc0cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc0cc068380 0x7fc0cc06a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0003e40 tx=0x7fc0d0009040 comp rx=0 tx=0).stop 2024-04-23T10:16:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 -- 172.21.15.29:0/3225050199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 msgr2=0x7fc0e015cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e015cd90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400d5f0 tx=0x7fc0d400dab0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 -- 172.21.15.29:0/3225050199 shutdown_connections 2024-04-23T10:16:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc0cc068380 0x7fc0cc06a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0e0153190 0x7fc0e015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0e00ccc50 0x7fc0e015cd90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 --2- 172.21.15.29:0/3225050199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e006f150 0x7fc0e01f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 -- 172.21.15.29:0/3225050199 >> 172.21.15.29:0/3225050199 conn(0x7fc0e006cfb0 msgr2=0x7fc0e00c9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 -- 172.21.15.29:0/3225050199 shutdown_connections 2024-04-23T10:16:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:38.898+0000 7fc0e638a640 1 -- 172.21.15.29:0/3225050199 wait complete. 2024-04-23T10:16:38.916 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-23T10:16:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e35499640 1 Processor -- start 2024-04-23T10:16:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e35499640 1 -- start start 2024-04-23T10:16:39.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e35499640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e3006f150 0x7f5e3006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e35499640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e300ccc50 0x7f5e300cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e35499640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e300cd5c0 con 0x7f5e30153190 2024-04-23T10:16:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e35499640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5e30159f20 con 0x7f5e3006f150 2024-04-23T10:16:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e35499640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5e30159380 con 0x7f5e300ccc50 2024-04-23T10:16:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5e30153190 0x7f5e30159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57014/0 (socket says 172.21.15.29:57014) 2024-04-23T10:16:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2effd640 1 -- 172.21.15.29:0/986247608 learned_addr learned my addr 172.21.15.29:0/986247608 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/986247608 >> v2:172.21.15.29:3300/0 conn(0x7f5e3006f150 0x7f5e3006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/986247608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e300ccc50 0x7f5e300cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2dffb640 1 -- 172.21.15.29:0/986247608 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607758540 0 0) 0x7f5e20001120 con 0x7f5e30153190 2024-04-23T10:16:39.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2dffb640 1 -- 172.21.15.29:0/986247608 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e1c003530 con 0x7f5e30153190 2024-04-23T10:16:39.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/986247608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e300ccc50 msgr2=0x7f5e300cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/986247608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e300ccc50 0x7f5e300cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/986247608 >> v1:172.21.15.29:6789/0 conn(0x7f5e30153190 legacy=0x7f5e30159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.030+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/986247608 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e300c3fe0 con 0x7f5e3006f150 2024-04-23T10:16:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/986247608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e3006f150 0x7f5e3006f580 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5e180097c0 tx=0x7f5e1801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94921d49b73d01a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e2dffb640 1 -- 172.21.15.29:0/986247608 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180b5070 con 0x7f5e3006f150 2024-04-23T10:16:39.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e2dffb640 1 -- 172.21.15.29:0/986247608 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e180a8990 con 0x7f5e3006f150 2024-04-23T10:16:39.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e2dffb640 1 -- 172.21.15.29:0/986247608 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180a8d60 con 0x7f5e3006f150 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 -- 172.21.15.29:0/986247608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e3006f150 msgr2=0x7f5e3006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 --2- 172.21.15.29:0/986247608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e3006f150 0x7f5e3006f580 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5e180097c0 tx=0x7f5e1801ec90 comp rx=0 tx=0).stop 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 -- 172.21.15.29:0/986247608 shutdown_connections 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 --2- 172.21.15.29:0/986247608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e300ccc50 0x7f5e300cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 --2- 172.21.15.29:0/986247608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e3006f150 0x7f5e3006f580 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 -- 172.21.15.29:0/986247608 >> 172.21.15.29:0/986247608 conn(0x7f5e3006cfb0 msgr2=0x7f5e3006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 -- 172.21.15.29:0/986247608 shutdown_connections 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 -- 172.21.15.29:0/986247608 wait complete. 2024-04-23T10:16:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 Processor -- start 2024-04-23T10:16:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.034+0000 7f5e35499640 1 -- start start 2024-04-23T10:16:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e35499640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3006f150 0x7f5e30158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e35499640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300ccc50 0x7f5e3014b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e35499640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e30153190 0x7f5e30148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e35499640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5e30159010 con 0x7f5e300ccc50 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e35499640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5e300c45a0 con 0x7f5e3006f150 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e35499640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5e30153570 con 0x7f5e30153190 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300ccc50 0x7f5e3014b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300ccc50 0x7f5e3014b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56744/0 (socket says 172.21.15.29:56744) 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/3560700532 learned_addr learned my addr 172.21.15.29:0/3560700532 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2effd640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3006f150 0x7f5e30158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e30153190 0x7f5e30148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e30153190 msgr2=0x7f5e30148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e30153190 0x7f5e30148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3006f150 msgr2=0x7f5e30158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3006f150 0x7f5e30158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/3560700532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e301478e0 con 0x7f5e300ccc50 2024-04-23T10:16:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300ccc50 0x7f5e3014b3e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5e180b3040 tx=0x7f5e1801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e277fe640 1 -- 172.21.15.29:0/3560700532 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180bf070 con 0x7f5e300ccc50 2024-04-23T10:16:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e277fe640 1 -- 172.21.15.29:0/3560700532 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e180b0660 con 0x7f5e300ccc50 2024-04-23T10:16:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e35499640 1 -- 172.21.15.29:0/3560700532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e30156ea0 con 0x7f5e300ccc50 2024-04-23T10:16:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e277fe640 1 -- 172.21.15.29:0/3560700532 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180b5040 con 0x7f5e300ccc50 2024-04-23T10:16:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e35499640 1 -- 172.21.15.29:0/3560700532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e30157140 con 0x7f5e300ccc50 2024-04-23T10:16:39.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e277fe640 1 -- 172.21.15.29:0/3560700532 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e180c2070 con 0x7f5e300ccc50 2024-04-23T10:16:39.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e277fe640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5e10068380 0x7f5e1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e277fe640 1 -- 172.21.15.29:0/3560700532 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5e181232f0 con 0x7f5e300ccc50 2024-04-23T10:16:39.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.038+0000 7f5e2effd640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5e10068380 0x7f5e1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 Processor -- start 2024-04-23T10:16:39.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- start start 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2effd640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5e10068380 0x7f5e1006a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e20005890 tx=0x7f5e20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffbdf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc1a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc1a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5574ffa28420 con 0x5574ffc1a5c0 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5574ff9c2bf0 con 0x5574ffbdf190 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5574ffa243e0 con 0x5574ffbdfab0 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc1a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc1a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56750/0 (socket says 172.21.15.29:56750) 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 -- 172.21.15.29:0/3253572352 learned_addr learned my addr 172.21.15.29:0/3253572352 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2effd640 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffbdf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc1a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 -- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 msgr2=0x5574ffc1a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc1a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 -- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 msgr2=0x5574ffbdf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffbdf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 -- 172.21.15.29:0/3253572352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574ffad0450 con 0x5574ffc1a5c0 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2effd640 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffbdf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc1a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc1a9a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007430 tx=0x7f5e28009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465504e1d6166b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e24ff9640 1 -- 172.21.15.29:0/3253572352 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28019020 con 0x5574ffc1a5c0 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e24ff9640 1 -- 172.21.15.29:0/3253572352 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e28015600 con 0x5574ffc1a5c0 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e24ff9640 1 -- 172.21.15.29:0/3253572352 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e280159f0 con 0x5574ffc1a5c0 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- 172.21.15.29:0/3253572352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 msgr2=0x5574ffc1a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc1a9a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007430 tx=0x7f5e28009750 comp rx=0 tx=0).stop 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- 172.21.15.29:0/3253572352 shutdown_connections 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc1a9a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc1a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- 172.21.15.29:0/3253572352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffbdf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- 172.21.15.29:0/3253572352 >> 172.21.15.29:0/3253572352 conn(0x5574ffc16e40 msgr2=0x5574ffc19260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- 172.21.15.29:0/3253572352 shutdown_connections 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- 172.21.15.29:0/3253572352 wait complete. 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- start start 2024-04-23T10:16:39.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 Processor -- start 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdf190 0x5574ffbdbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffbdc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffc1a5c0 0x5574ffbdc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5574ff9c8ec0 con 0x5574ffbdf190 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5574ffaa9120 con 0x5574ffc1a5c0 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5574ffa33350 con 0x5574ffbdfab0 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.042+0000 7f5e3861b000 10 client.0 _ll_register_callbacks cb 0x5574ffa054d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdf190 0x5574ffbdbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdf190 0x5574ffbdbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56752/0 (socket says 172.21.15.29:56752) 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 -- 172.21.15.29:0/2356545683 learned_addr learned my addr 172.21.15.29:0/2356545683 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffbdc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffc1a5c0 0x5574ffbdc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 -- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 msgr2=0x5574ffbdc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffbdc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 -- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffc1a5c0 msgr2=0x5574ffbdc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffc1a5c0 0x5574ffbdc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 -- 172.21.15.29:0/2356545683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574ffa6df80 con 0x5574ffbdf190 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffc1a5c0 0x5574ffbdc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2effd640 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdf190 0x5574ffbdbba0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5e20005ef0 tx=0x7f5e20000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be818f7b5df3280 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 1 -- 172.21.15.29:0/2356545683 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000eb80 con 0x5574ffbdf190 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 1 -- 172.21.15.29:0/2356545683 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5e2000ed20 con 0x5574ffbdf190 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 1 -- 172.21.15.29:0/2356545683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e28015600 con 0x5574ffbdf190 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 1 -- 172.21.15.29:0/2356545683 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f5e20022430 con 0x5574ffbdf190 2024-04-23T10:16:39.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 10 client.5097 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 1 -- 172.21.15.29:0/2356545683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5574ffa01f00 con 0x5574ffbdf190 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 1 -- 172.21.15.29:0/2356545683 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e28015600 con 0x5574ffbdf190 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 1 -- 172.21.15.29:0/2356545683 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f5e2002d750 con 0x5574ffbdf190 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 10 client.5097 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 10 client.5097 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 20 client.5097 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x5574ffc2ed90 0x5574ffc31180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 4 client.5097 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 1 -- 172.21.15.29:0/2356545683 --> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574ff9c1bc0 con 0x5574ffc2ed90 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x5574ffc2ed90 0x5574ffc31180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x5574ffc2ed90 0x5574ffc31180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=60f84f181841d0a6 server_cookie=69894c0fc3a0b35 in_seq=0 out_seq=0 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 10 client.5097 ms_handle_connect on v2:172.21.15.72:6834/1664530327 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 1 -- 172.21.15.29:0/2356545683 <== mds.2 v2:172.21.15.72:6834/1664530327 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5574ff9c1bc0 con 0x5574ffc2ed90 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e0dffb640 10 client.5097 handle_command_reply: tid=0 2024-04-23T10:16:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.046+0000 7f5e3861b000 1 client.5097 shutdown 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 -- 172.21.15.29:0/2356545683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdf190 msgr2=0x5574ffbdbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdf190 0x5574ffbdbba0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5e20005ef0 tx=0x7f5e20000bd0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 -- 172.21.15.29:0/2356545683 shutdown_connections 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x5574ffc2ed90 0x5574ffc31180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffc1a5c0 0x5574ffbdc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffbdc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e0dffb640 0 client.5097 ms_handle_reset on v2:172.21.15.72:6834/1664530327 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 --2- 172.21.15.29:0/2356545683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdf190 0x5574ffbdbba0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 -- 172.21.15.29:0/2356545683 >> 172.21.15.29:0/2356545683 conn(0x5574ffc16e40 msgr2=0x5574ffc181c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 -- 172.21.15.29:0/2356545683 shutdown_connections 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 1 -- 172.21.15.29:0/2356545683 wait complete. 2024-04-23T10:16:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.050+0000 7f5e3861b000 20 client.5097 trim_cache size 0 max 16384 2024-04-23T10:16:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e3861b000 1 Processor -- start 2024-04-23T10:16:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e3861b000 1 -- start start 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc14e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdfab0 0x5574ffc153d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffc1a5c0 0x5574ffc8b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e3861b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5e30202cd0 con 0x5574ffbdfab0 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e3861b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5e302033a0 con 0x5574ffbdf190 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e3861b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5e30142890 con 0x5574ffc1a5c0 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdfab0 0x5574ffc153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdfab0 0x5574ffc153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56760/0 (socket says 172.21.15.29:56760) 2024-04-23T10:16:39.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/85493687 learned_addr learned my addr 172.21.15.29:0/85493687 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/85493687 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffc1a5c0 msgr2=0x5574ffc8b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/85493687 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffc1a5c0 0x5574ffc8b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2effd640 1 --2- 172.21.15.29:0/85493687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc14e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/85493687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 msgr2=0x5574ffc14e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/85493687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc14e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 -- 172.21.15.29:0/85493687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574ff9aee80 con 0x5574ffbdfab0 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/85493687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdfab0 0x5574ffc153d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5e180ef280 tx=0x7f5e18121360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b34e05fcc1c1470 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e0ffff640 1 -- 172.21.15.29:0/85493687 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180f71d0 con 0x5574ffbdfab0 2024-04-23T10:16:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e0ffff640 1 -- 172.21.15.29:0/85493687 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e180fba00 con 0x5574ffbdfab0 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.066+0000 7f5e0ffff640 1 -- 172.21.15.29:0/85493687 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180a8950 con 0x5574ffbdfab0 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- 172.21.15.29:0/85493687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdfab0 msgr2=0x5574ffc153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 --2- 172.21.15.29:0/85493687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdfab0 0x5574ffc153d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5e180ef280 tx=0x7f5e18121360 comp rx=0 tx=0).stop 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- 172.21.15.29:0/85493687 shutdown_connections 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 --2- 172.21.15.29:0/85493687 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffc1a5c0 0x5574ffc8b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 --2- 172.21.15.29:0/85493687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffbdfab0 0x5574ffc153d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 --2- 172.21.15.29:0/85493687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc14e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- 172.21.15.29:0/85493687 >> 172.21.15.29:0/85493687 conn(0x5574ffc16e40 msgr2=0x5574ffbd8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- 172.21.15.29:0/85493687 shutdown_connections 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- 172.21.15.29:0/85493687 wait complete. 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- start start 2024-04-23T10:16:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 Processor -- start 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc85480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc859c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc318f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5574ffa27730 con 0x5574ffc1a5c0 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5574ff9f49e0 con 0x5574ffbdf190 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5574ffa2ca50 con 0x5574ffbdfab0 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 10 client.0 _ll_register_callbacks cb 0x7f5e20007e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc318f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc318f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56774/0 (socket says 172.21.15.29:56774) 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 -- 172.21.15.29:0/189852878 learned_addr learned my addr 172.21.15.29:0/189852878 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2effd640 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc85480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 -- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 msgr2=0x5574ffc859c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2e7fc640 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc859c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc859c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 -- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 msgr2=0x5574ffc85480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc85480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 -- 172.21.15.29:0/189852878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574ff9f0b30 con 0x5574ffc1a5c0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2effd640 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc85480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2f7fe640 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc318f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e28008010 tx=0x7f5e28004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae56fc22e82d8b23 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e0dffb640 1 -- 172.21.15.29:0/189852878 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28019040 con 0x5574ffc1a5c0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e0dffb640 1 -- 172.21.15.29:0/189852878 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5e2801e620 con 0x5574ffc1a5c0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- 172.21.15.29:0/189852878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e180fba00 con 0x5574ffc1a5c0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e0dffb640 1 -- 172.21.15.29:0/189852878 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f5e28030050 con 0x5574ffc1a5c0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 10 client.5103 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- 172.21.15.29:0/189852878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5574ffaa95b0 con 0x5574ffc1a5c0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e0dffb640 1 -- 172.21.15.29:0/189852878 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e180fba00 con 0x5574ffc1a5c0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e0dffb640 1 -- 172.21.15.29:0/189852878 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f5e28033020 con 0x5574ffc1a5c0 2024-04-23T10:16:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 10 client.5103 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 10 client.5103 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 20 client.5103 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x5574ffc32280 0x5574ffc32660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 4 client.5103 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e3861b000 1 -- 172.21.15.29:0/189852878 --> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] -- command(tid 0: {"prefix": "status"}) -- 0x5574ffa35e40 con 0x5574ffc32280 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.070+0000 7f5e2effd640 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x5574ffc32280 0x5574ffc32660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e0dffb640 10 client.5103 ms_handle_connect on v2:172.21.15.72:6834/1664530327 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e2effd640 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x5574ffc32280 0x5574ffc32660 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c3a4c8a1e067526 server_cookie=e5efba7423b83aa in_seq=0 out_seq=0 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e0dffb640 1 -- 172.21.15.29:0/189852878 <== mds.2 v2:172.21.15.72:6834/1664530327 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5574ffa35e40 con 0x5574ffc32280 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e0dffb640 10 client.5103 handle_command_reply: tid=0 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 client.5103 shutdown 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 -- 172.21.15.29:0/189852878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 msgr2=0x5574ffc318f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc318f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e28008010 tx=0x7f5e28004a50 comp rx=0 tx=0).stop 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 -- 172.21.15.29:0/189852878 shutdown_connections 2024-04-23T10:16:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:6834/1664530327,v1:172.21.15.72:6835/1664530327] conn(0x5574ffc32280 0x5574ffc32660 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5574ffc1a5c0 0x5574ffc318f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5574ffbdfab0 0x5574ffc859c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 --2- 172.21.15.29:0/189852878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5574ffbdf190 0x5574ffc85480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e0dffb640 0 client.5103 ms_handle_reset on v2:172.21.15.72:6834/1664530327 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 -- 172.21.15.29:0/189852878 >> 172.21.15.29:0/189852878 conn(0x5574ffc16e40 msgr2=0x5574ffc882c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 -- 172.21.15.29:0/189852878 shutdown_connections 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 1 -- 172.21.15.29:0/189852878 wait complete. 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e3861b000 20 client.5103 trim_cache size 0 max 16384 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 2, 2024-04-23T10:16:39.079 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4230, 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 35.742122273, 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 68.038747431000004 2024-04-23T10:16:39.080 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 -- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5e10068380 msgr2=0x7f5e1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5e10068380 0x7f5e1006a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e20005890 tx=0x7f5e20009040 comp rx=0 tx=0).stop 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 -- 172.21.15.29:0/3560700532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300ccc50 msgr2=0x7f5e3014b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300ccc50 0x7f5e3014b3e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5e180b3040 tx=0x7f5e1801ba30 comp rx=0 tx=0).stop 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 -- 172.21.15.29:0/3560700532 shutdown_connections 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5e10068380 0x7f5e1006a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e30153190 0x7f5e30148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e300ccc50 0x7f5e3014b3e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 --2- 172.21.15.29:0/3560700532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3006f150 0x7f5e30158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 -- 172.21.15.29:0/3560700532 >> 172.21.15.29:0/3560700532 conn(0x7f5e3006cfb0 msgr2=0x7f5e300c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 -- 172.21.15.29:0/3560700532 shutdown_connections 2024-04-23T10:16:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.074+0000 7f5e35499640 1 -- 172.21.15.29:0/3560700532 wait complete. 2024-04-23T10:16:39.093 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-23T10:16:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b86040640 1 Processor -- start 2024-04-23T10:16:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b86040640 1 -- start start 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b86040640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b8006f3b0 0x7f5b800c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b86040640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b800c7600 0x7f5b80071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b86040640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8015eae0 con 0x7f5b800c8950 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b86040640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5b80073b70 con 0x7f5b8006f3b0 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b86040640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5b8015edc0 con 0x7f5b800c7600 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5b800c8950 0x7f5b80154f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57028/0 (socket says 172.21.15.29:57028) 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7effd640 1 -- 172.21.15.29:0/3621571947 learned_addr learned my addr 172.21.15.29:0/3621571947 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/3621571947 >> v2:172.21.15.29:3300/0 conn(0x7f5b8006f3b0 0x7f5b800c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7ffff640 1 --2- 172.21.15.29:0/3621571947 >> v2:172.21.15.72:3300/0 conn(0x7f5b800c7600 0x7f5b80071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7e7fc640 1 -- 172.21.15.29:0/3621571947 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54807382 0 0) 0x7f5b8015eae0 con 0x7f5b800c8950 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7e7fc640 1 -- 172.21.15.29:0/3621571947 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b68003530 con 0x7f5b800c8950 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/3621571947 >> v2:172.21.15.72:3300/0 conn(0x7f5b800c7600 msgr2=0x7f5b80071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/3621571947 >> v2:172.21.15.72:3300/0 conn(0x7f5b800c7600 0x7f5b80071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/3621571947 >> v1:172.21.15.29:6789/0 conn(0x7f5b800c8950 legacy=0x7f5b80154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.218+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/3621571947 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8015f0a0 con 0x7f5b8006f3b0 2024-04-23T10:16:39.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/3621571947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006f3b0 0x7f5b800c70c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b80073140 tx=0x7f5b7001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686d3a8c148a43d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b7e7fc640 1 -- 172.21.15.29:0/3621571947 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700b5070 con 0x7f5b8006f3b0 2024-04-23T10:16:39.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b7e7fc640 1 -- 172.21.15.29:0/3621571947 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b700a8970 con 0x7f5b8006f3b0 2024-04-23T10:16:39.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b7e7fc640 1 -- 172.21.15.29:0/3621571947 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700a8d40 con 0x7f5b8006f3b0 2024-04-23T10:16:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b86040640 1 -- 172.21.15.29:0/3621571947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006f3b0 msgr2=0x7f5b800c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b86040640 1 --2- 172.21.15.29:0/3621571947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006f3b0 0x7f5b800c70c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b80073140 tx=0x7f5b7001ec70 comp rx=0 tx=0).stop 2024-04-23T10:16:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b86040640 1 -- 172.21.15.29:0/3621571947 shutdown_connections 2024-04-23T10:16:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b86040640 1 --2- 172.21.15.29:0/3621571947 >> v2:172.21.15.72:3300/0 conn(0x7f5b800c7600 0x7f5b80071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b86040640 1 --2- 172.21.15.29:0/3621571947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b8006f3b0 0x7f5b800c70c0 secure :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b80073140 tx=0x7f5b7001ec70 comp rx=0 tx=0).stop 2024-04-23T10:16:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b86040640 1 -- 172.21.15.29:0/3621571947 >> 172.21.15.29:0/3621571947 conn(0x7f5b8006cfb0 msgr2=0x7f5b8006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b86040640 1 -- 172.21.15.29:0/3621571947 shutdown_connections 2024-04-23T10:16:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.222+0000 7f5b86040640 1 -- 172.21.15.29:0/3621571947 wait complete. 2024-04-23T10:16:39.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 Processor -- start 2024-04-23T10:16:39.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 -- start start 2024-04-23T10:16:39.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b800c7600 0x7f5b80152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800c8950 0x7f5b8015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b80159e40 0x7f5b8015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5b80071960 con 0x7f5b800c7600 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8015f660 con 0x7f5b80159e40 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8015e780 con 0x7f5b800c8950 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b800c7600 0x7f5b80152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b800c7600 0x7f5b80152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56792/0 (socket says 172.21.15.29:56792) 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/1209527787 learned_addr learned my addr 172.21.15.29:0/1209527787 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7ffff640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b80159e40 0x7f5b8015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7effd640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800c8950 0x7f5b8015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800c8950 msgr2=0x7f5b8015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800c8950 0x7f5b8015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b80159e40 msgr2=0x7f5b8015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b80159e40 0x7f5b8015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/1209527787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b801f1180 con 0x7f5b800c7600 2024-04-23T10:16:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b800c7600 0x7f5b80152ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009880 tx=0x7f5b7001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b67fff640 1 -- 172.21.15.29:0/1209527787 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700bf070 con 0x7f5b800c7600 2024-04-23T10:16:39.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b67fff640 1 -- 172.21.15.29:0/1209527787 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b700b0640 con 0x7f5b800c7600 2024-04-23T10:16:39.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 -- 172.21.15.29:0/1209527787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b801f1460 con 0x7f5b800c7600 2024-04-23T10:16:39.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b67fff640 1 -- 172.21.15.29:0/1209527787 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700b5040 con 0x7f5b800c7600 2024-04-23T10:16:39.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b86040640 1 -- 172.21.15.29:0/1209527787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b801f1a20 con 0x7f5b800c7600 2024-04-23T10:16:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b67fff640 1 -- 172.21.15.29:0/1209527787 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b700c2070 con 0x7f5b800c7600 2024-04-23T10:16:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b67fff640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b6c068380 0x7f5b6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.226+0000 7f5b67fff640 1 -- 172.21.15.29:0/1209527787 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5b70123500 con 0x7f5b800c7600 2024-04-23T10:16:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7effd640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b6c068380 0x7f5b6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 Processor -- start 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- start start 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7effd640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b6c068380 0x7f5b6c06a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5b8014f1b0 tx=0x7f5b74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484190 0x55b0c6484570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 0x55b0c64bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c64bf5c0 0x55b0c64bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b0c62cd420 con 0x55b0c64bf5c0 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b0c6267bf0 con 0x55b0c6484ab0 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b0c62c93e0 con 0x55b0c6484190 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c64bf5c0 0x55b0c64bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c64bf5c0 0x55b0c64bf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56808/0 (socket says 172.21.15.29:56808) 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 -- 172.21.15.29:0/3057231536 learned_addr learned my addr 172.21.15.29:0/3057231536 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484190 0x55b0c6484570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 -- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484190 msgr2=0x55b0c6484570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484190 0x55b0c6484570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 -- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 msgr2=0x55b0c64bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7effd640 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 0x55b0c64bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 0x55b0c64bf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 -- 172.21.15.29:0/3057231536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0c6375450 con 0x55b0c64bf5c0 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484190 0x55b0c6484570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b7ffff640 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c64bf5c0 0x55b0c64bf9a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007400 tx=0x7f5b780078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135465d5c6824757 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b657fa640 1 -- 172.21.15.29:0/3057231536 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780147e0 con 0x55b0c64bf5c0 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b657fa640 1 -- 172.21.15.29:0/3057231536 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7801a070 con 0x55b0c64bf5c0 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b657fa640 1 -- 172.21.15.29:0/3057231536 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78014ba0 con 0x55b0c64bf5c0 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- 172.21.15.29:0/3057231536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c64bf5c0 msgr2=0x55b0c64bf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c64bf5c0 0x55b0c64bf9a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007400 tx=0x7f5b780078c0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- 172.21.15.29:0/3057231536 shutdown_connections 2024-04-23T10:16:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c64bf5c0 0x55b0c64bf9a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 0x55b0c64bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3057231536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484190 0x55b0c6484570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- 172.21.15.29:0/3057231536 >> 172.21.15.29:0/3057231536 conn(0x55b0c64bbe40 msgr2=0x55b0c64be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- 172.21.15.29:0/3057231536 shutdown_connections 2024-04-23T10:16:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- 172.21.15.29:0/3057231536 wait complete. 2024-04-23T10:16:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 -- start start 2024-04-23T10:16:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.230+0000 7f5b891c2000 1 Processor -- start 2024-04-23T10:16:39.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c6480b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 0x55b0c64810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 0x55b0c64815e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b0c626dec0 con 0x55b0c6484190 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b0c634e120 con 0x55b0c6484ab0 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b0c62d8350 con 0x55b0c64bf5c0 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 10 client.0 _ll_register_callbacks cb 0x55b0c62aa4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c6480b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c6480b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56820/0 (socket says 172.21.15.29:56820) 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/3113886707 learned_addr learned my addr 172.21.15.29:0/3113886707 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7ffff640 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 0x55b0c64815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7effd640 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 0x55b0c64810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 msgr2=0x55b0c64815e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 0x55b0c64815e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 msgr2=0x55b0c64810a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 0x55b0c64810a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/3113886707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0c6312f80 con 0x55b0c6484190 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c6480b60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5b70121610 tx=0x7f5b700f2930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6764ede788ebedb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/3113886707 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700fb8f0 con 0x55b0c6484190 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/3113886707 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5b701230b0 con 0x55b0c6484190 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 -- 172.21.15.29:0/3113886707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b7801a070 con 0x55b0c6484190 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/3113886707 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f5b7011f050 con 0x55b0c6484190 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 10 client.5118 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 -- 172.21.15.29:0/3113886707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b0c62a6f00 con 0x55b0c6484190 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/3113886707 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7801a070 con 0x55b0c6484190 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/3113886707 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f5b700b8070 con 0x55b0c6484190 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 10 client.5118 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 10 client.5118 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 20 client.5118 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55b0c64d3d90 0x55b0c64d6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 4 client.5118 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b891c2000 1 -- 172.21.15.29:0/3113886707 --> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0c6266bc0 con 0x55b0c64d3d90 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7effd640 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55b0c64d3d90 0x55b0c64d6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b7effd640 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55b0c64d3d90 0x55b0c64d6180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f97dc01177b2177 server_cookie=e4c3ddc6db1e6bab in_seq=0 out_seq=0 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.234+0000 7f5b5e7fc640 10 client.5118 ms_handle_connect on v2:172.21.15.72:6837/41085720 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/3113886707 <== mds.1 v2:172.21.15.72:6837/41085720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b0c6266bc0 con 0x55b0c64d3d90 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b5e7fc640 10 client.5118 handle_command_reply: tid=0 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 client.5118 shutdown 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 -- 172.21.15.29:0/3113886707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 msgr2=0x55b0c6480b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c6480b60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5b70121610 tx=0x7f5b700f2930 comp rx=0 tx=0).stop 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 -- 172.21.15.29:0/3113886707 shutdown_connections 2024-04-23T10:16:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 0x55b0c64815e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c6484ab0 0x55b0c64810a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55b0c64d3d90 0x55b0c64d6180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 --2- 172.21.15.29:0/3113886707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c6480b60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 -- 172.21.15.29:0/3113886707 >> 172.21.15.29:0/3113886707 conn(0x55b0c64bbe40 msgr2=0x55b0c64bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b5e7fc640 0 client.5118 ms_handle_reset on v2:172.21.15.72:6837/41085720 2024-04-23T10:16:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 -- 172.21.15.29:0/3113886707 shutdown_connections 2024-04-23T10:16:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 1 -- 172.21.15.29:0/3113886707 wait complete. 2024-04-23T10:16:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.238+0000 7f5b891c2000 20 client.5118 trim_cache size 0 max 16384 2024-04-23T10:16:39.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b891c2000 1 Processor -- start 2024-04-23T10:16:39.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b891c2000 1 -- start start 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c64b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484ab0 0x55b0c64ba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c64bf5c0 0x55b0c6530510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b891c2000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801ff040 con 0x55b0c6484190 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b891c2000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b801fd210 con 0x55b0c64bf5c0 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b891c2000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b0c62999e0 con 0x55b0c6484ab0 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c64b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c64b9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56836/0 (socket says 172.21.15.29:56836) 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/547071600 learned_addr learned my addr 172.21.15.29:0/547071600 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/547071600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484ab0 msgr2=0x55b0c64ba3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/547071600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484ab0 0x55b0c64ba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/547071600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c64bf5c0 msgr2=0x55b0c6530510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/547071600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c64bf5c0 0x55b0c6530510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/547071600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0c64848e0 con 0x55b0c6484190 2024-04-23T10:16:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/547071600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c64b9e90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b7001eaa0 tx=0x7f5b700f5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b92c04c50d4829d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b64ff9640 1 -- 172.21.15.29:0/547071600 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7010f070 con 0x55b0c6484190 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b64ff9640 1 -- 172.21.15.29:0/547071600 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b700f72c0 con 0x55b0c6484190 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.258+0000 7f5b64ff9640 1 -- 172.21.15.29:0/547071600 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700fbbd0 con 0x55b0c6484190 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- 172.21.15.29:0/547071600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 msgr2=0x55b0c64b9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 --2- 172.21.15.29:0/547071600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c64b9e90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b7001eaa0 tx=0x7f5b700f5000 comp rx=0 tx=0).stop 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- 172.21.15.29:0/547071600 shutdown_connections 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 --2- 172.21.15.29:0/547071600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c64bf5c0 0x55b0c6530510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 --2- 172.21.15.29:0/547071600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c6484ab0 0x55b0c64ba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 --2- 172.21.15.29:0/547071600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484190 0x55b0c64b9e90 secure :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b7001eaa0 tx=0x7f5b700f5000 comp rx=0 tx=0).stop 2024-04-23T10:16:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- 172.21.15.29:0/547071600 >> 172.21.15.29:0/547071600 conn(0x55b0c64bbe40 msgr2=0x55b0c647dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- 172.21.15.29:0/547071600 shutdown_connections 2024-04-23T10:16:39.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- 172.21.15.29:0/547071600 wait complete. 2024-04-23T10:16:39.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- start start 2024-04-23T10:16:39.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 Processor -- start 2024-04-23T10:16:39.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484ab0 0x55b0c652d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 0x55b0c652e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c652e820 0x55b0c652ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b0c62d1a50 con 0x55b0c6484ab0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b0c62cc730 con 0x55b0c652e820 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b0c62da630 con 0x55b0c64bf5c0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 10 client.0 _ll_register_callbacks cb 0x7f5b70009110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484ab0 0x55b0c652d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484ab0 0x55b0c652d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56838/0 (socket says 172.21.15.29:56838) 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/55188436 learned_addr learned my addr 172.21.15.29:0/55188436 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7effd640 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 0x55b0c652e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7ffff640 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c652e820 0x55b0c652ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 msgr2=0x55b0c652e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 0x55b0c652e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c652e820 msgr2=0x55b0c652ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c652e820 0x55b0c652ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 -- 172.21.15.29:0/55188436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0c6253e80 con 0x55b0c6484ab0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7f7fe640 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484ab0 0x55b0c652d2a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b70121610 tx=0x7f5b701214e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ec4cc83f993716 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/55188436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7010f070 con 0x55b0c6484ab0 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/55188436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5b700fb900 con 0x55b0c6484ab0 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- 172.21.15.29:0/55188436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b700f72c0 con 0x55b0c6484ab0 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/55188436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f5b700f2a50 con 0x55b0c6484ab0 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 10 client.5124 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- 172.21.15.29:0/55188436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b0c6295b30 con 0x55b0c6484ab0 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/55188436 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b700f72c0 con 0x55b0c6484ab0 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/55188436 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f5b700b8040 con 0x55b0c6484ab0 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 10 client.5124 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 10 client.5124 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 20 client.5124 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55b0c652f140 0x55b0c652f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 4 client.5124 mds_command: new command op to 4250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b891c2000 1 -- 172.21.15.29:0/55188436 --> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] -- command(tid 0: {"prefix": "status"}) -- 0x55b0c62dae40 con 0x55b0c652f140 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.262+0000 7f5b7effd640 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55b0c652f140 0x55b0c652f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b7effd640 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55b0c652f140 0x55b0c652f520 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9561d2183ccba95b server_cookie=3cbb3d36de73987e in_seq=0 out_seq=0 2024-04-23T10:16:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b5e7fc640 10 client.5124 ms_handle_connect on v2:172.21.15.72:6837/41085720 2024-04-23T10:16:39.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b5e7fc640 1 -- 172.21.15.29:0/55188436 <== mds.1 v2:172.21.15.72:6837/41085720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b0c62dae40 con 0x55b0c652f140 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b5e7fc640 10 client.5124 handle_command_reply: tid=0 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 client.5124 shutdown 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 -- 172.21.15.29:0/55188436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484ab0 msgr2=0x55b0c652d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484ab0 0x55b0c652d2a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b70121610 tx=0x7f5b701214e0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 -- 172.21.15.29:0/55188436 shutdown_connections 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b0c652e820 0x55b0c652ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b0c64bf5c0 0x55b0c652e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.72:6837/41085720,v1:172.21.15.72:6839/41085720] conn(0x55b0c652f140 0x55b0c652f520 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 --2- 172.21.15.29:0/55188436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b0c6484ab0 0x55b0c652d2a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b5e7fc640 0 client.5124 ms_handle_reset on v2:172.21.15.72:6837/41085720 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 -- 172.21.15.29:0/55188436 >> 172.21.15.29:0/55188436 conn(0x55b0c64bbe40 msgr2=0x55b0c647c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 -- 172.21.15.29:0/55188436 shutdown_connections 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 1 -- 172.21.15.29:0/55188436 wait complete. 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b891c2000 20 client.5124 trim_cache size 0 max 16384 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 1, 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4250, 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 40.977313485000003, 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:39.271 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:39.272 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 68.228982759000004 2024-04-23T10:16:39.272 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 -- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b6c068380 msgr2=0x7f5b6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b6c068380 0x7f5b6c06a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5b8014f1b0 tx=0x7f5b74009040 comp rx=0 tx=0).stop 2024-04-23T10:16:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 -- 172.21.15.29:0/1209527787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b800c7600 msgr2=0x7f5b80152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b800c7600 0x7f5b80152ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009880 tx=0x7f5b7001ba10 comp rx=0 tx=0).stop 2024-04-23T10:16:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 -- 172.21.15.29:0/1209527787 shutdown_connections 2024-04-23T10:16:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b6c068380 0x7f5b6c06a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b80159e40 0x7f5b8015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800c8950 0x7f5b8015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 --2- 172.21.15.29:0/1209527787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b800c7600 0x7f5b80152ae0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 -- 172.21.15.29:0/1209527787 >> 172.21.15.29:0/1209527787 conn(0x7f5b8006cfb0 msgr2=0x7f5b8014f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 -- 172.21.15.29:0/1209527787 shutdown_connections 2024-04-23T10:16:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.266+0000 7f5b86040640 1 -- 172.21.15.29:0/1209527787 wait complete. 2024-04-23T10:16:39.283 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-23T10:16:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc942b4e640 1 Processor -- start 2024-04-23T10:16:39.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc942b4e640 1 -- start start 2024-04-23T10:16:39.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc942b4e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc93c0ce960 0x7fc93c0c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc942b4e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c0ca7d0 0x7fc93c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc942b4e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93c074630 con 0x7fc93c0ced40 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc942b4e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc93c15b020 con 0x7fc93c0ce960 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc942b4e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c06bdc0 con 0x7fc93c0ca7d0 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc93c0ced40 0x7fc93c154cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57036/0 (socket says 172.21.15.29:57036) 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93bfff640 1 -- 172.21.15.29:0/2869270280 learned_addr learned my addr 172.21.15.29:0/2869270280 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc9408ea640 1 --2- 172.21.15.29:0/2869270280 >> v2:172.21.15.72:3300/0 conn(0x7fc93c0ce960 0x7fc93c0c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc9410eb640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c0ca7d0 0x7fc93c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694555600 0 0) 0x7fc93c074630 con 0x7fc93c0ced40 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc92c003530 con 0x7fc93c0ced40 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4053689575 0 0) 0x7fc92c003530 con 0x7fc93c0ced40 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c0ca7d0 msgr2=0x7fc93c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c0ca7d0 0x7fc93c1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 >> v2:172.21.15.72:3300/0 conn(0x7fc93c0ce960 msgr2=0x7fc93c0c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 --2- 172.21.15.29:0/2869270280 >> v2:172.21.15.72:3300/0 conn(0x7fc93c0ce960 0x7fc93c0c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c06c0a0 con 0x7fc93c0ced40 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fc928001680 con 0x7fc93c0ced40 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 >> v1:172.21.15.29:6789/0 conn(0x7fc93c0ced40 legacy=0x7fc93c154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92c0039c0 0x7fc92c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c0ca7d0 0x7fc92c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c004d50 0x7fc92c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c15b020 con 0x7fc92c004d50 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c06bdc0 con 0x7fc92c0039c0 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.406+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c00b9d0 con 0x7fc93c0ca7d0 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc9410eb640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c004d50 0x7fc92c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc9410eb640 1 -- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c0ca7d0 msgr2=0x7fc92c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc9410eb640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c0ca7d0 0x7fc92c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc9410eb640 1 -- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92c0039c0 msgr2=0x7fc92c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc9410eb640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92c0039c0 0x7fc92c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc9410eb640 1 -- 172.21.15.29:0/2869270280 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c003530 con 0x7fc92c004d50 2024-04-23T10:16:39.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc9410eb640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c004d50 0x7fc92c0051d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc934009fc0 tx=0x7fc93401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5886b80d07213c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340b2070 con 0x7fc92c004d50 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340a5cd0 con 0x7fc92c004d50 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc93b7fe640 1 -- 172.21.15.29:0/2869270280 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934009c10 con 0x7fc92c004d50 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc942b4e640 1 -- 172.21.15.29:0/2869270280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c004d50 msgr2=0x7fc92c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc942b4e640 1 --2- 172.21.15.29:0/2869270280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc92c004d50 0x7fc92c0051d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc934009fc0 tx=0x7fc93401ccc0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc9410eb640 1 -- 172.21.15.29:0/2869270280 reap_dead start 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc942b4e640 1 -- 172.21.15.29:0/2869270280 shutdown_connections 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc942b4e640 1 -- 172.21.15.29:0/2869270280 >> 172.21.15.29:0/2869270280 conn(0x7fc93c070f60 msgr2=0x7fc93c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc942b4e640 1 -- 172.21.15.29:0/2869270280 shutdown_connections 2024-04-23T10:16:39.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.410+0000 7fc942b4e640 1 -- 172.21.15.29:0/2869270280 wait complete. 2024-04-23T10:16:39.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 Processor -- start 2024-04-23T10:16:39.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 -- start start 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93c1f3db0 0x7fc93c1f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc93c1f46d0 0x7fc93c14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c147ba0 0x7fc93c145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c15b5c0 con 0x7fc93c1f46d0 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c15b2e0 con 0x7fc93c1f3db0 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c06b9e0 con 0x7fc93c147ba0 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc93c1f46d0 0x7fc93c14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc93c1f46d0 0x7fc93c14cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56856/0 (socket says 172.21.15.29:56856) 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 -- 172.21.15.29:0/12240519 learned_addr learned my addr 172.21.15.29:0/12240519 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc9408ea640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93c1f3db0 0x7fc93c1f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc9410eb640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c147ba0 0x7fc93c145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 -- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c147ba0 msgr2=0x7fc93c145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c147ba0 0x7fc93c145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 -- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93c1f3db0 msgr2=0x7fc93c1f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93c1f3db0 0x7fc93c1f4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 -- 172.21.15.29:0/12240519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c15a1e0 con 0x7fc93c1f46d0 2024-04-23T10:16:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc93bfff640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc93c1f46d0 0x7fc93c14cc10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc92800cad0 tx=0x7fc92800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc9397fa640 1 -- 172.21.15.29:0/12240519 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928018070 con 0x7fc93c1f46d0 2024-04-23T10:16:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc9397fa640 1 -- 172.21.15.29:0/12240519 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc928004cc0 con 0x7fc93c1f46d0 2024-04-23T10:16:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 -- 172.21.15.29:0/12240519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c15a450 con 0x7fc93c1f46d0 2024-04-23T10:16:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc9397fa640 1 -- 172.21.15.29:0/12240519 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928007310 con 0x7fc93c1f46d0 2024-04-23T10:16:39.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.414+0000 7fc942b4e640 1 -- 172.21.15.29:0/12240519 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c0715b0 con 0x7fc93c1f46d0 2024-04-23T10:16:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9397fa640 1 -- 172.21.15.29:0/12240519 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc92801b070 con 0x7fc93c1f46d0 2024-04-23T10:16:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9397fa640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc920068380 0x7fc92006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9397fa640 1 -- 172.21.15.29:0/12240519 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc928086430 con 0x7fc93c1f46d0 2024-04-23T10:16:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc920068380 0x7fc92006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 Processor -- start 2024-04-23T10:16:39.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- start start 2024-04-23T10:16:39.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc920068380 0x7fc92006a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9300047c0 tx=0x7fc930008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200190 0x564bb8200570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200ab0 0x564bb823b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb823b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564bb8049420 con 0x564bb8200190 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564bb7fe3bf0 con 0x564bb8200ab0 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x564bb80453e0 con 0x564bb823b5c0 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200190 0x564bb8200570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200190 0x564bb8200570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56862/0 (socket says 172.21.15.29:56862) 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 -- 172.21.15.29:0/2327798156 learned_addr learned my addr 172.21.15.29:0/2327798156 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc93bfff640 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200ab0 0x564bb823b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9410eb640 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb823b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 -- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 msgr2=0x564bb823b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb823b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 -- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200ab0 msgr2=0x564bb823b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200ab0 0x564bb823b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 -- 172.21.15.29:0/2327798156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bb80f1450 con 0x564bb8200190 2024-04-23T10:16:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc93bfff640 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200ab0 0x564bb823b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9408ea640 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200190 0x564bb8200570 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc930011ce0 tx=0x7fc930014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6dd138f5d1617c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9267fc640 1 -- 172.21.15.29:0/2327798156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930011d10 con 0x564bb8200190 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9267fc640 1 -- 172.21.15.29:0/2327798156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc930026070 con 0x564bb8200190 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc9267fc640 1 -- 172.21.15.29:0/2327798156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930021680 con 0x564bb8200190 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- 172.21.15.29:0/2327798156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200190 msgr2=0x564bb8200570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200190 0x564bb8200570 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc930011ce0 tx=0x7fc930014000 comp rx=0 tx=0).stop 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- 172.21.15.29:0/2327798156 shutdown_connections 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb823b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200ab0 0x564bb823b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2327798156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200190 0x564bb8200570 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- 172.21.15.29:0/2327798156 >> 172.21.15.29:0/2327798156 conn(0x564bb8237e40 msgr2=0x564bb823a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- 172.21.15.29:0/2327798156 shutdown_connections 2024-04-23T10:16:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- 172.21.15.29:0/2327798156 wait complete. 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 -- start start 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.418+0000 7fc945cd0000 1 Processor -- start 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb81fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb81fd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb81fd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564bb7fe9ec0 con 0x564bb8200ab0 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564bb80ca120 con 0x564bb8200190 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x564bb8054350 con 0x564bb823b5c0 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 10 client.0 _ll_register_callbacks cb 0x564bb80264d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb81fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb81fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56874/0 (socket says 172.21.15.29:56874) 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 -- 172.21.15.29:0/1068565005 learned_addr learned my addr 172.21.15.29:0/1068565005 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 -- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 msgr2=0x564bb81fd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc9410eb640 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb81fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc9408ea640 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb81fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb81fd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 -- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 msgr2=0x564bb81fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb81fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 -- 172.21.15.29:0/1068565005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bb808ef80 con 0x564bb8200ab0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc93bfff640 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb81fd110 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc928001ec0 tx=0x7fc928056670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c116ec748badd15 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc91b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc91b7fe640 1 -- 172.21.15.29:0/1068565005 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92805ea90 con 0x564bb8200ab0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc91b7fe640 1 -- 172.21.15.29:0/1068565005 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc9280860b0 con 0x564bb8200ab0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 -- 172.21.15.29:0/1068565005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc930026070 con 0x564bb8200ab0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc91b7fe640 1 -- 172.21.15.29:0/1068565005 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc92805e600 con 0x564bb8200ab0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 10 client.5136 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 -- 172.21.15.29:0/1068565005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564bb8022f00 con 0x564bb8200ab0 2024-04-23T10:16:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc91b7fe640 1 -- 172.21.15.29:0/1068565005 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc930026070 con 0x564bb8200ab0 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc91b7fe640 1 -- 172.21.15.29:0/1068565005 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc9280840d0 con 0x564bb8200ab0 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 10 client.5136 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 10 client.5136 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 20 client.5136 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564bb824fd90 0x564bb8252180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 4 client.5136 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc945cd0000 1 -- 172.21.15.29:0/1068565005 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bb7fe2bc0 con 0x564bb824fd90 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc9408ea640 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564bb824fd90 0x564bb8252180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc91b7fe640 10 client.5136 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.422+0000 7fc9408ea640 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564bb824fd90 0x564bb8252180 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30d44c40c08f182 server_cookie=9ace1a5c37135e93 in_seq=0 out_seq=0 2024-04-23T10:16:39.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc91b7fe640 1 -- 172.21.15.29:0/1068565005 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564bb7fe2bc0 con 0x564bb824fd90 2024-04-23T10:16:39.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc91b7fe640 10 client.5136 handle_command_reply: tid=0 2024-04-23T10:16:39.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 client.5136 shutdown 2024-04-23T10:16:39.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 -- 172.21.15.29:0/1068565005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 msgr2=0x564bb81fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb81fd110 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc928001ec0 tx=0x7fc928056670 comp rx=0 tx=0).stop 2024-04-23T10:16:39.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 -- 172.21.15.29:0/1068565005 shutdown_connections 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564bb824fd90 0x564bb8252180 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb81fd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb81fd110 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 --2- 172.21.15.29:0/1068565005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb81fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc91b7fe640 0 client.5136 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 -- 172.21.15.29:0/1068565005 >> 172.21.15.29:0/1068565005 conn(0x564bb8237e40 msgr2=0x564bb82391c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 -- 172.21.15.29:0/1068565005 shutdown_connections 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 1 -- 172.21.15.29:0/1068565005 wait complete. 2024-04-23T10:16:39.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.426+0000 7fc945cd0000 20 client.5136 trim_cache size 0 max 16384 2024-04-23T10:16:39.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 Processor -- start 2024-04-23T10:16:39.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- start start 2024-04-23T10:16:39.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb8236500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb8200ab0 0x564bb8236a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb823b5c0 0x564bb82a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1ff1a0 con 0x564bb823b5c0 2024-04-23T10:16:39.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1ff870 con 0x564bb8200190 2024-04-23T10:16:39.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c1fd920 con 0x564bb8200ab0 2024-04-23T10:16:39.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb823b5c0 0x564bb82a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb823b5c0 0x564bb82a76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56886/0 (socket says 172.21.15.29:56886) 2024-04-23T10:16:39.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 -- 172.21.15.29:0/667626430 learned_addr learned my addr 172.21.15.29:0/667626430 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 -- 172.21.15.29:0/667626430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb8200ab0 msgr2=0x564bb8236a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 --2- 172.21.15.29:0/667626430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb8200ab0 0x564bb8236a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 -- 172.21.15.29:0/667626430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 msgr2=0x564bb8236500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9408ea640 1 --2- 172.21.15.29:0/667626430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb8236500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 --2- 172.21.15.29:0/667626430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb8236500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 -- 172.21.15.29:0/667626430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bb7fcfe80 con 0x564bb823b5c0 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc9410eb640 1 --2- 172.21.15.29:0/667626430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb823b5c0 0x564bb82a76d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc93401c730 tx=0x7fc93401b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda71175503cfc31 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc925ffb640 1 -- 172.21.15.29:0/667626430 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340b2070 con 0x564bb823b5c0 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc925ffb640 1 -- 172.21.15.29:0/667626430 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340b3040 con 0x564bb823b5c0 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc925ffb640 1 -- 172.21.15.29:0/667626430 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340a5ad0 con 0x564bb823b5c0 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- 172.21.15.29:0/667626430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb823b5c0 msgr2=0x564bb82a76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- 172.21.15.29:0/667626430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb823b5c0 0x564bb82a76d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc93401c730 tx=0x7fc93401b500 comp rx=0 tx=0).stop 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- 172.21.15.29:0/667626430 shutdown_connections 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- 172.21.15.29:0/667626430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb823b5c0 0x564bb82a76d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- 172.21.15.29:0/667626430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb8200ab0 0x564bb8236a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- 172.21.15.29:0/667626430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb8236500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- 172.21.15.29:0/667626430 >> 172.21.15.29:0/667626430 conn(0x564bb8237e40 msgr2=0x564bb82553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- 172.21.15.29:0/667626430 shutdown_connections 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- 172.21.15.29:0/667626430 wait complete. 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- start start 2024-04-23T10:16:39.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 Processor -- start 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb8270d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb82712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb8271800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564bb8048730 con 0x564bb8200ab0 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564bb80159e0 con 0x564bb8200190 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x564bb804da50 con 0x564bb823b5c0 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.446+0000 7fc945cd0000 10 client.0 _ll_register_callbacks cb 0x7fc928004e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb82712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb82712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56892/0 (socket says 172.21.15.29:56892) 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 -- 172.21.15.29:0/2078856914 learned_addr learned my addr 172.21.15.29:0/2078856914 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc9408ea640 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb8270d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 -- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 msgr2=0x564bb8271800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc9410eb640 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb8271800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb8271800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 -- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 msgr2=0x564bb8270d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb8270d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 -- 172.21.15.29:0/2078856914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bb8011b30 con 0x564bb8200ab0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc93bfff640 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb82712c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc928052830 tx=0x7fc928000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cf515a0c8ff4bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 1 -- 172.21.15.29:0/2078856914 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92805ea90 con 0x564bb8200ab0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 1 -- 172.21.15.29:0/2078856914 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc92805e7a0 con 0x564bb8200ab0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 -- 172.21.15.29:0/2078856914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9340b3040 con 0x564bb8200ab0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 1 -- 172.21.15.29:0/2078856914 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc92806e1b0 con 0x564bb8200ab0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 10 client.5142 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 -- 172.21.15.29:0/2078856914 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564bb80ca5b0 con 0x564bb8200ab0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 1 -- 172.21.15.29:0/2078856914 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340b3040 con 0x564bb8200ab0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 1 -- 172.21.15.29:0/2078856914 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc928055300 con 0x564bb8200ab0 2024-04-23T10:16:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 10 client.5142 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 10 client.5142 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 20 client.5142 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564bb8272100 0x564bb82b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 4 client.5142 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 -- 172.21.15.29:0/2078856914 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "status"}) -- 0x564bb8056e40 con 0x564bb8272100 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc9408ea640 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564bb8272100 0x564bb82b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc9408ea640 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564bb8272100 0x564bb82b8c40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b88fd97af99c11 server_cookie=420592dbefc41044 in_seq=0 out_seq=0 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 10 client.5142 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 1 -- 172.21.15.29:0/2078856914 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564bb8056e40 con 0x564bb8272100 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 10 client.5142 handle_command_reply: tid=0 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 client.5142 shutdown 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 -- 172.21.15.29:0/2078856914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 msgr2=0x564bb82712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb82712c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc928052830 tx=0x7fc928000bd0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 -- 172.21.15.29:0/2078856914 shutdown_connections 2024-04-23T10:16:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564bb8272100 0x564bb82b8c40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564bb823b5c0 0x564bb8271800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564bb8200ab0 0x564bb82712c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 --2- 172.21.15.29:0/2078856914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564bb8200190 0x564bb8270d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 -- 172.21.15.29:0/2078856914 >> 172.21.15.29:0/2078856914 conn(0x564bb8237e40 msgr2=0x564bb82547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc91b7fe640 0 client.5142 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 -- 172.21.15.29:0/2078856914 shutdown_connections 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 1 -- 172.21.15.29:0/2078856914 wait complete. 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc945cd0000 20 client.5142 trim_cache size 0 max 16384 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "04cdcd58-672f-4635-ab0e-456f05ed3368", 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4288, 2024-04-23T10:16:39.457 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-23T10:16:39.458 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-23T10:16:39.458 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-23T10:16:39.458 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 61.423924341000003, 2024-04-23T10:16:39.458 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-23T10:16:39.458 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 26, 2024-04-23T10:16:39.458 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:16:39.458 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 68.415372278999996 2024-04-23T10:16:39.458 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 -- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc920068380 msgr2=0x7fc92006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc920068380 0x7fc92006a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9300047c0 tx=0x7fc930008040 comp rx=0 tx=0).stop 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 -- 172.21.15.29:0/12240519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc93c1f46d0 msgr2=0x7fc93c14cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc93c1f46d0 0x7fc93c14cc10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc92800cad0 tx=0x7fc92800cf90 comp rx=0 tx=0).stop 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 -- 172.21.15.29:0/12240519 shutdown_connections 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc920068380 0x7fc92006a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc93c147ba0 0x7fc93c145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc93c1f46d0 0x7fc93c14cc10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 --2- 172.21.15.29:0/12240519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93c1f3db0 0x7fc93c1f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 -- 172.21.15.29:0/12240519 >> 172.21.15.29:0/12240519 conn(0x7fc93c070f60 msgr2=0x7fc93c158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 -- 172.21.15.29:0/12240519 shutdown_connections 2024-04-23T10:16:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:39.450+0000 7fc942b4e640 1 -- 172.21.15.29:0/12240519 wait complete. 2024-04-23T10:16:39.468 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-23T10:16:45.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:16:45.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:16:54.469 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T10:16:54.470 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.45 2024-04-23T10:16:54.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:54.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1ccccbb640 1 Processor -- start 2024-04-23T10:16:54.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1ccccbb640 1 -- start start 2024-04-23T10:16:54.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1ccccbb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1cc8152080 0x7f1cc80c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1cc5d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1cc8152080 0x7f1cc80c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1cc5d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1cc8152080 0x7f1cc80c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45280/0 (socket says 172.21.15.29:45280) 2024-04-23T10:16:54.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1cc5d9b640 1 -- 172.21.15.29:0/3564319022 learned_addr learned my addr 172.21.15.29:0/3564319022 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:54.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1ccccbb640 1 -- 172.21.15.29:0/3564319022 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc8158160 con 0x7f1cc80c9b80 2024-04-23T10:16:54.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1ccccbb640 1 -- 172.21.15.29:0/3564319022 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc8158440 con 0x7f1cc8151ca0 2024-04-23T10:16:54.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1ccccbb640 1 -- 172.21.15.29:0/3564319022 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc80c8c70 con 0x7f1cc8152080 2024-04-23T10:16:54.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1cc5d9b640 1 -- 172.21.15.29:0/3564319022 >> v1:172.21.15.72:6789/0 conn(0x7f1cc8151ca0 legacy=0x7f1cc80ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1cc5d9b640 1 -- 172.21.15.29:0/3564319022 >> v1:172.21.15.29:6789/0 conn(0x7f1cc80c9b80 legacy=0x7f1cc815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.573+0000 7f1cc5d9b640 1 -- 172.21.15.29:0/3564319022 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc8158720 con 0x7f1cc8152080 2024-04-23T10:16:54.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 --2- 172.21.15.29:0/3564319022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8152080 0x7f1cc80c8730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87516348c35722cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc559a640 1 -- 172.21.15.29:0/3564319022 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0b5070 con 0x7f1cc8152080 2024-04-23T10:16:54.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc559a640 1 -- 172.21.15.29:0/3564319022 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0a8a10 con 0x7f1cc8152080 2024-04-23T10:16:54.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc559a640 1 -- 172.21.15.29:0/3564319022 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0a8de0 con 0x7f1cc8152080 2024-04-23T10:16:54.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- 172.21.15.29:0/3564319022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8152080 msgr2=0x7f1cc80c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 --2- 172.21.15.29:0/3564319022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8152080 0x7f1cc80c8730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc01ed10 comp rx=0 tx=0).stop 2024-04-23T10:16:54.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- 172.21.15.29:0/3564319022 shutdown_connections 2024-04-23T10:16:54.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 --2- 172.21.15.29:0/3564319022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8152080 0x7f1cc80c8730 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- 172.21.15.29:0/3564319022 >> 172.21.15.29:0/3564319022 conn(0x7f1cc806b9e0 msgr2=0x7f1cc806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:54.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- 172.21.15.29:0/3564319022 shutdown_connections 2024-04-23T10:16:54.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- 172.21.15.29:0/3564319022 wait complete. 2024-04-23T10:16:54.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 Processor -- start 2024-04-23T10:16:54.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- start start 2024-04-23T10:16:54.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1cc80c9b80 0x7f1cc81f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8151ca0 0x7f1cc81464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cc8152080 0x7f1cc8156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc8157e10 con 0x7f1cc8151ca0 2024-04-23T10:16:54.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc8158ce0 con 0x7f1cc8152080 2024-04-23T10:16:54.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1ccccbb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc80ca860 con 0x7f1cc80c9b80 2024-04-23T10:16:54.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8151ca0 0x7f1cc81464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8151ca0 0x7f1cc81464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45286/0 (socket says 172.21.15.29:45286) 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 -- 172.21.15.29:0/1482012607 learned_addr learned my addr 172.21.15.29:0/1482012607 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc659c640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1cc80c9b80 0x7f1cc81f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc6d9d640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cc8152080 0x7f1cc8156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 -- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1cc80c9b80 msgr2=0x7f1cc81f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1cc80c9b80 0x7f1cc81f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 -- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cc8152080 msgr2=0x7f1cc8156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cc8152080 0x7f1cc8156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.577+0000 7f1cc5d9b640 1 -- 172.21.15.29:0/1482012607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc8157c00 con 0x7f1cc8151ca0 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cc5d9b640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8151ca0 0x7f1cc81464f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0b3040 tx=0x7f1cbc01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cb6ffd640 1 -- 172.21.15.29:0/1482012607 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0b5070 con 0x7f1cc8151ca0 2024-04-23T10:16:54.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1ccccbb640 1 -- 172.21.15.29:0/1482012607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc81e4b90 con 0x7f1cc8151ca0 2024-04-23T10:16:54.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cb6ffd640 1 -- 172.21.15.29:0/1482012607 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0b0c20 con 0x7f1cc8151ca0 2024-04-23T10:16:54.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cb6ffd640 1 -- 172.21.15.29:0/1482012607 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0bb410 con 0x7f1cc8151ca0 2024-04-23T10:16:54.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1ccccbb640 1 -- 172.21.15.29:0/1482012607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc81e5150 con 0x7f1cc8151ca0 2024-04-23T10:16:54.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cb4ff9640 1 -- 172.21.15.29:0/1482012607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca00052a0 con 0x7f1cc8151ca0 2024-04-23T10:16:54.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cb6ffd640 1 -- 172.21.15.29:0/1482012607 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1cbc0c2060 con 0x7f1cc8151ca0 2024-04-23T10:16:54.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cb6ffd640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1ca8068380 0x7f1ca806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cb6ffd640 1 -- 172.21.15.29:0/1482012607 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1cbc124000 con 0x7f1cc8151ca0 2024-04-23T10:16:54.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.581+0000 7f1cc659c640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1ca8068380 0x7f1ca806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.585+0000 7f1cc659c640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1ca8068380 0x7f1ca806a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8004e30 tx=0x7f1cb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.585+0000 7f1cb6ffd640 1 -- 172.21.15.29:0/1482012607 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1cbc018870 con 0x7f1cc8151ca0 2024-04-23T10:16:54.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.777+0000 7f1cb4ff9640 1 -- 172.21.15.29:0/1482012607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ca0005860 con 0x7f1cc8151ca0 2024-04-23T10:16:54.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb6ffd640 1 -- 172.21.15.29:0/1482012607 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f1cbc0f4110 con 0x7f1cc8151ca0 2024-04-23T10:16:54.782 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:16:54.783 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:16:54.783 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:16:54.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 -- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1ca8068380 msgr2=0x7f1ca806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1ca8068380 0x7f1ca806a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8004e30 tx=0x7f1cb8009040 comp rx=0 tx=0).stop 2024-04-23T10:16:54.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 -- 172.21.15.29:0/1482012607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8151ca0 msgr2=0x7f1cc81464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8151ca0 0x7f1cc81464f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0b3040 tx=0x7f1cbc01bab0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 -- 172.21.15.29:0/1482012607 shutdown_connections 2024-04-23T10:16:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1ca8068380 0x7f1ca806a840 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8004e30 tx=0x7f1cb8009040 comp rx=0 tx=0).stop 2024-04-23T10:16:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cc8152080 0x7f1cc8156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cc8151ca0 0x7f1cc81464f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 --2- 172.21.15.29:0/1482012607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1cc80c9b80 0x7f1cc81f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 -- 172.21.15.29:0/1482012607 >> 172.21.15.29:0/1482012607 conn(0x7f1cc806b9e0 msgr2=0x7f1cc8073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 -- 172.21.15.29:0/1482012607 shutdown_connections 2024-04-23T10:16:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.781+0000 7f1cb4ff9640 1 -- 172.21.15.29:0/1482012607 wait complete. 2024-04-23T10:16:54.801 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 82.45 --await-for 42.0' 2024-04-23T10:16:54.801 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 82.45 --await-for 42.0 2024-04-23T10:16:54.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17db5c9640 1 Processor -- start 2024-04-23T10:16:54.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17db5c9640 1 -- start start 2024-04-23T10:16:54.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17db5c9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17d4144260 0x7f17d415b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17db5c9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17d40c9340 0x7f17d40c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17db5c9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17d4075ca0 con 0x7f17d40c7ee0 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17db5c9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f17d415bea0 con 0x7f17d40c9340 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17d8b64640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f17d40c7ee0 0x7f17d4074d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54472/0 (socket says 172.21.15.29:54472) 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17d8b64640 1 -- 172.21.15.29:0/1193256918 learned_addr learned my addr 172.21.15.29:0/1193256918 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17db5c9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f17d415e7f0 con 0x7f17d4144260 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17d9b66640 1 --2- 172.21.15.29:0/1193256918 >> v2:172.21.15.29:3300/0 conn(0x7f17d40c9340 0x7f17d40c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.909+0000 7f17d9365640 1 --2- 172.21.15.29:0/1193256918 >> v2:172.21.15.72:3300/0 conn(0x7f17d4144260 0x7f17d415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17d9b66640 1 -- 172.21.15.29:0/1193256918 >> v2:172.21.15.72:3300/0 conn(0x7f17d4144260 msgr2=0x7f17d415b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17d9b66640 1 --2- 172.21.15.29:0/1193256918 >> v2:172.21.15.72:3300/0 conn(0x7f17d4144260 0x7f17d415b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17d9b66640 1 -- 172.21.15.29:0/1193256918 >> v1:172.21.15.29:6789/0 conn(0x7f17d40c7ee0 legacy=0x7f17d4074d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17d9b66640 1 -- 172.21.15.29:0/1193256918 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d415ead0 con 0x7f17d40c9340 2024-04-23T10:16:54.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17d9b66640 1 --2- 172.21.15.29:0/1193256918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d40c9760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f17d406df10 tx=0x7f17cc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f5d8b2f0f7a9ba server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17cbfff640 1 -- 172.21.15.29:0/1193256918 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0b2070 con 0x7f17d40c9340 2024-04-23T10:16:54.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17cbfff640 1 -- 172.21.15.29:0/1193256918 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc0a57d0 con 0x7f17d40c9340 2024-04-23T10:16:54.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17cbfff640 1 -- 172.21.15.29:0/1193256918 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0a5be0 con 0x7f17d40c9340 2024-04-23T10:16:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17db5c9640 1 -- 172.21.15.29:0/1193256918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 msgr2=0x7f17d40c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.913+0000 7f17db5c9640 1 --2- 172.21.15.29:0/1193256918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d40c9760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f17d406df10 tx=0x7f17cc01c910 comp rx=0 tx=0).stop 2024-04-23T10:16:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- 172.21.15.29:0/1193256918 shutdown_connections 2024-04-23T10:16:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 --2- 172.21.15.29:0/1193256918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d40c9760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 --2- 172.21.15.29:0/1193256918 >> v2:172.21.15.72:3300/0 conn(0x7f17d4144260 0x7f17d415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- 172.21.15.29:0/1193256918 >> 172.21.15.29:0/1193256918 conn(0x7f17d40cd560 msgr2=0x7f17d40cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:54.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- 172.21.15.29:0/1193256918 shutdown_connections 2024-04-23T10:16:54.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- 172.21.15.29:0/1193256918 wait complete. 2024-04-23T10:16:54.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 Processor -- start 2024-04-23T10:16:54.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- start start 2024-04-23T10:16:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17d40c7ee0 0x7f17d4142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17d4144260 0x7f17d415c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f17d415f370 con 0x7f17d40c9340 2024-04-23T10:16:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f17d415e4d0 con 0x7f17d4144260 2024-04-23T10:16:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f17d4144640 con 0x7f17d40c7ee0 2024-04-23T10:16:54.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d415a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45306/0 (socket says 172.21.15.29:45306) 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 -- 172.21.15.29:0/3002497756 learned_addr learned my addr 172.21.15.29:0/3002497756 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d9365640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17d40c7ee0 0x7f17d4142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d9b66640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17d4144260 0x7f17d415c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 -- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17d40c7ee0 msgr2=0x7f17d4142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17d40c7ee0 0x7f17d4142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 -- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17d4144260 msgr2=0x7f17d415c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17d4144260 0x7f17d415c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 -- 172.21.15.29:0/3002497756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d4159a20 con 0x7f17d40c9340 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d9b66640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17d4144260 0x7f17d415c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17d8b64640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d415a4c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c440 tx=0x7f17c400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17c9ffb640 1 -- 172.21.15.29:0/3002497756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4017070 con 0x7f17d40c9340 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17c9ffb640 1 -- 172.21.15.29:0/3002497756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c4005d10 con 0x7f17d40c9340 2024-04-23T10:16:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17c9ffb640 1 -- 172.21.15.29:0/3002497756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4007310 con 0x7f17d40c9340 2024-04-23T10:16:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- 172.21.15.29:0/3002497756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d4135fd0 con 0x7f17d40c9340 2024-04-23T10:16:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.917+0000 7f17db5c9640 1 -- 172.21.15.29:0/3002497756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d4159cc0 con 0x7f17d40c9340 2024-04-23T10:16:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17c9ffb640 1 -- 172.21.15.29:0/3002497756 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17c401a070 con 0x7f17d40c9340 2024-04-23T10:16:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17de74b000 1 Processor -- start 2024-04-23T10:16:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17de74b000 1 -- start start 2024-04-23T10:16:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17c9ffb640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f17b8068380 0x7f17b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17c9ffb640 1 -- 172.21.15.29:0/3002497756 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f17c4086080 con 0x7f17d40c9340 2024-04-23T10:16:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f17b8068380 0x7f17b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17de74b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 0x556d658f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f17b8068380 0x7f17b806a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0af000 tx=0x7f17cc0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17de74b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f96c0 0x556d658f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17de74b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658fa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17de74b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d657a02a0 con 0x556d658f9fe0 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17de74b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556d657065f0 con 0x556d658f96c0 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17de74b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556d656a1820 con 0x556d658f4600 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658fa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45316/0 (socket says 172.21.15.29:45316) 2024-04-23T10:16:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 -- 172.21.15.29:0/2931551036 learned_addr learned my addr 172.21.15.29:0/2931551036 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:54.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d8b64640 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f96c0 0x556d658f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9365640 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 0x556d658f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 -- 172.21.15.29:0/2931551036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 msgr2=0x556d658f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 0x556d658f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 -- 172.21.15.29:0/2931551036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f96c0 msgr2=0x556d658f9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f96c0 0x556d658f9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.921+0000 7f17d9b66640 1 -- 172.21.15.29:0/2931551036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d6574cc00 con 0x556d658f9fe0 2024-04-23T10:16:54.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658fa3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0982f0 tx=0x7f17cc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1150c74f58e497 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17db5c9640 1 -- 172.21.15.29:0/2931551036 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0c8070 con 0x556d658f9fe0 2024-04-23T10:16:54.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17db5c9640 1 -- 172.21.15.29:0/2931551036 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc0b8670 con 0x556d658f9fe0 2024-04-23T10:16:54.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17db5c9640 1 -- 172.21.15.29:0/2931551036 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0b2040 con 0x556d658f9fe0 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- 172.21.15.29:0/2931551036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 msgr2=0x556d658fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658fa3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0982f0 tx=0x7f17cc004ac0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- 172.21.15.29:0/2931551036 shutdown_connections 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658fa3c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f96c0 0x556d658f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 --2- 172.21.15.29:0/2931551036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 0x556d658f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- 172.21.15.29:0/2931551036 >> 172.21.15.29:0/2931551036 conn(0x556d658f5470 msgr2=0x556d658f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- 172.21.15.29:0/2931551036 shutdown_connections 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- 172.21.15.29:0/2931551036 wait complete. 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- start start 2024-04-23T10:16:54.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 Processor -- start 2024-04-23T10:16:54.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 0x556d658f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d656b1c60 con 0x556d658f9fe0 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556d65788bf0 con 0x556d658f4600 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556d657c3560 con 0x556d658f96c0 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17de74b000 10 client.0 _ll_register_callbacks cb 0x556d656dd570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9365640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d8b64640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 0x556d658f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45320/0 (socket says 172.21.15.29:45320) 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9365640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:40186/0 (socket says 172.21.15.29:40186) 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 -- 172.21.15.29:0/3289752168 learned_addr learned my addr 172.21.15.29:0/3289752168 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 -- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 msgr2=0x556d658f3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 0x556d658f3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 -- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 msgr2=0x556d658f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.925+0000 7f17d9b66640 1 -- 172.21.15.29:0/3289752168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d65741630 con 0x556d658f9fe0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17d9b66640 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658ff620 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f17cc01cdf0 tx=0x7f17cc01b150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f3f50a64e98bae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 1 -- 172.21.15.29:0/3289752168 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0c8040 con 0x556d658f9fe0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 1 -- 172.21.15.29:0/3289752168 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f17cc0b8820 con 0x556d658f9fe0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 1 -- 172.21.15.29:0/3289752168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17cc0b8670 con 0x556d658f9fe0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 1 -- 172.21.15.29:0/3289752168 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f17cc0db050 con 0x556d658f9fe0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 10 client.5163 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 1 -- 172.21.15.29:0/3289752168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556d656a6490 con 0x556d658f9fe0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 1 -- 172.21.15.29:0/3289752168 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc0d3070 con 0x556d658f9fe0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 1 -- 172.21.15.29:0/3289752168 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f17cc0de020 con 0x556d658f9fe0 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 10 client.5163 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:54.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 10 client.5163 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:16:54.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 20 client.5163 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:54.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556d659003c0 0x556d659007a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 4 client.5163 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:54.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 1 -- 172.21.15.29:0/3289752168 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f17cc0b8670 con 0x556d659003c0 2024-04-23T10:16:54.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17d9365640 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556d659003c0 0x556d659007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 10 client.5163 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:54.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17d9365640 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556d659003c0 0x556d659007a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26303df939a8ff72 server_cookie=739fbb0428e0da00 in_seq=0 out_seq=0 2024-04-23T10:16:54.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 1 -- 172.21.15.29:0/3289752168 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f17cc0b8670 con 0x556d659003c0 2024-04-23T10:16:54.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17affff640 10 client.5163 handle_command_reply: tid=0 2024-04-23T10:16:54.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 1 client.5163 shutdown 2024-04-23T10:16:54.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 1 -- 172.21.15.29:0/3289752168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 msgr2=0x556d658ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.929+0000 7f17de74b000 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658ff620 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f17cc01cdf0 tx=0x7f17cc01b150 comp rx=0 tx=0).stop 2024-04-23T10:16:54.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 1 -- 172.21.15.29:0/3289752168 shutdown_connections 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556d659003c0 0x556d659007a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658ff620 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 0x556d658f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 1 --2- 172.21.15.29:0/3289752168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17affff640 0 client.5163 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 1 -- 172.21.15.29:0/3289752168 >> 172.21.15.29:0/3289752168 conn(0x556d658f5470 msgr2=0x556d658f86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 1 -- 172.21.15.29:0/3289752168 shutdown_connections 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 1 -- 172.21.15.29:0/3289752168 wait complete. 2024-04-23T10:16:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.933+0000 7f17de74b000 20 client.5163 trim_cache size 0 max 16384 2024-04-23T10:16:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 Processor -- start 2024-04-23T10:16:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- start start 2024-04-23T10:16:54.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 0x556d65914010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f96c0 0x556d65914550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f9fe0 0x556d65914a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f17d42015c0 con 0x556d658f96c0 2024-04-23T10:16:54.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4201c90 con 0x556d658f9fe0 2024-04-23T10:16:54.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f17d41f7f80 con 0x556d658f4600 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f96c0 0x556d65914550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f96c0 0x556d65914550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45324/0 (socket says 172.21.15.29:45324) 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 -- 172.21.15.29:0/2860960260 learned_addr learned my addr 172.21.15.29:0/2860960260 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 -- 172.21.15.29:0/2860960260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 msgr2=0x556d65914010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 --2- 172.21.15.29:0/2860960260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 0x556d65914010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d9b66640 1 --2- 172.21.15.29:0/2860960260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f9fe0 0x556d65914a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 -- 172.21.15.29:0/2860960260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f9fe0 msgr2=0x556d65914a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 --2- 172.21.15.29:0/2860960260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f9fe0 0x556d65914a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 -- 172.21.15.29:0/2860960260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d656a1a70 con 0x556d658f96c0 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17d8b64640 1 --2- 172.21.15.29:0/2860960260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f96c0 0x556d65914550 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001220 tx=0x7f17c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2e2dda24d27f7c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17b67fc640 1 -- 172.21.15.29:0/2860960260 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c408b060 con 0x556d658f96c0 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17b67fc640 1 -- 172.21.15.29:0/2860960260 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c405e670 con 0x556d658f96c0 2024-04-23T10:16:54.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17b67fc640 1 -- 172.21.15.29:0/2860960260 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4053d00 con 0x556d658f96c0 2024-04-23T10:16:54.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- 172.21.15.29:0/2860960260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f96c0 msgr2=0x556d65914550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 --2- 172.21.15.29:0/2860960260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f96c0 0x556d65914550 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001220 tx=0x7f17c4009040 comp rx=0 tx=0).stop 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- 172.21.15.29:0/2860960260 shutdown_connections 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 --2- 172.21.15.29:0/2860960260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f9fe0 0x556d65914a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 --2- 172.21.15.29:0/2860960260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f96c0 0x556d65914550 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 --2- 172.21.15.29:0/2860960260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f4600 0x556d65914010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- 172.21.15.29:0/2860960260 >> 172.21.15.29:0/2860960260 conn(0x556d658f5470 msgr2=0x556d6590aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- 172.21.15.29:0/2860960260 shutdown_connections 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.961+0000 7f17de74b000 1 -- 172.21.15.29:0/2860960260 wait complete. 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 -- start start 2024-04-23T10:16:54.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 Processor -- start 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 0x556d658bc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556d65705900 con 0x556d658f9fe0 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556d656d0e60 con 0x556d658f4600 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556d6570ac20 con 0x556d658f96c0 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 10 client.0 _ll_register_callbacks cb 0x7f17cc0c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45326/0 (socket says 172.21.15.29:45326) 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 -- 172.21.15.29:0/1048901487 learned_addr learned my addr 172.21.15.29:0/1048901487 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9365640 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d8b64640 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 0x556d658bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 -- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 msgr2=0x556d658bc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 0x556d658bc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 -- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 msgr2=0x556d658bc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658bc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 -- 172.21.15.29:0/1048901487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d65789080 con 0x556d658f9fe0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9b66640 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658bcdb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f17cc019aa0 tx=0x7f17cc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941b4b6d477f399e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17affff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17affff640 1 -- 172.21.15.29:0/1048901487 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0e5060 con 0x556d658f9fe0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17affff640 1 -- 172.21.15.29:0/1048901487 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f17cc0ce440 con 0x556d658f9fe0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 -- 172.21.15.29:0/1048901487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17c405e670 con 0x556d658f9fe0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17affff640 1 -- 172.21.15.29:0/1048901487 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f17cc0c8040 con 0x556d658f9fe0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 10 client.5169 fetch_fsmap learned FSMap version 18 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 -- 172.21.15.29:0/1048901487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556d656ac3e0 con 0x556d658f9fe0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17affff640 1 -- 172.21.15.29:0/1048901487 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc0d3040 con 0x556d658f9fe0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17affff640 1 -- 172.21.15.29:0/1048901487 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f17cc0de070 con 0x556d658f9fe0 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 10 client.5169 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:16:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 10 client.5169 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:16:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 20 client.5169 populate_metadata read hostname 'smithi029' 2024-04-23T10:16:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556d658bd770 0x556d65975a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 4 client.5169 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.45, "await_for": 42.0}] 2024-04-23T10:16:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17de74b000 1 -- 172.21.15.29:0/1048901487 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.45, "await_for": 42.0}) -- 0x7f17c405e670 con 0x556d658bd770 2024-04-23T10:16:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.965+0000 7f17d9365640 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556d658bd770 0x556d65975a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.969+0000 7f17affff640 10 client.5169 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.969+0000 7f17d9365640 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556d658bd770 0x556d65975a90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73197bec4fc9962c server_cookie=4d111d4588ee5c3d in_seq=0 out_seq=0 2024-04-23T10:16:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17affff640 1 -- 172.21.15.29:0/1048901487 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x7f17c405e670 con 0x556d658bd770 2024-04-23T10:16:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17affff640 10 client.5169 handle_command_reply: tid=0 2024-04-23T10:16:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 client.5169 shutdown 2024-04-23T10:16:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 -- 172.21.15.29:0/1048901487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 msgr2=0x556d658bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658bcdb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f17cc019aa0 tx=0x7f17cc0196b0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 -- 172.21.15.29:0/1048901487 shutdown_connections 2024-04-23T10:16:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556d658bd770 0x556d65975a90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556d658f9fe0 0x556d658bcdb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556d658f96c0 0x556d658bc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 --2- 172.21.15.29:0/1048901487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556d658f4600 0x556d658bc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 -- 172.21.15.29:0/1048901487 >> 172.21.15.29:0/1048901487 conn(0x556d658f5470 msgr2=0x556d6590a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17affff640 0 client.5169 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:16:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 -- 172.21.15.29:0/1048901487 shutdown_connections 2024-04-23T10:16:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 1 -- 172.21.15.29:0/1048901487 wait complete. 2024-04-23T10:16:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17de74b000 20 client.5169 trim_cache size 0 max 16384 2024-04-23T10:16:54.978 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:16:54.978 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:16:54.978 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 2, 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "4cb6c522": { 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 2, 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 82.5, 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:16:54.979 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:16:54.980 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:16:54.980 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:16:54.980 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:16:54.980 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:16:54.980 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:16:54.980 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:16:54.980 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:16:54.980 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 -- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f17b8068380 msgr2=0x7f17b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f17b8068380 0x7f17b806a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0af000 tx=0x7f17cc0a7070 comp rx=0 tx=0).stop 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 -- 172.21.15.29:0/3002497756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 msgr2=0x7f17d415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d415a4c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c440 tx=0x7f17c400c900 comp rx=0 tx=0).stop 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 -- 172.21.15.29:0/3002497756 shutdown_connections 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f17b8068380 0x7f17b806a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17d4144260 0x7f17d415c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40c9340 0x7f17d415a4c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 --2- 172.21.15.29:0/3002497756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17d40c7ee0 0x7f17d4142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.973+0000 7f17b77fe640 1 -- 172.21.15.29:0/3002497756 >> 172.21.15.29:0/3002497756 conn(0x7f17d40cd560 msgr2=0x7f17d40cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.977+0000 7f17b77fe640 1 -- 172.21.15.29:0/3002497756 shutdown_connections 2024-04-23T10:16:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:16:54.977+0000 7f17b77fe640 1 -- 172.21.15.29:0/3002497756 wait complete. 2024-04-23T10:16:54.993 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4cb6c522', quiesce took 0.5 seconds. Will release after: 22.45 2024-04-23T10:17:15.525 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:17:15.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:17:17.444 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:17:17.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe63e03640 1 Processor -- start 2024-04-23T10:17:17.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe63e03640 1 -- start start 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe63e03640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe5c153300 0x7efe5c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe63e03640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe5c074400 0x7efe5c06d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe63e03640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe5c067d30 con 0x7efe5c06e7f0 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe63e03640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7efe5c067ae0 con 0x7efe5c074400 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe63e03640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efe5c068010 con 0x7efe5c153300 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe6139e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe5c074400 0x7efe5c06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe6139e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efe5c074400 0x7efe5c06d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35406/0 (socket says 172.21.15.29:35406) 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe6139e640 1 -- 172.21.15.29:0/2315914877 learned_addr learned my addr 172.21.15.29:0/2315914877 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe61b9f640 1 --2- 172.21.15.29:0/2315914877 >> v2:172.21.15.72:3300/0 conn(0x7efe5c153300 0x7efe5c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe6139e640 1 -- 172.21.15.29:0/2315914877 >> v2:172.21.15.72:3300/0 conn(0x7efe5c153300 msgr2=0x7efe5c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe6139e640 1 --2- 172.21.15.29:0/2315914877 >> v2:172.21.15.72:3300/0 conn(0x7efe5c153300 0x7efe5c0c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe6139e640 1 -- 172.21.15.29:0/2315914877 >> v1:172.21.15.72:6789/0 conn(0x7efe5c06e7f0 legacy=0x7efe5c15c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe6139e640 1 -- 172.21.15.29:0/2315914877 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c0c8a10 con 0x7efe5c074400 2024-04-23T10:17:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe6139e640 1 --2- 172.21.15.29:0/2315914877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c074400 0x7efe5c06d920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efe5c070540 tx=0x7efe4c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8392db29ae9be900 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.565+0000 7efe60b9d640 1 -- 172.21.15.29:0/2315914877 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0aa5f0 con 0x7efe5c074400 2024-04-23T10:17:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe60b9d640 1 -- 172.21.15.29:0/2315914877 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4c0af070 con 0x7efe5c074400 2024-04-23T10:17:17.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe60b9d640 1 -- 172.21.15.29:0/2315914877 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0aa9b0 con 0x7efe5c074400 2024-04-23T10:17:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- 172.21.15.29:0/2315914877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c074400 msgr2=0x7efe5c06d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 --2- 172.21.15.29:0/2315914877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c074400 0x7efe5c06d920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efe5c070540 tx=0x7efe4c01c490 comp rx=0 tx=0).stop 2024-04-23T10:17:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- 172.21.15.29:0/2315914877 shutdown_connections 2024-04-23T10:17:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 --2- 172.21.15.29:0/2315914877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c074400 0x7efe5c06d920 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 --2- 172.21.15.29:0/2315914877 >> v2:172.21.15.72:3300/0 conn(0x7efe5c153300 0x7efe5c0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- 172.21.15.29:0/2315914877 >> 172.21.15.29:0/2315914877 conn(0x7efe5c0c9a90 msgr2=0x7efe5c0c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- 172.21.15.29:0/2315914877 shutdown_connections 2024-04-23T10:17:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- 172.21.15.29:0/2315914877 wait complete. 2024-04-23T10:17:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 Processor -- start 2024-04-23T10:17:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- start start 2024-04-23T10:17:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c06e7f0 0x7efe5c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5c074400 0x7efe5c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5c153300 0x7efe5c142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c166110 con 0x7efe5c06e7f0 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c1536e0 con 0x7efe5c153300 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efe5c166290 con 0x7efe5c074400 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c06e7f0 0x7efe5c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c06e7f0 0x7efe5c0c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35416/0 (socket says 172.21.15.29:35416) 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 -- 172.21.15.29:0/235203400 learned_addr learned my addr 172.21.15.29:0/235203400 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 -- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5c074400 msgr2=0x7efe5c155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5c074400 0x7efe5c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 -- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5c153300 msgr2=0x7efe5c142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe623a0640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5c153300 0x7efe5c142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5c153300 0x7efe5c142cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 -- 172.21.15.29:0/235203400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c146cf0 con 0x7efe5c06e7f0 2024-04-23T10:17:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe61b9f640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c06e7f0 0x7efe5c0c4370 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efe5800d620 tx=0x7efe5800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe527fc640 1 -- 172.21.15.29:0/235203400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5800b620 con 0x7efe5c06e7f0 2024-04-23T10:17:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe527fc640 1 -- 172.21.15.29:0/235203400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe58019070 con 0x7efe5c06e7f0 2024-04-23T10:17:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5c1565e0 con 0x7efe5c06e7f0 2024-04-23T10:17:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe527fc640 1 -- 172.21.15.29:0/235203400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5800b9e0 con 0x7efe5c06e7f0 2024-04-23T10:17:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.569+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5c154b70 con 0x7efe5c06e7f0 2024-04-23T10:17:17.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.573+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe5c0693c0 con 0x7efe5c06e7f0 2024-04-23T10:17:17.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.573+0000 7efe527fc640 1 -- 172.21.15.29:0/235203400 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe5800bb80 con 0x7efe5c06e7f0 2024-04-23T10:17:17.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.573+0000 7efe527fc640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efe40068380 0x7efe4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.573+0000 7efe527fc640 1 -- 172.21.15.29:0/235203400 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efe58087290 con 0x7efe5c06e7f0 2024-04-23T10:17:17.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.573+0000 7efe6139e640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efe40068380 0x7efe4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.573+0000 7efe6139e640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efe40068380 0x7efe4006a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0ae000 tx=0x7efe4c004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.577+0000 7efe527fc640 1 -- 172.21.15.29:0/235203400 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe58057420 con 0x7efe5c06e7f0 2024-04-23T10:17:17.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe5c073f00 con 0x7efe5c06e7f0 2024-04-23T10:17:17.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe527fc640 1 -- 172.21.15.29:0/235203400 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7efe58056d20 con 0x7efe5c06e7f0 2024-04-23T10:17:17.772 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:17:17.772 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:17:17.772 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:17:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efe40068380 msgr2=0x7efe4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efe40068380 0x7efe4006a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0ae000 tx=0x7efe4c004740 comp rx=0 tx=0).stop 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c06e7f0 msgr2=0x7efe5c0c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c06e7f0 0x7efe5c0c4370 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efe5800d620 tx=0x7efe5800dae0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 shutdown_connections 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efe40068380 0x7efe4006a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5c153300 0x7efe5c142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5c074400 0x7efe5c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 --2- 172.21.15.29:0/235203400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe5c06e7f0 0x7efe5c0c4370 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 >> 172.21.15.29:0/235203400 conn(0x7efe5c0c9a90 msgr2=0x7efe5c0c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 shutdown_connections 2024-04-23T10:17:17.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.769+0000 7efe63e03640 1 -- 172.21.15.29:0/235203400 wait complete. 2024-04-23T10:17:17.788 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id 4cb6c522 --release --await' 2024-04-23T10:17:17.788 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id 4cb6c522 --release --await 2024-04-23T10:17:17.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f054e9c9640 1 Processor -- start 2024-04-23T10:17:17.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f054e9c9640 1 -- start start 2024-04-23T10:17:17.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f054e9c9640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ced60 0x7f0548154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f054e9c9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0548074330 0x7f0548155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f054e9c9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05480740c0 con 0x7f05480ce980 2024-04-23T10:17:17.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f054e9c9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f05480c9c20 con 0x7f0548074330 2024-04-23T10:17:17.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f054e9c9640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f054815b5e0 con 0x7f05480ced60 2024-04-23T10:17:17.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f054cf66640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0548074330 0x7f0548155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f05477fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ced60 0x7f0548154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f0547fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f05480ce980 0x7f054815ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:42602/0 (socket says 172.21.15.29:42602) 2024-04-23T10:17:17.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.917+0000 7f0547fff640 1 -- 172.21.15.29:0/3931231356 learned_addr learned my addr 172.21.15.29:0/3931231356 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:17:17.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f05477fe640 1 -- 172.21.15.29:0/3931231356 >> v2:172.21.15.72:3300/0 conn(0x7f0548074330 msgr2=0x7f0548155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f05477fe640 1 --2- 172.21.15.29:0/3931231356 >> v2:172.21.15.72:3300/0 conn(0x7f0548074330 0x7f0548155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f05477fe640 1 -- 172.21.15.29:0/3931231356 >> v1:172.21.15.72:6789/0 conn(0x7f05480ce980 legacy=0x7f054815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f05477fe640 1 -- 172.21.15.29:0/3931231356 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054815b2b0 con 0x7f05480ced60 2024-04-23T10:17:17.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f05477fe640 1 --2- 172.21.15.29:0/3931231356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ced60 0x7f0548154ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f053c0097c0 tx=0x7f053c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d889d5a3a02e1c03 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f0546ffd640 1 -- 172.21.15.29:0/3931231356 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0b5070 con 0x7f05480ced60 2024-04-23T10:17:17.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f0546ffd640 1 -- 172.21.15.29:0/3931231356 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c0a8990 con 0x7f05480ced60 2024-04-23T10:17:17.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f0546ffd640 1 -- 172.21.15.29:0/3931231356 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0a8d60 con 0x7f05480ced60 2024-04-23T10:17:17.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f054e9c9640 1 -- 172.21.15.29:0/3931231356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ced60 msgr2=0x7f0548154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3931231356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ced60 0x7f0548154ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f053c0097c0 tx=0x7f053c01ec90 comp rx=0 tx=0).stop 2024-04-23T10:17:17.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f054e9c9640 1 -- 172.21.15.29:0/3931231356 shutdown_connections 2024-04-23T10:17:17.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3931231356 >> v2:172.21.15.72:3300/0 conn(0x7f0548074330 0x7f0548155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3931231356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ced60 0x7f0548154ee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f054e9c9640 1 -- 172.21.15.29:0/3931231356 >> 172.21.15.29:0/3931231356 conn(0x7f0548070f60 msgr2=0x7f0548071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f054e9c9640 1 -- 172.21.15.29:0/3931231356 shutdown_connections 2024-04-23T10:17:17.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.921+0000 7f054e9c9640 1 -- 172.21.15.29:0/3931231356 wait complete. 2024-04-23T10:17:17.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 Processor -- start 2024-04-23T10:17:17.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 -- start start 2024-04-23T10:17:17.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0548074330 0x7f054814c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ce980 0x7f054815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05480ced60 0x7f05481f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0548073de0 con 0x7f0548074330 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0548073b00 con 0x7f05480ced60 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f05480ca910 con 0x7f05480ce980 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0548074330 0x7f054814c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0548074330 0x7f054814c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35418/0 (socket says 172.21.15.29:35418) 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 -- 172.21.15.29:0/3258274634 learned_addr learned my addr 172.21.15.29:0/3258274634 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f05477fe640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ce980 0x7f054815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054cf66640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05480ced60 0x7f05481f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 -- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ce980 msgr2=0x7f054815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ce980 0x7f054815d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 -- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05480ced60 msgr2=0x7f05481f14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05480ced60 0x7f05481f14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 -- 172.21.15.29:0/3258274634 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054815f4f0 con 0x7f0548074330 2024-04-23T10:17:17.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0547fff640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0548074330 0x7f054814c370 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f053800c420 tx=0x7f053800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0544ff9640 1 -- 172.21.15.29:0/3258274634 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538017070 con 0x7f0548074330 2024-04-23T10:17:17.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0544ff9640 1 -- 172.21.15.29:0/3258274634 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0538005cf0 con 0x7f0548074330 2024-04-23T10:17:17.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 -- 172.21.15.29:0/3258274634 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054814eb70 con 0x7f0548074330 2024-04-23T10:17:17.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f0544ff9640 1 -- 172.21.15.29:0/3258274634 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380072f0 con 0x7f0548074330 2024-04-23T10:17:17.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.925+0000 7f054e9c9640 1 -- 172.21.15.29:0/3258274634 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05480c85b0 con 0x7f0548074330 2024-04-23T10:17:17.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0544ff9640 1 -- 172.21.15.29:0/3258274634 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f053801a070 con 0x7f0548074330 2024-04-23T10:17:17.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0544ff9640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0534068380 0x7f053406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0544ff9640 1 -- 172.21.15.29:0/3258274634 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0538086060 con 0x7f0548074330 2024-04-23T10:17:17.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0534068380 0x7f053406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 Processor -- start 2024-04-23T10:17:17.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- start start 2024-04-23T10:17:17.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0534068380 0x7f053406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f053c0b2000 tx=0x7f053c0aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083749c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083752e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 0x558a083b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558a081bc660 con 0x558a08374f00 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558a081615d0 con 0x558a083b0120 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558a081b8620 con 0x558a083ab8a0 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083752e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35434/0 (socket says 172.21.15.29:35434) 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 -- 172.21.15.29:0/1293738503 learned_addr learned my addr 172.21.15.29:0/1293738503 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0547fff640 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f054cf66640 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 0x558a083b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 -- 172.21.15.29:0/1293738503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 msgr2=0x558a083749c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083749c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 -- 172.21.15.29:0/1293738503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 msgr2=0x558a083b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 0x558a083b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 -- 172.21.15.29:0/1293738503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a08195bd0 con 0x558a08374f00 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f05477fe640 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083752e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f053c009580 tx=0x7f053c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314431f7a348cde0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f052dffb640 1 -- 172.21.15.29:0/1293738503 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0b5040 con 0x558a08374f00 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f052dffb640 1 -- 172.21.15.29:0/1293738503 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c0a8ce0 con 0x558a08374f00 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f052dffb640 1 -- 172.21.15.29:0/1293738503 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0ba640 con 0x558a08374f00 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- 172.21.15.29:0/1293738503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 msgr2=0x558a083752e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083752e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f053c009580 tx=0x7f053c004740 comp rx=0 tx=0).stop 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- 172.21.15.29:0/1293738503 shutdown_connections 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 0x558a083b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083752e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 --2- 172.21.15.29:0/1293738503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083749c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- 172.21.15.29:0/1293738503 >> 172.21.15.29:0/1293738503 conn(0x558a08256b00 msgr2=0x558a083adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- 172.21.15.29:0/1293738503 shutdown_connections 2024-04-23T10:17:17.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.929+0000 7f0551b4b000 1 -- 172.21.15.29:0/1293738503 wait complete. 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 -- start start 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 Processor -- start 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083aa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083aab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 0x558a0836f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558a08279d40 con 0x558a08374f00 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558a08176eb0 con 0x558a083b0120 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558a081b72a0 con 0x558a083ab8a0 2024-04-23T10:17:17.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 10 client.0 _ll_register_callbacks cb 0x558a0835aa90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35448/0 (socket says 172.21.15.29:35448) 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 -- 172.21.15.29:0/3425208644 learned_addr learned my addr 172.21.15.29:0/3425208644 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f054cf66640 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 0x558a0836f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f05477fe640 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 -- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 msgr2=0x558a083aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 -- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 msgr2=0x558a0836f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 0x558a0836f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 -- 172.21.15.29:0/3425208644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a08202b30 con 0x558a08374f00 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f05477fe640 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0547fff640 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083aa650 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f05380520a0 tx=0x7f0538055d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f424faac7efa87ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0526ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0526ffd640 1 -- 172.21.15.29:0/3425208644 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538007490 con 0x558a08374f00 2024-04-23T10:17:17.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0526ffd640 1 -- 172.21.15.29:0/3425208644 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0538007630 con 0x558a08374f00 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 -- 172.21.15.29:0/3425208644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a08156060 con 0x558a08374f00 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0526ffd640 1 -- 172.21.15.29:0/3425208644 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f053807db60 con 0x558a08374f00 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 10 client.5184 fetch_fsmap learned FSMap version 18 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 -- 172.21.15.29:0/3425208644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558a0815bb70 con 0x558a08374f00 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0526ffd640 1 -- 172.21.15.29:0/3425208644 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558a08156060 con 0x558a08374f00 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0526ffd640 1 -- 172.21.15.29:0/3425208644 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f0538055090 con 0x558a08374f00 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 10 client.5184 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 10 client.5184 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 20 client.5184 populate_metadata read hostname 'smithi029' 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558a083706a0 0x558a08370ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 4 client.5184 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0551b4b000 1 -- 172.21.15.29:0/3425208644 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a08194e30 con 0x558a083706a0 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f05477fe640 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558a083706a0 0x558a08370ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f05477fe640 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558a083706a0 0x558a08370ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e23ea91ef6ab3885 server_cookie=cb85c814ca11b4ad in_seq=0 out_seq=0 2024-04-23T10:17:17.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.933+0000 7f0526ffd640 10 client.5184 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:17.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0526ffd640 1 -- 172.21.15.29:0/3425208644 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a08194e30 con 0x558a083706a0 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0526ffd640 10 client.5184 handle_command_reply: tid=0 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 client.5184 shutdown 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 -- 172.21.15.29:0/3425208644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 msgr2=0x558a083aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083aa650 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f05380520a0 tx=0x7f0538055d00 comp rx=0 tx=0).stop 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 -- 172.21.15.29:0/3425208644 shutdown_connections 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558a083706a0 0x558a08370ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a083b0120 0x558a0836f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0526ffd640 0 client.5184 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 --2- 172.21.15.29:0/3425208644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a08374f00 0x558a083aa650 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 -- 172.21.15.29:0/3425208644 >> 172.21.15.29:0/3425208644 conn(0x558a08256b00 msgr2=0x558a083af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 -- 172.21.15.29:0/3425208644 shutdown_connections 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 1 -- 172.21.15.29:0/3425208644 wait complete. 2024-04-23T10:17:17.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.937+0000 7f0551b4b000 20 client.5184 trim_cache size 0 max 16384 2024-04-23T10:17:17.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 Processor -- start 2024-04-23T10:17:17.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- start start 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083706a0 0x558a08419af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 0x558a0841a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083ab8a0 0x558a0841a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f05481fe730 con 0x558a083ab8a0 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f05481fee00 con 0x558a08374f00 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f05481fceb0 con 0x558a083706a0 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083ab8a0 0x558a0841a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083ab8a0 0x558a0841a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35460/0 (socket says 172.21.15.29:35460) 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 -- 172.21.15.29:0/925469594 learned_addr learned my addr 172.21.15.29:0/925469594 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 -- 172.21.15.29:0/925469594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083706a0 msgr2=0x558a08419af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 --2- 172.21.15.29:0/925469594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083706a0 0x558a08419af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f05477fe640 1 --2- 172.21.15.29:0/925469594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 0x558a0841a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 -- 172.21.15.29:0/925469594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 msgr2=0x558a0841a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 --2- 172.21.15.29:0/925469594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 0x558a0841a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 -- 172.21.15.29:0/925469594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a0823e5e0 con 0x558a083ab8a0 2024-04-23T10:17:17.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f054cf66640 1 --2- 172.21.15.29:0/925469594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083ab8a0 0x558a0841a570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0540003db0 tx=0x7f0540009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb7c8d742eb631 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f052d7fa640 1 -- 172.21.15.29:0/925469594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05400178e0 con 0x558a083ab8a0 2024-04-23T10:17:17.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f052d7fa640 1 -- 172.21.15.29:0/925469594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540017a80 con 0x558a083ab8a0 2024-04-23T10:17:17.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f052d7fa640 1 -- 172.21.15.29:0/925469594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054001f400 con 0x558a083ab8a0 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- 172.21.15.29:0/925469594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083ab8a0 msgr2=0x558a0841a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 --2- 172.21.15.29:0/925469594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083ab8a0 0x558a0841a570 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0540003db0 tx=0x7f0540009750 comp rx=0 tx=0).stop 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- 172.21.15.29:0/925469594 shutdown_connections 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 --2- 172.21.15.29:0/925469594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083ab8a0 0x558a0841a570 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 --2- 172.21.15.29:0/925469594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 0x558a0841a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 --2- 172.21.15.29:0/925469594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083706a0 0x558a08419af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- 172.21.15.29:0/925469594 >> 172.21.15.29:0/925469594 conn(0x558a08256b00 msgr2=0x558a08372a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- 172.21.15.29:0/925469594 shutdown_connections 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.953+0000 7f0551b4b000 1 -- 172.21.15.29:0/925469594 wait complete. 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 -- start start 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 Processor -- start 2024-04-23T10:17:17.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083706a0 0x558a083c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 0x558a083c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558a081bb970 con 0x558a083706a0 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558a081718f0 con 0x558a08374f00 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558a081c0c90 con 0x558a083ab8a0 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 10 client.0 _ll_register_callbacks cb 0x7f053c0b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083706a0 0x558a083c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083706a0 0x558a083c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35472/0 (socket says 172.21.15.29:35472) 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 -- 172.21.15.29:0/2528881217 learned_addr learned my addr 172.21.15.29:0/2528881217 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 -- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 msgr2=0x558a083c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f05477fe640 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 0x558a083c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 -- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 msgr2=0x558a083c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:17.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 0x558a083c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 -- 172.21.15.29:0/2528881217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a0814eae0 con 0x558a083706a0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0547fff640 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083706a0 0x558a083c9340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0538055ac0 tx=0x7f0538000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80098e91e6ecbfe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0526ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0526ffd640 1 -- 172.21.15.29:0/2528881217 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538074060 con 0x558a083706a0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0526ffd640 1 -- 172.21.15.29:0/2528881217 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0538007690 con 0x558a083706a0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 -- 172.21.15.29:0/2528881217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0540017a80 con 0x558a083706a0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0526ffd640 1 -- 172.21.15.29:0/2528881217 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0538079050 con 0x558a083706a0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 10 client.5190 fetch_fsmap learned FSMap version 18 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 -- 172.21.15.29:0/2528881217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558a08151d80 con 0x558a083706a0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0526ffd640 1 -- 172.21.15.29:0/2528881217 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540017a80 con 0x558a083706a0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0526ffd640 1 -- 172.21.15.29:0/2528881217 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f053807c020 con 0x558a083706a0 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 10 client.5190 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 10 client.5190 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 20 client.5190 populate_metadata read hostname 'smithi029' 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558a083b0120 0x558a083ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 4 client.5190 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4cb6c522", "release": true, "await": true}] 2024-04-23T10:17:17.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0551b4b000 1 -- 172.21.15.29:0/2528881217 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4cb6c522", "release": true, "await": true}) -- 0x558a0815a0d0 con 0x558a083b0120 2024-04-23T10:17:17.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f05477fe640 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558a083b0120 0x558a083ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f0526ffd640 10 client.5190 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:17.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.957+0000 7f05477fe640 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558a083b0120 0x558a083ca7e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f47135729716d778 server_cookie=9adaa1c5a3fd7f9f in_seq=0 out_seq=0 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0526ffd640 1 -- 172.21.15.29:0/2528881217 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x558a0815a0d0 con 0x558a083b0120 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0526ffd640 10 client.5190 handle_command_reply: tid=0 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 client.5190 shutdown 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 -- 172.21.15.29:0/2528881217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083706a0 msgr2=0x558a083c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083706a0 0x558a083c9340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0538055ac0 tx=0x7f0538000bd0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 -- 172.21.15.29:0/2528881217 shutdown_connections 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558a083b0120 0x558a083ca7e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558a083ab8a0 0x558a083c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a08374f00 0x558a083c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0526ffd640 0 client.5190 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 --2- 172.21.15.29:0/2528881217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558a083706a0 0x558a083c9340 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 -- 172.21.15.29:0/2528881217 >> 172.21.15.29:0/2528881217 conn(0x558a08256b00 msgr2=0x558a0836f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 -- 172.21.15.29:0/2528881217 shutdown_connections 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 1 -- 172.21.15.29:0/2528881217 wait complete. 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f0551b4b000 20 client.5190 trim_cache size 0 max 16384 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 4, 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stdout: "4cb6c522": { 2024-04-23T10:17:17.966 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 4, 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 82.5, 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:17.967 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:17.968 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:17.968 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:17.968 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:17:17.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 -- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0534068380 msgr2=0x7f053406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0534068380 0x7f053406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f053c0b2000 tx=0x7f053c0aa070 comp rx=0 tx=0).stop 2024-04-23T10:17:17.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 -- 172.21.15.29:0/3258274634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0548074330 msgr2=0x7f054814c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0548074330 0x7f054814c370 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f053800c420 tx=0x7f053800c8e0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 -- 172.21.15.29:0/3258274634 shutdown_connections 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0534068380 0x7f053406a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05480ced60 0x7f05481f14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05480ce980 0x7f054815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 --2- 172.21.15.29:0/3258274634 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0548074330 0x7f054814c370 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 -- 172.21.15.29:0/3258274634 >> 172.21.15.29:0/3258274634 conn(0x7f0548070f60 msgr2=0x7f05480c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 -- 172.21.15.29:0/3258274634 shutdown_connections 2024-04-23T10:17:17.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:17.961+0000 7f054e9c9640 1 -- 172.21.15.29:0/3258274634 wait complete. 2024-04-23T10:17:17.979 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4cb6c522', seconds elapsed: 23.5 2024-04-23T10:17:17.979 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.45 2024-04-23T10:17:17.979 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:17:18.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.077+0000 7fb82ca6a640 1 Processor -- start 2024-04-23T10:17:18.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.077+0000 7fb82ca6a640 1 -- start start 2024-04-23T10:17:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.077+0000 7fb82ca6a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8281518f0 0x7fb82815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.077+0000 7fb82ca6a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 0x7fb8280c5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82ca6a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8280c5890 con 0x7fb8280c7730 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82ca6a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fb8280c4280 con 0x7fb8281518f0 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82ca6a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb82815b350 con 0x7fb8280c4f00 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8281518f0 0x7fb82815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8281518f0 0x7fb82815ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35480/0 (socket says 172.21.15.29:35480) 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82659c640 1 -- 172.21.15.29:0/2096202285 learned_addr learned my addr 172.21.15.29:0/2096202285 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb826d9d640 1 --2- 172.21.15.29:0/2096202285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 0x7fb8280c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82659c640 1 -- 172.21.15.29:0/2096202285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 msgr2=0x7fb8280c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82659c640 1 --2- 172.21.15.29:0/2096202285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 0x7fb8280c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82659c640 1 -- 172.21.15.29:0/2096202285 >> v1:172.21.15.72:6789/0 conn(0x7fb8280c7730 legacy=0x7fb8280c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82659c640 1 -- 172.21.15.29:0/2096202285 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82815b630 con 0x7fb8281518f0 2024-04-23T10:17:18.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.081+0000 7fb82659c640 1 --2- 172.21.15.29:0/2096202285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8281518f0 0x7fb82815ac10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb818009870 tx=0x7fb81801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a1dcc280c3bab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb825d9b640 1 -- 172.21.15.29:0/2096202285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8180b0070 con 0x7fb8281518f0 2024-04-23T10:17:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb825d9b640 1 -- 172.21.15.29:0/2096202285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8180ab600 con 0x7fb8281518f0 2024-04-23T10:17:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb825d9b640 1 -- 172.21.15.29:0/2096202285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8180ab9d0 con 0x7fb8281518f0 2024-04-23T10:17:18.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- 172.21.15.29:0/2096202285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8281518f0 msgr2=0x7fb82815ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/2096202285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8281518f0 0x7fb82815ac10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb818009870 tx=0x7fb81801c560 comp rx=0 tx=0).stop 2024-04-23T10:17:18.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- 172.21.15.29:0/2096202285 shutdown_connections 2024-04-23T10:17:18.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/2096202285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 0x7fb8280c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/2096202285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8281518f0 0x7fb82815ac10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- 172.21.15.29:0/2096202285 >> 172.21.15.29:0/2096202285 conn(0x7fb82806cfb0 msgr2=0x7fb82806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:18.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- 172.21.15.29:0/2096202285 shutdown_connections 2024-04-23T10:17:18.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- 172.21.15.29:0/2096202285 wait complete. 2024-04-23T10:17:18.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 Processor -- start 2024-04-23T10:17:18.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- start start 2024-04-23T10:17:18.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 0x7fb828146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8280c7730 0x7fb8281f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8281518f0 0x7fb828159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb828151e50 con 0x7fb8280c7730 2024-04-23T10:17:18.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb828151cd0 con 0x7fb8281518f0 2024-04-23T10:17:18.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82ca6a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb8280c6a30 con 0x7fb8280c4f00 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8280c7730 0x7fb8281f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8280c7730 0x7fb8281f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35490/0 (socket says 172.21.15.29:35490) 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 -- 172.21.15.29:0/783649773 learned_addr learned my addr 172.21.15.29:0/783649773 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb82659c640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 0x7fb828146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb826d9d640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8281518f0 0x7fb828159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 -- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 msgr2=0x7fb828146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 0x7fb828146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 -- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8281518f0 msgr2=0x7fb828159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8281518f0 0x7fb828159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 -- 172.21.15.29:0/783649773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb828147b50 con 0x7fb8280c7730 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb826d9d640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8281518f0 0x7fb828159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81ffff640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8280c7730 0x7fb8281f43a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c530 tx=0x7fb81000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.085+0000 7fb81effd640 1 -- 172.21.15.29:0/783649773 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810016020 con 0x7fb8280c7730 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb81effd640 1 -- 172.21.15.29:0/783649773 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb810005220 con 0x7fb8280c7730 2024-04-23T10:17:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb828147e30 con 0x7fb8280c7730 2024-04-23T10:17:18.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb81effd640 1 -- 172.21.15.29:0/783649773 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810007030 con 0x7fb8280c7730 2024-04-23T10:17:18.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8281483f0 con 0x7fb8280c7730 2024-04-23T10:17:18.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb828068d70 con 0x7fb8280c7730 2024-04-23T10:17:18.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb81effd640 1 -- 172.21.15.29:0/783649773 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8100071d0 con 0x7fb8280c7730 2024-04-23T10:17:18.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb81effd640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb80c0683b0 0x7fb80c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb81effd640 1 -- 172.21.15.29:0/783649773 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb810086760 con 0x7fb8280c7730 2024-04-23T10:17:18.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb82659c640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb80c0683b0 0x7fb80c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.089+0000 7fb82659c640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb80c0683b0 0x7fb80c06a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8180ad000 tx=0x7fb8180a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.093+0000 7fb81effd640 1 -- 172.21.15.29:0/783649773 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb810020020 con 0x7fb8280c7730 2024-04-23T10:17:18.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.289+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8280c8dc0 con 0x7fb8280c7730 2024-04-23T10:17:18.406 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:17:18.407 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:17:18.407 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:17:18.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb81effd640 1 -- 172.21.15.29:0/783649773 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7fb810056990 con 0x7fb8280c7730 2024-04-23T10:17:18.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb80c0683b0 msgr2=0x7fb80c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb80c0683b0 0x7fb80c06a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8180ad000 tx=0x7fb8180a6000 comp rx=0 tx=0).stop 2024-04-23T10:17:18.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8280c7730 msgr2=0x7fb8281f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8280c7730 0x7fb8281f43a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c530 tx=0x7fb81000c9f0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 shutdown_connections 2024-04-23T10:17:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb80c0683b0 0x7fb80c06a870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8281518f0 0x7fb828159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8280c7730 0x7fb8281f43a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 --2- 172.21.15.29:0/783649773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8280c4f00 0x7fb828146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 >> 172.21.15.29:0/783649773 conn(0x7fb82806cfb0 msgr2=0x7fb82814fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 shutdown_connections 2024-04-23T10:17:18.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.405+0000 7fb82ca6a640 1 -- 172.21.15.29:0/783649773 wait complete. 2024-04-23T10:17:18.441 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 82.45 --await-for 42.0' 2024-04-23T10:17:18.441 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 82.45 --await-for 42.0 2024-04-23T10:17:18.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.577+0000 7f8e5ec69640 1 Processor -- start 2024-04-23T10:17:18.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.577+0000 7f8e5ec69640 1 -- start start 2024-04-23T10:17:18.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5ec69640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e580c85e0 0x7f8e58151e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5ec69640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e58158cd0 0x7f8e58152360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5ec69640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5806e9e0 con 0x7f8e580c8200 2024-04-23T10:17:18.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5ec69640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8e5806ecc0 con 0x7f8e58158cd0 2024-04-23T10:17:18.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5ec69640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8e5806efa0 con 0x7f8e580c85e0 2024-04-23T10:17:18.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5d206640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e58158cd0 0x7f8e58152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5ca05640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8e580c8200 0x7f8e580c3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39348/0 (socket says 172.21.15.29:39348) 2024-04-23T10:17:18.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5d206640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e58158cd0 0x7f8e58152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35498/0 (socket says 172.21.15.29:35498) 2024-04-23T10:17:18.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5ca05640 1 -- 172.21.15.29:0/2089235042 learned_addr learned my addr 172.21.15.29:0/2089235042 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:17:18.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e57fff640 1 --2- 172.21.15.29:0/2089235042 >> v2:172.21.15.72:3300/0 conn(0x7f8e580c85e0 0x7f8e58151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5d206640 1 -- 172.21.15.29:0/2089235042 >> v2:172.21.15.72:3300/0 conn(0x7f8e580c85e0 msgr2=0x7f8e58151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5d206640 1 --2- 172.21.15.29:0/2089235042 >> v2:172.21.15.72:3300/0 conn(0x7f8e580c85e0 0x7f8e58151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5d206640 1 -- 172.21.15.29:0/2089235042 >> v1:172.21.15.29:6789/0 conn(0x7f8e580c8200 legacy=0x7f8e580c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5d206640 1 -- 172.21.15.29:0/2089235042 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5806f280 con 0x7f8e58158cd0 2024-04-23T10:17:18.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e57fff640 1 --2- 172.21.15.29:0/2089235042 >> v2:172.21.15.72:3300/0 conn(0x7f8e580c85e0 0x7f8e58151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:18.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e5d206640 1 --2- 172.21.15.29:0/2089235042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e58152360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8e580c4460 tx=0x7f8e4801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827aecae1ea7c5ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e577fe640 1 -- 172.21.15.29:0/2089235042 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b0070 con 0x7f8e58158cd0 2024-04-23T10:17:18.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e577fe640 1 -- 172.21.15.29:0/2089235042 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e480ab600 con 0x7f8e58158cd0 2024-04-23T10:17:18.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.581+0000 7f8e577fe640 1 -- 172.21.15.29:0/2089235042 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480ab9d0 con 0x7f8e58158cd0 2024-04-23T10:17:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- 172.21.15.29:0/2089235042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 msgr2=0x7f8e58152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/2089235042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e58152360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8e580c4460 tx=0x7f8e4801c480 comp rx=0 tx=0).stop 2024-04-23T10:17:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- 172.21.15.29:0/2089235042 shutdown_connections 2024-04-23T10:17:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/2089235042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e58152360 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/2089235042 >> v2:172.21.15.72:3300/0 conn(0x7f8e580c85e0 0x7f8e58151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- 172.21.15.29:0/2089235042 >> 172.21.15.29:0/2089235042 conn(0x7f8e580cc490 msgr2=0x7f8e580cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- 172.21.15.29:0/2089235042 shutdown_connections 2024-04-23T10:17:18.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- 172.21.15.29:0/2089235042 wait complete. 2024-04-23T10:17:18.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 Processor -- start 2024-04-23T10:17:18.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- start start 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e580c8200 0x7f8e58144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e580c85e0 0x7f8e581f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e580ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58164aa0 con 0x7f8e58158cd0 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58164920 con 0x7f8e580c8200 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8e58164c20 con 0x7f8e580c85e0 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e580ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e580ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35512/0 (socket says 172.21.15.29:35512) 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 -- 172.21.15.29:0/3307883164 learned_addr learned my addr 172.21.15.29:0/3307883164 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e580c8200 0x7f8e58144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e57fff640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e580c85e0 0x7f8e581f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 -- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e580c85e0 msgr2=0x7f8e581f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e580c85e0 0x7f8e581f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 -- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e580c8200 msgr2=0x7f8e58144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e580c8200 0x7f8e58144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 -- 172.21.15.29:0/3307883164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e580ca290 con 0x7f8e58158cd0 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5d206640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e580ca770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8e480ae040 tx=0x7f8e48019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e557fa640 1 -- 172.21.15.29:0/3307883164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b0040 con 0x7f8e58158cd0 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e557fa640 1 -- 172.21.15.29:0/3307883164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e480b9070 con 0x7f8e58158cd0 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- 172.21.15.29:0/3307883164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e581f42a0 con 0x7f8e58158cd0 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e557fa640 1 -- 172.21.15.29:0/3307883164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b4630 con 0x7f8e58158cd0 2024-04-23T10:17:18.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.585+0000 7f8e5ec69640 1 -- 172.21.15.29:0/3307883164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e58157ad0 con 0x7f8e58158cd0 2024-04-23T10:17:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e557fa640 1 -- 172.21.15.29:0/3307883164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e480b47d0 con 0x7f8e58158cd0 2024-04-23T10:17:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e557fa640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e44068380 0x7f8e4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e557fa640 1 -- 172.21.15.29:0/3307883164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8e48120b90 con 0x7f8e58158cd0 2024-04-23T10:17:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e44068380 0x7f8e4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e61deb000 1 Processor -- start 2024-04-23T10:17:18.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e61deb000 1 -- start start 2024-04-23T10:17:18.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e44068380 0x7f8e4406a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e500012f0 tx=0x7f8e500019a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5582653226c0 0x558265322aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558265322fe0 0x5582653233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e61deb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5582651c92a0 con 0x55826531d600 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e61deb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55826512f5f0 con 0x558265322fe0 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e61deb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5582650ca820 con 0x5582653226c0 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35516/0 (socket says 172.21.15.29:35516) 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 -- 172.21.15.29:0/1079342962 learned_addr learned my addr 172.21.15.29:0/1079342962 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e57fff640 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5582653226c0 0x558265322aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5d206640 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558265322fe0 0x5582653233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 -- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5582653226c0 msgr2=0x558265322aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5582653226c0 0x558265322aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 -- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558265322fe0 msgr2=0x5582653233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558265322fe0 0x5582653233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5ca05640 1 -- 172.21.15.29:0/1079342962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558265175c00 con 0x55826531d600 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.589+0000 7f8e5d206640 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558265322fe0 0x5582653233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531d9e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8e50007ba0 tx=0x7f8e50002200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7a2e930b29e19 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e3e7fc640 1 -- 172.21.15.29:0/1079342962 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50021450 con 0x55826531d600 2024-04-23T10:17:18.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e3e7fc640 1 -- 172.21.15.29:0/1079342962 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e500215f0 con 0x55826531d600 2024-04-23T10:17:18.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e3e7fc640 1 -- 172.21.15.29:0/1079342962 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500219a0 con 0x55826531d600 2024-04-23T10:17:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- 172.21.15.29:0/1079342962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 msgr2=0x55826531d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531d9e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8e50007ba0 tx=0x7f8e50002200 comp rx=0 tx=0).stop 2024-04-23T10:17:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- 172.21.15.29:0/1079342962 shutdown_connections 2024-04-23T10:17:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558265322fe0 0x5582653233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5582653226c0 0x558265322aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 --2- 172.21.15.29:0/1079342962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531d9e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- 172.21.15.29:0/1079342962 >> 172.21.15.29:0/1079342962 conn(0x55826531e470 msgr2=0x558265320890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- 172.21.15.29:0/1079342962 shutdown_connections 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- 172.21.15.29:0/1079342962 wait complete. 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- start start 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 Processor -- start 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826531cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x558265328620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5582650dac60 con 0x55826531d600 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5582651b1bf0 con 0x5582653226c0 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5582651ec560 con 0x558265322fe0 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 10 client.0 _ll_register_callbacks cb 0x558265106570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35524/0 (socket says 172.21.15.29:35524) 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 -- 172.21.15.29:0/10518985 learned_addr learned my addr 172.21.15.29:0/10518985 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:18.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5d206640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x558265328620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e57fff640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826531cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 -- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 msgr2=0x558265328620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x558265328620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 -- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 msgr2=0x55826531cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826531cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 -- 172.21.15.29:0/10518985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55826516a630 con 0x55826531d600 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5d206640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x558265328620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e57fff640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826531cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531c9e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8e50004fd0 tx=0x7f8e50012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed2cff7e95ec634 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e377fe640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e377fe640 1 -- 172.21.15.29:0/10518985 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50021450 con 0x55826531d600 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e377fe640 1 -- 172.21.15.29:0/10518985 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8e50013600 con 0x55826531d600 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- 172.21.15.29:0/10518985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e500215f0 con 0x55826531d600 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e377fe640 1 -- 172.21.15.29:0/10518985 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8e50033050 con 0x55826531d600 2024-04-23T10:17:18.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 10 client.5211 fetch_fsmap learned FSMap version 18 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- 172.21.15.29:0/10518985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5582650cf490 con 0x55826531d600 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e377fe640 1 -- 172.21.15.29:0/10518985 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e500215f0 con 0x55826531d600 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e377fe640 1 -- 172.21.15.29:0/10518985 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f8e50036020 con 0x55826531d600 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 10 client.5211 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 10 client.5211 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 20 client.5211 populate_metadata read hostname 'smithi029' 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558265329360 0x558265329740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 4 client.5211 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.593+0000 7f8e61deb000 1 -- 172.21.15.29:0/10518985 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582650c97f0 con 0x558265329360 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e57fff640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558265329360 0x558265329740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e57fff640 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558265329360 0x558265329740 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa0ef30beebfbbb server_cookie=976ebfeef23d2ef6 in_seq=0 out_seq=0 2024-04-23T10:17:18.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e377fe640 10 client.5211 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:18.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e377fe640 1 -- 172.21.15.29:0/10518985 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5582650c97f0 con 0x558265329360 2024-04-23T10:17:18.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e377fe640 10 client.5211 handle_command_reply: tid=0 2024-04-23T10:17:18.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 client.5211 shutdown 2024-04-23T10:17:18.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 -- 172.21.15.29:0/10518985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 msgr2=0x55826531c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531c9e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8e50004fd0 tx=0x7f8e50012000 comp rx=0 tx=0).stop 2024-04-23T10:17:18.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 -- 172.21.15.29:0/10518985 shutdown_connections 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558265329360 0x558265329740 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x558265328620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826531cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e377fe640 0 client.5211 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 --2- 172.21.15.29:0/10518985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x55826531c9e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 -- 172.21.15.29:0/10518985 >> 172.21.15.29:0/10518985 conn(0x55826531e470 msgr2=0x5582653216b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 -- 172.21.15.29:0/10518985 shutdown_connections 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 1 -- 172.21.15.29:0/10518985 wait complete. 2024-04-23T10:17:18.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.597+0000 7f8e61deb000 20 client.5211 trim_cache size 0 max 16384 2024-04-23T10:17:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.613+0000 7f8e61deb000 1 Processor -- start 2024-04-23T10:17:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.613+0000 7f8e61deb000 1 -- start start 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582653344f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x55826532aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8e582018e0 con 0x55826531d600 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58201fb0 con 0x5582653226c0 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8e581f81f0 con 0x558265322fe0 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582653344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582653344f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35530/0 (socket says 172.21.15.29:35530) 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 -- 172.21.15.29:0/3304717664 learned_addr learned my addr 172.21.15.29:0/3304717664 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5d206640 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x55826532aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e57fff640 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 -- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 msgr2=0x55826532aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x55826532aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 -- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 msgr2=0x55826532a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 -- 172.21.15.29:0/3304717664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582650caa70 con 0x55826531d600 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e57fff640 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5d206640 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x55826532aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582653344f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8e50004fa0 tx=0x7f8e50017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffe8f0e22cb3f2b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e3dffb640 1 -- 172.21.15.29:0/3304717664 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50021ab0 con 0x55826531d600 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e3dffb640 1 -- 172.21.15.29:0/3304717664 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50021c70 con 0x55826531d600 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e3dffb640 1 -- 172.21.15.29:0/3304717664 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50013c00 con 0x55826531d600 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- 172.21.15.29:0/3304717664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 msgr2=0x5582653344f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582653344f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8e50004fa0 tx=0x7f8e50017070 comp rx=0 tx=0).stop 2024-04-23T10:17:18.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- 172.21.15.29:0/3304717664 shutdown_connections 2024-04-23T10:17:18.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x55826532aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- 172.21.15.29:0/3304717664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582653344f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- 172.21.15.29:0/3304717664 >> 172.21.15.29:0/3304717664 conn(0x55826531e470 msgr2=0x55826533e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:18.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- 172.21.15.29:0/3304717664 shutdown_connections 2024-04-23T10:17:18.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- 172.21.15.29:0/3304717664 wait complete. 2024-04-23T10:17:18.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- start start 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 Processor -- start 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582652e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x55826532ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55826512e900 con 0x55826531d600 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5582650f9e60 con 0x5582653226c0 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558265133c20 con 0x558265322fe0 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 10 client.0 _ll_register_callbacks cb 0x7f8e50007a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582652e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582652e66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35532/0 (socket says 172.21.15.29:35532) 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 -- 172.21.15.29:0/2058747513 learned_addr learned my addr 172.21.15.29:0/2058747513 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e57fff640 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 -- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 msgr2=0x55826532ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x55826532ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 -- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 msgr2=0x55826532a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 -- 172.21.15.29:0/2058747513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582651b2080 con 0x55826531d600 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e5ca05640 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582652e66e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8e50001410 tx=0x7f8e50013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459c8088b5044ef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e377fe640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e377fe640 1 -- 172.21.15.29:0/2058747513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50021ab0 con 0x55826531d600 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e377fe640 1 -- 172.21.15.29:0/2058747513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8e5002d420 con 0x55826531d600 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.617+0000 7f8e61deb000 1 -- 172.21.15.29:0/2058747513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e50021c70 con 0x55826531d600 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e377fe640 1 -- 172.21.15.29:0/2058747513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8e5002d680 con 0x55826531d600 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e61deb000 10 client.5217 fetch_fsmap learned FSMap version 18 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e61deb000 1 -- 172.21.15.29:0/2058747513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5582650d53e0 con 0x55826531d600 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e377fe640 1 -- 172.21.15.29:0/2058747513 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50021c70 con 0x55826531d600 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e377fe640 1 -- 172.21.15.29:0/2058747513 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f8e50036070 con 0x55826531d600 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e61deb000 10 client.5217 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:17:18.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e61deb000 10 client.5217 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:17:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e61deb000 20 client.5217 populate_metadata read hostname 'smithi029' 2024-04-23T10:17:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e61deb000 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5582652e4300 0x5582652e4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e61deb000 4 client.5217 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.45, "await_for": 42.0}] 2024-04-23T10:17:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e61deb000 1 -- 172.21.15.29:0/2058747513 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.45, "await_for": 42.0}) -- 0x5582650d8940 con 0x5582652e4300 2024-04-23T10:17:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e57fff640 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5582652e4300 0x5582652e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e57fff640 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5582652e4300 0x5582652e4710 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2e6b4a90527235 server_cookie=5e9d7f5671b17a27 in_seq=0 out_seq=0 2024-04-23T10:17:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.621+0000 7f8e377fe640 10 client.5217 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e377fe640 1 -- 172.21.15.29:0/2058747513 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x5582650d8940 con 0x5582652e4300 2024-04-23T10:17:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e377fe640 10 client.5217 handle_command_reply: tid=0 2024-04-23T10:17:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 client.5217 shutdown 2024-04-23T10:17:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 -- 172.21.15.29:0/2058747513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 msgr2=0x5582652e66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582652e66e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8e50001410 tx=0x7f8e50013000 comp rx=0 tx=0).stop 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 -- 172.21.15.29:0/2058747513 shutdown_connections 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5582652e4300 0x5582652e4710 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558265322fe0 0x55826532ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5582653226c0 0x55826532a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 --2- 172.21.15.29:0/2058747513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55826531d600 0x5582652e66e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e377fe640 0 client.5217 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 -- 172.21.15.29:0/2058747513 >> 172.21.15.29:0/2058747513 conn(0x55826531e470 msgr2=0x55826533e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 -- 172.21.15.29:0/2058747513 shutdown_connections 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.625+0000 7f8e61deb000 1 -- 172.21.15.29:0/2058747513 wait complete. 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e61deb000 20 client.5217 trim_cache size 0 max 16384 2024-04-23T10:17:18.631 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 6, 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "bd644ca6": { 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 6, 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 82.5, 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:17:18.632 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:18.633 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 -- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e44068380 msgr2=0x7f8e4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e44068380 0x7f8e4406a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e500012f0 tx=0x7f8e500019a0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 -- 172.21.15.29:0/3307883164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 msgr2=0x7f8e580ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e580ca770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8e480ae040 tx=0x7f8e48019220 comp rx=0 tx=0).stop 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 -- 172.21.15.29:0/3307883164 shutdown_connections 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e44068380 0x7f8e4406a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e58158cd0 0x7f8e580ca770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e580c85e0 0x7f8e581f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 --2- 172.21.15.29:0/3307883164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e580c8200 0x7f8e58144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 -- 172.21.15.29:0/3307883164 >> 172.21.15.29:0/3307883164 conn(0x7f8e580cc490 msgr2=0x7f8e580cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 -- 172.21.15.29:0/3307883164 shutdown_connections 2024-04-23T10:17:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:18.629+0000 7f8e5ec69640 1 -- 172.21.15.29:0/3307883164 wait complete. 2024-04-23T10:17:18.646 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bd644ca6', quiesce took 0.7 seconds. Will release after: 22.45 2024-04-23T10:17:24.509 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '0a6c3ed699031b80a2b419e7e795368719871394'. 2024-04-23T10:17:24.509 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-23T10:17:24.509 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T10:17:24.509 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T10:17:24.509 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T10:17:24.509 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-23T10:17:24.510 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 0a6c3ed6990 qa/suites/fs: add quiescer to the fs suite 2024-04-23T10:17:24.511 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-23T10:17:24.518 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T10:17:24.522 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T10:17:24.522 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T10:17:25.628 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T10:17:25.754 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T10:17:25.805 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T10:17:25.806 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T10:17:25.807 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T10:17:25.853 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T10:17:25.858 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:17:25.858 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-23T10:17:25.911 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-23T10:17:25.912 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-23T10:17:25.912 DEBUG:teuthology.orchestra.run.smithi029:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a6c3ed699031b80a2b419e7e795368719871394 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-23T10:17:41.098 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:17:41.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d54d90640 1 Processor -- start 2024-04-23T10:17:41.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d54d90640 1 -- start start 2024-04-23T10:17:41.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d54d90640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d5006f790 0x7f4d50071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d54d90640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d5015eae0 con 0x7f4d500c8950 2024-04-23T10:17:41.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d54d90640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d5015edc0 con 0x7f4d5006f3b0 2024-04-23T10:17:41.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d54d90640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4d50073b70 con 0x7f4d5006f790 2024-04-23T10:17:41.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d4ed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d5006f790 0x7f4d50071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d4dd9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4d500c8950 0x7f4d50154f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50270/0 (socket says 172.21.15.29:50270) 2024-04-23T10:17:41.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d4dd9b640 1 -- 172.21.15.29:0/223148291 learned_addr learned my addr 172.21.15.29:0/223148291 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:17:41.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d4ed9d640 1 -- 172.21.15.29:0/223148291 >> v1:172.21.15.72:6789/0 conn(0x7f4d5006f3b0 legacy=0x7f4d500c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d4ed9d640 1 -- 172.21.15.29:0/223148291 >> v1:172.21.15.29:6789/0 conn(0x7f4d500c8950 legacy=0x7f4d50154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.229+0000 7f4d4ed9d640 1 -- 172.21.15.29:0/223148291 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5015f0a0 con 0x7f4d5006f790 2024-04-23T10:17:41.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4ed9d640 1 --2- 172.21.15.29:0/223148291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f790 0x7f4d50071e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009d90 tx=0x7f4d4801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fce13f3c5c854de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4d59a640 1 -- 172.21.15.29:0/223148291 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480b4070 con 0x7f4d5006f790 2024-04-23T10:17:41.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4d59a640 1 -- 172.21.15.29:0/223148291 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d480af600 con 0x7f4d5006f790 2024-04-23T10:17:41.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4d59a640 1 -- 172.21.15.29:0/223148291 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480af9d0 con 0x7f4d5006f790 2024-04-23T10:17:41.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- 172.21.15.29:0/223148291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f790 msgr2=0x7f4d50071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 --2- 172.21.15.29:0/223148291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f790 0x7f4d50071e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009d90 tx=0x7f4d4801f150 comp rx=0 tx=0).stop 2024-04-23T10:17:41.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- 172.21.15.29:0/223148291 shutdown_connections 2024-04-23T10:17:41.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 --2- 172.21.15.29:0/223148291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f790 0x7f4d50071e80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- 172.21.15.29:0/223148291 >> 172.21.15.29:0/223148291 conn(0x7f4d5006cfb0 msgr2=0x7f4d5006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:41.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- 172.21.15.29:0/223148291 shutdown_connections 2024-04-23T10:17:41.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- 172.21.15.29:0/223148291 wait complete. 2024-04-23T10:17:41.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 Processor -- start 2024-04-23T10:17:41.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- start start 2024-04-23T10:17:41.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f3b0 0x7f4d5015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5006f790 0x7f4d500cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d500c8950 0x7f4d5014b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50071960 con 0x7f4d5006f3b0 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5015f440 con 0x7f4d5006f790 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d54d90640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4d500c77d0 con 0x7f4d500c8950 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f3b0 0x7f4d5015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f3b0 0x7f4d5015ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47484/0 (socket says 172.21.15.29:47484) 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4e59c640 1 -- 172.21.15.29:0/3880750762 learned_addr learned my addr 172.21.15.29:0/3880750762 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4dd9b640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5006f790 0x7f4d500cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.233+0000 7f4d4ed9d640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d500c8950 0x7f4d5014b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d4e59c640 1 -- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d500c8950 msgr2=0x7f4d5014b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d4e59c640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d500c8950 0x7f4d5014b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d4e59c640 1 -- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5006f790 msgr2=0x7f4d500cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d4e59c640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5006f790 0x7f4d500cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d4e59c640 1 -- 172.21.15.29:0/3880750762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5014eb20 con 0x7f4d5006f3b0 2024-04-23T10:17:41.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d4e59c640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f3b0 0x7f4d5015ae20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c420 tx=0x7f4d4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d3effd640 1 -- 172.21.15.29:0/3880750762 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400052d0 con 0x7f4d5006f3b0 2024-04-23T10:17:41.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d3effd640 1 -- 172.21.15.29:0/3880750762 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d40005470 con 0x7f4d5006f3b0 2024-04-23T10:17:41.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5015a340 con 0x7f4d5006f3b0 2024-04-23T10:17:41.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d3effd640 1 -- 172.21.15.29:0/3880750762 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40007260 con 0x7f4d5006f3b0 2024-04-23T10:17:41.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5015a900 con 0x7f4d5006f3b0 2024-04-23T10:17:41.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5014fe20 con 0x7f4d5006f3b0 2024-04-23T10:17:41.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d3effd640 1 -- 172.21.15.29:0/3880750762 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d40007400 con 0x7f4d5006f3b0 2024-04-23T10:17:41.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d3effd640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4d30068380 0x7f4d3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d3effd640 1 -- 172.21.15.29:0/3880750762 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4d40086a80 con 0x7f4d5006f3b0 2024-04-23T10:17:41.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d4dd9b640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4d30068380 0x7f4d3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.237+0000 7f4d4dd9b640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4d30068380 0x7f4d3006a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d500cc430 tx=0x7f4d44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.241+0000 7f4d3effd640 1 -- 172.21.15.29:0/3880750762 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d40056d10 con 0x7f4d5006f3b0 2024-04-23T10:17:41.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.441+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d50068d70 con 0x7f4d5006f3b0 2024-04-23T10:17:41.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.441+0000 7f4d3effd640 1 -- 172.21.15.29:0/3880750762 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f4d40056610 con 0x7f4d5006f3b0 2024-04-23T10:17:41.445 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:17:41.445 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:17:41.445 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:17:41.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4d30068380 msgr2=0x7f4d3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4d30068380 0x7f4d3006a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d500cc430 tx=0x7f4d44009040 comp rx=0 tx=0).stop 2024-04-23T10:17:41.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f3b0 msgr2=0x7f4d5015ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f3b0 0x7f4d5015ae20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c420 tx=0x7f4d4000c8e0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 shutdown_connections 2024-04-23T10:17:41.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4d30068380 0x7f4d3006a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d500c8950 0x7f4d5014b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5006f790 0x7f4d500cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 --2- 172.21.15.29:0/3880750762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d5006f3b0 0x7f4d5015ae20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 >> 172.21.15.29:0/3880750762 conn(0x7f4d5006cfb0 msgr2=0x7f4d50154110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:41.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 shutdown_connections 2024-04-23T10:17:41.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.445+0000 7f4d54d90640 1 -- 172.21.15.29:0/3880750762 wait complete. 2024-04-23T10:17:41.464 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id bd644ca6 --release --await' 2024-04-23T10:17:41.465 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id bd644ca6 --release --await 2024-04-23T10:17:41.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe10b96b640 1 Processor -- start 2024-04-23T10:17:41.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe10b96b640 1 -- start start 2024-04-23T10:17:41.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe10b96b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe104151bb0 0x7fe10415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe10b96b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1040c5d50 0x7fe1040c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe10b96b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1040c6180 con 0x7fe1040c5900 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe10b96b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe10406c910 con 0x7fe104151bb0 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe10b96b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe10406cbf0 con 0x7fe1040c5d50 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe109707640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe104151bb0 0x7fe10415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe109707640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe104151bb0 0x7fe10415bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47494/0 (socket says 172.21.15.29:47494) 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe109707640 1 -- 172.21.15.29:0/1095659741 learned_addr learned my addr 172.21.15.29:0/1095659741 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe109f08640 1 --2- 172.21.15.29:0/1095659741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1040c5d50 0x7fe1040c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe109707640 1 -- 172.21.15.29:0/1095659741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1040c5d50 msgr2=0x7fe1040c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe109707640 1 --2- 172.21.15.29:0/1095659741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1040c5d50 0x7fe1040c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe109707640 1 -- 172.21.15.29:0/1095659741 >> v1:172.21.15.72:6789/0 conn(0x7fe1040c5900 legacy=0x7fe1040cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.601+0000 7fe109707640 1 -- 172.21.15.29:0/1095659741 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10406ced0 con 0x7fe104151bb0 2024-04-23T10:17:41.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe109707640 1 --2- 172.21.15.29:0/1095659741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe104151bb0 0x7fe10415bd80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe100009870 tx=0x7fe10001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41afa4215dc39e83 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe0fbfff640 1 -- 172.21.15.29:0/1095659741 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000b5070 con 0x7fe104151bb0 2024-04-23T10:17:41.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe0fbfff640 1 -- 172.21.15.29:0/1095659741 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1000a89d0 con 0x7fe104151bb0 2024-04-23T10:17:41.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe0fbfff640 1 -- 172.21.15.29:0/1095659741 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000a8da0 con 0x7fe104151bb0 2024-04-23T10:17:41.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 -- 172.21.15.29:0/1095659741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe104151bb0 msgr2=0x7fe10415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1095659741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe104151bb0 0x7fe10415bd80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe100009870 tx=0x7fe10001ed10 comp rx=0 tx=0).stop 2024-04-23T10:17:41.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 -- 172.21.15.29:0/1095659741 shutdown_connections 2024-04-23T10:17:41.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1095659741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1040c5d50 0x7fe1040c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1095659741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe104151bb0 0x7fe10415bd80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 -- 172.21.15.29:0/1095659741 >> 172.21.15.29:0/1095659741 conn(0x7fe1040730f0 msgr2=0x7fe104073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:41.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 -- 172.21.15.29:0/1095659741 shutdown_connections 2024-04-23T10:17:41.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 -- 172.21.15.29:0/1095659741 wait complete. 2024-04-23T10:17:41.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 Processor -- start 2024-04-23T10:17:41.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 -- start start 2024-04-23T10:17:41.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1040c5900 0x7fe104159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.605+0000 7fe10b96b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040c5d50 0x7fe1041e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe10b96b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe104151bb0 0x7fe1041e8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe10b96b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe104151f90 con 0x7fe1040c5900 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe10b96b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe10406d490 con 0x7fe1040c5d50 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe10b96b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe1040cbe80 con 0x7fe104151bb0 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1040c5900 0x7fe104159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1040c5900 0x7fe104159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47504/0 (socket says 172.21.15.29:47504) 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 -- 172.21.15.29:0/1880926006 learned_addr learned my addr 172.21.15.29:0/1880926006 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109f08640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe104151bb0 0x7fe1041e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe108f06640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040c5d50 0x7fe1041e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 -- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe104151bb0 msgr2=0x7fe1041e8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe104151bb0 0x7fe1041e8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 -- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040c5d50 msgr2=0x7fe1041e7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040c5d50 0x7fe1041e7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 -- 172.21.15.29:0/1880926006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe104149040 con 0x7fe1040c5900 2024-04-23T10:17:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109f08640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe104151bb0 0x7fe1041e8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:17:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe108f06640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040c5d50 0x7fe1041e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:17:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe109707640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1040c5900 0x7fe104159880 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe1000b3040 tx=0x7fe10001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe0f9ffb640 1 -- 172.21.15.29:0/1880926006 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000c0070 con 0x7fe1040c5900 2024-04-23T10:17:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe0f9ffb640 1 -- 172.21.15.29:0/1880926006 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1000b0a90 con 0x7fe1040c5900 2024-04-23T10:17:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe0f9ffb640 1 -- 172.21.15.29:0/1880926006 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000b5070 con 0x7fe1040c5900 2024-04-23T10:17:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe10b96b640 1 -- 172.21.15.29:0/1880926006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1041590c0 con 0x7fe1040c5900 2024-04-23T10:17:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe10b96b640 1 -- 172.21.15.29:0/1880926006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1040b63a0 con 0x7fe1040c5900 2024-04-23T10:17:41.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe0f9ffb640 1 -- 172.21.15.29:0/1880926006 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1000c3070 con 0x7fe1040c5900 2024-04-23T10:17:41.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe0f9ffb640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe0e8068380 0x7fe0e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe0f9ffb640 1 -- 172.21.15.29:0/1880926006 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe100123d70 con 0x7fe1040c5900 2024-04-23T10:17:41.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.609+0000 7fe108f06640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe0e8068380 0x7fe0e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 Processor -- start 2024-04-23T10:17:41.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- start start 2024-04-23T10:17:41.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe0e8068380 0x7fe0e806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe1040b4c10 tx=0x7fe0f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df1749c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1752e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5583defbc660 con 0x5583df174f00 2024-04-23T10:17:41.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5583def615d0 con 0x5583df1b0120 2024-04-23T10:17:41.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5583defb8620 con 0x5583df1ab8a0 2024-04-23T10:17:41.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1752e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47506/0 (socket says 172.21.15.29:47506) 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 -- 172.21.15.29:0/278227420 learned_addr learned my addr 172.21.15.29:0/278227420 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe109707640 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df1749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 -- 172.21.15.29:0/278227420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 msgr2=0x5583df1749c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe109f08640 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df1749c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 -- 172.21.15.29:0/278227420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 msgr2=0x5583df1b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 -- 172.21.15.29:0/278227420 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583def95bd0 con 0x5583df174f00 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe108f06640 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1752e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40068e0 tx=0x7fe0f4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2307dd65295b43 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe0e6ffd640 1 -- 172.21.15.29:0/278227420 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4007240 con 0x5583df174f00 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe0e6ffd640 1 -- 172.21.15.29:0/278227420 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f40073e0 con 0x5583df174f00 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe0e6ffd640 1 -- 172.21.15.29:0/278227420 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40075d0 con 0x5583df174f00 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- 172.21.15.29:0/278227420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 msgr2=0x5583df1752e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1752e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40068e0 tx=0x7fe0f4011000 comp rx=0 tx=0).stop 2024-04-23T10:17:41.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- 172.21.15.29:0/278227420 shutdown_connections 2024-04-23T10:17:41.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1752e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 --2- 172.21.15.29:0/278227420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df1749c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- 172.21.15.29:0/278227420 >> 172.21.15.29:0/278227420 conn(0x5583df056b00 msgr2=0x5583df1adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:41.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- 172.21.15.29:0/278227420 shutdown_connections 2024-04-23T10:17:41.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- 172.21.15.29:0/278227420 wait complete. 2024-04-23T10:17:41.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 -- start start 2024-04-23T10:17:41.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.613+0000 7fe10eaed000 1 Processor -- start 2024-04-23T10:17:41.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1aa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1ab8a0 0x5583df1aab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1b0120 0x5583df16f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5583df079d40 con 0x5583df174f00 2024-04-23T10:17:41.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5583def76eb0 con 0x5583df1ab8a0 2024-04-23T10:17:41.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5583defb72a0 con 0x5583df1b0120 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 10 client.0 _ll_register_callbacks cb 0x5583df15aa90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47520/0 (socket says 172.21.15.29:47520) 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 -- 172.21.15.29:0/3815089775 learned_addr learned my addr 172.21.15.29:0/3815089775 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109f08640 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1b0120 0x5583df16f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe108f06640 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1ab8a0 0x5583df1aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 -- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1b0120 msgr2=0x5583df16f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1b0120 0x5583df16f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 -- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1ab8a0 msgr2=0x5583df1aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1ab8a0 0x5583df1aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 -- 172.21.15.29:0/3815089775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583df002b30 con 0x5583df174f00 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe108f06640 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1ab8a0 0x5583df1aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe109707640 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1aa650 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe10001f5b0 tx=0x7fe1000f34a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf2301e22a4003c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe0dffff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:17:41.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe0dffff640 1 -- 172.21.15.29:0/3815089775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000f3fa0 con 0x5583df174f00 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe0dffff640 1 -- 172.21.15.29:0/3815089775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe1000f4bd0 con 0x5583df174f00 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 -- 172.21.15.29:0/3815089775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5583def56060 con 0x5583df174f00 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe0dffff640 1 -- 172.21.15.29:0/3815089775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe1000f38a0 con 0x5583df174f00 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 10 client.5238 fetch_fsmap learned FSMap version 18 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 -- 172.21.15.29:0/3815089775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5583def5bb70 con 0x5583df174f00 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe0dffff640 1 -- 172.21.15.29:0/3815089775 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5583def56060 con 0x5583df174f00 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe0dffff640 1 -- 172.21.15.29:0/3815089775 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fe1000fbff0 con 0x5583df174f00 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 10 client.5238 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 10 client.5238 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 20 client.5238 populate_metadata read hostname 'smithi029' 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5583df170670 0x5583df170a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 4 client.5238 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe10eaed000 1 -- 172.21.15.29:0/3815089775 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583def94e30 con 0x5583df170670 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe108f06640 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5583df170670 0x5583df170a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe0dffff640 10 client.5238 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:41.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.617+0000 7fe108f06640 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5583df170670 0x5583df170a50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d7f893baa1873ca server_cookie=4d1cc77404645fe in_seq=0 out_seq=0 2024-04-23T10:17:41.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe0dffff640 1 -- 172.21.15.29:0/3815089775 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5583def94e30 con 0x5583df170670 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe0dffff640 10 client.5238 handle_command_reply: tid=0 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 client.5238 shutdown 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 -- 172.21.15.29:0/3815089775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 msgr2=0x5583df1aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1aa650 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe10001f5b0 tx=0x7fe1000f34a0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 -- 172.21.15.29:0/3815089775 shutdown_connections 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5583df170670 0x5583df170a50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1b0120 0x5583df16f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1ab8a0 0x5583df1aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3815089775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1aa650 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe0dffff640 0 client.5238 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 -- 172.21.15.29:0/3815089775 >> 172.21.15.29:0/3815089775 conn(0x5583df056b00 msgr2=0x5583df1af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 -- 172.21.15.29:0/3815089775 shutdown_connections 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 1 -- 172.21.15.29:0/3815089775 wait complete. 2024-04-23T10:17:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.621+0000 7fe10eaed000 20 client.5238 trim_cache size 0 max 16384 2024-04-23T10:17:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe10eaed000 1 Processor -- start 2024-04-23T10:17:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe10eaed000 1 -- start start 2024-04-23T10:17:41.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df173830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe10eaed000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe1041fe7a0 con 0x5583df174f00 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe10eaed000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe1041fee70 con 0x5583df1b0120 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe10eaed000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe1041fd090 con 0x5583df1ab8a0 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47522/0 (socket says 172.21.15.29:47522) 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 -- 172.21.15.29:0/660935316 learned_addr learned my addr 172.21.15.29:0/660935316 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe108f06640 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df173830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109f08640 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 -- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 msgr2=0x5583df173830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df173830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 -- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 msgr2=0x5583df1c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 -- 172.21.15.29:0/660935316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583df03e5e0 con 0x5583df174f00 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe108f06640 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df173830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe109707640 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1732f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe100020320 tx=0x7fe1000f5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a4be569d059b3a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe0e67fc640 1 -- 172.21.15.29:0/660935316 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000f3670 con 0x5583df174f00 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe0e67fc640 1 -- 172.21.15.29:0/660935316 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10010f050 con 0x5583df174f00 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.637+0000 7fe0e67fc640 1 -- 172.21.15.29:0/660935316 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000f3fa0 con 0x5583df174f00 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- 172.21.15.29:0/660935316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 msgr2=0x5583df1732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1732f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe100020320 tx=0x7fe1000f5000 comp rx=0 tx=0).stop 2024-04-23T10:17:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- 172.21.15.29:0/660935316 shutdown_connections 2024-04-23T10:17:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df173830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 --2- 172.21.15.29:0/660935316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df1732f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- 172.21.15.29:0/660935316 >> 172.21.15.29:0/660935316 conn(0x5583df056b00 msgr2=0x5583df1ab080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- 172.21.15.29:0/660935316 shutdown_connections 2024-04-23T10:17:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- 172.21.15.29:0/660935316 wait complete. 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- start start 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 Processor -- start 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df21df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df21e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5583defbb970 con 0x5583df174f00 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5583def718f0 con 0x5583df1b0120 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5583defc0c90 con 0x5583df1ab8a0 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 10 client.0 _ll_register_callbacks cb 0x7fe100006d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df21df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df21df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47536/0 (socket says 172.21.15.29:47536) 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 -- 172.21.15.29:0/3475121372 learned_addr learned my addr 172.21.15.29:0/3475121372 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe108f06640 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df21e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109f08640 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 -- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 msgr2=0x5583df21e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df21e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 -- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 msgr2=0x5583df1c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 -- 172.21.15.29:0/3475121372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583def4eae0 con 0x5583df174f00 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109f08640 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe109707640 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df21df20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe100006db0 tx=0x7fe1000bd070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879b7c63c39bb94 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe0dffff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe0dffff640 1 -- 172.21.15.29:0/3475121372 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000f3fa0 con 0x5583df174f00 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe0dffff640 1 -- 172.21.15.29:0/3475121372 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe1000f4bd0 con 0x5583df174f00 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- 172.21.15.29:0/3475121372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe10010f050 con 0x5583df174f00 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe0dffff640 1 -- 172.21.15.29:0/3475121372 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe1000e5050 con 0x5583df174f00 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 10 client.5244 fetch_fsmap learned FSMap version 18 2024-04-23T10:17:41.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- 172.21.15.29:0/3475121372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5583def51d80 con 0x5583df174f00 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe0dffff640 1 -- 172.21.15.29:0/3475121372 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10010f050 con 0x5583df174f00 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe0dffff640 1 -- 172.21.15.29:0/3475121372 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fe10011b3a0 con 0x5583df174f00 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 10 client.5244 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 10 client.5244 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 20 client.5244 populate_metadata read hostname 'smithi029' 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5583df1c9850 0x5583df1c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 4 client.5244 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bd644ca6", "release": true, "await": true}] 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe10eaed000 1 -- 172.21.15.29:0/3475121372 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bd644ca6", "release": true, "await": true}) -- 0x5583def5a0d0 con 0x5583df1c9850 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.641+0000 7fe108f06640 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5583df1c9850 0x5583df1c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe108f06640 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5583df1c9850 0x5583df1c9c60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee02912a1d3cc0 server_cookie=f241506d730fa35 in_seq=0 out_seq=0 2024-04-23T10:17:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe0dffff640 10 client.5244 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe0dffff640 1 -- 172.21.15.29:0/3475121372 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x5583def5a0d0 con 0x5583df1c9850 2024-04-23T10:17:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe0dffff640 10 client.5244 handle_command_reply: tid=0 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 client.5244 shutdown 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 -- 172.21.15.29:0/3475121372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 msgr2=0x5583df21df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df21df20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe100006db0 tx=0x7fe1000bd070 comp rx=0 tx=0).stop 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 -- 172.21.15.29:0/3475121372 shutdown_connections 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5583df1c9850 0x5583df1c9c60 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5583df1b0120 0x5583df1c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5583df1ab8a0 0x5583df21e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 --2- 172.21.15.29:0/3475121372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5583df174f00 0x5583df21df20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe0dffff640 0 client.5244 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 -- 172.21.15.29:0/3475121372 >> 172.21.15.29:0/3475121372 conn(0x5583df056b00 msgr2=0x5583df1cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 -- 172.21.15.29:0/3475121372 shutdown_connections 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 1 -- 172.21.15.29:0/3475121372 wait complete. 2024-04-23T10:17:41.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.645+0000 7fe10eaed000 20 client.5244 trim_cache size 0 max 16384 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 8, 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "bd644ca6": { 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 8, 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:17:41.653 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 82.5, 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:17:41.654 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:17:41.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 -- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe0e8068380 msgr2=0x7fe0e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe0e8068380 0x7fe0e806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe1040b4c10 tx=0x7fe0f4009040 comp rx=0 tx=0).stop 2024-04-23T10:17:41.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 -- 172.21.15.29:0/1880926006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1040c5900 msgr2=0x7fe104159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:41.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1040c5900 0x7fe104159880 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe1000b3040 tx=0x7fe10001bab0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 -- 172.21.15.29:0/1880926006 shutdown_connections 2024-04-23T10:17:41.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe0e8068380 0x7fe0e806a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe104151bb0 0x7fe1041e8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040c5d50 0x7fe1041e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 --2- 172.21.15.29:0/1880926006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1040c5900 0x7fe104159880 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:41.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 -- 172.21.15.29:0/1880926006 >> 172.21.15.29:0/1880926006 conn(0x7fe1040730f0 msgr2=0x7fe1040734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:41.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 -- 172.21.15.29:0/1880926006 shutdown_connections 2024-04-23T10:17:41.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:17:41.649+0000 7fe10b96b640 1 -- 172.21.15.29:0/1880926006 wait complete. 2024-04-23T10:17:41.668 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bd644ca6', seconds elapsed: 23.7 2024-04-23T10:17:43.103 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir -p fsstress 2024-04-23T10:17:43.109 INFO:tasks.workunit.client.0.smithi029.stderr:+ pushd fsstress 2024-04-23T10:17:43.113 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T10:17:43.113 INFO:tasks.workunit.client.0.smithi029.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-23T10:17:44.488 INFO:tasks.workunit.client.0.smithi029.stderr:+ tar xzf ltp-full.tgz 2024-04-23T10:17:46.416 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:17:46.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:18:16.464 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:18:16.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:18:46.519 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:18:46.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:05.055 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.2) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T10:19:05.055 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.6 2024-04-23T10:19:05.055 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:19:05.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.212+0000 7f2e5ab2f640 1 Processor -- start 2024-04-23T10:19:05.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.212+0000 7f2e5ab2f640 1 -- start start 2024-04-23T10:19:05.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e5ab2f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2e540ca790 0x7f2e54143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e5ab2f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540c80c0 0x7f2e54144410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e5ab2f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e54070b30 con 0x7f2e540ca3b0 2024-04-23T10:19:05.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e5ab2f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5415e7a0 con 0x7f2e540ca790 2024-04-23T10:19:05.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e5ab2f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5415b400 con 0x7f2e540c80c0 2024-04-23T10:19:05.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e53fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2e540ca790 0x7f2e54143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e588cb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2e540ca3b0 0x7f2e54070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36036/0 (socket says 172.21.15.29:36036) 2024-04-23T10:19:05.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e588cb640 1 -- 172.21.15.29:0/3067943482 learned_addr learned my addr 172.21.15.29:0/3067943482 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:19:05.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e590cc640 1 --2- 172.21.15.29:0/3067943482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540c80c0 0x7f2e54144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e53fff640 1 -- 172.21.15.29:0/3067943482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540c80c0 msgr2=0x7f2e54144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e53fff640 1 --2- 172.21.15.29:0/3067943482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540c80c0 0x7f2e54144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e53fff640 1 -- 172.21.15.29:0/3067943482 >> v1:172.21.15.29:6789/0 conn(0x7f2e540ca3b0 legacy=0x7f2e54070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.216+0000 7f2e53fff640 1 -- 172.21.15.29:0/3067943482 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5415b6e0 con 0x7f2e540ca790 2024-04-23T10:19:05.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 --2- 172.21.15.29:0/3067943482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca790 0x7f2e54143ed0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2e400097c0 tx=0x7f2e4001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c75d722472798ca server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e537fe640 1 -- 172.21.15.29:0/3067943482 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e400b5070 con 0x7f2e540ca790 2024-04-23T10:19:05.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e537fe640 1 -- 172.21.15.29:0/3067943482 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e400a8990 con 0x7f2e540ca790 2024-04-23T10:19:05.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e537fe640 1 -- 172.21.15.29:0/3067943482 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e400a8d60 con 0x7f2e540ca790 2024-04-23T10:19:05.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3067943482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca790 msgr2=0x7f2e54143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3067943482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca790 0x7f2e54143ed0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2e400097c0 tx=0x7f2e4001ec90 comp rx=0 tx=0).stop 2024-04-23T10:19:05.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3067943482 shutdown_connections 2024-04-23T10:19:05.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3067943482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540c80c0 0x7f2e54144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3067943482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca790 0x7f2e54143ed0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3067943482 >> 172.21.15.29:0/3067943482 conn(0x7f2e5406b9e0 msgr2=0x7f2e5406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:05.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3067943482 shutdown_connections 2024-04-23T10:19:05.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3067943482 wait complete. 2024-04-23T10:19:05.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 Processor -- start 2024-04-23T10:19:05.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- start start 2024-04-23T10:19:05.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e540c80c0 0x7f2e541f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca3b0 0x7f2e540c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540ca790 0x7f2e540c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5415bf80 con 0x7f2e540ca3b0 2024-04-23T10:19:05.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5415bca0 con 0x7f2e540c80c0 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e5ab2f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5415ec30 con 0x7f2e540ca790 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca3b0 0x7f2e540c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca3b0 0x7f2e540c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34002/0 (socket says 172.21.15.29:34002) 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 -- 172.21.15.29:0/3514805609 learned_addr learned my addr 172.21.15.29:0/3514805609 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e590cc640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540ca790 0x7f2e540c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e588cb640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e540c80c0 0x7f2e541f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 -- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540ca790 msgr2=0x7f2e540c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540ca790 0x7f2e540c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 -- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e540c80c0 msgr2=0x7f2e541f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e540c80c0 0x7f2e541f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e53fff640 1 -- 172.21.15.29:0/3514805609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e540c6bc0 con 0x7f2e540ca3b0 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.220+0000 7f2e588cb640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e540c80c0 0x7f2e541f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e53fff640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca3b0 0x7f2e540c56e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2e4001d340 tx=0x7f2e4001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e517fa640 1 -- 172.21.15.29:0/3514805609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e400c1070 con 0x7f2e540ca3b0 2024-04-23T10:19:05.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e517fa640 1 -- 172.21.15.29:0/3514805609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e400b0780 con 0x7f2e540ca3b0 2024-04-23T10:19:05.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e540c6ea0 con 0x7f2e540ca3b0 2024-04-23T10:19:05.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e517fa640 1 -- 172.21.15.29:0/3514805609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e400b5040 con 0x7f2e540ca3b0 2024-04-23T10:19:05.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e540c4ee0 con 0x7f2e540ca3b0 2024-04-23T10:19:05.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e540693c0 con 0x7f2e540ca3b0 2024-04-23T10:19:05.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e517fa640 1 -- 172.21.15.29:0/3514805609 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2e400c4070 con 0x7f2e540ca3b0 2024-04-23T10:19:05.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e517fa640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2e38068380 0x7f2e3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e517fa640 1 -- 172.21.15.29:0/3514805609 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2e40123db0 con 0x7f2e540ca3b0 2024-04-23T10:19:05.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.224+0000 7f2e588cb640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2e38068380 0x7f2e3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.228+0000 7f2e588cb640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2e38068380 0x7f2e3806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000f70 tx=0x7f2e48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.228+0000 7f2e517fa640 1 -- 172.21.15.29:0/3514805609 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2e400187f0 con 0x7f2e540ca3b0 2024-04-23T10:19:05.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.500+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e5415e580 con 0x7f2e540ca3b0 2024-04-23T10:19:05.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.500+0000 7f2e517fa640 1 -- 172.21.15.29:0/3514805609 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f2e400f4150 con 0x7f2e540ca3b0 2024-04-23T10:19:05.499 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:19:05.499 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:19:05.500 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2e38068380 msgr2=0x7f2e3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2e38068380 0x7f2e3806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000f70 tx=0x7f2e48009040 comp rx=0 tx=0).stop 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca3b0 msgr2=0x7f2e540c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca3b0 0x7f2e540c56e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2e4001d340 tx=0x7f2e4001ba30 comp rx=0 tx=0).stop 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 shutdown_connections 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2e38068380 0x7f2e3806a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e540ca790 0x7f2e540c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e540ca3b0 0x7f2e540c56e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 --2- 172.21.15.29:0/3514805609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e540c80c0 0x7f2e541f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 >> 172.21.15.29:0/3514805609 conn(0x7f2e5406b9e0 msgr2=0x7f2e540c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 shutdown_connections 2024-04-23T10:19:05.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.504+0000 7f2e5ab2f640 1 -- 172.21.15.29:0/3514805609 wait complete. 2024-04-23T10:19:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 79.6 --await-for 42.0' 2024-04-23T10:19:05.523 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 79.6 --await-for 42.0 2024-04-23T10:19:05.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f822b41b640 1 Processor -- start 2024-04-23T10:19:05.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f822b41b640 1 -- start start 2024-04-23T10:19:05.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f822b41b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82240c8200 0x7f82240c3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f822b41b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f82240c85e0 0x7f8224151e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f822b41b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f822406e9e0 con 0x7f8224158cd0 2024-04-23T10:19:05.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f822b41b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f822406ecc0 con 0x7f82240c85e0 2024-04-23T10:19:05.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f822b41b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f822406efa0 con 0x7f82240c8200 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82289b6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f82240c85e0 0x7f8224151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82299b8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8224158cd0 0x7f82240c4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36042/0 (socket says 172.21.15.29:36042) 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82299b8640 1 -- 172.21.15.29:0/718431259 learned_addr learned my addr 172.21.15.29:0/718431259 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82291b7640 1 --2- 172.21.15.29:0/718431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82240c8200 0x7f82240c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82289b6640 1 -- 172.21.15.29:0/718431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82240c8200 msgr2=0x7f82240c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82289b6640 1 --2- 172.21.15.29:0/718431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82240c8200 0x7f82240c3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82289b6640 1 -- 172.21.15.29:0/718431259 >> v1:172.21.15.29:6789/0 conn(0x7f8224158cd0 legacy=0x7f82240c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82289b6640 1 -- 172.21.15.29:0/718431259 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822406f280 con 0x7f82240c85e0 2024-04-23T10:19:05.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f821bfff640 1 -- 172.21.15.29:0/718431259 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544441671 0 0) 0x7f822406e9e0 con 0x7f8224158cd0 2024-04-23T10:19:05.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.648+0000 7f82289b6640 1 --2- 172.21.15.29:0/718431259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224151e20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f82140097c0 tx=0x7f821401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec37e952e492af6e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f821bfff640 1 -- 172.21.15.29:0/718431259 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140a7070 con 0x7f82240c85e0 2024-04-23T10:19:05.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f821bfff640 1 -- 172.21.15.29:0/718431259 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82140b0070 con 0x7f82240c85e0 2024-04-23T10:19:05.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f821bfff640 1 -- 172.21.15.29:0/718431259 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140ab890 con 0x7f82240c85e0 2024-04-23T10:19:05.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- 172.21.15.29:0/718431259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 msgr2=0x7f8224151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 --2- 172.21.15.29:0/718431259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224151e20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f82140097c0 tx=0x7f821401c470 comp rx=0 tx=0).stop 2024-04-23T10:19:05.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- 172.21.15.29:0/718431259 shutdown_connections 2024-04-23T10:19:05.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 --2- 172.21.15.29:0/718431259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224151e20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 --2- 172.21.15.29:0/718431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82240c8200 0x7f82240c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- 172.21.15.29:0/718431259 >> 172.21.15.29:0/718431259 conn(0x7f82240cc490 msgr2=0x7f82240cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:05.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- 172.21.15.29:0/718431259 shutdown_connections 2024-04-23T10:19:05.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- 172.21.15.29:0/718431259 wait complete. 2024-04-23T10:19:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 Processor -- start 2024-04-23T10:19:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- start start 2024-04-23T10:19:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82240c8200 0x7f82240cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8224158cd0 0x7f8224140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f822406e5c0 con 0x7f82240c85e0 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f822406e740 con 0x7f82240c8200 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8224165130 con 0x7f8224158cd0 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34024/0 (socket says 172.21.15.29:34024) 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 -- 172.21.15.29:0/902947564 learned_addr learned my addr 172.21.15.29:0/902947564 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82299b8640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8224158cd0 0x7f8224140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 -- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8224158cd0 msgr2=0x7f8224140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8224158cd0 0x7f8224140c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 -- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82240c8200 msgr2=0x7f82240cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82291b7640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82240c8200 0x7f82240cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82240c8200 0x7f82240cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 -- 172.21.15.29:0/902947564 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82240cc1e0 con 0x7f82240c85e0 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82299b8640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8224158cd0 0x7f8224140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:05.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f82289b6640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224146200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f82140ad040 tx=0x7f821401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f8219ffb640 1 -- 172.21.15.29:0/902947564 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140bf610 con 0x7f82240c85e0 2024-04-23T10:19:05.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f8219ffb640 1 -- 172.21.15.29:0/902947564 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82140bf7d0 con 0x7f82240c85e0 2024-04-23T10:19:05.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f8219ffb640 1 -- 172.21.15.29:0/902947564 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140bfbc0 con 0x7f82240c85e0 2024-04-23T10:19:05.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- 172.21.15.29:0/902947564 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822413bf90 con 0x7f82240c85e0 2024-04-23T10:19:05.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.652+0000 7f822b41b640 1 -- 172.21.15.29:0/902947564 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82240ca4e0 con 0x7f82240c85e0 2024-04-23T10:19:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f8219ffb640 1 -- 172.21.15.29:0/902947564 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82140bd020 con 0x7f82240c85e0 2024-04-23T10:19:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f8219ffb640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8208068380 0x7f820806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f8219ffb640 1 -- 172.21.15.29:0/902947564 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8214121250 con 0x7f82240c85e0 2024-04-23T10:19:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f82291b7640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8208068380 0x7f820806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f822e59d000 1 Processor -- start 2024-04-23T10:19:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f822e59d000 1 -- start start 2024-04-23T10:19:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f82291b7640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8208068380 0x7f820806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8220009a30 tx=0x7f8220008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f822e59d000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec1226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f822e59d000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec122c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f822e59d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec123520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f822e59d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e0ebfc92a0 con 0x55e0ec123140 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f822e59d000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e0ebf2f5f0 con 0x55e0ec11da20 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f822e59d000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55e0ebeca820 con 0x55e0ec11de00 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f82299b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec123520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f82299b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec123520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34038/0 (socket says 172.21.15.29:34038) 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f82299b8640 1 -- 172.21.15.29:0/422460465 learned_addr learned my addr 172.21.15.29:0/422460465 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.656+0000 7f82291b7640 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec1226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82299b8640 1 -- 172.21.15.29:0/422460465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 msgr2=0x55e0ec122c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82299b8640 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec122c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82299b8640 1 -- 172.21.15.29:0/422460465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 msgr2=0x55e0ec1226c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82299b8640 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec1226c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82299b8640 1 -- 172.21.15.29:0/422460465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ebf75c00 con 0x55e0ec123140 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82299b8640 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec123520 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f821c001de0 tx=0x7f821c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7223a2fd3add8db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f8206ffd640 1 -- 172.21.15.29:0/422460465 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c00de30 con 0x55e0ec123140 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f8206ffd640 1 -- 172.21.15.29:0/422460465 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821c004b70 con 0x55e0ec123140 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f8206ffd640 1 -- 172.21.15.29:0/422460465 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c0070d0 con 0x55e0ec123140 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- 172.21.15.29:0/422460465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 msgr2=0x55e0ec123520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec123520 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f821c001de0 tx=0x7f821c00d520 comp rx=0 tx=0).stop 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- 172.21.15.29:0/422460465 shutdown_connections 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec123520 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 --2- 172.21.15.29:0/422460465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec1226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- 172.21.15.29:0/422460465 >> 172.21.15.29:0/422460465 conn(0x55e0ec11e470 msgr2=0x55e0ec120890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- 172.21.15.29:0/422460465 shutdown_connections 2024-04-23T10:19:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- 172.21.15.29:0/422460465 wait complete. 2024-04-23T10:19:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- start start 2024-04-23T10:19:05.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 Processor -- start 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec0e7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec11de00 0x55e0ec12c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec123140 0x55e0ec12cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e0ebedac60 con 0x55e0ec11de00 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e0ebfb1bf0 con 0x55e0ec11da20 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55e0ebfec560 con 0x55e0ec123140 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 10 client.0 _ll_register_callbacks cb 0x55e0ebf06570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec11de00 0x55e0ec12c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec11de00 0x55e0ec12c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34048/0 (socket says 172.21.15.29:34048) 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 -- 172.21.15.29:0/2180518908 learned_addr learned my addr 172.21.15.29:0/2180518908 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:05.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82299b8640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec123140 0x55e0ec12cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82291b7640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec0e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 -- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec123140 msgr2=0x55e0ec12cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec123140 0x55e0ec12cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 -- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 msgr2=0x55e0ec0e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec0e7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 -- 172.21.15.29:0/2180518908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ebf6a630 con 0x55e0ec11de00 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82291b7640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec0e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82299b8640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec123140 0x55e0ec12cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f82289b6640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec11de00 0x55e0ec12c7c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f82140ed140 tx=0x7f82140f0700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f12bc80f21c918 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f81fffff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f81fffff640 1 -- 172.21.15.29:0/2180518908 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214109220 con 0x55e0ec11de00 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f81fffff640 1 -- 172.21.15.29:0/2180518908 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f82140f0130 con 0x55e0ec11de00 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- 172.21.15.29:0/2180518908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c004b70 con 0x55e0ec11de00 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f81fffff640 1 -- 172.21.15.29:0/2180518908 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f82140f98c0 con 0x55e0ec11de00 2024-04-23T10:19:05.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 10 client.5268 fetch_fsmap learned FSMap version 18 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.660+0000 7f822e59d000 1 -- 172.21.15.29:0/2180518908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e0ebecf490 con 0x55e0ec11de00 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f81fffff640 1 -- 172.21.15.29:0/2180518908 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821c004b70 con 0x55e0ec11de00 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f81fffff640 1 -- 172.21.15.29:0/2180518908 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f82140f7290 con 0x55e0ec11de00 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 10 client.5268 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 10 client.5268 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 20 client.5268 populate_metadata read hostname 'smithi029' 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55e0ec11cac0 0x55e0ec11cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 4 client.5268 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 -- 172.21.15.29:0/2180518908 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0ebec97f0 con 0x55e0ec11cac0 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f82291b7640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55e0ec11cac0 0x55e0ec11cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f82291b7640 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55e0ec11cac0 0x55e0ec11cea0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e4fc61a35704ae9 server_cookie=51cfcf7efd41523a in_seq=0 out_seq=0 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f81fffff640 10 client.5268 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f81fffff640 1 -- 172.21.15.29:0/2180518908 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e0ebec97f0 con 0x55e0ec11cac0 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f81fffff640 10 client.5268 handle_command_reply: tid=0 2024-04-23T10:19:05.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 client.5268 shutdown 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 -- 172.21.15.29:0/2180518908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec11de00 msgr2=0x55e0ec12c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec11de00 0x55e0ec12c7c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f82140ed140 tx=0x7f82140f0700 comp rx=0 tx=0).stop 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 -- 172.21.15.29:0/2180518908 shutdown_connections 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55e0ec11cac0 0x55e0ec11cea0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec123140 0x55e0ec12cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec11de00 0x55e0ec12c7c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f81fffff640 0 client.5268 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 --2- 172.21.15.29:0/2180518908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec0e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 -- 172.21.15.29:0/2180518908 >> 172.21.15.29:0/2180518908 conn(0x55e0ec11e470 msgr2=0x55e0ec122650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 -- 172.21.15.29:0/2180518908 shutdown_connections 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 1 -- 172.21.15.29:0/2180518908 wait complete. 2024-04-23T10:19:05.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.664+0000 7f822e59d000 20 client.5268 trim_cache size 0 max 16384 2024-04-23T10:19:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 Processor -- start 2024-04-23T10:19:05.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- start start 2024-04-23T10:19:05.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec12cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec13d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec13d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f82241fd600 con 0x55e0ec123140 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f82241fdcd0 con 0x55e0ec11da20 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f82241f5110 con 0x55e0ec11de00 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec13d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec13d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34062/0 (socket says 172.21.15.29:34062) 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 -- 172.21.15.29:0/3120782317 learned_addr learned my addr 172.21.15.29:0/3120782317 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82291b7640 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec12cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82289b6640 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec13d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 -- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 msgr2=0x55e0ec13d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec13d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 -- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 msgr2=0x55e0ec12cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec12cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 -- 172.21.15.29:0/3120782317 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ebecaa70 con 0x55e0ec123140 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82291b7640 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec12cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82299b8640 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec13d6d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f821c000f90 tx=0x7f821c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1ac33cd1a5051d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82067fc640 1 -- 172.21.15.29:0/3120782317 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c004b70 con 0x55e0ec123140 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82067fc640 1 -- 172.21.15.29:0/3120782317 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821c004d30 con 0x55e0ec123140 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f82067fc640 1 -- 172.21.15.29:0/3120782317 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c007310 con 0x55e0ec123140 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- 172.21.15.29:0/3120782317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 msgr2=0x55e0ec13d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec13d6d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f821c000f90 tx=0x7f821c006000 comp rx=0 tx=0).stop 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- 172.21.15.29:0/3120782317 shutdown_connections 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec13d6d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec13d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- 172.21.15.29:0/3120782317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec12cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- 172.21.15.29:0/3120782317 >> 172.21.15.29:0/3120782317 conn(0x55e0ec11e470 msgr2=0x55e0ec12b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:05.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- 172.21.15.29:0/3120782317 shutdown_connections 2024-04-23T10:19:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- 172.21.15.29:0/3120782317 wait complete. 2024-04-23T10:19:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- start start 2024-04-23T10:19:05.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 Processor -- start 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec193f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec1944b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec1403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.684+0000 7f822e59d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e0ebf2e900 con 0x55e0ec123140 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55e0ebef9e60 con 0x55e0ec11da20 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55e0ebf33c20 con 0x55e0ec11de00 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 10 client.0 _ll_register_callbacks cb 0x7f82140abf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec1403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec1403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34068/0 (socket says 172.21.15.29:34068) 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 -- 172.21.15.29:0/1725003804 learned_addr learned my addr 172.21.15.29:0/1725003804 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:05.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82289b6640 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec1944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82291b7640 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec193f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 -- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 msgr2=0x55e0ec1944b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec1944b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 -- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 msgr2=0x55e0ec193f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec193f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 -- 172.21.15.29:0/1725003804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ebfb2080 con 0x55e0ec123140 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82299b8640 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec1403c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f821c011000 tx=0x7f821c007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c3430557c098c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f81fffff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f81fffff640 1 -- 172.21.15.29:0/1725003804 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c0072d0 con 0x55e0ec123140 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f81fffff640 1 -- 172.21.15.29:0/1725003804 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f821c007470 con 0x55e0ec123140 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 1 -- 172.21.15.29:0/1725003804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c004d30 con 0x55e0ec123140 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f81fffff640 1 -- 172.21.15.29:0/1725003804 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f821c03b050 con 0x55e0ec123140 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 10 client.5274 fetch_fsmap learned FSMap version 18 2024-04-23T10:19:05.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 1 -- 172.21.15.29:0/1725003804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e0ebed53e0 con 0x55e0ec123140 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f81fffff640 1 -- 172.21.15.29:0/1725003804 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821c004d30 con 0x55e0ec123140 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f81fffff640 1 -- 172.21.15.29:0/1725003804 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f821c03e020 con 0x55e0ec123140 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 10 client.5274 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 10 client.5274 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 20 client.5274 populate_metadata read hostname 'smithi029' 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55e0ec140d50 0x55e0ec141130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 4 client.5274 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.6, "await_for": 42.0}] 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f822e59d000 1 -- 172.21.15.29:0/1725003804 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.6, "await_for": 42.0}) -- 0x55e0ebed8940 con 0x55e0ec140d50 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82291b7640 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55e0ec140d50 0x55e0ec141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f81fffff640 10 client.5274 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:05.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:05.688+0000 7f82291b7640 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55e0ec140d50 0x55e0ec141130 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc73b3bc2e6e387c server_cookie=eb99d187d0b2ab78 in_seq=0 out_seq=0 2024-04-23T10:19:10.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f81fffff640 1 -- 172.21.15.29:0/1725003804 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e0ebed8940 con 0x55e0ec140d50 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f81fffff640 10 client.5274 handle_command_reply: tid=0 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 client.5274 shutdown 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 -- 172.21.15.29:0/1725003804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 msgr2=0x55e0ec1403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec1403c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f821c011000 tx=0x7f821c007cd0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 -- 172.21.15.29:0/1725003804 shutdown_connections 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55e0ec140d50 0x55e0ec141130 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e0ec123140 0x55e0ec1403c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55e0ec11de00 0x55e0ec1944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 --2- 172.21.15.29:0/1725003804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e0ec11da20 0x55e0ec193f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f81fffff640 0 client.5274 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:10.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.948+0000 7f822e59d000 1 -- 172.21.15.29:0/1725003804 >> 172.21.15.29:0/1725003804 conn(0x55e0ec11e470 msgr2=0x55e0ec12b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:10.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822e59d000 1 -- 172.21.15.29:0/1725003804 shutdown_connections 2024-04-23T10:19:10.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822e59d000 1 -- 172.21.15.29:0/1725003804 wait complete. 2024-04-23T10:19:10.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822e59d000 20 client.5274 trim_cache size 0 max 16384 2024-04-23T10:19:10.952 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:19:10.952 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 10, 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "f06d0f68": { 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 10, 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:19:10.953 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 79.6, 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:10.954 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:10.955 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:19:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 -- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8208068380 msgr2=0x7f820806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8208068380 0x7f820806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8220009a30 tx=0x7f8220008040 comp rx=0 tx=0).stop 2024-04-23T10:19:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 -- 172.21.15.29:0/902947564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 msgr2=0x7f8224146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224146200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f82140ad040 tx=0x7f821401acb0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 -- 172.21.15.29:0/902947564 shutdown_connections 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8208068380 0x7f820806a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8224158cd0 0x7f8224140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82240c85e0 0x7f8224146200 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 --2- 172.21.15.29:0/902947564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82240c8200 0x7f82240cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 -- 172.21.15.29:0/902947564 >> 172.21.15.29:0/902947564 conn(0x7f82240cc490 msgr2=0x7f82241510f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 -- 172.21.15.29:0/902947564 shutdown_connections 2024-04-23T10:19:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:10.952+0000 7f822b41b640 1 -- 172.21.15.29:0/902947564 wait complete. 2024-04-23T10:19:10.973 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f06d0f68', quiesce took 5.9 seconds. Will release after: 19.6 2024-04-23T10:19:17.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:17.334 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:30.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:19:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58f4e23640 1 Processor -- start 2024-04-23T10:19:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58f4e23640 1 -- start start 2024-04-23T10:19:30.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58f4e23640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58f006f3b0 0x7f58f00c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:30.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58f4e23640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58f00c8950 0x7f58f0154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58f4e23640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f015eae0 con 0x7f58f00c7600 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58f4e23640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f58f0073b70 con 0x7f58f00c8950 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58f4e23640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f58f015edc0 con 0x7f58f006f3b0 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58edd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58f00c8950 0x7f58f0154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58edd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f58f00c8950 0x7f58f0154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35784/0 (socket says 172.21.15.29:35784) 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58edd9b640 1 -- 172.21.15.29:0/4158927896 learned_addr learned my addr 172.21.15.29:0/4158927896 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58ee59c640 1 --2- 172.21.15.29:0/4158927896 >> v2:172.21.15.72:3300/0 conn(0x7f58f006f3b0 0x7f58f00c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58edd9b640 1 -- 172.21.15.29:0/4158927896 >> v2:172.21.15.72:3300/0 conn(0x7f58f006f3b0 msgr2=0x7f58f00c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58edd9b640 1 --2- 172.21.15.29:0/4158927896 >> v2:172.21.15.72:3300/0 conn(0x7f58f006f3b0 0x7f58f00c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58edd9b640 1 -- 172.21.15.29:0/4158927896 >> v1:172.21.15.72:6789/0 conn(0x7f58f00c7600 legacy=0x7f58f0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:30.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.711+0000 7f58edd9b640 1 -- 172.21.15.29:0/4158927896 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f015f0a0 con 0x7f58f00c8950 2024-04-23T10:19:30.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58edd9b640 1 --2- 172.21.15.29:0/4158927896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f00c8950 0x7f58f0154f10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f58f00cce50 tx=0x7f58e401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffbc80036208484 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:30.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ed59a640 1 -- 172.21.15.29:0/4158927896 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40b5070 con 0x7f58f00c8950 2024-04-23T10:19:30.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ed59a640 1 -- 172.21.15.29:0/4158927896 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e40a8a10 con 0x7f58f00c8950 2024-04-23T10:19:30.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ed59a640 1 -- 172.21.15.29:0/4158927896 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40a8de0 con 0x7f58f00c8950 2024-04-23T10:19:30.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- 172.21.15.29:0/4158927896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f00c8950 msgr2=0x7f58f0154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:30.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 --2- 172.21.15.29:0/4158927896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f00c8950 0x7f58f0154f10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f58f00cce50 tx=0x7f58e401ed10 comp rx=0 tx=0).stop 2024-04-23T10:19:30.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- 172.21.15.29:0/4158927896 shutdown_connections 2024-04-23T10:19:30.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 --2- 172.21.15.29:0/4158927896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f00c8950 0x7f58f0154f10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 --2- 172.21.15.29:0/4158927896 >> v2:172.21.15.72:3300/0 conn(0x7f58f006f3b0 0x7f58f00c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- 172.21.15.29:0/4158927896 >> 172.21.15.29:0/4158927896 conn(0x7f58f006cfb0 msgr2=0x7f58f006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:30.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- 172.21.15.29:0/4158927896 shutdown_connections 2024-04-23T10:19:30.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- 172.21.15.29:0/4158927896 wait complete. 2024-04-23T10:19:30.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 Processor -- start 2024-04-23T10:19:30.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- start start 2024-04-23T10:19:30.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f006f3b0 0x7f58f00c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:30.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c7600 0x7f58f00c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:30.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f00c8950 0x7f58f01463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:30.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f58f0071960 con 0x7f58f006f3b0 2024-04-23T10:19:30.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f58f015f660 con 0x7f58f00c7600 2024-04-23T10:19:30.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58f4e23640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f58f015e780 con 0x7f58f00c8950 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f006f3b0 0x7f58f00c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f006f3b0 0x7f58f00c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35794/0 (socket says 172.21.15.29:35794) 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 -- 172.21.15.29:0/3288512799 learned_addr learned my addr 172.21.15.29:0/3288512799 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58edd9b640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c7600 0x7f58f00c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58eed9d640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f00c8950 0x7f58f01463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 -- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f00c8950 msgr2=0x7f58f01463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f00c8950 0x7f58f01463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 -- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c7600 msgr2=0x7f58f00c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c7600 0x7f58f00c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 -- 172.21.15.29:0/3288512799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f00c4a50 con 0x7f58f006f3b0 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58edd9b640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c7600 0x7f58f00c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58eed9d640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f00c8950 0x7f58f01463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.715+0000 7f58ee59c640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f006f3b0 0x7f58f00c5970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f58e000d800 tx=0x7f58e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:30.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58deffd640 1 -- 172.21.15.29:0/3288512799 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e000b660 con 0x7f58f006f3b0 2024-04-23T10:19:30.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58deffd640 1 -- 172.21.15.29:0/3288512799 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e0019070 con 0x7f58f006f3b0 2024-04-23T10:19:30.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f00cc1d0 con 0x7f58f006f3b0 2024-04-23T10:19:30.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58deffd640 1 -- 172.21.15.29:0/3288512799 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e000ba00 con 0x7f58f006f3b0 2024-04-23T10:19:30.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f00cb350 con 0x7f58f006f3b0 2024-04-23T10:19:30.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f0068d70 con 0x7f58f006f3b0 2024-04-23T10:19:30.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58deffd640 1 -- 172.21.15.29:0/3288512799 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58e000bba0 con 0x7f58f006f3b0 2024-04-23T10:19:30.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58deffd640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f58d0068380 0x7f58d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:30.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58deffd640 1 -- 172.21.15.29:0/3288512799 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f58e0087390 con 0x7f58f006f3b0 2024-04-23T10:19:30.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58edd9b640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f58d0068380 0x7f58d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:30.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.719+0000 7f58edd9b640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f58d0068380 0x7f58d006a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f58e40b2000 tx=0x7f58e40aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:30.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.723+0000 7f58deffd640 1 -- 172.21.15.29:0/3288512799 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f58e0057400 con 0x7f58f006f3b0 2024-04-23T10:19:30.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.923+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58f00ccc80 con 0x7f58f006f3b0 2024-04-23T10:19:30.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.923+0000 7f58deffd640 1 -- 172.21.15.29:0/3288512799 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f58e0056d00 con 0x7f58f006f3b0 2024-04-23T10:19:30.924 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:19:30.924 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:19:30.924 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:19:30.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f58d0068380 msgr2=0x7f58d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:30.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f58d0068380 0x7f58d006a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f58e40b2000 tx=0x7f58e40aa070 comp rx=0 tx=0).stop 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f006f3b0 msgr2=0x7f58f00c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f006f3b0 0x7f58f00c5970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f58e000d800 tx=0x7f58e000dcc0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 shutdown_connections 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f58d0068380 0x7f58d006a840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f00c8950 0x7f58f01463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c7600 0x7f58f00c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 --2- 172.21.15.29:0/3288512799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58f006f3b0 0x7f58f00c5970 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 >> 172.21.15.29:0/3288512799 conn(0x7f58f006cfb0 msgr2=0x7f58f00c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 shutdown_connections 2024-04-23T10:19:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:30.927+0000 7f58f4e23640 1 -- 172.21.15.29:0/3288512799 wait complete. 2024-04-23T10:19:30.944 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id f06d0f68 --release --await' 2024-04-23T10:19:30.944 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id f06d0f68 --release --await 2024-04-23T10:19:31.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.075+0000 7f9c994eb640 1 Processor -- start 2024-04-23T10:19:31.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.075+0000 7f9c994eb640 1 -- start start 2024-04-23T10:19:31.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.075+0000 7f9c994eb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c9406f3b0 0x7f9c940c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.075+0000 7f9c994eb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c9406f790 0x7f9c94073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.075+0000 7f9c994eb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c94071160 0x7f9c94157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.075+0000 7f9c994eb640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f9c94072fe0 con 0x7f9c9406f790 2024-04-23T10:19:31.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.075+0000 7f9c994eb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9c94158df0 con 0x7f9c9406f3b0 2024-04-23T10:19:31.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.075+0000 7f9c994eb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9c94072590 con 0x7f9c94071160 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c9406f790 0x7f9c94073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9c9406f790 0x7f9c94073470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35796/0 (socket says 172.21.15.29:35796) 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 -- 172.21.15.29:0/1784112709 learned_addr learned my addr 172.21.15.29:0/1784112709 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/1784112709 >> v2:172.21.15.72:3300/0 conn(0x7f9c9406f3b0 0x7f9c940c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c937fe640 1 --2- 172.21.15.29:0/1784112709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c94071160 0x7f9c94157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 -- 172.21.15.29:0/1784112709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c94071160 msgr2=0x7f9c94157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 --2- 172.21.15.29:0/1784112709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c94071160 0x7f9c94157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 -- 172.21.15.29:0/1784112709 >> v2:172.21.15.72:3300/0 conn(0x7f9c9406f3b0 msgr2=0x7f9c940c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 --2- 172.21.15.29:0/1784112709 >> v2:172.21.15.72:3300/0 conn(0x7f9c9406f3b0 0x7f9c940c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 -- 172.21.15.29:0/1784112709 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c94158830 con 0x7f9c9406f790 2024-04-23T10:19:31.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c927fc640 1 --2- 172.21.15.29:0/1784112709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f790 0x7f9c94073470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9c940c7d30 tx=0x7f9c8801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bf4e921c83bbcf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c91ffb640 1 -- 172.21.15.29:0/1784112709 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880aa610 con 0x7f9c9406f790 2024-04-23T10:19:31.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c91ffb640 1 -- 172.21.15.29:0/1784112709 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c880af070 con 0x7f9c9406f790 2024-04-23T10:19:31.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c91ffb640 1 -- 172.21.15.29:0/1784112709 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880aa9d0 con 0x7f9c9406f790 2024-04-23T10:19:31.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 -- 172.21.15.29:0/1784112709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f790 msgr2=0x7f9c94073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 --2- 172.21.15.29:0/1784112709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f790 0x7f9c94073470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9c940c7d30 tx=0x7f9c8801c4f0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 -- 172.21.15.29:0/1784112709 shutdown_connections 2024-04-23T10:19:31.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 --2- 172.21.15.29:0/1784112709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c94071160 0x7f9c94157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 --2- 172.21.15.29:0/1784112709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f790 0x7f9c94073470 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 --2- 172.21.15.29:0/1784112709 >> v2:172.21.15.72:3300/0 conn(0x7f9c9406f3b0 0x7f9c940c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 -- 172.21.15.29:0/1784112709 >> 172.21.15.29:0/1784112709 conn(0x7f9c9406cfb0 msgr2=0x7f9c9406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:31.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 -- 172.21.15.29:0/1784112709 shutdown_connections 2024-04-23T10:19:31.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.079+0000 7f9c994eb640 1 -- 172.21.15.29:0/1784112709 wait complete. 2024-04-23T10:19:31.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 Processor -- start 2024-04-23T10:19:31.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 -- start start 2024-04-23T10:19:31.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f3b0 0x7f9c940c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c9406f790 0x7f9c94154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c94071160 0x7f9c9415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9c941524b0 con 0x7f9c9406f3b0 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94152330 con 0x7f9c94071160 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9415b3e0 con 0x7f9c9406f790 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f3b0 0x7f9c940c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f3b0 0x7f9c940c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35804/0 (socket says 172.21.15.29:35804) 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 -- 172.21.15.29:0/3828032687 learned_addr learned my addr 172.21.15.29:0/3828032687 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c937fe640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c94071160 0x7f9c9415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 -- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c9406f790 msgr2=0x7f9c94154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c927fc640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c9406f790 0x7f9c94154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c9406f790 0x7f9c94154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 -- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c94071160 msgr2=0x7f9c9415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c94071160 0x7f9c9415a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 -- 172.21.15.29:0/3828032687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9414f370 con 0x7f9c9406f3b0 2024-04-23T10:19:31.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f3b0 0x7f9c940c5b10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9c84007e60 tx=0x7f9c8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c7b7fe640 1 -- 172.21.15.29:0/3828032687 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84014620 con 0x7f9c9406f3b0 2024-04-23T10:19:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c7b7fe640 1 -- 172.21.15.29:0/3828032687 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c84019070 con 0x7f9c9406f3b0 2024-04-23T10:19:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c7b7fe640 1 -- 172.21.15.29:0/3828032687 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84014a00 con 0x7f9c9406f3b0 2024-04-23T10:19:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 -- 172.21.15.29:0/3828032687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9414ebb0 con 0x7f9c9406f3b0 2024-04-23T10:19:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.083+0000 7f9c994eb640 1 -- 172.21.15.29:0/3828032687 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c941f7360 con 0x7f9c9406f3b0 2024-04-23T10:19:31.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c7b7fe640 1 -- 172.21.15.29:0/3828032687 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c84014ba0 con 0x7f9c9406f3b0 2024-04-23T10:19:31.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c7b7fe640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c80068380 0x7f9c8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c7b7fe640 1 -- 172.21.15.29:0/3828032687 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9c84087710 con 0x7f9c9406f3b0 2024-04-23T10:19:31.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c927fc640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c80068380 0x7f9c8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c9c66d000 1 Processor -- start 2024-04-23T10:19:31.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c9c66d000 1 -- start start 2024-04-23T10:19:31.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c927fc640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c80068380 0x7f9c8006a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c880ae000 tx=0x7f9c88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c51da9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 0x55b7c51db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c5216500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b7c5022660 con 0x55b7c52118a0 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b7c4fc75d0 con 0x55b7c51daf00 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b7c501e620 con 0x55b7c5216120 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c51da9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c51da9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35820/0 (socket says 172.21.15.29:35820) 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 -- 172.21.15.29:0/4169083632 learned_addr learned my addr 172.21.15.29:0/4169083632 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c927fc640 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 0x55b7c51db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c937fe640 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c5216500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 -- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 msgr2=0x55b7c5216500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c5216500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 -- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 msgr2=0x55b7c51db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 0x55b7c51db2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 -- 172.21.15.29:0/4169083632 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c4ffbbd0 con 0x55b7c52118a0 2024-04-23T10:19:31.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c937fe640 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c5216500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:19:31.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.087+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c51da9c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400efd0 tx=0x7f9c84057810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497d312b4e5a8968 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c78ff9640 1 -- 172.21.15.29:0/4169083632 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8405fcf0 con 0x55b7c52118a0 2024-04-23T10:19:31.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c78ff9640 1 -- 172.21.15.29:0/4169083632 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c84055410 con 0x55b7c52118a0 2024-04-23T10:19:31.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c78ff9640 1 -- 172.21.15.29:0/4169083632 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84053780 con 0x55b7c52118a0 2024-04-23T10:19:31.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- 172.21.15.29:0/4169083632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 msgr2=0x55b7c51da9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c51da9c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400efd0 tx=0x7f9c84057810 comp rx=0 tx=0).stop 2024-04-23T10:19:31.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- 172.21.15.29:0/4169083632 shutdown_connections 2024-04-23T10:19:31.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c5216500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 0x55b7c51db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/4169083632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c51da9c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- 172.21.15.29:0/4169083632 >> 172.21.15.29:0/4169083632 conn(0x55b7c50bcb00 msgr2=0x55b7c5213ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- 172.21.15.29:0/4169083632 shutdown_connections 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- 172.21.15.29:0/4169083632 wait complete. 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- start start 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 Processor -- start 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c5210650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c52118a0 0x55b7c5210b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c51d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b7c50dfd40 con 0x55b7c51daf00 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b7c4fdceb0 con 0x55b7c52118a0 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b7c501d2a0 con 0x55b7c5216120 2024-04-23T10:19:31.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 10 client.0 _ll_register_callbacks cb 0x55b7c51c0a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c5210650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c5210650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35826/0 (socket says 172.21.15.29:35826) 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 -- 172.21.15.29:0/1511271856 learned_addr learned my addr 172.21.15.29:0/1511271856 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 -- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 msgr2=0x55b7c51d58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c51d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 -- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c52118a0 msgr2=0x55b7c5210b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c52118a0 0x55b7c5210b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 -- 172.21.15.29:0/1511271856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c5068b30 con 0x55b7c51daf00 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c5210650 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009b90 tx=0x7f9c84007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d40f61512cc8cf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c71ffb640 1 -- 172.21.15.29:0/1511271856 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8405b170 con 0x55b7c51daf00 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c71ffb640 1 -- 172.21.15.29:0/1511271856 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9c84053780 con 0x55b7c51daf00 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- 172.21.15.29:0/1511271856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7c4fbc060 con 0x55b7c51daf00 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c71ffb640 1 -- 172.21.15.29:0/1511271856 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9c8407c050 con 0x55b7c51daf00 2024-04-23T10:19:31.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 10 client.5292 fetch_fsmap learned FSMap version 18 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- 172.21.15.29:0/1511271856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b7c4fc1b70 con 0x55b7c51daf00 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c71ffb640 1 -- 172.21.15.29:0/1511271856 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b7c4fbc060 con 0x55b7c51daf00 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c71ffb640 1 -- 172.21.15.29:0/1511271856 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f9c84085be0 con 0x55b7c51daf00 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 10 client.5292 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 10 client.5292 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 20 client.5292 populate_metadata read hostname 'smithi029' 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b7c51d6610 0x55b7c51d6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 4 client.5292 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c9c66d000 1 -- 172.21.15.29:0/1511271856 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7c4ffae30 con 0x55b7c51d6610 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.091+0000 7f9c927fc640 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b7c51d6610 0x55b7c51d6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c927fc640 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b7c51d6610 0x55b7c51d6a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc1271fcedaccbf3 server_cookie=7db96ffa3beae11 in_seq=0 out_seq=0 2024-04-23T10:19:31.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c71ffb640 10 client.5292 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:31.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c71ffb640 1 -- 172.21.15.29:0/1511271856 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b7c4ffae30 con 0x55b7c51d6610 2024-04-23T10:19:31.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c71ffb640 10 client.5292 handle_command_reply: tid=0 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 client.5292 shutdown 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 -- 172.21.15.29:0/1511271856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 msgr2=0x55b7c5210650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c5210650 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009b90 tx=0x7f9c84007f50 comp rx=0 tx=0).stop 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 -- 172.21.15.29:0/1511271856 shutdown_connections 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b7c51d6610 0x55b7c51d6a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c51d58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c52118a0 0x55b7c5210b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c71ffb640 0 client.5292 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/1511271856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c5210650 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 -- 172.21.15.29:0/1511271856 >> 172.21.15.29:0/1511271856 conn(0x55b7c50bcb00 msgr2=0x55b7c52159a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 -- 172.21.15.29:0/1511271856 shutdown_connections 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 1 -- 172.21.15.29:0/1511271856 wait complete. 2024-04-23T10:19:31.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.095+0000 7f9c9c66d000 20 client.5292 trim_cache size 0 max 16384 2024-04-23T10:19:31.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.111+0000 7f9c9c66d000 1 Processor -- start 2024-04-23T10:19:31.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.111+0000 7f9c9c66d000 1 -- start start 2024-04-23T10:19:31.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c51d9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c52118a0 0x55b7c51d97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c522cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94201930 con 0x55b7c51daf00 2024-04-23T10:19:31.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94202000 con 0x55b7c52118a0 2024-04-23T10:19:31.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9c94200170 con 0x55b7c5216120 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c51d9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c51d9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35842/0 (socket says 172.21.15.29:35842) 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 -- 172.21.15.29:0/2430869530 learned_addr learned my addr 172.21.15.29:0/2430869530 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 -- 172.21.15.29:0/2430869530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 msgr2=0x55b7c522cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/2430869530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c522cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 -- 172.21.15.29:0/2430869530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c52118a0 msgr2=0x55b7c51d97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/2430869530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c52118a0 0x55b7c51d97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 -- 172.21.15.29:0/2430869530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c50a45e0 con 0x55b7c51daf00 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/2430869530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c51d9290 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9c84056e10 tx=0x7f9c84081000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00fc131346d5112 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c73fff640 1 -- 172.21.15.29:0/2430869530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c840551b0 con 0x55b7c51daf00 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c73fff640 1 -- 172.21.15.29:0/2430869530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c84085be0 con 0x55b7c51daf00 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c73fff640 1 -- 172.21.15.29:0/2430869530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8405f860 con 0x55b7c51daf00 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2430869530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 msgr2=0x55b7c51d9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2430869530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c51d9290 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9c84056e10 tx=0x7f9c84081000 comp rx=0 tx=0).stop 2024-04-23T10:19:31.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2430869530 shutdown_connections 2024-04-23T10:19:31.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2430869530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c522cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2430869530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c52118a0 0x55b7c51d97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2430869530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c51daf00 0x55b7c51d9290 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2430869530 >> 172.21.15.29:0/2430869530 conn(0x55b7c50bcb00 msgr2=0x55b7c5211080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:31.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2430869530 shutdown_connections 2024-04-23T10:19:31.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2430869530 wait complete. 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- start start 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 Processor -- start 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 0x55b7c5283d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c5284250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c522ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b7c5021970 con 0x55b7c52118a0 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55b7c4fd78f0 con 0x55b7c51daf00 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55b7c5026c90 con 0x55b7c5216120 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c9c66d000 10 client.0 _ll_register_callbacks cb 0x7f9c880096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:19:31.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c5284250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c5284250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35854/0 (socket says 172.21.15.29:35854) 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 -- 172.21.15.29:0/2352910123 learned_addr learned my addr 172.21.15.29:0/2352910123 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c937fe640 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c522ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 0x55b7c5283d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 -- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 msgr2=0x55b7c522ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c522ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 -- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 msgr2=0x55b7c5283d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 0x55b7c5283d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 -- 172.21.15.29:0/2352910123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c4fb4ae0 con 0x55b7c52118a0 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c937fe640 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c522ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c927fc640 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c5284250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9c880ac040 tx=0x7f9c8801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7439bc2923fb1e50 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.115+0000 7f9c71ffb640 1 -- 172.21.15.29:0/2352910123 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880c5430 con 0x55b7c52118a0 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c71ffb640 1 -- 172.21.15.29:0/2352910123 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9c880c55d0 con 0x55b7c52118a0 2024-04-23T10:19:31.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2352910123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c84085be0 con 0x55b7c52118a0 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c71ffb640 1 -- 172.21.15.29:0/2352910123 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9c880d4050 con 0x55b7c52118a0 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 10 client.5298 fetch_fsmap learned FSMap version 18 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2352910123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b7c4fb7d80 con 0x55b7c52118a0 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c71ffb640 1 -- 172.21.15.29:0/2352910123 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c84085be0 con 0x55b7c52118a0 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c71ffb640 1 -- 172.21.15.29:0/2352910123 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f9c880d7020 con 0x55b7c52118a0 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 10 client.5298 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 10 client.5298 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 20 client.5298 populate_metadata read hostname 'smithi029' 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b7c522fbc0 0x55b7c522ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 4 client.5298 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f06d0f68", "release": true, "await": true}] 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2352910123 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f06d0f68", "release": true, "await": true}) -- 0x55b7c4fc00d0 con 0x55b7c522fbc0 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b7c522fbc0 0x55b7c522ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c92ffd640 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b7c522fbc0 0x55b7c522ffd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edfb6f247491944c server_cookie=a986f6c9114eec2f in_seq=0 out_seq=0 2024-04-23T10:19:31.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.119+0000 7f9c71ffb640 10 client.5298 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:31.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.451+0000 7f9c71ffb640 1 -- 172.21.15.29:0/2352910123 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b7c4fc00d0 con 0x55b7c522fbc0 2024-04-23T10:19:31.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.451+0000 7f9c71ffb640 10 client.5298 handle_command_reply: tid=0 2024-04-23T10:19:31.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.451+0000 7f9c9c66d000 1 client.5298 shutdown 2024-04-23T10:19:31.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2352910123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 msgr2=0x55b7c5284250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c5284250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9c880ac040 tx=0x7f9c8801ad30 comp rx=0 tx=0).stop 2024-04-23T10:19:31.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2352910123 shutdown_connections 2024-04-23T10:19:31.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55b7c522fbc0 0x55b7c522ffd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55b7c5216120 0x55b7c522ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c71ffb640 0 client.5298 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b7c52118a0 0x55b7c5284250 secure :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9c880ac040 tx=0x7f9c8801ad30 comp rx=0 tx=0).stop 2024-04-23T10:19:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 --2- 172.21.15.29:0/2352910123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b7c51daf00 0x55b7c5283d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2352910123 >> 172.21.15.29:0/2352910123 conn(0x55b7c50bcb00 msgr2=0x55b7c51d4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2352910123 shutdown_connections 2024-04-23T10:19:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 1 -- 172.21.15.29:0/2352910123 wait complete. 2024-04-23T10:19:31.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c9c66d000 20 client.5298 trim_cache size 0 max 16384 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 12, 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "f06d0f68": { 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 12, 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:19:31.456 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 79.6, 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:31.457 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:31.458 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:31.458 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:19:31.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 -- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c80068380 msgr2=0x7f9c8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c80068380 0x7f9c8006a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c880ae000 tx=0x7f9c88008040 comp rx=0 tx=0).stop 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 -- 172.21.15.29:0/3828032687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f3b0 msgr2=0x7f9c940c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f3b0 0x7f9c940c5b10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9c84007e60 tx=0x7f9c8400e4b0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 -- 172.21.15.29:0/3828032687 shutdown_connections 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f9c80068380 0x7f9c8006a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c94071160 0x7f9c9415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c9406f790 0x7f9c94154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 --2- 172.21.15.29:0/3828032687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c9406f3b0 0x7f9c940c5b10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 -- 172.21.15.29:0/3828032687 >> 172.21.15.29:0/3828032687 conn(0x7f9c9406cfb0 msgr2=0x7f9c94150f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 -- 172.21.15.29:0/3828032687 shutdown_connections 2024-04-23T10:19:31.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.455+0000 7f9c994eb640 1 -- 172.21.15.29:0/3828032687 wait complete. 2024-04-23T10:19:31.486 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f06d0f68', seconds elapsed: 26.4 2024-04-23T10:19:31.486 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.6 2024-04-23T10:19:31.487 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:19:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f049dd78640 1 Processor -- start 2024-04-23T10:19:31.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f049dd78640 1 -- start start 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f049dd78640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04980ce960 0x7f04980c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f049dd78640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 0x7f04980cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f049dd78640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0498074380 0x7f04980cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f049dd78640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f04980740f0 con 0x7f0498074380 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f049dd78640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0498073b70 con 0x7f04980ce960 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f049dd78640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0498073e10 con 0x7f04980ced40 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0497fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0498074380 0x7f04980cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0497fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0498074380 0x7f04980cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35858/0 (socket says 172.21.15.29:35858) 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0497fff640 1 -- 172.21.15.29:0/2042133242 learned_addr learned my addr 172.21.15.29:0/2042133242 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0496ffd640 1 --2- 172.21.15.29:0/2042133242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 0x7f04980cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f04977fe640 1 --2- 172.21.15.29:0/2042133242 >> v2:172.21.15.72:3300/0 conn(0x7f04980ce960 0x7f04980c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0497fff640 1 -- 172.21.15.29:0/2042133242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 msgr2=0x7f04980cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0497fff640 1 --2- 172.21.15.29:0/2042133242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 0x7f04980cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0497fff640 1 -- 172.21.15.29:0/2042133242 >> v2:172.21.15.72:3300/0 conn(0x7f04980ce960 msgr2=0x7f04980c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0497fff640 1 --2- 172.21.15.29:0/2042133242 >> v2:172.21.15.72:3300/0 conn(0x7f04980ce960 0x7f04980c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f0497fff640 1 -- 172.21.15.29:0/2042133242 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04980ca8d0 con 0x7f0498074380 2024-04-23T10:19:31.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.635+0000 7f04977fe640 1 --2- 172.21.15.29:0/2042133242 >> v2:172.21.15.72:3300/0 conn(0x7f04980ce960 0x7f04980c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:19:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f0497fff640 1 --2- 172.21.15.29:0/2042133242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0498074380 0x7f04980cb920 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f04980cb170 tx=0x7f049001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e60a3cb9bc2d8e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f04967fc640 1 -- 172.21.15.29:0/2042133242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900a5780 con 0x7f0498074380 2024-04-23T10:19:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f04967fc640 1 -- 172.21.15.29:0/2042133242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04900a5920 con 0x7f0498074380 2024-04-23T10:19:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f04967fc640 1 -- 172.21.15.29:0/2042133242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900a5cf0 con 0x7f0498074380 2024-04-23T10:19:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 -- 172.21.15.29:0/2042133242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0498074380 msgr2=0x7f04980cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 --2- 172.21.15.29:0/2042133242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0498074380 0x7f04980cb920 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f04980cb170 tx=0x7f049001c9f0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 -- 172.21.15.29:0/2042133242 shutdown_connections 2024-04-23T10:19:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 --2- 172.21.15.29:0/2042133242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0498074380 0x7f04980cb920 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 --2- 172.21.15.29:0/2042133242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 0x7f04980cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 --2- 172.21.15.29:0/2042133242 >> v2:172.21.15.72:3300/0 conn(0x7f04980ce960 0x7f04980c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 -- 172.21.15.29:0/2042133242 >> 172.21.15.29:0/2042133242 conn(0x7f0498070f60 msgr2=0x7f0498071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:31.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 -- 172.21.15.29:0/2042133242 shutdown_connections 2024-04-23T10:19:31.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.639+0000 7f049dd78640 1 -- 172.21.15.29:0/2042133242 wait complete. 2024-04-23T10:19:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 Processor -- start 2024-04-23T10:19:31.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 -- start start 2024-04-23T10:19:31.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0498074380 0x7f04981f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04980ce960 0x7f0498149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 0x7f0498145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f049806d9f0 con 0x7f04980ce960 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0498153620 con 0x7f0498074380 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f04980c7d60 con 0x7f04980ced40 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04980ce960 0x7f0498149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04980ce960 0x7f0498149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35860/0 (socket says 172.21.15.29:35860) 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 -- 172.21.15.29:0/2790487512 learned_addr learned my addr 172.21.15.29:0/2790487512 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f04977fe640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0498074380 0x7f04981f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0497fff640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 0x7f0498145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 -- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 msgr2=0x7f0498145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 0x7f0498145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 -- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0498074380 msgr2=0x7f04981f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0498074380 0x7f04981f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 -- 172.21.15.29:0/2790487512 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049814a3a0 con 0x7f04980ce960 2024-04-23T10:19:31.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f0496ffd640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04980ce960 0x7f0498149cf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f048c00e870 tx=0x7f048c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f047ffff640 1 -- 172.21.15.29:0/2790487512 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c017070 con 0x7f04980ce960 2024-04-23T10:19:31.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f047ffff640 1 -- 172.21.15.29:0/2790487512 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c00c940 con 0x7f04980ce960 2024-04-23T10:19:31.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049814a680 con 0x7f04980ce960 2024-04-23T10:19:31.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f047ffff640 1 -- 172.21.15.29:0/2790487512 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c00cd10 con 0x7f04980ce960 2024-04-23T10:19:31.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.643+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049814b270 con 0x7f04980ce960 2024-04-23T10:19:31.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.647+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04980693c0 con 0x7f04980ce960 2024-04-23T10:19:31.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.647+0000 7f047ffff640 1 -- 172.21.15.29:0/2790487512 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f048c01a070 con 0x7f04980ce960 2024-04-23T10:19:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.647+0000 7f047ffff640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0484068380 0x7f048406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.647+0000 7f047ffff640 1 -- 172.21.15.29:0/2790487512 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f048c086fb0 con 0x7f04980ce960 2024-04-23T10:19:31.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.647+0000 7f04977fe640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0484068380 0x7f048406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:31.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.647+0000 7f04977fe640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0484068380 0x7f048406a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04880098d0 tx=0x7f0488008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:31.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.651+0000 7f047ffff640 1 -- 172.21.15.29:0/2790487512 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f048c056ae0 con 0x7f04980ce960 2024-04-23T10:19:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.923+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04980cc630 con 0x7f04980ce960 2024-04-23T10:19:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.923+0000 7f047ffff640 1 -- 172.21.15.29:0/2790487512 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f048c05ade0 con 0x7f04980ce960 2024-04-23T10:19:31.923 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:19:31.923 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:19:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.923+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0484068380 msgr2=0x7f048406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.923+0000 7f049dd78640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0484068380 0x7f048406a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04880098d0 tx=0x7f0488008040 comp rx=0 tx=0).stop 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04980ce960 msgr2=0x7f0498149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04980ce960 0x7f0498149cf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f048c00e870 tx=0x7f048c00ed30 comp rx=0 tx=0).stop 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 shutdown_connections 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0484068380 0x7f048406a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04980ced40 0x7f0498145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04980ce960 0x7f0498149cf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 --2- 172.21.15.29:0/2790487512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0498074380 0x7f04981f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 >> 172.21.15.29:0/2790487512 conn(0x7f0498070f60 msgr2=0x7f04980cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 shutdown_connections 2024-04-23T10:19:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:31.927+0000 7f049dd78640 1 -- 172.21.15.29:0/2790487512 wait complete. 2024-04-23T10:19:31.948 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 79.6 --await-for 42.0' 2024-04-23T10:19:31.948 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 79.6 --await-for 42.0 2024-04-23T10:19:32.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5b5602640 1 Processor -- start 2024-04-23T10:19:32.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5b5602640 1 -- start start 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5b5602640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b006de70 0x7fb5b015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5b5602640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b0072bf0 con 0x7fb5b00c38c0 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5b5602640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b0071630 con 0x7fb5b0152180 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5b5602640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b00c9160 con 0x7fb5b006de70 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5a7fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb5b00c38c0 0x7fb5b0160800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37544/0 (socket says 172.21.15.29:37544) 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5a7fff640 1 -- 172.21.15.29:0/173621000 learned_addr learned my addr 172.21.15.29:0/173621000 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/173621000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b006de70 0x7fb5b015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5ae7fc640 1 -- 172.21.15.29:0/173621000 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635042884 0 0) 0x7fb5b0072bf0 con 0x7fb5b00c38c0 2024-04-23T10:19:32.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5ae7fc640 1 -- 172.21.15.29:0/173621000 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb59c003530 con 0x7fb5b00c38c0 2024-04-23T10:19:32.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5af7fe640 1 -- 172.21.15.29:0/173621000 >> v1:172.21.15.72:6789/0 conn(0x7fb5b0152180 legacy=0x7fb5b0072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5af7fe640 1 -- 172.21.15.29:0/173621000 >> v1:172.21.15.29:6789/0 conn(0x7fb5b00c38c0 legacy=0x7fb5b0160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5ae7fc640 1 -- 172.21.15.29:0/173621000 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1532940433 0 0) 0x7fb5b0071630 con 0x7fb5b0152180 2024-04-23T10:19:32.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.099+0000 7fb5af7fe640 1 -- 172.21.15.29:0/173621000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b0071910 con 0x7fb5b006de70 2024-04-23T10:19:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/173621000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b006de70 0x7fb5b015bfc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009dc0 tx=0x7fb5a801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c861275da49e33 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5ae7fc640 1 -- 172.21.15.29:0/173621000 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80b2070 con 0x7fb5b006de70 2024-04-23T10:19:32.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5ae7fc640 1 -- 172.21.15.29:0/173621000 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a80a5850 con 0x7fb5b006de70 2024-04-23T10:19:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5ae7fc640 1 -- 172.21.15.29:0/173621000 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80a5c00 con 0x7fb5b006de70 2024-04-23T10:19:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5b5602640 1 -- 172.21.15.29:0/173621000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b006de70 msgr2=0x7fb5b015bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5b5602640 1 --2- 172.21.15.29:0/173621000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b006de70 0x7fb5b015bfc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009dc0 tx=0x7fb5a801c990 comp rx=0 tx=0).stop 2024-04-23T10:19:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5b5602640 1 -- 172.21.15.29:0/173621000 shutdown_connections 2024-04-23T10:19:32.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5b5602640 1 --2- 172.21.15.29:0/173621000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b006de70 0x7fb5b015bfc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5b5602640 1 -- 172.21.15.29:0/173621000 >> 172.21.15.29:0/173621000 conn(0x7fb5b006d350 msgr2=0x7fb5b006d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:32.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5b5602640 1 -- 172.21.15.29:0/173621000 shutdown_connections 2024-04-23T10:19:32.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.103+0000 7fb5b5602640 1 -- 172.21.15.29:0/173621000 wait complete. 2024-04-23T10:19:32.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5b5602640 1 Processor -- start 2024-04-23T10:19:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5b5602640 1 -- start start 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5b5602640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b006de70 0x7fb5b0157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5b5602640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5b00c38c0 0x7fb5b013b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5b5602640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b0152180 0x7fb5b01f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5b5602640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00c8d90 con 0x7fb5b006de70 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5b5602640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0158380 con 0x7fb5b00c38c0 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5b5602640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b00c8f10 con 0x7fb5b0152180 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5aeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b006de70 0x7fb5b0157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5aeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b006de70 0x7fb5b0157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35876/0 (socket says 172.21.15.29:35876) 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5aeffd640 1 -- 172.21.15.29:0/2338117156 learned_addr learned my addr 172.21.15.29:0/2338117156 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5a7fff640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5b00c38c0 0x7fb5b013b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b0152180 0x7fb5b01f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5aeffd640 1 -- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b0152180 msgr2=0x7fb5b01f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b0152180 0x7fb5b01f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5aeffd640 1 -- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5b00c38c0 msgr2=0x7fb5b013b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5b00c38c0 0x7fb5b013b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.107+0000 7fb5aeffd640 1 -- 172.21.15.29:0/2338117156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b00c5f40 con 0x7fb5b006de70 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b006de70 0x7fb5b0157200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000c500 tx=0x7fb5a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5a77fe640 1 -- 172.21.15.29:0/2338117156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0017070 con 0x7fb5b006de70 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5b5602640 1 -- 172.21.15.29:0/2338117156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b013f5d0 con 0x7fb5b006de70 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5a77fe640 1 -- 172.21.15.29:0/2338117156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a0003600 con 0x7fb5b006de70 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5a77fe640 1 -- 172.21.15.29:0/2338117156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0017070 con 0x7fb5b006de70 2024-04-23T10:19:32.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5b5602640 1 -- 172.21.15.29:0/2338117156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b0157740 con 0x7fb5b006de70 2024-04-23T10:19:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5a77fe640 1 -- 172.21.15.29:0/2338117156 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb5a001a070 con 0x7fb5b006de70 2024-04-23T10:19:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5a77fe640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb5900685b0 0x7fb59006aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5a77fe640 1 -- 172.21.15.29:0/2338117156 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb5a0085ba0 con 0x7fb5b006de70 2024-04-23T10:19:32.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5b8784000 1 Processor -- start 2024-04-23T10:19:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.111+0000 7fb5b8784000 1 -- start start 2024-04-23T10:19:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5a7fff640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb5900685b0 0x7fb59006aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41230 0x55a9a0c40590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c40ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0b232a0 con 0x55a9a0c41230 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0a895f0 con 0x55a9a0c41610 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a9a0a24820 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5a7fff640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb5900685b0 0x7fb59006aa70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0139ee0 tx=0x7fb598007d00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41230 0x55a9a0c40590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41230 0x55a9a0c40590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35892/0 (socket says 172.21.15.29:35892) 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 -- 172.21.15.29:0/2710597975 learned_addr learned my addr 172.21.15.29:0/2710597975 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5a7fff640 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c40ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 -- 172.21.15.29:0/2710597975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c7c6c0 msgr2=0x55a9a0c7caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 -- 172.21.15.29:0/2710597975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 msgr2=0x55a9a0c40ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c40ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 -- 172.21.15.29:0/2710597975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a0acfc00 con 0x55a9a0c41230 2024-04-23T10:19:32.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41230 0x55a9a0c40590 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0007fd0 tx=0x7fb5a0055720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249adc6dd3912e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:32.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5a4ff9640 1 -- 172.21.15.29:0/2710597975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0082070 con 0x55a9a0c41230 2024-04-23T10:19:32.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5a4ff9640 1 -- 172.21.15.29:0/2710597975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a005e250 con 0x55a9a0c41230 2024-04-23T10:19:32.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5a4ff9640 1 -- 172.21.15.29:0/2710597975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0051d90 con 0x55a9a0c41230 2024-04-23T10:19:32.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- 172.21.15.29:0/2710597975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41230 msgr2=0x55a9a0c40590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41230 0x55a9a0c40590 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0007fd0 tx=0x7fb5a0055720 comp rx=0 tx=0).stop 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- 172.21.15.29:0/2710597975 shutdown_connections 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c40ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2710597975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41230 0x55a9a0c40590 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- 172.21.15.29:0/2710597975 >> 172.21.15.29:0/2710597975 conn(0x55a9a0c78470 msgr2=0x55a9a0c7a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- 172.21.15.29:0/2710597975 shutdown_connections 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- 172.21.15.29:0/2710597975 wait complete. 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 -- start start 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.115+0000 7fb5b8784000 1 Processor -- start 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 0x55a9a0c76350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c76890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0a34c60 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0b0bbf0 con 0x55a9a0c41610 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a9a0b46560 con 0x55a9a0c41230 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 10 client.0 _ll_register_callbacks cb 0x55a9a0a60570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c76890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5aeffd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 0x55a9a0c76350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c76890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:51440/0 (socket says 172.21.15.29:51440) 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5a7fff640 1 -- 172.21.15.29:0/2617048850 learned_addr learned my addr 172.21.15.29:0/2617048850 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5af7fe640 1 -- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 msgr2=0x55a9a0c76350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 0x55a9a0c76350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5af7fe640 1 -- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 msgr2=0x55a9a0c76890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c76890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5af7fe640 1 -- 172.21.15.29:0/2617048850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a0ac4630 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80ac000 tx=0x7fb5a801b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2968724deaafa252 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb58dffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb58dffb640 1 -- 172.21.15.29:0/2617048850 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80be070 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb58dffb640 1 -- 172.21.15.29:0/2617048850 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb5a80a5a90 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 -- 172.21.15.29:0/2617048850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a005e250 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb58dffb640 1 -- 172.21.15.29:0/2617048850 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb5a80b2040 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 10 client.5316 fetch_fsmap learned FSMap version 18 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 -- 172.21.15.29:0/2617048850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a9a0a29490 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb58dffb640 1 -- 172.21.15.29:0/2617048850 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a005e250 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb58dffb640 1 -- 172.21.15.29:0/2617048850 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fb5a80a5c90 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 10 client.5316 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 10 client.5316 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 20 client.5316 populate_metadata read hostname 'smithi029' 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a9a0c7d840 0x55a9a0c7dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 4 client.5316 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:19:32.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5b8784000 1 -- 172.21.15.29:0/2617048850 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9a0a237f0 con 0x55a9a0c7d840 2024-04-23T10:19:32.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a9a0c7d840 0x55a9a0c7dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a9a0c7d840 0x55a9a0c7dc20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac7032d3429ae5f server_cookie=2bfdcdbe97a6a4fd in_seq=0 out_seq=0 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.119+0000 7fb58dffb640 10 client.5316 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb58dffb640 1 -- 172.21.15.29:0/2617048850 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a9a0a237f0 con 0x55a9a0c7d840 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb58dffb640 10 client.5316 handle_command_reply: tid=0 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 client.5316 shutdown 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 -- 172.21.15.29:0/2617048850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 msgr2=0x55a9a0c7caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80ac000 tx=0x7fb5a801b1d0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 -- 172.21.15.29:0/2617048850 shutdown_connections 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a9a0c7d840 0x55a9a0c7dc20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c7caa0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41610 0x55a9a0c76890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2617048850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 0x55a9a0c76350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 -- 172.21.15.29:0/2617048850 >> 172.21.15.29:0/2617048850 conn(0x55a9a0c78470 msgr2=0x55a9a0c77810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:32.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb58dffb640 0 client.5316 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:32.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 -- 172.21.15.29:0/2617048850 shutdown_connections 2024-04-23T10:19:32.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 1 -- 172.21.15.29:0/2617048850 wait complete. 2024-04-23T10:19:32.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.123+0000 7fb5b8784000 20 client.5316 trim_cache size 0 max 16384 2024-04-23T10:19:32.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.147+0000 7fb5b8784000 1 Processor -- start 2024-04-23T10:19:32.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.147+0000 7fb5b8784000 1 -- start start 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 0x55a9a0c7b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41610 0x55a9a0c7bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c76170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b015f570 con 0x55a9a0c41610 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b015fc40 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b00c5ad0 con 0x55a9a0c41230 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41610 0x55a9a0c7bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41610 0x55a9a0c7bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35906/0 (socket says 172.21.15.29:35906) 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 -- 172.21.15.29:0/2561373851 learned_addr learned my addr 172.21.15.29:0/2561373851 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c76170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 0x55a9a0c7b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 -- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 msgr2=0x55a9a0c7b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 0x55a9a0c7b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 -- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c7c6c0 msgr2=0x55a9a0c76170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c76170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 -- 172.21.15.29:0/2561373851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a0a24a70 con 0x55a9a0c41610 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c76170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5a7fff640 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41610 0x55a9a0c7bbf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb598007fd0 tx=0x7fb59800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae35e14bede5eb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb58ffff640 1 -- 172.21.15.29:0/2561373851 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598027030 con 0x55a9a0c41610 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb58ffff640 1 -- 172.21.15.29:0/2561373851 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb598013c40 con 0x55a9a0c41610 2024-04-23T10:19:32.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb58ffff640 1 -- 172.21.15.29:0/2561373851 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598013df0 con 0x55a9a0c41610 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- 172.21.15.29:0/2561373851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41610 msgr2=0x55a9a0c7bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41610 0x55a9a0c7bbf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb598007fd0 tx=0x7fb59800c000 comp rx=0 tx=0).stop 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- 172.21.15.29:0/2561373851 shutdown_connections 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c76170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c41610 0x55a9a0c7bbf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2561373851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41230 0x55a9a0c7b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- 172.21.15.29:0/2561373851 >> 172.21.15.29:0/2561373851 conn(0x55a9a0c78470 msgr2=0x55a9a0ca15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- 172.21.15.29:0/2561373851 shutdown_connections 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- 172.21.15.29:0/2561373851 wait complete. 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- start start 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 Processor -- start 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41230 0x55a9a0ca1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41610 0x55a9a0ca1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c9f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0a88900 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a9a0a53e60 con 0x55a9a0c41230 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a9a0a8dc20 con 0x55a9a0c41610 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5b8784000 10 client.0 _ll_register_callbacks cb 0x7fb5a8009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c9f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c9f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35914/0 (socket says 172.21.15.29:35914) 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.151+0000 7fb5af7fe640 1 -- 172.21.15.29:0/2401526298 learned_addr learned my addr 172.21.15.29:0/2401526298 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41230 0x55a9a0ca1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5a7fff640 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41610 0x55a9a0ca1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5af7fe640 1 -- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41610 msgr2=0x55a9a0ca1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41610 0x55a9a0ca1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5af7fe640 1 -- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41230 msgr2=0x55a9a0ca1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41230 0x55a9a0ca1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5af7fe640 1 -- 172.21.15.29:0/2401526298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a0b0c080 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5af7fe640 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c9f580 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8098370 tx=0x7fb5a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dba460569d5b11 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb58dffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb58dffb640 1 -- 172.21.15.29:0/2401526298 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80be070 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb58dffb640 1 -- 172.21.15.29:0/2401526298 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb5a8002040 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 1 -- 172.21.15.29:0/2401526298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb598013c40 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb58dffb640 1 -- 172.21.15.29:0/2401526298 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb5a8009450 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 10 client.5322 fetch_fsmap learned FSMap version 18 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 1 -- 172.21.15.29:0/2401526298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a9a0a2f3e0 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb58dffb640 1 -- 172.21.15.29:0/2401526298 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb598013c40 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb58dffb640 1 -- 172.21.15.29:0/2401526298 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fb5a80a5890 con 0x55a9a0c7c6c0 2024-04-23T10:19:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 10 client.5322 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:19:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 10 client.5322 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:19:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 20 client.5322 populate_metadata read hostname 'smithi029' 2024-04-23T10:19:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a9a0c9ff40 0x55a9a0ca0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 4 client.5322 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.6, "await_for": 42.0}] 2024-04-23T10:19:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5b8784000 1 -- 172.21.15.29:0/2401526298 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.6, "await_for": 42.0}) -- 0x55a9a0a32940 con 0x55a9a0c9ff40 2024-04-23T10:19:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a9a0c9ff40 0x55a9a0ca0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb5aeffd640 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a9a0c9ff40 0x55a9a0ca0350 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebec9367c1d4568d server_cookie=addc6cbc0d5e61df in_seq=0 out_seq=0 2024-04-23T10:19:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:32.155+0000 7fb58dffb640 10 client.5322 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:34.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb58dffb640 1 -- 172.21.15.29:0/2401526298 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a9a0a32940 con 0x55a9a0c9ff40 2024-04-23T10:19:34.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb58dffb640 10 client.5322 handle_command_reply: tid=0 2024-04-23T10:19:34.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 client.5322 shutdown 2024-04-23T10:19:34.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 -- 172.21.15.29:0/2401526298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 msgr2=0x55a9a0c9f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:34.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c9f580 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8098370 tx=0x7fb5a8009750 comp rx=0 tx=0).stop 2024-04-23T10:19:34.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 -- 172.21.15.29:0/2401526298 shutdown_connections 2024-04-23T10:19:34.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a9a0c9ff40 0x55a9a0ca0350 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9a0c7c6c0 0x55a9a0c9f580 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb58dffb640 0 client.5322 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a9a0c41610 0x55a9a0ca1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 --2- 172.21.15.29:0/2401526298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a9a0c41230 0x55a9a0ca1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 -- 172.21.15.29:0/2401526298 >> 172.21.15.29:0/2401526298 conn(0x55a9a0c78470 msgr2=0x55a9a0c462f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 -- 172.21.15.29:0/2401526298 shutdown_connections 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 1 -- 172.21.15.29:0/2401526298 wait complete. 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.867+0000 7fb5b8784000 20 client.5322 trim_cache size 0 max 16384 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:19:34.870 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 14, 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "b4f27fa8": { 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 14, 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 79.6, 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:19:34.871 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:19:34.872 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:19:34.872 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:19:34.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:34.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:34.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:34.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:34.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:34.872 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 -- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb5900685b0 msgr2=0x7fb59006aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb5900685b0 0x7fb59006aa70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0139ee0 tx=0x7fb598007d00 comp rx=0 tx=0).stop 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 -- 172.21.15.29:0/2338117156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b006de70 msgr2=0x7fb5b0157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b006de70 0x7fb5b0157200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000c500 tx=0x7fb5a000c9c0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 -- 172.21.15.29:0/2338117156 shutdown_connections 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fb5900685b0 0x7fb59006aa70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5b0152180 0x7fb5b01f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5b00c38c0 0x7fb5b013b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 --2- 172.21.15.29:0/2338117156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b006de70 0x7fb5b0157200 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 -- 172.21.15.29:0/2338117156 >> 172.21.15.29:0/2338117156 conn(0x7fb5b006d350 msgr2=0x7fb5b0141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:34.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 -- 172.21.15.29:0/2338117156 shutdown_connections 2024-04-23T10:19:34.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:34.871+0000 7fb5b5602640 1 -- 172.21.15.29:0/2338117156 wait complete. 2024-04-23T10:19:34.895 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b4f27fa8', quiesce took 3.4 seconds. Will release after: 19.6 2024-04-23T10:19:47.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:47.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:54.496 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:19:54.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24c57d640 1 Processor -- start 2024-04-23T10:19:54.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24c57d640 1 -- start start 2024-04-23T10:19:54.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24c57d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24415bd80 0x7fd2440cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24c57d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2440cbcb0 0x7fd2440c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24c57d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24406c910 con 0x7fd244151bb0 2024-04-23T10:19:54.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24c57d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd24406cbf0 con 0x7fd2440cbcb0 2024-04-23T10:19:54.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24c57d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd24406ced0 con 0x7fd24415bd80 2024-04-23T10:19:54.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24a319640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd244151bb0 0x7fd2440c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:52152/0 (socket says 172.21.15.29:52152) 2024-04-23T10:19:54.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24a319640 1 -- 172.21.15.29:0/876324272 learned_addr learned my addr 172.21.15.29:0/876324272 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24ab1a640 1 --2- 172.21.15.29:0/876324272 >> v2:172.21.15.72:3300/0 conn(0x7fd2440cbcb0 0x7fd2440c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249b18640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24415bd80 0x7fd2440cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394480198 0 0) 0x7fd24406c910 con 0x7fd244151bb0 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd230003530 con 0x7fd244151bb0 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 217045995 0 0) 0x7fd230003530 con 0x7fd244151bb0 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24415bd80 msgr2=0x7fd2440cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24415bd80 0x7fd2440cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 >> v2:172.21.15.72:3300/0 conn(0x7fd2440cbcb0 msgr2=0x7fd2440c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 --2- 172.21.15.29:0/876324272 >> v2:172.21.15.72:3300/0 conn(0x7fd2440cbcb0 0x7fd2440c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24406d1b0 con 0x7fd244151bb0 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fd240001680 con 0x7fd244151bb0 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 >> v1:172.21.15.29:6789/0 conn(0x7fd244151bb0 legacy=0x7fd2440c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:54.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300039c0 0x7fd230003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd230004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24415bd80 0x7fd2300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd24406cbf0 con 0x7fd230004810 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd24406ced0 con 0x7fd2300039c0 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd23000ba00 con 0x7fd24415bd80 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249b18640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd230004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24ab1a640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24415bd80 0x7fd2300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd24a319640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300039c0 0x7fd230003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249b18640 1 -- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24415bd80 msgr2=0x7fd2300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249b18640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24415bd80 0x7fd2300051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249b18640 1 -- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300039c0 msgr2=0x7fd230003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249b18640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300039c0 0x7fd230003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.631+0000 7fd249b18640 1 -- 172.21.15.29:0/876324272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd230003530 con 0x7fd230004810 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd249b18640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd230004c90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd234009ac0 tx=0x7fd23401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77173327cbe403f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2340b2070 con 0x7fd230004810 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2340a5560 con 0x7fd230004810 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd249317640 1 -- 172.21.15.29:0/876324272 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234009690 con 0x7fd230004810 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24c57d640 1 -- 172.21.15.29:0/876324272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 msgr2=0x7fd230004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24c57d640 1 --2- 172.21.15.29:0/876324272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd230004c90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd234009ac0 tx=0x7fd23401ca50 comp rx=0 tx=0).stop 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24ab1a640 1 -- 172.21.15.29:0/876324272 reap_dead start 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24c57d640 1 -- 172.21.15.29:0/876324272 shutdown_connections 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24c57d640 1 -- 172.21.15.29:0/876324272 >> 172.21.15.29:0/876324272 conn(0x7fd2440730f0 msgr2=0x7fd244073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24c57d640 1 -- 172.21.15.29:0/876324272 shutdown_connections 2024-04-23T10:19:54.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24c57d640 1 -- 172.21.15.29:0/876324272 wait complete. 2024-04-23T10:19:54.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24c57d640 1 Processor -- start 2024-04-23T10:19:54.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.635+0000 7fd24c57d640 1 -- start start 2024-04-23T10:19:54.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd244152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24414bf80 0x7fd24415e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24415edb0 0x7fd2441f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd2440c6010 con 0x7fd230004810 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd244151f90 con 0x7fd24415edb0 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd2440c6190 con 0x7fd24414bf80 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd244152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd244152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46278/0 (socket says 172.21.15.29:46278) 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 -- 172.21.15.29:0/2916832558 learned_addr learned my addr 172.21.15.29:0/2916832558 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd249b18640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24414bf80 0x7fd24415e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24ab1a640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24415edb0 0x7fd2441f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 -- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24414bf80 msgr2=0x7fd24415e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24414bf80 0x7fd24415e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 -- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24415edb0 msgr2=0x7fd2441f0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24415edb0 0x7fd2441f0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 -- 172.21.15.29:0/2916832558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24414d2d0 con 0x7fd230004810 2024-04-23T10:19:54.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24ab1a640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24415edb0 0x7fd2441f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:54.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24a319640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd244152370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e7f0 tx=0x7fd24000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:54.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd23affd640 1 -- 172.21.15.29:0/2916832558 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24000c8d0 con 0x7fd230004810 2024-04-23T10:19:54.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd23affd640 1 -- 172.21.15.29:0/2916832558 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd240018070 con 0x7fd230004810 2024-04-23T10:19:54.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24415f2b0 con 0x7fd230004810 2024-04-23T10:19:54.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd23affd640 1 -- 172.21.15.29:0/2916832558 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24000cc90 con 0x7fd230004810 2024-04-23T10:19:54.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2441545f0 con 0x7fd230004810 2024-04-23T10:19:54.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd244068d70 con 0x7fd230004810 2024-04-23T10:19:54.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd23affd640 1 -- 172.21.15.29:0/2916832558 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd240013420 con 0x7fd230004810 2024-04-23T10:19:54.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd23affd640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd2280683b0 0x7fd22806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:54.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd23affd640 1 -- 172.21.15.29:0/2916832558 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd2400869d0 con 0x7fd230004810 2024-04-23T10:19:54.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.639+0000 7fd249b18640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd2280683b0 0x7fd22806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:54.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.643+0000 7fd249b18640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd2280683b0 0x7fd22806a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2340af000 tx=0x7fd2340046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:54.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.643+0000 7fd23affd640 1 -- 172.21.15.29:0/2916832558 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd24414d2d0 con 0x7fd230004810 2024-04-23T10:19:54.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.847+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2441513e0 con 0x7fd230004810 2024-04-23T10:19:54.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.847+0000 7fd23affd640 1 -- 172.21.15.29:0/2916832558 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7fd240056ae0 con 0x7fd230004810 2024-04-23T10:19:54.848 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:19:54.848 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:19:54.848 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd2280683b0 msgr2=0x7fd22806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd2280683b0 0x7fd22806a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2340af000 tx=0x7fd2340046d0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 msgr2=0x7fd244152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd244152370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e7f0 tx=0x7fd24000ecb0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 shutdown_connections 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd2280683b0 0x7fd22806a870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd24415edb0 0x7fd2441f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd24414bf80 0x7fd24415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 --2- 172.21.15.29:0/2916832558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd230004810 0x7fd244152370 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 >> 172.21.15.29:0/2916832558 conn(0x7fd2440730f0 msgr2=0x7fd2440cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 shutdown_connections 2024-04-23T10:19:54.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.851+0000 7fd24c57d640 1 -- 172.21.15.29:0/2916832558 wait complete. 2024-04-23T10:19:54.867 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id b4f27fa8 --release --await' 2024-04-23T10:19:54.867 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id b4f27fa8 --release --await 2024-04-23T10:19:54.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe203bee640 1 Processor -- start 2024-04-23T10:19:54.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe203bee640 1 -- start start 2024-04-23T10:19:55.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe203bee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1fc153190 0x7fe1fc159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe203bee640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc0cd360 0x7fe1fc06f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe203bee640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc0c3fe0 con 0x7fe1fc06f150 2024-04-23T10:19:55.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe203bee640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe1fc159380 con 0x7fe1fc153190 2024-04-23T10:19:55.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe203bee640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe1fc0c42c0 con 0x7fe1fc0cd360 2024-04-23T10:19:55.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe20198a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1fc153190 0x7fe1fc159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe20198a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1fc153190 0x7fe1fc159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46290/0 (socket says 172.21.15.29:46290) 2024-04-23T10:19:55.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe20198a640 1 -- 172.21.15.29:0/3643276645 learned_addr learned my addr 172.21.15.29:0/3643276645 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:55.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe20218b640 1 --2- 172.21.15.29:0/3643276645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc0cd360 0x7fe1fc06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe20198a640 1 -- 172.21.15.29:0/3643276645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc0cd360 msgr2=0x7fe1fc06f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe20198a640 1 --2- 172.21.15.29:0/3643276645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc0cd360 0x7fe1fc06f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe20198a640 1 -- 172.21.15.29:0/3643276645 >> v1:172.21.15.72:6789/0 conn(0x7fe1fc06f150 legacy=0x7fe1fc0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:54.999+0000 7fe20198a640 1 -- 172.21.15.29:0/3643276645 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc0c45a0 con 0x7fe1fc153190 2024-04-23T10:19:55.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe20198a640 1 --2- 172.21.15.29:0/3643276645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc159810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009870 tx=0x7fe1f801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2053df0a439c368 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:55.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe200988640 1 -- 172.21.15.29:0/3643276645 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80b5070 con 0x7fe1fc153190 2024-04-23T10:19:55.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe200988640 1 -- 172.21.15.29:0/3643276645 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f80a89d0 con 0x7fe1fc153190 2024-04-23T10:19:55.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe200988640 1 -- 172.21.15.29:0/3643276645 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80a8da0 con 0x7fe1fc153190 2024-04-23T10:19:55.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- 172.21.15.29:0/3643276645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 msgr2=0x7fe1fc159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 --2- 172.21.15.29:0/3643276645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc159810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009870 tx=0x7fe1f801ed10 comp rx=0 tx=0).stop 2024-04-23T10:19:55.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- 172.21.15.29:0/3643276645 shutdown_connections 2024-04-23T10:19:55.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 --2- 172.21.15.29:0/3643276645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc0cd360 0x7fe1fc06f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 --2- 172.21.15.29:0/3643276645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc159810 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- 172.21.15.29:0/3643276645 >> 172.21.15.29:0/3643276645 conn(0x7fe1fc06cfb0 msgr2=0x7fe1fc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:55.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- 172.21.15.29:0/3643276645 shutdown_connections 2024-04-23T10:19:55.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- 172.21.15.29:0/3643276645 wait complete. 2024-04-23T10:19:55.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 Processor -- start 2024-04-23T10:19:55.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- start start 2024-04-23T10:19:55.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc06f150 0x7fe1fc15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1fc0cd360 0x7fe1fc15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc0c4880 con 0x7fe1fc153190 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc153570 con 0x7fe1fc0cd360 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe203bee640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe1fc0c9070 con 0x7fe1fc06f150 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.003+0000 7fe20218b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20218b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46298/0 (socket says 172.21.15.29:46298) 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20218b640 1 -- 172.21.15.29:0/1936230186 learned_addr learned my addr 172.21.15.29:0/1936230186 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20198a640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc06f150 0x7fe1fc15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe201189640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1fc0cd360 0x7fe1fc15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20218b640 1 -- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc06f150 msgr2=0x7fe1fc15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20218b640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc06f150 0x7fe1fc15c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20218b640 1 -- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1fc0cd360 msgr2=0x7fe1fc15c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20218b640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1fc0cd360 0x7fe1fc15c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20218b640 1 -- 172.21.15.29:0/1936230186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc1f1650 con 0x7fe1fc153190 2024-04-23T10:19:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20198a640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc06f150 0x7fe1fc15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:19:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20218b640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc0cae00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4007e60 tx=0x7fe1f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe1f27fc640 1 -- 172.21.15.29:0/1936230186 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4014620 con 0x7fe1fc153190 2024-04-23T10:19:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe1f27fc640 1 -- 172.21.15.29:0/1936230186 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4019070 con 0x7fe1fc153190 2024-04-23T10:19:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe203bee640 1 -- 172.21.15.29:0/1936230186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1fc1f1910 con 0x7fe1fc153190 2024-04-23T10:19:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe1f27fc640 1 -- 172.21.15.29:0/1936230186 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4014a00 con 0x7fe1fc153190 2024-04-23T10:19:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe203bee640 1 -- 172.21.15.29:0/1936230186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1fc1f1ed0 con 0x7fe1fc153190 2024-04-23T10:19:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe1f27fc640 1 -- 172.21.15.29:0/1936230186 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1f4014ba0 con 0x7fe1fc153190 2024-04-23T10:19:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe1f27fc640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe1e0068380 0x7fe1e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe1f27fc640 1 -- 172.21.15.29:0/1936230186 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe1f4087780 con 0x7fe1fc153190 2024-04-23T10:19:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20198a640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe1e0068380 0x7fe1e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe20198a640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe1e0068380 0x7fe1e006a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80b2000 tx=0x7fe1f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.007+0000 7fe206d70000 1 Processor -- start 2024-04-23T10:19:55.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- start start 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f0fc09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0fc12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f0ffc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0e08660 con 0x55c3f0ffc120 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0dad5d0 con 0x55c3f0fc0f00 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55c3f0e04620 con 0x55c3f0ff78a0 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f0ffc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f0ffc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46314/0 (socket says 172.21.15.29:46314) 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 -- 172.21.15.29:0/381378275 learned_addr learned my addr 172.21.15.29:0/381378275 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe201189640 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0fc12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 -- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 msgr2=0x55c3f0fc09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20198a640 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f0fc09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f0fc09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 -- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 msgr2=0x55c3f0fc12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0fc12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 -- 172.21.15.29:0/381378275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f0de1bd0 con 0x55c3f0ffc120 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe201189640 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0fc12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe20218b640 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f0ffc500 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe1f405f8d0 tx=0x7fe1f4056e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cabc651f059208 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe1df7fe640 1 -- 172.21.15.29:0/381378275 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f406f020 con 0x55c3f0ffc120 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe1df7fe640 1 -- 172.21.15.29:0/381378275 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f405b540 con 0x55c3f0ffc120 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe1df7fe640 1 -- 172.21.15.29:0/381378275 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f405fe00 con 0x55c3f0ffc120 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- 172.21.15.29:0/381378275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 msgr2=0x55c3f0ffc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f0ffc500 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe1f405f8d0 tx=0x7fe1f4056e00 comp rx=0 tx=0).stop 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- 172.21.15.29:0/381378275 shutdown_connections 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f0ffc500 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0fc12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 --2- 172.21.15.29:0/381378275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f0fc09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- 172.21.15.29:0/381378275 >> 172.21.15.29:0/381378275 conn(0x55c3f0ea2b00 msgr2=0x55c3f0ff9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:55.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- 172.21.15.29:0/381378275 shutdown_connections 2024-04-23T10:19:55.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- 172.21.15.29:0/381378275 wait complete. 2024-04-23T10:19:55.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 -- start start 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.011+0000 7fe206d70000 1 Processor -- start 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0ff6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ff78a0 0x55c3f0ff6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ffc120 0x55c3f0fbb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0ec5d40 con 0x55c3f0ff78a0 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0dc2eb0 con 0x55c3f0fc0f00 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55c3f0e032a0 con 0x55c3f0ffc120 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 10 client.0 _ll_register_callbacks cb 0x55c3f0fa6a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ff78a0 0x55c3f0ff6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ff78a0 0x55c3f0ff6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46320/0 (socket says 172.21.15.29:46320) 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 -- 172.21.15.29:0/1200686222 learned_addr learned my addr 172.21.15.29:0/1200686222 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe20218b640 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ffc120 0x55c3f0fbb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe20198a640 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0ff6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 -- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ffc120 msgr2=0x55c3f0fbb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ffc120 0x55c3f0fbb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 -- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 msgr2=0x55c3f0ff6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0ff6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 -- 172.21.15.29:0/1200686222 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f0e4eb30 con 0x55c3f0ff78a0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe201189640 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ff78a0 0x55c3f0ff6b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009fc0 tx=0x7fe1ec00e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955cac4518f37fb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe1dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe1dcff9640 1 -- 172.21.15.29:0/1200686222 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec017030 con 0x55c3f0ff78a0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe1dcff9640 1 -- 172.21.15.29:0/1200686222 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe1ec00ee30 con 0x55c3f0ff78a0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 -- 172.21.15.29:0/1200686222 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c3f0da2060 con 0x55c3f0ff78a0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe1dcff9640 1 -- 172.21.15.29:0/1200686222 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe1ec020050 con 0x55c3f0ff78a0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 10 client.5340 fetch_fsmap learned FSMap version 18 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 -- 172.21.15.29:0/1200686222 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c3f0da7b70 con 0x55c3f0ff78a0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe1dcff9640 1 -- 172.21.15.29:0/1200686222 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c3f0da2060 con 0x55c3f0ff78a0 2024-04-23T10:19:55.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe1dcff9640 1 -- 172.21.15.29:0/1200686222 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fe1ec023020 con 0x55c3f0ff78a0 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 10 client.5340 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 10 client.5340 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 20 client.5340 populate_metadata read hostname 'smithi029' 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55c3f0fbc6d0 0x55c3f0fbcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 4 client.5340 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe206d70000 1 -- 172.21.15.29:0/1200686222 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3f0de0e30 con 0x55c3f0fbc6d0 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe20198a640 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55c3f0fbc6d0 0x55c3f0fbcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe1dcff9640 10 client.5340 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.015+0000 7fe20198a640 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55c3f0fbc6d0 0x55c3f0fbcae0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dcc064ca434b07b server_cookie=b987fc35b761551c in_seq=0 out_seq=0 2024-04-23T10:19:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe1dcff9640 1 -- 172.21.15.29:0/1200686222 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c3f0de0e30 con 0x55c3f0fbc6d0 2024-04-23T10:19:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe1dcff9640 10 client.5340 handle_command_reply: tid=0 2024-04-23T10:19:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 client.5340 shutdown 2024-04-23T10:19:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 -- 172.21.15.29:0/1200686222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ff78a0 msgr2=0x55c3f0ff6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ff78a0 0x55c3f0ff6b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009fc0 tx=0x7fe1ec00e600 comp rx=0 tx=0).stop 2024-04-23T10:19:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 -- 172.21.15.29:0/1200686222 shutdown_connections 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55c3f0fbc6d0 0x55c3f0fbcae0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ffc120 0x55c3f0fbb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ff78a0 0x55c3f0ff6b90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 --2- 172.21.15.29:0/1200686222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0ff6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe1dcff9640 0 client.5340 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 -- 172.21.15.29:0/1200686222 >> 172.21.15.29:0/1200686222 conn(0x55c3f0ea2b00 msgr2=0x55c3f0ffb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 -- 172.21.15.29:0/1200686222 shutdown_connections 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 1 -- 172.21.15.29:0/1200686222 wait complete. 2024-04-23T10:19:55.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.019+0000 7fe206d70000 20 client.5340 trim_cache size 0 max 16384 2024-04-23T10:19:55.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe206d70000 1 Processor -- start 2024-04-23T10:19:55.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe206d70000 1 -- start start 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe206d70000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0fbf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe206d70000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f0fbf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe206d70000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1012b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe206d70000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc1fea70 con 0x55c3f0ffc120 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe206d70000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc1ff140 con 0x55c3f0fc0f00 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe206d70000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe1fc14b710 con 0x55c3f0ff78a0 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1012b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1012b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46330/0 (socket says 172.21.15.29:46330) 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 -- 172.21.15.29:0/1732113084 learned_addr learned my addr 172.21.15.29:0/1732113084 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:55.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 -- 172.21.15.29:0/1732113084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 msgr2=0x55c3f0fbf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 --2- 172.21.15.29:0/1732113084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f0fbf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 -- 172.21.15.29:0/1732113084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 msgr2=0x55c3f0fbf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 --2- 172.21.15.29:0/1732113084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0fbf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 -- 172.21.15.29:0/1732113084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f0e8a5e0 con 0x55c3f0ffc120 2024-04-23T10:19:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe20218b640 1 --2- 172.21.15.29:0/1732113084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1012b10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40570d0 tx=0x7fe1f405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec915e57c54fd096 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe1deffd640 1 -- 172.21.15.29:0/1732113084 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f406f040 con 0x55c3f0ffc120 2024-04-23T10:19:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe1deffd640 1 -- 172.21.15.29:0/1732113084 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4073070 con 0x55c3f0ffc120 2024-04-23T10:19:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.035+0000 7fe1deffd640 1 -- 172.21.15.29:0/1732113084 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f405fe00 con 0x55c3f0ffc120 2024-04-23T10:19:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- 172.21.15.29:0/1732113084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 msgr2=0x55c3f1012b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 --2- 172.21.15.29:0/1732113084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1012b10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40570d0 tx=0x7fe1f405b000 comp rx=0 tx=0).stop 2024-04-23T10:19:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- 172.21.15.29:0/1732113084 shutdown_connections 2024-04-23T10:19:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 --2- 172.21.15.29:0/1732113084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1012b10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 --2- 172.21.15.29:0/1732113084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f0fbf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 --2- 172.21.15.29:0/1732113084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f0fbf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- 172.21.15.29:0/1732113084 >> 172.21.15.29:0/1732113084 conn(0x55c3f0ea2b00 msgr2=0x55c3f0ff7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- 172.21.15.29:0/1732113084 shutdown_connections 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- 172.21.15.29:0/1732113084 wait complete. 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- start start 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 Processor -- start 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f1069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f106a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1014e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0e07970 con 0x55c3f0ffc120 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0dbd8f0 con 0x55c3f0fc0f00 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55c3f0e0cc90 con 0x55c3f0ff78a0 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 10 client.0 _ll_register_callbacks cb 0x7fe1ec006f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1014e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1014e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46338/0 (socket says 172.21.15.29:46338) 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 -- 172.21.15.29:0/768797928 learned_addr learned my addr 172.21.15.29:0/768797928 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20198a640 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f1069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 -- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 msgr2=0x55c3f106a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f106a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 -- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 msgr2=0x55c3f1069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f1069d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 -- 172.21.15.29:0/768797928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f0d9aae0 con 0x55c3f0ffc120 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20218b640 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1014e30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe1f405f8d0 tx=0x7fe1f4020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c56df3525564b48 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe1dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe1dcff9640 1 -- 172.21.15.29:0/768797928 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f406f040 con 0x55c3f0ffc120 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe1dcff9640 1 -- 172.21.15.29:0/768797928 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe1f405b190 con 0x55c3f0ffc120 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- 172.21.15.29:0/768797928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1f4073070 con 0x55c3f0ffc120 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe1dcff9640 1 -- 172.21.15.29:0/768797928 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe1f405b540 con 0x55c3f0ffc120 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 10 client.5346 fetch_fsmap learned FSMap version 18 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- 172.21.15.29:0/768797928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c3f0d9dd80 con 0x55c3f0ffc120 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe1dcff9640 1 -- 172.21.15.29:0/768797928 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4073070 con 0x55c3f0ffc120 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe1dcff9640 1 -- 172.21.15.29:0/768797928 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fe1f4082020 con 0x55c3f0ffc120 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 10 client.5346 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:19:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 10 client.5346 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:19:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 20 client.5346 populate_metadata read hostname 'smithi029' 2024-04-23T10:19:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55c3f1015820 0x55c3f1015c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 4 client.5346 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b4f27fa8", "release": true, "await": true}] 2024-04-23T10:19:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe206d70000 1 -- 172.21.15.29:0/768797928 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b4f27fa8", "release": true, "await": true}) -- 0x55c3f0da60d0 con 0x55c3f1015820 2024-04-23T10:19:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20198a640 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55c3f1015820 0x55c3f1015c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe20198a640 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55c3f1015820 0x55c3f1015c30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b9dffa3557efaee server_cookie=3b61fd48cef05250 in_seq=0 out_seq=0 2024-04-23T10:19:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.039+0000 7fe1dcff9640 10 client.5346 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe1dcff9640 1 -- 172.21.15.29:0/768797928 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c3f0da60d0 con 0x55c3f1015820 2024-04-23T10:19:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe1dcff9640 10 client.5346 handle_command_reply: tid=0 2024-04-23T10:19:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 client.5346 shutdown 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 -- 172.21.15.29:0/768797928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 msgr2=0x55c3f1014e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1014e30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe1f405f8d0 tx=0x7fe1f4020040 comp rx=0 tx=0).stop 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 -- 172.21.15.29:0/768797928 shutdown_connections 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55c3f1015820 0x55c3f1015c30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c3f0ffc120 0x55c3f1014e30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55c3f0ff78a0 0x55c3f106a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 --2- 172.21.15.29:0/768797928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c3f0fc0f00 0x55c3f1069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 -- 172.21.15.29:0/768797928 >> 172.21.15.29:0/768797928 conn(0x55c3f0ea2b00 msgr2=0x55c3f0fbad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe1dcff9640 0 client.5346 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 -- 172.21.15.29:0/768797928 shutdown_connections 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 1 -- 172.21.15.29:0/768797928 wait complete. 2024-04-23T10:19:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe206d70000 20 client.5346 trim_cache size 0 max 16384 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 16, 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "b4f27fa8": { 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 16, 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:19:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 79.6, 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:55.346 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:19:55.347 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:19:55.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 -- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe1e0068380 msgr2=0x7fe1e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe1e0068380 0x7fe1e006a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80b2000 tx=0x7fe1f8008040 comp rx=0 tx=0).stop 2024-04-23T10:19:55.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 -- 172.21.15.29:0/1936230186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 msgr2=0x7fe1fc0cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:55.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc0cae00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4007e60 tx=0x7fe1f400e4b0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 -- 172.21.15.29:0/1936230186 shutdown_connections 2024-04-23T10:19:55.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe1e0068380 0x7fe1e006a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1fc153190 0x7fe1fc0cae00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1fc0cd360 0x7fe1fc15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 --2- 172.21.15.29:0/1936230186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1fc06f150 0x7fe1fc15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:55.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 -- 172.21.15.29:0/1936230186 >> 172.21.15.29:0/1936230186 conn(0x7fe1fc06cfb0 msgr2=0x7fe1fc069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:55.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 -- 172.21.15.29:0/1936230186 shutdown_connections 2024-04-23T10:19:55.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:19:55.343+0000 7fe203bee640 1 -- 172.21.15.29:0/1936230186 wait complete. 2024-04-23T10:19:55.383 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b4f27fa8', seconds elapsed: 23.9 2024-04-23T10:20:17.427 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:20:17.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:20:45.222 INFO:tasks.workunit.client.0.smithi029.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-23T10:20:45.234 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T10:20:45.234 INFO:tasks.workunit.client.0.smithi029.stderr:+ make 2024-04-23T10:20:45.474 INFO:tasks.workunit.client.0.smithi029.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-23T10:20:46.128 INFO:tasks.workunit.client.0.smithi029.stderr:++ readlink -f fsstress 2024-04-23T10:20:46.131 INFO:tasks.workunit.client.0.smithi029.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-23T10:20:46.131 INFO:tasks.workunit.client.0.smithi029.stderr:+ popd 2024-04-23T10:20:46.132 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T10:20:46.132 INFO:tasks.workunit.client.0.smithi029.stderr:+ popd 2024-04-23T10:20:46.133 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-23T10:20:46.133 INFO:tasks.workunit.client.0.smithi029.stderr:++ mktemp -d -p . 2024-04-23T10:20:46.139 INFO:tasks.workunit.client.0.smithi029.stderr:+ T=./tmp.vPgxgTD9ov 2024-04-23T10:20:46.139 INFO:tasks.workunit.client.0.smithi029.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.vPgxgTD9ov -l 1 -n 1000 -p 10 -v 2024-04-23T10:20:46.145 INFO:tasks.workunit.client.0.smithi029.stdout:seed = 1713752107 2024-04-23T10:20:46.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/0: readlink - no filename 2024-04-23T10:20:46.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/1: fsync - no filename 2024-04-23T10:20:46.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/2: dread - no filename 2024-04-23T10:20:46.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/3: dread - no filename 2024-04-23T10:20:46.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/4: mkdir d0 0 2024-04-23T10:20:46.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/5: fsync - no filename 2024-04-23T10:20:46.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/6: dread - no filename 2024-04-23T10:20:46.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/7: truncate - no filename 2024-04-23T10:20:46.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/8: truncate - no filename 2024-04-23T10:20:46.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/9: dwrite - no filename 2024-04-23T10:20:46.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/10: link - no file 2024-04-23T10:20:46.157 INFO:tasks.workunit.client.0.smithi029.stdout:2/0: dread - no filename 2024-04-23T10:20:46.157 INFO:tasks.workunit.client.0.smithi029.stdout:2/1: truncate - no filename 2024-04-23T10:20:46.161 INFO:tasks.workunit.client.0.smithi029.stdout:1/0: symlink l0 0 2024-04-23T10:20:46.161 INFO:tasks.workunit.client.0.smithi029.stdout:3/0: dread - no filename 2024-04-23T10:20:46.162 INFO:tasks.workunit.client.0.smithi029.stdout:0/11: creat d0/f1 x:0 0 0 2024-04-23T10:20:46.162 INFO:tasks.workunit.client.0.smithi029.stdout:0/12: stat d0 0 2024-04-23T10:20:46.164 INFO:tasks.workunit.client.0.smithi029.stdout:1/1: rename l0 to l1 0 2024-04-23T10:20:46.164 INFO:tasks.workunit.client.0.smithi029.stdout:1/2: dread - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/0: write - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/1: write - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/2: dwrite - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/3: dwrite - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/4: stat - no entries 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/5: dread - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/6: rename - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/7: readlink - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/8: dwrite - no filename 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/9: chown . 1 1 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/2: getdents . 0 2024-04-23T10:20:46.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/3: dread - no filename 2024-04-23T10:20:46.168 INFO:tasks.workunit.client.0.smithi029.stdout:0/13: symlink d0/l2 0 2024-04-23T10:20:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/1: getdents . 0 2024-04-23T10:20:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/2: write - no filename 2024-04-23T10:20:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/3: rmdir - no directory 2024-04-23T10:20:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/4: dread - no filename 2024-04-23T10:20:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/5: dwrite - no filename 2024-04-23T10:20:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/6: dwrite - no filename 2024-04-23T10:20:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/7: dread - no filename 2024-04-23T10:20:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/8: truncate - no filename 2024-04-23T10:20:46.170 INFO:tasks.workunit.client.0.smithi029.stdout:3/9: read - no filename 2024-04-23T10:20:46.170 INFO:tasks.workunit.client.0.smithi029.stdout:3/10: chown . 121 1 2024-04-23T10:20:46.172 INFO:tasks.workunit.client.0.smithi029.stdout:5/0: write - no filename 2024-04-23T10:20:46.173 INFO:tasks.workunit.client.0.smithi029.stdout:5/1: rename - no filename 2024-04-23T10:20:46.174 INFO:tasks.workunit.client.0.smithi029.stdout:4/10: mkdir d0 0 2024-04-23T10:20:46.175 INFO:tasks.workunit.client.0.smithi029.stdout:4/11: dread - no filename 2024-04-23T10:20:46.176 INFO:tasks.workunit.client.0.smithi029.stdout:2/4: mknod c0 0 2024-04-23T10:20:46.179 INFO:tasks.workunit.client.0.smithi029.stdout:6/0: rename - no filename 2024-04-23T10:20:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/1: truncate - no filename 2024-04-23T10:20:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/2: rename - no filename 2024-04-23T10:20:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/3: readlink - no filename 2024-04-23T10:20:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/4: dread - no filename 2024-04-23T10:20:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/5: dread - no filename 2024-04-23T10:20:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/6: dwrite - no filename 2024-04-23T10:20:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/7: truncate - no filename 2024-04-23T10:20:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/8: readlink - no filename 2024-04-23T10:20:46.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/11: creat f0 x:0 0 0 2024-04-23T10:20:46.181 INFO:tasks.workunit.client.0.smithi029.stdout:0/14: dwrite d0/f1 [0,4194304] 0 2024-04-23T10:20:46.182 INFO:tasks.workunit.client.0.smithi029.stdout:0/15: chown d0/l2 1762629 1 2024-04-23T10:20:46.189 INFO:tasks.workunit.client.0.smithi029.stdout:2/5: mkdir d1 0 2024-04-23T10:20:46.189 INFO:tasks.workunit.client.0.smithi029.stdout:2/6: chown c0 12862 1 2024-04-23T10:20:46.192 INFO:tasks.workunit.client.0.smithi029.stdout:3/12: mknod c1 0 2024-04-23T10:20:46.193 INFO:tasks.workunit.client.0.smithi029.stdout:3/13: truncate f0 180405 0 2024-04-23T10:20:46.194 INFO:tasks.workunit.client.0.smithi029.stdout:5/2: mkdir d0 0 2024-04-23T10:20:46.196 INFO:tasks.workunit.client.0.smithi029.stdout:0/16: creat d0/f3 x:0 0 0 2024-04-23T10:20:46.197 INFO:tasks.workunit.client.0.smithi029.stdout:4/12: creat d0/f1 x:0 0 0 2024-04-23T10:20:46.197 INFO:tasks.workunit.client.0.smithi029.stdout:4/13: dread - d0/f1 zero size 2024-04-23T10:20:46.199 INFO:tasks.workunit.client.0.smithi029.stdout:8/0: dread - no filename 2024-04-23T10:20:46.199 INFO:tasks.workunit.client.0.smithi029.stdout:8/1: dread - no filename 2024-04-23T10:20:46.207 INFO:tasks.workunit.client.0.smithi029.stdout:4/14: creat d0/f2 x:0 0 0 2024-04-23T10:20:46.209 INFO:tasks.workunit.client.0.smithi029.stdout:9/0: dwrite - no filename 2024-04-23T10:20:46.211 INFO:tasks.workunit.client.0.smithi029.stdout:7/0: mknod c0 0 2024-04-23T10:20:46.212 INFO:tasks.workunit.client.0.smithi029.stdout:7/1: chown c0 29 1 2024-04-23T10:20:46.213 INFO:tasks.workunit.client.0.smithi029.stdout:5/3: symlink d0/l1 0 2024-04-23T10:20:46.213 INFO:tasks.workunit.client.0.smithi029.stdout:5/4: write - no filename 2024-04-23T10:20:46.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/2: chown c0 12 1 2024-04-23T10:20:46.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/3: truncate - no filename 2024-04-23T10:20:46.215 INFO:tasks.workunit.client.0.smithi029.stdout:8/2: creat f0 x:0 0 0 2024-04-23T10:20:46.216 INFO:tasks.workunit.client.0.smithi029.stdout:8/3: dread - f0 zero size 2024-04-23T10:20:46.218 INFO:tasks.workunit.client.0.smithi029.stdout:4/15: dwrite d0/f1 [0,4194304] 0 2024-04-23T10:20:46.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/4: write f0 [903467,91029] 0 2024-04-23T10:20:46.220 INFO:tasks.workunit.client.0.smithi029.stdout:7/4: creat f1 x:0 0 0 2024-04-23T10:20:46.222 INFO:tasks.workunit.client.0.smithi029.stdout:5/5: creat d0/f2 x:0 0 0 2024-04-23T10:20:46.223 INFO:tasks.workunit.client.0.smithi029.stdout:5/6: dread - d0/f2 zero size 2024-04-23T10:20:46.223 INFO:tasks.workunit.client.0.smithi029.stdout:9/1: mkdir d0 0 2024-04-23T10:20:46.226 INFO:tasks.workunit.client.0.smithi029.stdout:4/16: mknod d0/c3 0 2024-04-23T10:20:46.228 INFO:tasks.workunit.client.0.smithi029.stdout:7/5: symlink l2 0 2024-04-23T10:20:46.230 INFO:tasks.workunit.client.0.smithi029.stdout:5/7: symlink d0/l3 0 2024-04-23T10:20:46.230 INFO:tasks.workunit.client.0.smithi029.stdout:7/6: dread - f1 zero size 2024-04-23T10:20:46.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/7: rmdir - no directory 2024-04-23T10:20:46.233 INFO:tasks.workunit.client.0.smithi029.stdout:8/5: dwrite f0 [0,4194304] 0 2024-04-23T10:20:46.233 INFO:tasks.workunit.client.0.smithi029.stdout:7/8: chown l2 1528017 1 2024-04-23T10:20:46.234 INFO:tasks.workunit.client.0.smithi029.stdout:4/17: creat d0/f4 x:0 0 0 2024-04-23T10:20:46.235 INFO:tasks.workunit.client.0.smithi029.stdout:9/2: mkdir d0/d1 0 2024-04-23T10:20:46.236 INFO:tasks.workunit.client.0.smithi029.stdout:9/3: chown d0 1202578 1 2024-04-23T10:20:46.236 INFO:tasks.workunit.client.0.smithi029.stdout:9/4: write - no filename 2024-04-23T10:20:46.236 INFO:tasks.workunit.client.0.smithi029.stdout:9/5: dread - no filename 2024-04-23T10:20:46.236 INFO:tasks.workunit.client.0.smithi029.stdout:9/6: dread - no filename 2024-04-23T10:20:46.239 INFO:tasks.workunit.client.0.smithi029.stdout:7/9: creat f3 x:0 0 0 2024-04-23T10:20:46.241 INFO:tasks.workunit.client.0.smithi029.stdout:4/18: symlink d0/l5 0 2024-04-23T10:20:46.249 INFO:tasks.workunit.client.0.smithi029.stdout:7/10: dwrite f1 [0,4194304] 0 2024-04-23T10:20:46.250 INFO:tasks.workunit.client.0.smithi029.stdout:7/11: chown c0 128251326 1 2024-04-23T10:20:46.286 INFO:tasks.workunit.client.0.smithi029.stdout:3/14: getdents . 0 2024-04-23T10:20:46.287 INFO:tasks.workunit.client.0.smithi029.stdout:3/15: truncate f0 245043 0 2024-04-23T10:20:46.290 INFO:tasks.workunit.client.0.smithi029.stdout:8/6: getdents . 0 2024-04-23T10:20:46.292 INFO:tasks.workunit.client.0.smithi029.stdout:1/3: rename l1 to l2 0 2024-04-23T10:20:46.292 INFO:tasks.workunit.client.0.smithi029.stdout:1/4: write - no filename 2024-04-23T10:20:46.293 INFO:tasks.workunit.client.0.smithi029.stdout:5/8: fsync d0/f2 0 2024-04-23T10:20:46.296 INFO:tasks.workunit.client.0.smithi029.stdout:3/16: creat f2 x:0 0 0 2024-04-23T10:20:46.298 INFO:tasks.workunit.client.0.smithi029.stdout:8/7: rename f0 to f1 0 2024-04-23T10:20:46.300 INFO:tasks.workunit.client.0.smithi029.stdout:1/5: mknod c3 0 2024-04-23T10:20:46.304 INFO:tasks.workunit.client.0.smithi029.stdout:5/9: unlink d0/f2 0 2024-04-23T10:20:46.304 INFO:tasks.workunit.client.0.smithi029.stdout:5/10: dread - no filename 2024-04-23T10:20:46.305 INFO:tasks.workunit.client.0.smithi029.stdout:5/11: chown d0 50538 1 2024-04-23T10:20:46.305 INFO:tasks.workunit.client.0.smithi029.stdout:3/17: dwrite f0 [0,4194304] 0 2024-04-23T10:20:46.306 INFO:tasks.workunit.client.0.smithi029.stdout:3/18: chown c1 55 1 2024-04-23T10:20:46.308 INFO:tasks.workunit.client.0.smithi029.stdout:9/7: getdents d0 0 2024-04-23T10:20:46.310 INFO:tasks.workunit.client.0.smithi029.stdout:4/19: getdents d0 0 2024-04-23T10:20:46.311 INFO:tasks.workunit.client.0.smithi029.stdout:1/6: mknod c4 0 2024-04-23T10:20:46.311 INFO:tasks.workunit.client.0.smithi029.stdout:4/20: truncate d0/f4 475845 0 2024-04-23T10:20:46.313 INFO:tasks.workunit.client.0.smithi029.stdout:3/19: fsync f2 0 2024-04-23T10:20:46.313 INFO:tasks.workunit.client.0.smithi029.stdout:3/20: chown f0 545498 1 2024-04-23T10:20:46.315 INFO:tasks.workunit.client.0.smithi029.stdout:5/12: creat d0/f4 x:0 0 0 2024-04-23T10:20:46.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/13: truncate d0/f4 741698 0 2024-04-23T10:20:46.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/14: chown d0 17402 1 2024-04-23T10:20:46.318 INFO:tasks.workunit.client.0.smithi029.stdout:5/15: write d0/f4 [1130418,106798] 0 2024-04-23T10:20:46.321 INFO:tasks.workunit.client.0.smithi029.stdout:1/7: mkdir d5 0 2024-04-23T10:20:46.321 INFO:tasks.workunit.client.0.smithi029.stdout:1/8: write - no filename 2024-04-23T10:20:46.321 INFO:tasks.workunit.client.0.smithi029.stdout:1/9: dwrite - no filename 2024-04-23T10:20:46.321 INFO:tasks.workunit.client.0.smithi029.stdout:1/10: truncate - no filename 2024-04-23T10:20:46.323 INFO:tasks.workunit.client.0.smithi029.stdout:4/21: rename d0/f2 to d0/f6 0 2024-04-23T10:20:46.323 INFO:tasks.workunit.client.0.smithi029.stdout:5/16: write d0/f4 [1711094,40037] 0 2024-04-23T10:20:46.324 INFO:tasks.workunit.client.0.smithi029.stdout:3/21: mkdir d3 0 2024-04-23T10:20:46.327 INFO:tasks.workunit.client.0.smithi029.stdout:9/8: symlink d0/d1/l2 0 2024-04-23T10:20:46.327 INFO:tasks.workunit.client.0.smithi029.stdout:3/22: fdatasync f0 0 2024-04-23T10:20:46.330 INFO:tasks.workunit.client.0.smithi029.stdout:4/22: dread d0/f4 [0,4194304] 0 2024-04-23T10:20:46.330 INFO:tasks.workunit.client.0.smithi029.stdout:8/8: dwrite f1 [4194304,4194304] 0 2024-04-23T10:20:46.330 INFO:tasks.workunit.client.0.smithi029.stdout:3/23: truncate f2 182405 0 2024-04-23T10:20:46.331 INFO:tasks.workunit.client.0.smithi029.stdout:5/17: symlink d0/l5 0 2024-04-23T10:20:46.332 INFO:tasks.workunit.client.0.smithi029.stdout:1/11: mkdir d5/d6 0 2024-04-23T10:20:46.332 INFO:tasks.workunit.client.0.smithi029.stdout:1/12: dread - no filename 2024-04-23T10:20:46.335 INFO:tasks.workunit.client.0.smithi029.stdout:9/9: rename d0/d1/l2 to d0/l3 0 2024-04-23T10:20:46.336 INFO:tasks.workunit.client.0.smithi029.stdout:9/10: truncate - no filename 2024-04-23T10:20:46.336 INFO:tasks.workunit.client.0.smithi029.stdout:1/13: rename d5 to d5/d6/d7 22 2024-04-23T10:20:46.338 INFO:tasks.workunit.client.0.smithi029.stdout:4/23: rename d0/l5 to d0/l7 0 2024-04-23T10:20:46.341 INFO:tasks.workunit.client.0.smithi029.stdout:9/11: symlink d0/d1/l4 0 2024-04-23T10:20:46.342 INFO:tasks.workunit.client.0.smithi029.stdout:4/24: symlink d0/l8 0 2024-04-23T10:20:46.343 INFO:tasks.workunit.client.0.smithi029.stdout:3/24: symlink d3/l4 0 2024-04-23T10:20:46.344 INFO:tasks.workunit.client.0.smithi029.stdout:8/9: dwrite f1 [4194304,4194304] 0 2024-04-23T10:20:46.346 INFO:tasks.workunit.client.0.smithi029.stdout:8/10: stat f1 0 2024-04-23T10:20:46.346 INFO:tasks.workunit.client.0.smithi029.stdout:1/14: creat d5/d6/f8 x:0 0 0 2024-04-23T10:20:46.348 INFO:tasks.workunit.client.0.smithi029.stdout:5/18: dwrite d0/f4 [0,4194304] 0 2024-04-23T10:20:46.348 INFO:tasks.workunit.client.0.smithi029.stdout:1/15: stat d5/d6/f8 0 2024-04-23T10:20:46.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/12: symlink d0/d1/l5 0 2024-04-23T10:20:46.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/13: dwrite - no filename 2024-04-23T10:20:46.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/14: fsync - no filename 2024-04-23T10:20:46.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/15: dread - no filename 2024-04-23T10:20:46.351 INFO:tasks.workunit.client.0.smithi029.stdout:3/25: unlink f2 0 2024-04-23T10:20:46.352 INFO:tasks.workunit.client.0.smithi029.stdout:5/19: symlink d0/l6 0 2024-04-23T10:20:46.354 INFO:tasks.workunit.client.0.smithi029.stdout:8/11: dread f1 [0,4194304] 0 2024-04-23T10:20:46.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/16: mkdir d0/d1/d6 0 2024-04-23T10:20:46.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/17: write - no filename 2024-04-23T10:20:46.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/18: dwrite - no filename 2024-04-23T10:20:46.356 INFO:tasks.workunit.client.0.smithi029.stdout:4/25: link d0/f1 d0/f9 0 2024-04-23T10:20:46.362 INFO:tasks.workunit.client.0.smithi029.stdout:8/12: symlink l2 0 2024-04-23T10:20:46.365 INFO:tasks.workunit.client.0.smithi029.stdout:9/19: unlink d0/d1/l4 0 2024-04-23T10:20:46.365 INFO:tasks.workunit.client.0.smithi029.stdout:1/16: dwrite d5/d6/f8 [0,4194304] 0 2024-04-23T10:20:46.368 INFO:tasks.workunit.client.0.smithi029.stdout:5/20: write d0/f4 [4668739,5313] 0 2024-04-23T10:20:46.369 INFO:tasks.workunit.client.0.smithi029.stdout:8/13: fsync f1 0 2024-04-23T10:20:46.370 INFO:tasks.workunit.client.0.smithi029.stdout:4/26: unlink d0/l7 0 2024-04-23T10:20:46.372 INFO:tasks.workunit.client.0.smithi029.stdout:9/20: rename d0/d1 to d0/d7 0 2024-04-23T10:20:46.372 INFO:tasks.workunit.client.0.smithi029.stdout:9/21: fdatasync - no filename 2024-04-23T10:20:46.372 INFO:tasks.workunit.client.0.smithi029.stdout:9/22: dwrite - no filename 2024-04-23T10:20:46.374 INFO:tasks.workunit.client.0.smithi029.stdout:8/14: mkdir d3 0 2024-04-23T10:20:46.374 INFO:tasks.workunit.client.0.smithi029.stdout:1/17: dread d5/d6/f8 [0,4194304] 0 2024-04-23T10:20:46.374 INFO:tasks.workunit.client.0.smithi029.stdout:5/21: creat d0/f7 x:0 0 0 2024-04-23T10:20:46.375 INFO:tasks.workunit.client.0.smithi029.stdout:3/26: getdents d3 0 2024-04-23T10:20:46.375 INFO:tasks.workunit.client.0.smithi029.stdout:5/22: readlink d0/l1 0 2024-04-23T10:20:46.382 INFO:tasks.workunit.client.0.smithi029.stdout:8/15: creat d3/f4 x:0 0 0 2024-04-23T10:20:46.382 INFO:tasks.workunit.client.0.smithi029.stdout:3/27: getdents d3 0 2024-04-23T10:20:46.383 INFO:tasks.workunit.client.0.smithi029.stdout:8/16: chown l2 64659 1 2024-04-23T10:20:46.383 INFO:tasks.workunit.client.0.smithi029.stdout:9/23: getdents d0 0 2024-04-23T10:20:46.383 INFO:tasks.workunit.client.0.smithi029.stdout:9/24: dwrite - no filename 2024-04-23T10:20:46.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/28: creat d3/f5 x:0 0 0 2024-04-23T10:20:46.387 INFO:tasks.workunit.client.0.smithi029.stdout:9/25: creat d0/d7/f8 x:0 0 0 2024-04-23T10:20:46.390 INFO:tasks.workunit.client.0.smithi029.stdout:5/23: dwrite d0/f4 [4194304,4194304] 0 2024-04-23T10:20:46.392 INFO:tasks.workunit.client.0.smithi029.stdout:9/26: creat d0/d7/f9 x:0 0 0 2024-04-23T10:20:46.393 INFO:tasks.workunit.client.0.smithi029.stdout:4/27: dwrite d0/f1 [0,4194304] 0 2024-04-23T10:20:46.395 INFO:tasks.workunit.client.0.smithi029.stdout:4/28: read d0/f9 [3709057,119183] 0 2024-04-23T10:20:46.397 INFO:tasks.workunit.client.0.smithi029.stdout:9/27: creat d0/d7/fa x:0 0 0 2024-04-23T10:20:46.403 INFO:tasks.workunit.client.0.smithi029.stdout:8/17: dwrite f1 [4194304,4194304] 0 2024-04-23T10:20:46.410 INFO:tasks.workunit.client.0.smithi029.stdout:9/28: dread - d0/d7/fa zero size 2024-04-23T10:20:46.412 INFO:tasks.workunit.client.0.smithi029.stdout:3/29: dwrite d3/f5 [0,4194304] 0 2024-04-23T10:20:46.418 INFO:tasks.workunit.client.0.smithi029.stdout:9/29: creat d0/d7/d6/fb x:0 0 0 2024-04-23T10:20:46.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/24: dwrite d0/f4 [8388608,4194304] 0 2024-04-23T10:20:46.421 INFO:tasks.workunit.client.0.smithi029.stdout:9/30: dread - d0/d7/fa zero size 2024-04-23T10:20:46.423 INFO:tasks.workunit.client.0.smithi029.stdout:5/25: write d0/f4 [6986931,14405] 0 2024-04-23T10:20:46.425 INFO:tasks.workunit.client.0.smithi029.stdout:5/26: write d0/f4 [10836213,97773] 0 2024-04-23T10:20:46.426 INFO:tasks.workunit.client.0.smithi029.stdout:5/27: chown d0/f7 170743 1 2024-04-23T10:20:46.429 INFO:tasks.workunit.client.0.smithi029.stdout:5/28: write d0/f4 [12411254,97239] 0 2024-04-23T10:20:46.431 INFO:tasks.workunit.client.0.smithi029.stdout:9/31: dread - d0/d7/f9 zero size 2024-04-23T10:20:46.431 INFO:tasks.workunit.client.0.smithi029.stdout:4/29: dwrite d0/f9 [0,4194304] 0 2024-04-23T10:20:46.435 INFO:tasks.workunit.client.0.smithi029.stdout:5/29: chown d0/f4 1 1 2024-04-23T10:20:46.435 INFO:tasks.workunit.client.0.smithi029.stdout:3/30: dread f0 [0,4194304] 0 2024-04-23T10:20:46.437 INFO:tasks.workunit.client.0.smithi029.stdout:3/31: chown d3 220 1 2024-04-23T10:20:46.439 INFO:tasks.workunit.client.0.smithi029.stdout:8/18: dwrite d3/f4 [0,4194304] 0 2024-04-23T10:20:46.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/30: chown d0/f1 6 1 2024-04-23T10:20:46.444 INFO:tasks.workunit.client.0.smithi029.stdout:9/32: dread - d0/d7/d6/fb zero size 2024-04-23T10:20:46.445 INFO:tasks.workunit.client.0.smithi029.stdout:4/31: stat d0/l8 0 2024-04-23T10:20:46.446 INFO:tasks.workunit.client.0.smithi029.stdout:5/30: rename d0/l3 to d0/l8 0 2024-04-23T10:20:46.448 INFO:tasks.workunit.client.0.smithi029.stdout:5/31: stat d0/l1 0 2024-04-23T10:20:46.449 INFO:tasks.workunit.client.0.smithi029.stdout:9/33: dread - d0/d7/f8 zero size 2024-04-23T10:20:46.450 INFO:tasks.workunit.client.0.smithi029.stdout:4/32: write d0/f6 [301427,71332] 0 2024-04-23T10:20:46.452 INFO:tasks.workunit.client.0.smithi029.stdout:5/32: dread - d0/f7 zero size 2024-04-23T10:20:46.453 INFO:tasks.workunit.client.0.smithi029.stdout:4/33: fsync d0/f9 0 2024-04-23T10:20:46.453 INFO:tasks.workunit.client.0.smithi029.stdout:9/34: chown d0/d7/fa 103551 1 2024-04-23T10:20:46.455 INFO:tasks.workunit.client.0.smithi029.stdout:3/32: dread f0 [0,4194304] 0 2024-04-23T10:20:46.456 INFO:tasks.workunit.client.0.smithi029.stdout:9/35: dread - d0/d7/f9 zero size 2024-04-23T10:20:46.458 INFO:tasks.workunit.client.0.smithi029.stdout:5/33: unlink d0/l6 0 2024-04-23T10:20:46.458 INFO:tasks.workunit.client.0.smithi029.stdout:3/33: write f0 [3325196,93008] 0 2024-04-23T10:20:46.459 INFO:tasks.workunit.client.0.smithi029.stdout:4/34: creat d0/fa x:0 0 0 2024-04-23T10:20:46.461 INFO:tasks.workunit.client.0.smithi029.stdout:3/34: read d3/f5 [2791726,49438] 0 2024-04-23T10:20:46.461 INFO:tasks.workunit.client.0.smithi029.stdout:4/35: stat d0/f4 0 2024-04-23T10:20:46.461 INFO:tasks.workunit.client.0.smithi029.stdout:8/19: dwrite d3/f4 [4194304,4194304] 0 2024-04-23T10:20:46.462 INFO:tasks.workunit.client.0.smithi029.stdout:5/34: creat d0/f9 x:0 0 0 2024-04-23T10:20:46.462 INFO:tasks.workunit.client.0.smithi029.stdout:4/36: stat d0 0 2024-04-23T10:20:46.463 INFO:tasks.workunit.client.0.smithi029.stdout:5/35: fdatasync d0/f9 0 2024-04-23T10:20:46.464 INFO:tasks.workunit.client.0.smithi029.stdout:5/36: fdatasync d0/f9 0 2024-04-23T10:20:46.464 INFO:tasks.workunit.client.0.smithi029.stdout:4/37: write d0/f6 [901235,78259] 0 2024-04-23T10:20:46.466 INFO:tasks.workunit.client.0.smithi029.stdout:3/35: creat d3/f6 x:0 0 0 2024-04-23T10:20:46.467 INFO:tasks.workunit.client.0.smithi029.stdout:8/20: mknod d3/c5 0 2024-04-23T10:20:46.469 INFO:tasks.workunit.client.0.smithi029.stdout:5/37: unlink d0/f7 0 2024-04-23T10:20:46.471 INFO:tasks.workunit.client.0.smithi029.stdout:4/38: mknod d0/cb 0 2024-04-23T10:20:46.479 INFO:tasks.workunit.client.0.smithi029.stdout:9/36: dwrite d0/d7/d6/fb [0,4194304] 0 2024-04-23T10:20:46.482 INFO:tasks.workunit.client.0.smithi029.stdout:8/21: truncate f1 3392924 0 2024-04-23T10:20:46.484 INFO:tasks.workunit.client.0.smithi029.stdout:9/37: write d0/d7/f9 [4758,98810] 0 2024-04-23T10:20:46.486 INFO:tasks.workunit.client.0.smithi029.stdout:3/36: dwrite f0 [0,4194304] 0 2024-04-23T10:20:46.486 INFO:tasks.workunit.client.0.smithi029.stdout:9/38: stat d0/d7 0 2024-04-23T10:20:46.486 INFO:tasks.workunit.client.0.smithi029.stdout:5/38: dwrite d0/f4 [0,4194304] 0 2024-04-23T10:20:46.489 INFO:tasks.workunit.client.0.smithi029.stdout:8/22: symlink d3/l6 0 2024-04-23T10:20:46.491 INFO:tasks.workunit.client.0.smithi029.stdout:9/39: creat d0/d7/d6/fc x:0 0 0 2024-04-23T10:20:46.492 INFO:tasks.workunit.client.0.smithi029.stdout:5/39: mknod d0/ca 0 2024-04-23T10:20:46.495 INFO:tasks.workunit.client.0.smithi029.stdout:4/39: dread d0/f6 [0,4194304] 0 2024-04-23T10:20:46.498 INFO:tasks.workunit.client.0.smithi029.stdout:9/40: mknod d0/d7/cd 0 2024-04-23T10:20:46.503 INFO:tasks.workunit.client.0.smithi029.stdout:5/40: mkdir d0/db 0 2024-04-23T10:20:46.503 INFO:tasks.workunit.client.0.smithi029.stdout:5/41: read d0/f4 [6472806,14506] 0 2024-04-23T10:20:46.503 INFO:tasks.workunit.client.0.smithi029.stdout:9/41: fdatasync d0/d7/d6/fc 0 2024-04-23T10:20:46.504 INFO:tasks.workunit.client.0.smithi029.stdout:5/42: dread - d0/f9 zero size 2024-04-23T10:20:46.505 INFO:tasks.workunit.client.0.smithi029.stdout:4/40: dread d0/f1 [0,4194304] 0 2024-04-23T10:20:46.508 INFO:tasks.workunit.client.0.smithi029.stdout:9/42: dread d0/d7/f9 [0,4194304] 0 2024-04-23T10:20:46.509 INFO:tasks.workunit.client.0.smithi029.stdout:5/43: mkdir d0/dc 0 2024-04-23T10:20:46.510 INFO:tasks.workunit.client.0.smithi029.stdout:9/43: stat d0/d7/f9 0 2024-04-23T10:20:46.510 INFO:tasks.workunit.client.0.smithi029.stdout:3/37: dwrite d3/f5 [0,4194304] 0 2024-04-23T10:20:46.512 INFO:tasks.workunit.client.0.smithi029.stdout:9/44: read - d0/d7/d6/fc zero size 2024-04-23T10:20:46.515 INFO:tasks.workunit.client.0.smithi029.stdout:9/45: creat d0/d7/d6/fe x:0 0 0 2024-04-23T10:20:46.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/41: link d0/f9 d0/fc 0 2024-04-23T10:20:46.521 INFO:tasks.workunit.client.0.smithi029.stdout:9/46: write d0/d7/f8 [983443,103882] 0 2024-04-23T10:20:46.522 INFO:tasks.workunit.client.0.smithi029.stdout:4/42: rmdir d0 39 2024-04-23T10:20:46.524 INFO:tasks.workunit.client.0.smithi029.stdout:3/38: dread d3/f5 [0,4194304] 0 2024-04-23T10:20:46.533 INFO:tasks.workunit.client.0.smithi029.stdout:5/44: dwrite d0/f9 [0,4194304] 0 2024-04-23T10:20:46.533 INFO:tasks.workunit.client.0.smithi029.stdout:8/23: dwrite f1 [0,4194304] 0 2024-04-23T10:20:46.534 INFO:tasks.workunit.client.0.smithi029.stdout:3/39: truncate d3/f5 4914352 0 2024-04-23T10:20:46.538 INFO:tasks.workunit.client.0.smithi029.stdout:3/40: dread d3/f5 [4194304,4194304] 0 2024-04-23T10:20:46.538 INFO:tasks.workunit.client.0.smithi029.stdout:3/41: stat d3/f6 0 2024-04-23T10:20:46.579 INFO:tasks.workunit.client.0.smithi029.stdout:4/43: fsync d0/f6 0 2024-04-23T10:20:46.579 INFO:tasks.workunit.client.0.smithi029.stdout:8/24: creat d3/f7 x:0 0 0 2024-04-23T10:20:46.580 INFO:tasks.workunit.client.0.smithi029.stdout:3/42: mknod d3/c7 0 2024-04-23T10:20:46.582 INFO:tasks.workunit.client.0.smithi029.stdout:5/45: symlink d0/dc/ld 0 2024-04-23T10:20:46.585 INFO:tasks.workunit.client.0.smithi029.stdout:8/25: dread d3/f4 [4194304,4194304] 0 2024-04-23T10:20:46.586 INFO:tasks.workunit.client.0.smithi029.stdout:8/26: truncate d3/f7 944947 0 2024-04-23T10:20:46.587 INFO:tasks.workunit.client.0.smithi029.stdout:8/27: mknod d3/c8 0 2024-04-23T10:20:46.587 INFO:tasks.workunit.client.0.smithi029.stdout:5/46: dread d0/f9 [0,4194304] 0 2024-04-23T10:20:46.588 INFO:tasks.workunit.client.0.smithi029.stdout:5/47: read d0/f4 [9919779,81039] 0 2024-04-23T10:20:46.590 INFO:tasks.workunit.client.0.smithi029.stdout:5/48: creat d0/fe x:0 0 0 2024-04-23T10:20:46.592 INFO:tasks.workunit.client.0.smithi029.stdout:8/28: dread d3/f4 [0,4194304] 0 2024-04-23T10:20:46.595 INFO:tasks.workunit.client.0.smithi029.stdout:8/29: rename d3/c5 to d3/c9 0 2024-04-23T10:20:46.595 INFO:tasks.workunit.client.0.smithi029.stdout:8/30: chown d3/f7 3958 1 2024-04-23T10:20:46.595 INFO:tasks.workunit.client.0.smithi029.stdout:5/49: dread d0/f9 [0,4194304] 0 2024-04-23T10:20:46.597 INFO:tasks.workunit.client.0.smithi029.stdout:8/31: write d3/f4 [3141978,123026] 0 2024-04-23T10:20:46.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/50: fsync d0/f4 0 2024-04-23T10:20:46.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/51: chown d0/f4 222797264 1 2024-04-23T10:20:46.598 INFO:tasks.workunit.client.0.smithi029.stdout:8/32: write f1 [4702633,21298] 0 2024-04-23T10:20:46.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/33: creat d3/fa x:0 0 0 2024-04-23T10:20:46.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/34: creat d3/fb x:0 0 0 2024-04-23T10:20:46.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/35: stat d3/f4 0 2024-04-23T10:20:46.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/36: dwrite d3/f7 [0,4194304] 0 2024-04-23T10:20:46.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/37: chown d3/c8 411747 1 2024-04-23T10:20:46.618 INFO:tasks.workunit.client.0.smithi029.stdout:8/38: rename d3/c8 to d3/cc 0 2024-04-23T10:20:46.618 INFO:tasks.workunit.client.0.smithi029.stdout:9/47: truncate d0/d7/d6/fb 1836849 0 2024-04-23T10:20:46.619 INFO:tasks.workunit.client.0.smithi029.stdout:3/43: truncate d3/f5 1392709 0 2024-04-23T10:20:46.619 INFO:tasks.workunit.client.0.smithi029.stdout:8/39: fsync d3/f4 0 2024-04-23T10:20:46.620 INFO:tasks.workunit.client.0.smithi029.stdout:9/48: chown d0/d7/l5 299 1 2024-04-23T10:20:46.622 INFO:tasks.workunit.client.0.smithi029.stdout:8/40: creat d3/fd x:0 0 0 2024-04-23T10:20:46.622 INFO:tasks.workunit.client.0.smithi029.stdout:8/41: write d3/fb [397033,7567] 0 2024-04-23T10:20:46.625 INFO:tasks.workunit.client.0.smithi029.stdout:3/44: rename d3/f6 to d3/f8 0 2024-04-23T10:20:46.625 INFO:tasks.workunit.client.0.smithi029.stdout:9/49: mknod d0/cf 0 2024-04-23T10:20:46.625 INFO:tasks.workunit.client.0.smithi029.stdout:5/52: truncate d0/f9 2451721 0 2024-04-23T10:20:46.625 INFO:tasks.workunit.client.0.smithi029.stdout:5/53: rename d0 to d0/df 22 2024-04-23T10:20:46.627 INFO:tasks.workunit.client.0.smithi029.stdout:9/50: creat d0/d7/f10 x:0 0 0 2024-04-23T10:20:46.628 INFO:tasks.workunit.client.0.smithi029.stdout:5/54: mkdir d0/dc/d10 0 2024-04-23T10:20:46.628 INFO:tasks.workunit.client.0.smithi029.stdout:5/55: dread - d0/fe zero size 2024-04-23T10:20:46.629 INFO:tasks.workunit.client.0.smithi029.stdout:8/42: fdatasync d3/fb 0 2024-04-23T10:20:46.630 INFO:tasks.workunit.client.0.smithi029.stdout:9/51: read - d0/d7/fa zero size 2024-04-23T10:20:46.631 INFO:tasks.workunit.client.0.smithi029.stdout:8/43: chown d3/l6 196560813 1 2024-04-23T10:20:46.632 INFO:tasks.workunit.client.0.smithi029.stdout:5/56: symlink d0/dc/d10/l11 0 2024-04-23T10:20:46.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/44: fsync d3/f7 0 2024-04-23T10:20:46.636 INFO:tasks.workunit.client.0.smithi029.stdout:5/57: creat d0/f12 x:0 0 0 2024-04-23T10:20:46.636 INFO:tasks.workunit.client.0.smithi029.stdout:8/45: mknod d3/ce 0 2024-04-23T10:20:46.637 INFO:tasks.workunit.client.0.smithi029.stdout:5/58: stat d0 0 2024-04-23T10:20:46.643 INFO:tasks.workunit.client.0.smithi029.stdout:5/59: rmdir d0 39 2024-04-23T10:20:46.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/45: dwrite d3/f8 [0,4194304] 0 2024-04-23T10:20:46.645 INFO:tasks.workunit.client.0.smithi029.stdout:8/46: mknod d3/cf 0 2024-04-23T10:20:46.647 INFO:tasks.workunit.client.0.smithi029.stdout:8/47: stat d3/fd 0 2024-04-23T10:20:46.649 INFO:tasks.workunit.client.0.smithi029.stdout:5/60: read - d0/fe zero size 2024-04-23T10:20:46.649 INFO:tasks.workunit.client.0.smithi029.stdout:8/48: readlink d3/l6 0 2024-04-23T10:20:46.649 INFO:tasks.workunit.client.0.smithi029.stdout:9/52: dwrite d0/d7/fa [0,4194304] 0 2024-04-23T10:20:46.653 INFO:tasks.workunit.client.0.smithi029.stdout:8/49: creat d3/f10 x:0 0 0 2024-04-23T10:20:46.654 INFO:tasks.workunit.client.0.smithi029.stdout:9/53: creat d0/f11 x:0 0 0 2024-04-23T10:20:46.656 INFO:tasks.workunit.client.0.smithi029.stdout:5/61: mkdir d0/d13 0 2024-04-23T10:20:46.657 INFO:tasks.workunit.client.0.smithi029.stdout:8/50: creat d3/f11 x:0 0 0 2024-04-23T10:20:46.660 INFO:tasks.workunit.client.0.smithi029.stdout:3/46: fdatasync d3/f8 0 2024-04-23T10:20:46.660 INFO:tasks.workunit.client.0.smithi029.stdout:8/51: creat d3/f12 x:0 0 0 2024-04-23T10:20:46.660 INFO:tasks.workunit.client.0.smithi029.stdout:3/47: chown d3/f8 178369738 1 2024-04-23T10:20:46.661 INFO:tasks.workunit.client.0.smithi029.stdout:3/48: fsync f0 0 2024-04-23T10:20:46.661 INFO:tasks.workunit.client.0.smithi029.stdout:5/62: truncate d0/f4 697678 0 2024-04-23T10:20:46.662 INFO:tasks.workunit.client.0.smithi029.stdout:3/49: chown d3/f8 7404923 1 2024-04-23T10:20:46.664 INFO:tasks.workunit.client.0.smithi029.stdout:8/52: rename d3/f12 to d3/f13 0 2024-04-23T10:20:46.665 INFO:tasks.workunit.client.0.smithi029.stdout:3/50: mknod d3/c9 0 2024-04-23T10:20:46.667 INFO:tasks.workunit.client.0.smithi029.stdout:8/53: rename d3/f4 to d3/f14 0 2024-04-23T10:20:46.669 INFO:tasks.workunit.client.0.smithi029.stdout:9/54: getdents d0 0 2024-04-23T10:20:46.670 INFO:tasks.workunit.client.0.smithi029.stdout:5/63: link d0/dc/d10/l11 d0/l14 0 2024-04-23T10:20:46.670 INFO:tasks.workunit.client.0.smithi029.stdout:3/51: dread d3/f5 [0,4194304] 0 2024-04-23T10:20:46.670 INFO:tasks.workunit.client.0.smithi029.stdout:5/64: chown d0/fe 645 1 2024-04-23T10:20:46.672 INFO:tasks.workunit.client.0.smithi029.stdout:8/54: rename d3/l6 to d3/l15 0 2024-04-23T10:20:46.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/55: symlink d3/l16 0 2024-04-23T10:20:46.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/56: chown d3/f14 84557894 1 2024-04-23T10:20:46.681 INFO:tasks.workunit.client.0.smithi029.stdout:5/65: mknod d0/d13/c15 0 2024-04-23T10:20:46.684 INFO:tasks.workunit.client.0.smithi029.stdout:9/55: write d0/d7/d6/fb [934180,19386] 0 2024-04-23T10:20:46.684 INFO:tasks.workunit.client.0.smithi029.stdout:5/66: creat d0/db/f16 x:0 0 0 2024-04-23T10:20:46.688 INFO:tasks.workunit.client.0.smithi029.stdout:5/67: creat d0/f17 x:0 0 0 2024-04-23T10:20:46.688 INFO:tasks.workunit.client.0.smithi029.stdout:9/56: rename d0/d7/f9 to d0/d7/f12 0 2024-04-23T10:20:46.690 INFO:tasks.workunit.client.0.smithi029.stdout:5/68: dread - d0/f17 zero size 2024-04-23T10:20:46.690 INFO:tasks.workunit.client.0.smithi029.stdout:3/52: dwrite d3/f5 [0,4194304] 0 2024-04-23T10:20:46.691 INFO:tasks.workunit.client.0.smithi029.stdout:9/57: dread d0/d7/f12 [0,4194304] 0 2024-04-23T10:20:46.693 INFO:tasks.workunit.client.0.smithi029.stdout:5/69: creat d0/db/f18 x:0 0 0 2024-04-23T10:20:46.693 INFO:tasks.workunit.client.0.smithi029.stdout:8/57: dwrite d3/f14 [0,4194304] 0 2024-04-23T10:20:46.694 INFO:tasks.workunit.client.0.smithi029.stdout:5/70: stat d0/ca 0 2024-04-23T10:20:46.695 INFO:tasks.workunit.client.0.smithi029.stdout:9/58: creat d0/d7/f13 x:0 0 0 2024-04-23T10:20:46.697 INFO:tasks.workunit.client.0.smithi029.stdout:5/71: write d0/db/f18 [110616,123853] 0 2024-04-23T10:20:46.698 INFO:tasks.workunit.client.0.smithi029.stdout:3/53: getdents d3 0 2024-04-23T10:20:46.700 INFO:tasks.workunit.client.0.smithi029.stdout:3/54: read d3/f8 [1231470,62598] 0 2024-04-23T10:20:46.701 INFO:tasks.workunit.client.0.smithi029.stdout:3/55: rename d3 to d3/da 22 2024-04-23T10:20:46.701 INFO:tasks.workunit.client.0.smithi029.stdout:9/59: creat d0/d7/d6/f14 x:0 0 0 2024-04-23T10:20:46.704 INFO:tasks.workunit.client.0.smithi029.stdout:9/60: write d0/d7/d6/fe [490746,7551] 0 2024-04-23T10:20:46.709 INFO:tasks.workunit.client.0.smithi029.stdout:8/58: dwrite d3/fd [0,4194304] 0 2024-04-23T10:20:46.711 INFO:tasks.workunit.client.0.smithi029.stdout:3/56: dread d3/f8 [0,4194304] 0 2024-04-23T10:20:46.712 INFO:tasks.workunit.client.0.smithi029.stdout:8/59: chown d3/fd 2 1 2024-04-23T10:20:46.712 INFO:tasks.workunit.client.0.smithi029.stdout:5/72: write d0/f9 [3071555,12197] 0 2024-04-23T10:20:46.714 INFO:tasks.workunit.client.0.smithi029.stdout:3/57: symlink d3/lb 0 2024-04-23T10:20:46.714 INFO:tasks.workunit.client.0.smithi029.stdout:8/60: rmdir d3 39 2024-04-23T10:20:46.714 INFO:tasks.workunit.client.0.smithi029.stdout:3/58: stat d3 0 2024-04-23T10:20:46.716 INFO:tasks.workunit.client.0.smithi029.stdout:5/73: stat d0/l14 0 2024-04-23T10:20:46.717 INFO:tasks.workunit.client.0.smithi029.stdout:3/59: chown d3/f5 99550501 1 2024-04-23T10:20:46.718 INFO:tasks.workunit.client.0.smithi029.stdout:8/61: creat d3/f17 x:0 0 0 2024-04-23T10:20:46.720 INFO:tasks.workunit.client.0.smithi029.stdout:5/74: unlink d0/ca 0 2024-04-23T10:20:46.721 INFO:tasks.workunit.client.0.smithi029.stdout:9/61: dwrite d0/d7/d6/f14 [0,4194304] 0 2024-04-23T10:20:46.721 INFO:tasks.workunit.client.0.smithi029.stdout:8/62: chown d3/fd 12 1 2024-04-23T10:20:46.722 INFO:tasks.workunit.client.0.smithi029.stdout:5/75: chown d0/db 14971 1 2024-04-23T10:20:46.727 INFO:tasks.workunit.client.0.smithi029.stdout:9/62: chown d0/d7/f12 4 1 2024-04-23T10:20:46.728 INFO:tasks.workunit.client.0.smithi029.stdout:3/60: dread d3/f5 [0,4194304] 0 2024-04-23T10:20:46.730 INFO:tasks.workunit.client.0.smithi029.stdout:5/76: rename d0/f4 to d0/f19 0 2024-04-23T10:20:46.731 INFO:tasks.workunit.client.0.smithi029.stdout:8/63: link d3/ce d3/c18 0 2024-04-23T10:20:46.732 INFO:tasks.workunit.client.0.smithi029.stdout:9/63: write d0/d7/f12 [634351,76706] 0 2024-04-23T10:20:46.732 INFO:tasks.workunit.client.0.smithi029.stdout:3/61: rmdir d3 39 2024-04-23T10:20:46.733 INFO:tasks.workunit.client.0.smithi029.stdout:5/77: mknod d0/db/c1a 0 2024-04-23T10:20:46.733 INFO:tasks.workunit.client.0.smithi029.stdout:8/64: fdatasync d3/f10 0 2024-04-23T10:20:46.734 INFO:tasks.workunit.client.0.smithi029.stdout:3/62: chown d3/f5 1030855 1 2024-04-23T10:20:46.734 INFO:tasks.workunit.client.0.smithi029.stdout:5/78: write d0/f17 [736533,94192] 0 2024-04-23T10:20:46.735 INFO:tasks.workunit.client.0.smithi029.stdout:9/64: mkdir d0/d7/d15 0 2024-04-23T10:20:46.736 INFO:tasks.workunit.client.0.smithi029.stdout:8/65: write f1 [5301211,121070] 0 2024-04-23T10:20:46.736 INFO:tasks.workunit.client.0.smithi029.stdout:3/63: mkdir d3/dc 0 2024-04-23T10:20:46.737 INFO:tasks.workunit.client.0.smithi029.stdout:5/79: dread - d0/db/f16 zero size 2024-04-23T10:20:46.739 INFO:tasks.workunit.client.0.smithi029.stdout:9/65: creat d0/d7/d15/f16 x:0 0 0 2024-04-23T10:20:46.740 INFO:tasks.workunit.client.0.smithi029.stdout:5/80: truncate d0/db/f18 910875 0 2024-04-23T10:20:46.740 INFO:tasks.workunit.client.0.smithi029.stdout:9/66: stat d0 0 2024-04-23T10:20:46.741 INFO:tasks.workunit.client.0.smithi029.stdout:3/64: creat d3/fd x:0 0 0 2024-04-23T10:20:46.741 INFO:tasks.workunit.client.0.smithi029.stdout:5/81: fsync d0/fe 0 2024-04-23T10:20:46.742 INFO:tasks.workunit.client.0.smithi029.stdout:3/65: chown d3/l4 21166 1 2024-04-23T10:20:46.742 INFO:tasks.workunit.client.0.smithi029.stdout:8/66: chown d3/ce 15402845 1 2024-04-23T10:20:46.743 INFO:tasks.workunit.client.0.smithi029.stdout:9/67: creat d0/d7/f17 x:0 0 0 2024-04-23T10:20:46.743 INFO:tasks.workunit.client.0.smithi029.stdout:9/68: readlink d0/d7/l5 0 2024-04-23T10:20:46.743 INFO:tasks.workunit.client.0.smithi029.stdout:5/82: mknod d0/dc/c1b 0 2024-04-23T10:20:46.744 INFO:tasks.workunit.client.0.smithi029.stdout:8/67: creat d3/f19 x:0 0 0 2024-04-23T10:20:46.744 INFO:tasks.workunit.client.0.smithi029.stdout:9/69: fsync d0/d7/d6/fc 0 2024-04-23T10:20:46.745 INFO:tasks.workunit.client.0.smithi029.stdout:5/83: creat d0/dc/f1c x:0 0 0 2024-04-23T10:20:46.746 INFO:tasks.workunit.client.0.smithi029.stdout:8/68: write d3/f7 [3174568,32252] 0 2024-04-23T10:20:46.746 INFO:tasks.workunit.client.0.smithi029.stdout:3/66: mkdir d3/dc/de 0 2024-04-23T10:20:46.748 INFO:tasks.workunit.client.0.smithi029.stdout:5/84: unlink d0/f9 0 2024-04-23T10:20:46.749 INFO:tasks.workunit.client.0.smithi029.stdout:9/70: getdents d0 0 2024-04-23T10:20:46.751 INFO:tasks.workunit.client.0.smithi029.stdout:5/85: symlink d0/db/l1d 0 2024-04-23T10:20:46.751 INFO:tasks.workunit.client.0.smithi029.stdout:9/71: write d0/d7/d6/fc [100942,26666] 0 2024-04-23T10:20:46.755 INFO:tasks.workunit.client.0.smithi029.stdout:3/67: dwrite d3/f8 [0,4194304] 0 2024-04-23T10:20:46.758 INFO:tasks.workunit.client.0.smithi029.stdout:3/68: rename d3/lb to d3/dc/de/lf 0 2024-04-23T10:20:46.760 INFO:tasks.workunit.client.0.smithi029.stdout:8/69: dread f1 [4194304,4194304] 0 2024-04-23T10:20:46.762 INFO:tasks.workunit.client.0.smithi029.stdout:3/69: write d3/f5 [2099601,53064] 0 2024-04-23T10:20:46.766 INFO:tasks.workunit.client.0.smithi029.stdout:9/72: dwrite d0/d7/f13 [0,4194304] 0 2024-04-23T10:20:46.767 INFO:tasks.workunit.client.0.smithi029.stdout:3/70: chown d3/fd 11 1 2024-04-23T10:20:46.768 INFO:tasks.workunit.client.0.smithi029.stdout:3/71: rename d3/dc to d3/d10 0 2024-04-23T10:20:46.769 INFO:tasks.workunit.client.0.smithi029.stdout:9/73: truncate d0/d7/f17 220678 0 2024-04-23T10:20:46.770 INFO:tasks.workunit.client.0.smithi029.stdout:9/74: fsync d0/d7/d6/fe 0 2024-04-23T10:20:46.770 INFO:tasks.workunit.client.0.smithi029.stdout:8/70: dread d3/f14 [4194304,4194304] 0 2024-04-23T10:20:46.775 INFO:tasks.workunit.client.0.smithi029.stdout:9/75: dread d0/d7/d6/fb [0,4194304] 0 2024-04-23T10:20:46.782 INFO:tasks.workunit.client.0.smithi029.stdout:8/71: dwrite d3/f13 [0,4194304] 0 2024-04-23T10:20:46.784 INFO:tasks.workunit.client.0.smithi029.stdout:9/76: dread d0/d7/d6/f14 [0,4194304] 0 2024-04-23T10:20:46.785 INFO:tasks.workunit.client.0.smithi029.stdout:8/72: write f1 [1319118,117501] 0 2024-04-23T10:20:46.786 INFO:tasks.workunit.client.0.smithi029.stdout:8/73: chown d3/cc 1102425 1 2024-04-23T10:20:46.787 INFO:tasks.workunit.client.0.smithi029.stdout:8/74: readlink d3/l16 0 2024-04-23T10:20:46.787 INFO:tasks.workunit.client.0.smithi029.stdout:8/75: fdatasync d3/f7 0 2024-04-23T10:20:46.789 INFO:tasks.workunit.client.0.smithi029.stdout:8/76: chown d3/f7 2629955 1 2024-04-23T10:20:46.791 INFO:tasks.workunit.client.0.smithi029.stdout:8/77: mkdir d3/d1a 0 2024-04-23T10:20:46.793 INFO:tasks.workunit.client.0.smithi029.stdout:8/78: mknod d3/c1b 0 2024-04-23T10:20:46.796 INFO:tasks.workunit.client.0.smithi029.stdout:9/77: dwrite d0/d7/fa [4194304,4194304] 0 2024-04-23T10:20:46.798 INFO:tasks.workunit.client.0.smithi029.stdout:9/78: unlink d0/cf 0 2024-04-23T10:20:46.800 INFO:tasks.workunit.client.0.smithi029.stdout:8/79: rmdir d3/d1a 0 2024-04-23T10:20:46.805 INFO:tasks.workunit.client.0.smithi029.stdout:9/79: dread d0/d7/d6/fe [0,4194304] 0 2024-04-23T10:20:46.805 INFO:tasks.workunit.client.0.smithi029.stdout:9/80: dread - d0/d7/d15/f16 zero size 2024-04-23T10:20:46.806 INFO:tasks.workunit.client.0.smithi029.stdout:9/81: chown d0/d7/l5 3973 1 2024-04-23T10:20:46.815 INFO:tasks.workunit.client.0.smithi029.stdout:9/82: dwrite d0/d7/d6/fe [0,4194304] 0 2024-04-23T10:20:46.818 INFO:tasks.workunit.client.0.smithi029.stdout:9/83: rename d0/d7/d6/f14 to d0/d7/f18 0 2024-04-23T10:20:46.818 INFO:tasks.workunit.client.0.smithi029.stdout:9/84: readlink d0/d7/l5 0 2024-04-23T10:20:46.819 INFO:tasks.workunit.client.0.smithi029.stdout:9/85: fsync d0/d7/d6/fc 0 2024-04-23T10:20:46.819 INFO:tasks.workunit.client.0.smithi029.stdout:9/86: chown d0/l3 330 1 2024-04-23T10:20:46.820 INFO:tasks.workunit.client.0.smithi029.stdout:9/87: chown d0/d7/d6 132 1 2024-04-23T10:20:46.821 INFO:tasks.workunit.client.0.smithi029.stdout:9/88: fdatasync d0/f11 0 2024-04-23T10:20:47.480 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:20:47.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:20:51.114 INFO:tasks.workunit.client.0.smithi029.stdout:6/9: sync 2024-04-23T10:20:51.114 INFO:tasks.workunit.client.0.smithi029.stdout:6/10: rmdir - no directory 2024-04-23T10:20:51.115 INFO:tasks.workunit.client.0.smithi029.stdout:6/11: truncate - no filename 2024-04-23T10:20:51.118 INFO:tasks.workunit.client.0.smithi029.stdout:6/12: creat f0 x:0 0 0 2024-04-23T10:20:51.119 INFO:tasks.workunit.client.0.smithi029.stdout:6/13: dread - f0 zero size 2024-04-23T10:20:51.122 INFO:tasks.workunit.client.0.smithi029.stdout:6/14: symlink l1 0 2024-04-23T10:20:51.126 INFO:tasks.workunit.client.0.smithi029.stdout:6/15: creat f2 x:0 0 0 2024-04-23T10:20:51.130 INFO:tasks.workunit.client.0.smithi029.stdout:6/16: mknod c3 0 2024-04-23T10:20:51.131 INFO:tasks.workunit.client.0.smithi029.stdout:6/17: write f0 [110952,50113] 0 2024-04-23T10:20:51.133 INFO:tasks.workunit.client.0.smithi029.stdout:6/18: write f2 [227497,62328] 0 2024-04-23T10:20:51.145 INFO:tasks.workunit.client.0.smithi029.stdout:6/19: dwrite f2 [0,4194304] 0 2024-04-23T10:20:51.147 INFO:tasks.workunit.client.0.smithi029.stdout:6/20: write f0 [678855,87036] 0 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:9/89: sync 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:0/17: sync 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:8/80: sync 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:4/44: sync 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/72: sync 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:2/7: sync 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:5/86: sync 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:1/18: sync 2024-04-23T10:20:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:7/12: sync 2024-04-23T10:20:51.388 INFO:tasks.workunit.client.0.smithi029.stdout:0/18: chown d0/f3 2331085 1 2024-04-23T10:20:51.388 INFO:tasks.workunit.client.0.smithi029.stdout:8/81: chown d3/f10 6162 1 2024-04-23T10:20:51.389 INFO:tasks.workunit.client.0.smithi029.stdout:9/90: truncate d0/d7/f10 237645 0 2024-04-23T10:20:51.390 INFO:tasks.workunit.client.0.smithi029.stdout:4/45: creat d0/fd x:0 0 0 2024-04-23T10:20:51.392 INFO:tasks.workunit.client.0.smithi029.stdout:1/19: unlink c4 0 2024-04-23T10:20:51.399 INFO:tasks.workunit.client.0.smithi029.stdout:0/19: creat d0/f4 x:0 0 0 2024-04-23T10:20:51.399 INFO:tasks.workunit.client.0.smithi029.stdout:3/73: dread d3/f8 [0,4194304] 0 2024-04-23T10:20:51.400 INFO:tasks.workunit.client.0.smithi029.stdout:9/91: mknod d0/d7/c19 0 2024-04-23T10:20:51.402 INFO:tasks.workunit.client.0.smithi029.stdout:4/46: fdatasync d0/f4 0 2024-04-23T10:20:51.403 INFO:tasks.workunit.client.0.smithi029.stdout:3/74: stat d3/c7 0 2024-04-23T10:20:51.404 INFO:tasks.workunit.client.0.smithi029.stdout:5/87: dwrite d0/db/f18 [0,4194304] 0 2024-04-23T10:20:51.407 INFO:tasks.workunit.client.0.smithi029.stdout:1/20: write d5/d6/f8 [865753,24428] 0 2024-04-23T10:20:51.407 INFO:tasks.workunit.client.0.smithi029.stdout:7/13: dwrite f1 [0,4194304] 0 2024-04-23T10:20:51.412 INFO:tasks.workunit.client.0.smithi029.stdout:1/21: truncate d5/d6/f8 4234262 0 2024-04-23T10:20:51.412 INFO:tasks.workunit.client.0.smithi029.stdout:9/92: fdatasync d0/d7/d6/fb 0 2024-04-23T10:20:51.416 INFO:tasks.workunit.client.0.smithi029.stdout:9/93: dread - d0/f11 zero size 2024-04-23T10:20:51.416 INFO:tasks.workunit.client.0.smithi029.stdout:3/75: creat d3/d10/de/f11 x:0 0 0 2024-04-23T10:20:51.420 INFO:tasks.workunit.client.0.smithi029.stdout:7/14: rename f3 to f4 0 2024-04-23T10:20:51.421 INFO:tasks.workunit.client.0.smithi029.stdout:1/22: dread d5/d6/f8 [4194304,4194304] 0 2024-04-23T10:20:51.422 INFO:tasks.workunit.client.0.smithi029.stdout:0/20: dwrite d0/f1 [0,4194304] 0 2024-04-23T10:20:51.427 INFO:tasks.workunit.client.0.smithi029.stdout:5/88: dwrite d0/db/f16 [0,4194304] 0 2024-04-23T10:20:51.429 INFO:tasks.workunit.client.0.smithi029.stdout:5/89: chown d0/db/f16 2 1 2024-04-23T10:20:51.431 INFO:tasks.workunit.client.0.smithi029.stdout:9/94: dread d0/d7/f18 [0,4194304] 0 2024-04-23T10:20:51.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/95: write d0/d7/d6/fe [6008,107179] 0 2024-04-23T10:20:51.437 INFO:tasks.workunit.client.0.smithi029.stdout:8/82: dread d3/f13 [0,4194304] 0 2024-04-23T10:20:51.439 INFO:tasks.workunit.client.0.smithi029.stdout:5/90: dwrite d0/f12 [0,4194304] 0 2024-04-23T10:20:51.443 INFO:tasks.workunit.client.0.smithi029.stdout:8/83: dread f1 [0,4194304] 0 2024-04-23T10:20:51.445 INFO:tasks.workunit.client.0.smithi029.stdout:4/47: truncate d0/f6 871430 0 2024-04-23T10:20:51.445 INFO:tasks.workunit.client.0.smithi029.stdout:4/48: readlink d0/l8 0 2024-04-23T10:20:51.454 INFO:tasks.workunit.client.0.smithi029.stdout:8/84: dwrite f1 [0,4194304] 0 2024-04-23T10:20:51.454 INFO:tasks.workunit.client.0.smithi029.stdout:4/49: dread d0/f1 [0,4194304] 0 2024-04-23T10:20:51.455 INFO:tasks.workunit.client.0.smithi029.stdout:4/50: readlink d0/l8 0 2024-04-23T10:20:51.460 INFO:tasks.workunit.client.0.smithi029.stdout:3/76: creat d3/d10/de/f12 x:0 0 0 2024-04-23T10:20:51.461 INFO:tasks.workunit.client.0.smithi029.stdout:3/77: write f0 [319952,130242] 0 2024-04-23T10:20:51.463 INFO:tasks.workunit.client.0.smithi029.stdout:0/21: symlink d0/l5 0 2024-04-23T10:20:51.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/22: chown d0/l2 404 1 2024-04-23T10:20:51.468 INFO:tasks.workunit.client.0.smithi029.stdout:6/21: sync 2024-04-23T10:20:51.469 INFO:tasks.workunit.client.0.smithi029.stdout:6/22: truncate f0 987415 0 2024-04-23T10:20:51.471 INFO:tasks.workunit.client.0.smithi029.stdout:1/23: write d5/d6/f8 [4186094,7217] 0 2024-04-23T10:20:51.473 INFO:tasks.workunit.client.0.smithi029.stdout:7/15: unlink c0 0 2024-04-23T10:20:51.482 INFO:tasks.workunit.client.0.smithi029.stdout:1/24: dwrite d5/d6/f8 [4194304,4194304] 0 2024-04-23T10:20:51.484 INFO:tasks.workunit.client.0.smithi029.stdout:9/96: creat d0/d7/f1a x:0 0 0 2024-04-23T10:20:51.487 INFO:tasks.workunit.client.0.smithi029.stdout:6/23: dread f0 [0,4194304] 0 2024-04-23T10:20:51.489 INFO:tasks.workunit.client.0.smithi029.stdout:6/24: chown f0 72619 1 2024-04-23T10:20:51.489 INFO:tasks.workunit.client.0.smithi029.stdout:5/91: rename d0/dc/ld to d0/dc/l1e 0 2024-04-23T10:20:51.493 INFO:tasks.workunit.client.0.smithi029.stdout:8/85: symlink d3/l1c 0 2024-04-23T10:20:51.495 INFO:tasks.workunit.client.0.smithi029.stdout:4/51: creat d0/fe x:0 0 0 2024-04-23T10:20:51.496 INFO:tasks.workunit.client.0.smithi029.stdout:9/97: dwrite d0/d7/f12 [0,4194304] 0 2024-04-23T10:20:51.496 INFO:tasks.workunit.client.0.smithi029.stdout:0/23: rmdir d0 39 2024-04-23T10:20:51.501 INFO:tasks.workunit.client.0.smithi029.stdout:7/16: mkdir d5 0 2024-04-23T10:20:51.503 INFO:tasks.workunit.client.0.smithi029.stdout:2/8: creat d1/f2 x:0 0 0 2024-04-23T10:20:51.509 INFO:tasks.workunit.client.0.smithi029.stdout:6/25: unlink f2 0 2024-04-23T10:20:51.510 INFO:tasks.workunit.client.0.smithi029.stdout:5/92: symlink d0/d13/l1f 0 2024-04-23T10:20:51.511 INFO:tasks.workunit.client.0.smithi029.stdout:9/98: dwrite d0/d7/f10 [0,4194304] 0 2024-04-23T10:20:51.514 INFO:tasks.workunit.client.0.smithi029.stdout:8/86: stat d3/c18 0 2024-04-23T10:20:51.515 INFO:tasks.workunit.client.0.smithi029.stdout:5/93: chown d0/dc/c1b 52954 1 2024-04-23T10:20:51.515 INFO:tasks.workunit.client.0.smithi029.stdout:4/52: creat d0/ff x:0 0 0 2024-04-23T10:20:51.518 INFO:tasks.workunit.client.0.smithi029.stdout:2/9: dwrite d1/f2 [0,4194304] 0 2024-04-23T10:20:51.523 INFO:tasks.workunit.client.0.smithi029.stdout:6/26: creat f4 x:0 0 0 2024-04-23T10:20:51.530 INFO:tasks.workunit.client.0.smithi029.stdout:8/87: symlink d3/l1d 0 2024-04-23T10:20:51.530 INFO:tasks.workunit.client.0.smithi029.stdout:4/53: symlink d0/l10 0 2024-04-23T10:20:51.531 INFO:tasks.workunit.client.0.smithi029.stdout:7/17: mknod d5/c6 0 2024-04-23T10:20:51.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/94: dread d0/f19 [0,4194304] 0 2024-04-23T10:20:51.532 INFO:tasks.workunit.client.0.smithi029.stdout:4/54: truncate d0/fa 1020435 0 2024-04-23T10:20:51.533 INFO:tasks.workunit.client.0.smithi029.stdout:2/10: symlink d1/l3 0 2024-04-23T10:20:51.533 INFO:tasks.workunit.client.0.smithi029.stdout:7/18: mkdir d5/d7 0 2024-04-23T10:20:51.533 INFO:tasks.workunit.client.0.smithi029.stdout:9/99: fdatasync d0/d7/f10 0 2024-04-23T10:20:51.535 INFO:tasks.workunit.client.0.smithi029.stdout:7/19: rmdir d5 39 2024-04-23T10:20:51.536 INFO:tasks.workunit.client.0.smithi029.stdout:2/11: mkdir d1/d4 0 2024-04-23T10:20:51.537 INFO:tasks.workunit.client.0.smithi029.stdout:9/100: readlink d0/d7/l5 0 2024-04-23T10:20:51.539 INFO:tasks.workunit.client.0.smithi029.stdout:2/12: write d1/f2 [600526,114819] 0 2024-04-23T10:20:51.540 INFO:tasks.workunit.client.0.smithi029.stdout:8/88: dread d3/fb [0,4194304] 0 2024-04-23T10:20:51.541 INFO:tasks.workunit.client.0.smithi029.stdout:9/101: read d0/d7/fa [1560298,62296] 0 2024-04-23T10:20:51.543 INFO:tasks.workunit.client.0.smithi029.stdout:2/13: write d1/f2 [3231453,6024] 0 2024-04-23T10:20:51.546 INFO:tasks.workunit.client.0.smithi029.stdout:8/89: creat d3/f1e x:0 0 0 2024-04-23T10:20:51.546 INFO:tasks.workunit.client.0.smithi029.stdout:2/14: readlink d1/l3 0 2024-04-23T10:20:51.548 INFO:tasks.workunit.client.0.smithi029.stdout:5/95: dwrite d0/fe [0,4194304] 0 2024-04-23T10:20:51.550 INFO:tasks.workunit.client.0.smithi029.stdout:2/15: chown d1/f2 1 1 2024-04-23T10:20:51.550 INFO:tasks.workunit.client.0.smithi029.stdout:8/90: creat d3/f1f x:0 0 0 2024-04-23T10:20:51.552 INFO:tasks.workunit.client.0.smithi029.stdout:8/91: chown d3/l1c 222791813 1 2024-04-23T10:20:51.552 INFO:tasks.workunit.client.0.smithi029.stdout:5/96: creat d0/d13/f20 x:0 0 0 2024-04-23T10:20:51.553 INFO:tasks.workunit.client.0.smithi029.stdout:2/16: symlink d1/d4/l5 0 2024-04-23T10:20:51.554 INFO:tasks.workunit.client.0.smithi029.stdout:9/102: dread d0/d7/d6/fe [0,4194304] 0 2024-04-23T10:20:51.554 INFO:tasks.workunit.client.0.smithi029.stdout:8/92: symlink d3/l20 0 2024-04-23T10:20:51.554 INFO:tasks.workunit.client.0.smithi029.stdout:2/17: write d1/f2 [577559,12031] 0 2024-04-23T10:20:51.557 INFO:tasks.workunit.client.0.smithi029.stdout:2/18: write d1/f2 [1261012,30187] 0 2024-04-23T10:20:51.558 INFO:tasks.workunit.client.0.smithi029.stdout:8/93: mkdir d3/d21 0 2024-04-23T10:20:51.561 INFO:tasks.workunit.client.0.smithi029.stdout:2/19: truncate d1/f2 4677698 0 2024-04-23T10:20:51.561 INFO:tasks.workunit.client.0.smithi029.stdout:9/103: write d0/d7/fa [8137554,46216] 0 2024-04-23T10:20:51.564 INFO:tasks.workunit.client.0.smithi029.stdout:9/104: mkdir d0/d1b 0 2024-04-23T10:20:51.564 INFO:tasks.workunit.client.0.smithi029.stdout:5/97: dwrite d0/f12 [0,4194304] 0 2024-04-23T10:20:51.567 INFO:tasks.workunit.client.0.smithi029.stdout:2/20: rename d1/l3 to d1/d4/l6 0 2024-04-23T10:20:51.567 INFO:tasks.workunit.client.0.smithi029.stdout:2/21: rename d1 to d1/d4/d7 22 2024-04-23T10:20:51.570 INFO:tasks.workunit.client.0.smithi029.stdout:9/105: creat d0/f1c x:0 0 0 2024-04-23T10:20:51.573 INFO:tasks.workunit.client.0.smithi029.stdout:2/22: creat d1/d4/f8 x:0 0 0 2024-04-23T10:20:51.574 INFO:tasks.workunit.client.0.smithi029.stdout:5/98: link d0/db/f16 d0/d13/f21 0 2024-04-23T10:20:51.576 INFO:tasks.workunit.client.0.smithi029.stdout:9/106: mkdir d0/d7/d1d 0 2024-04-23T10:20:51.577 INFO:tasks.workunit.client.0.smithi029.stdout:9/107: write d0/d7/f1a [505507,22450] 0 2024-04-23T10:20:51.579 INFO:tasks.workunit.client.0.smithi029.stdout:2/23: dread d1/f2 [0,4194304] 0 2024-04-23T10:20:51.580 INFO:tasks.workunit.client.0.smithi029.stdout:9/108: write d0/d7/d6/fc [433103,83276] 0 2024-04-23T10:20:51.580 INFO:tasks.workunit.client.0.smithi029.stdout:2/24: chown d1 9411 1 2024-04-23T10:20:51.581 INFO:tasks.workunit.client.0.smithi029.stdout:5/99: rename d0/d13/f21 to d0/db/f22 0 2024-04-23T10:20:51.583 INFO:tasks.workunit.client.0.smithi029.stdout:9/109: creat d0/f1e x:0 0 0 2024-04-23T10:20:51.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/100: symlink d0/d13/l23 0 2024-04-23T10:20:51.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/101: chown d0/f17 0 1 2024-04-23T10:20:51.595 INFO:tasks.workunit.client.0.smithi029.stdout:9/110: dwrite d0/f1e [0,4194304] 0 2024-04-23T10:20:51.595 INFO:tasks.workunit.client.0.smithi029.stdout:2/25: dwrite d1/f2 [0,4194304] 0 2024-04-23T10:20:51.601 INFO:tasks.workunit.client.0.smithi029.stdout:9/111: creat d0/d7/d1d/f1f x:0 0 0 2024-04-23T10:20:51.602 INFO:tasks.workunit.client.0.smithi029.stdout:5/102: dread d0/db/f22 [0,4194304] 0 2024-04-23T10:20:51.608 INFO:tasks.workunit.client.0.smithi029.stdout:9/112: creat d0/d7/d1d/f20 x:0 0 0 2024-04-23T10:20:51.610 INFO:tasks.workunit.client.0.smithi029.stdout:2/26: dwrite d1/d4/f8 [0,4194304] 0 2024-04-23T10:20:51.610 INFO:tasks.workunit.client.0.smithi029.stdout:5/103: symlink d0/l24 0 2024-04-23T10:20:51.610 INFO:tasks.workunit.client.0.smithi029.stdout:2/27: chown d1 1108550919 1 2024-04-23T10:20:51.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/104: write d0/d13/f20 [310967,78352] 0 2024-04-23T10:20:51.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/105: stat d0/d13/c15 0 2024-04-23T10:20:51.615 INFO:tasks.workunit.client.0.smithi029.stdout:5/106: truncate d0/d13/f20 1191057 0 2024-04-23T10:20:51.619 INFO:tasks.workunit.client.0.smithi029.stdout:9/113: creat d0/f21 x:0 0 0 2024-04-23T10:20:51.624 INFO:tasks.workunit.client.0.smithi029.stdout:5/107: link d0/f19 d0/d13/f25 0 2024-04-23T10:20:51.625 INFO:tasks.workunit.client.0.smithi029.stdout:2/28: dwrite d1/f2 [0,4194304] 0 2024-04-23T10:20:51.627 INFO:tasks.workunit.client.0.smithi029.stdout:5/108: read d0/db/f22 [2639561,91600] 0 2024-04-23T10:20:51.632 INFO:tasks.workunit.client.0.smithi029.stdout:9/114: dwrite d0/f1c [0,4194304] 0 2024-04-23T10:20:51.636 INFO:tasks.workunit.client.0.smithi029.stdout:9/115: unlink d0/d7/f13 0 2024-04-23T10:20:51.636 INFO:tasks.workunit.client.0.smithi029.stdout:9/116: fsync d0/d7/fa 0 2024-04-23T10:20:51.637 INFO:tasks.workunit.client.0.smithi029.stdout:5/109: dread d0/d13/f25 [0,4194304] 0 2024-04-23T10:20:51.638 INFO:tasks.workunit.client.0.smithi029.stdout:9/117: chown d0/d7/f17 43966873 1 2024-04-23T10:20:51.638 INFO:tasks.workunit.client.0.smithi029.stdout:9/118: dread - d0/d7/d1d/f20 zero size 2024-04-23T10:20:51.642 INFO:tasks.workunit.client.0.smithi029.stdout:9/119: creat d0/d7/f22 x:0 0 0 2024-04-23T10:20:51.643 INFO:tasks.workunit.client.0.smithi029.stdout:5/110: fdatasync d0/d13/f25 0 2024-04-23T10:20:51.644 INFO:tasks.workunit.client.0.smithi029.stdout:5/111: fdatasync d0/fe 0 2024-04-23T10:20:51.645 INFO:tasks.workunit.client.0.smithi029.stdout:5/112: chown d0/dc/d10 867 1 2024-04-23T10:20:51.646 INFO:tasks.workunit.client.0.smithi029.stdout:9/120: creat d0/d7/d6/f23 x:0 0 0 2024-04-23T10:20:51.647 INFO:tasks.workunit.client.0.smithi029.stdout:9/121: dread - d0/d7/f22 zero size 2024-04-23T10:20:51.647 INFO:tasks.workunit.client.0.smithi029.stdout:5/113: mkdir d0/dc/d10/d26 0 2024-04-23T10:20:51.649 INFO:tasks.workunit.client.0.smithi029.stdout:5/114: symlink d0/dc/d10/l27 0 2024-04-23T10:20:51.649 INFO:tasks.workunit.client.0.smithi029.stdout:5/115: chown d0/db/f18 107260 1 2024-04-23T10:20:51.649 INFO:tasks.workunit.client.0.smithi029.stdout:9/122: mkdir d0/d1b/d24 0 2024-04-23T10:20:51.651 INFO:tasks.workunit.client.0.smithi029.stdout:5/116: mknod d0/c28 0 2024-04-23T10:20:51.652 INFO:tasks.workunit.client.0.smithi029.stdout:5/117: mkdir d0/db/d29 0 2024-04-23T10:20:51.653 INFO:tasks.workunit.client.0.smithi029.stdout:5/118: chown d0/dc/f1c 374245 1 2024-04-23T10:20:51.654 INFO:tasks.workunit.client.0.smithi029.stdout:5/119: symlink d0/l2a 0 2024-04-23T10:20:51.756 INFO:tasks.workunit.client.0.smithi029.stdout:7/20: chown d5/d7 2 1 2024-04-23T10:20:51.756 INFO:tasks.workunit.client.0.smithi029.stdout:3/78: truncate d3/f8 2428540 0 2024-04-23T10:20:51.758 INFO:tasks.workunit.client.0.smithi029.stdout:1/25: truncate d5/d6/f8 4831673 0 2024-04-23T10:20:51.760 INFO:tasks.workunit.client.0.smithi029.stdout:7/21: write f1 [3792480,95176] 0 2024-04-23T10:20:51.761 INFO:tasks.workunit.client.0.smithi029.stdout:3/79: write d3/d10/de/f12 [704193,10789] 0 2024-04-23T10:20:51.763 INFO:tasks.workunit.client.0.smithi029.stdout:3/80: dread - d3/fd zero size 2024-04-23T10:20:51.769 INFO:tasks.workunit.client.0.smithi029.stdout:8/94: getdents d3 0 2024-04-23T10:20:51.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/95: dread - d3/f19 zero size 2024-04-23T10:20:51.772 INFO:tasks.workunit.client.0.smithi029.stdout:3/81: write d3/d10/de/f11 [1046805,35928] 0 2024-04-23T10:20:51.772 INFO:tasks.workunit.client.0.smithi029.stdout:9/123: getdents d0/d7/d6 0 2024-04-23T10:20:51.773 INFO:tasks.workunit.client.0.smithi029.stdout:2/29: chown d1/d4/l6 6217672 1 2024-04-23T10:20:51.777 INFO:tasks.workunit.client.0.smithi029.stdout:9/124: symlink d0/d1b/l25 0 2024-04-23T10:20:51.781 INFO:tasks.workunit.client.0.smithi029.stdout:3/82: fdatasync d3/d10/de/f11 0 2024-04-23T10:20:51.784 INFO:tasks.workunit.client.0.smithi029.stdout:1/26: getdents d5/d6 0 2024-04-23T10:20:51.785 INFO:tasks.workunit.client.0.smithi029.stdout:9/125: mknod d0/d7/d1d/c26 0 2024-04-23T10:20:51.786 INFO:tasks.workunit.client.0.smithi029.stdout:3/83: fsync d3/d10/de/f11 0 2024-04-23T10:20:51.789 INFO:tasks.workunit.client.0.smithi029.stdout:8/96: rmdir d3/d21 0 2024-04-23T10:20:51.795 INFO:tasks.workunit.client.0.smithi029.stdout:7/22: dwrite f4 [0,4194304] 0 2024-04-23T10:20:51.797 INFO:tasks.workunit.client.0.smithi029.stdout:9/126: symlink d0/d7/d15/l27 0 2024-04-23T10:20:51.798 INFO:tasks.workunit.client.0.smithi029.stdout:2/30: dwrite d1/d4/f8 [0,4194304] 0 2024-04-23T10:20:51.805 INFO:tasks.workunit.client.0.smithi029.stdout:3/84: mkdir d3/d10/d13 0 2024-04-23T10:20:51.805 INFO:tasks.workunit.client.0.smithi029.stdout:2/31: write d1/d4/f8 [4962668,73120] 0 2024-04-23T10:20:51.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/23: unlink l2 0 2024-04-23T10:20:51.808 INFO:tasks.workunit.client.0.smithi029.stdout:3/85: creat d3/d10/de/f14 x:0 0 0 2024-04-23T10:20:51.811 INFO:tasks.workunit.client.0.smithi029.stdout:8/97: dread f1 [0,4194304] 0 2024-04-23T10:20:51.815 INFO:tasks.workunit.client.0.smithi029.stdout:2/32: unlink d1/f2 0 2024-04-23T10:20:51.817 INFO:tasks.workunit.client.0.smithi029.stdout:9/127: mknod d0/d7/c28 0 2024-04-23T10:20:51.820 INFO:tasks.workunit.client.0.smithi029.stdout:3/86: dwrite d3/d10/de/f12 [0,4194304] 0 2024-04-23T10:20:51.821 INFO:tasks.workunit.client.0.smithi029.stdout:7/24: getdents d5/d7 0 2024-04-23T10:20:51.822 INFO:tasks.workunit.client.0.smithi029.stdout:7/25: fdatasync f4 0 2024-04-23T10:20:51.827 INFO:tasks.workunit.client.0.smithi029.stdout:2/33: dwrite d1/d4/f8 [0,4194304] 0 2024-04-23T10:20:51.833 INFO:tasks.workunit.client.0.smithi029.stdout:3/87: mkdir d3/d15 0 2024-04-23T10:20:51.839 INFO:tasks.workunit.client.0.smithi029.stdout:7/26: rename d5/d7 to d5/d8 0 2024-04-23T10:20:51.840 INFO:tasks.workunit.client.0.smithi029.stdout:7/27: write f4 [2420822,70995] 0 2024-04-23T10:20:51.843 INFO:tasks.workunit.client.0.smithi029.stdout:9/128: mknod d0/d1b/d24/c29 0 2024-04-23T10:20:51.844 INFO:tasks.workunit.client.0.smithi029.stdout:3/88: dwrite f0 [0,4194304] 0 2024-04-23T10:20:51.844 INFO:tasks.workunit.client.0.smithi029.stdout:9/129: stat d0/l3 0 2024-04-23T10:20:51.844 INFO:tasks.workunit.client.0.smithi029.stdout:2/34: fsync d1/d4/f8 0 2024-04-23T10:20:51.845 INFO:tasks.workunit.client.0.smithi029.stdout:3/89: readlink d3/l4 0 2024-04-23T10:20:51.845 INFO:tasks.workunit.client.0.smithi029.stdout:9/130: dread - d0/d7/f22 zero size 2024-04-23T10:20:51.849 INFO:tasks.workunit.client.0.smithi029.stdout:7/28: dread f1 [0,4194304] 0 2024-04-23T10:20:51.850 INFO:tasks.workunit.client.0.smithi029.stdout:8/98: getdents d3 0 2024-04-23T10:20:51.851 INFO:tasks.workunit.client.0.smithi029.stdout:9/131: chown d0/d7/d1d/f1f 2 1 2024-04-23T10:20:51.852 INFO:tasks.workunit.client.0.smithi029.stdout:2/35: rename d1/d4/f8 to d1/d4/f9 0 2024-04-23T10:20:51.853 INFO:tasks.workunit.client.0.smithi029.stdout:8/99: rmdir d3 39 2024-04-23T10:20:51.856 INFO:tasks.workunit.client.0.smithi029.stdout:7/29: mkdir d5/d9 0 2024-04-23T10:20:51.858 INFO:tasks.workunit.client.0.smithi029.stdout:9/132: symlink d0/d1b/l2a 0 2024-04-23T10:20:51.859 INFO:tasks.workunit.client.0.smithi029.stdout:2/36: rmdir d1 39 2024-04-23T10:20:51.861 INFO:tasks.workunit.client.0.smithi029.stdout:8/100: truncate d3/f19 678150 0 2024-04-23T10:20:51.862 INFO:tasks.workunit.client.0.smithi029.stdout:9/133: mknod d0/d1b/d24/c2b 0 2024-04-23T10:20:51.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/134: symlink d0/d7/d15/l2c 0 2024-04-23T10:20:51.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/135: fsync d0/d7/f17 0 2024-04-23T10:20:51.867 INFO:tasks.workunit.client.0.smithi029.stdout:9/136: rmdir d0/d1b 39 2024-04-23T10:20:51.868 INFO:tasks.workunit.client.0.smithi029.stdout:7/30: getdents d5 0 2024-04-23T10:20:51.871 INFO:tasks.workunit.client.0.smithi029.stdout:7/31: getdents d5/d8 0 2024-04-23T10:20:51.872 INFO:tasks.workunit.client.0.smithi029.stdout:1/27: dwrite d5/d6/f8 [4194304,4194304] 0 2024-04-23T10:20:51.875 INFO:tasks.workunit.client.0.smithi029.stdout:2/37: dwrite d1/d4/f9 [0,4194304] 0 2024-04-23T10:20:51.875 INFO:tasks.workunit.client.0.smithi029.stdout:1/28: rename d5/d6/f8 to d5/f9 0 2024-04-23T10:20:51.879 INFO:tasks.workunit.client.0.smithi029.stdout:1/29: creat d5/fa x:0 0 0 2024-04-23T10:20:51.883 INFO:tasks.workunit.client.0.smithi029.stdout:7/32: dwrite f1 [0,4194304] 0 2024-04-23T10:20:51.883 INFO:tasks.workunit.client.0.smithi029.stdout:7/33: readlink - no filename 2024-04-23T10:20:51.884 INFO:tasks.workunit.client.0.smithi029.stdout:1/30: unlink d5/fa 0 2024-04-23T10:20:51.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/31: read d5/f9 [3273842,27793] 0 2024-04-23T10:20:51.886 INFO:tasks.workunit.client.0.smithi029.stdout:2/38: truncate d1/d4/f9 752993 0 2024-04-23T10:20:51.886 INFO:tasks.workunit.client.0.smithi029.stdout:7/34: rmdir d5 39 2024-04-23T10:20:51.887 INFO:tasks.workunit.client.0.smithi029.stdout:2/39: readlink d1/d4/l6 0 2024-04-23T10:20:51.892 INFO:tasks.workunit.client.0.smithi029.stdout:1/32: dread d5/f9 [4194304,4194304] 0 2024-04-23T10:20:51.892 INFO:tasks.workunit.client.0.smithi029.stdout:2/40: creat d1/fa x:0 0 0 2024-04-23T10:20:51.895 INFO:tasks.workunit.client.0.smithi029.stdout:1/33: chown d5/f9 637588604 1 2024-04-23T10:20:51.896 INFO:tasks.workunit.client.0.smithi029.stdout:1/34: read d5/f9 [4150718,57076] 0 2024-04-23T10:20:51.896 INFO:tasks.workunit.client.0.smithi029.stdout:7/35: symlink d5/d8/la 0 2024-04-23T10:20:51.897 INFO:tasks.workunit.client.0.smithi029.stdout:2/41: unlink d1/d4/l5 0 2024-04-23T10:20:51.897 INFO:tasks.workunit.client.0.smithi029.stdout:2/42: dread - d1/fa zero size 2024-04-23T10:20:51.900 INFO:tasks.workunit.client.0.smithi029.stdout:7/36: getdents d5 0 2024-04-23T10:20:51.900 INFO:tasks.workunit.client.0.smithi029.stdout:1/35: dread d5/f9 [0,4194304] 0 2024-04-23T10:20:51.902 INFO:tasks.workunit.client.0.smithi029.stdout:7/37: creat d5/d8/fb x:0 0 0 2024-04-23T10:20:51.902 INFO:tasks.workunit.client.0.smithi029.stdout:7/38: readlink d5/d8/la 0 2024-04-23T10:20:51.903 INFO:tasks.workunit.client.0.smithi029.stdout:7/39: dread - d5/d8/fb zero size 2024-04-23T10:20:51.908 INFO:tasks.workunit.client.0.smithi029.stdout:0/24: sync 2024-04-23T10:20:51.910 INFO:tasks.workunit.client.0.smithi029.stdout:1/36: symlink d5/lb 0 2024-04-23T10:20:51.910 INFO:tasks.workunit.client.0.smithi029.stdout:2/43: dread d1/d4/f9 [0,4194304] 0 2024-04-23T10:20:51.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/40: fsync f4 0 2024-04-23T10:20:51.913 INFO:tasks.workunit.client.0.smithi029.stdout:1/37: write d5/f9 [8003362,78440] 0 2024-04-23T10:20:51.913 INFO:tasks.workunit.client.0.smithi029.stdout:2/44: truncate d1/d4/f9 1791843 0 2024-04-23T10:20:51.914 INFO:tasks.workunit.client.0.smithi029.stdout:1/38: write d5/f9 [2807635,43697] 0 2024-04-23T10:20:51.914 INFO:tasks.workunit.client.0.smithi029.stdout:7/41: rename f4 to d5/d8/fc 0 2024-04-23T10:20:51.916 INFO:tasks.workunit.client.0.smithi029.stdout:0/25: creat d0/f6 x:0 0 0 2024-04-23T10:20:51.917 INFO:tasks.workunit.client.0.smithi029.stdout:0/26: stat d0/f3 0 2024-04-23T10:20:51.919 INFO:tasks.workunit.client.0.smithi029.stdout:1/39: creat d5/fc x:0 0 0 2024-04-23T10:20:51.920 INFO:tasks.workunit.client.0.smithi029.stdout:0/27: truncate d0/f3 835948 0 2024-04-23T10:20:51.921 INFO:tasks.workunit.client.0.smithi029.stdout:1/40: write d5/fc [801810,103284] 0 2024-04-23T10:20:51.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/42: dread d5/d8/fc [0,4194304] 0 2024-04-23T10:20:51.922 INFO:tasks.workunit.client.0.smithi029.stdout:0/28: creat d0/f7 x:0 0 0 2024-04-23T10:20:51.923 INFO:tasks.workunit.client.0.smithi029.stdout:0/29: chown d0 6 1 2024-04-23T10:20:51.925 INFO:tasks.workunit.client.0.smithi029.stdout:0/30: rmdir d0 39 2024-04-23T10:20:51.926 INFO:tasks.workunit.client.0.smithi029.stdout:7/43: symlink d5/d9/ld 0 2024-04-23T10:20:51.926 INFO:tasks.workunit.client.0.smithi029.stdout:2/45: dwrite d1/d4/f9 [0,4194304] 0 2024-04-23T10:20:51.929 INFO:tasks.workunit.client.0.smithi029.stdout:2/46: truncate d1/fa 339078 0 2024-04-23T10:20:51.931 INFO:tasks.workunit.client.0.smithi029.stdout:2/47: mkdir d1/d4/db 0 2024-04-23T10:20:51.934 INFO:tasks.workunit.client.0.smithi029.stdout:7/44: truncate f1 926433 0 2024-04-23T10:20:51.935 INFO:tasks.workunit.client.0.smithi029.stdout:2/48: write d1/fa [1260696,120769] 0 2024-04-23T10:20:51.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/41: dwrite d5/f9 [0,4194304] 0 2024-04-23T10:20:51.938 INFO:tasks.workunit.client.0.smithi029.stdout:7/45: creat d5/fe x:0 0 0 2024-04-23T10:20:51.939 INFO:tasks.workunit.client.0.smithi029.stdout:0/31: dwrite d0/f6 [0,4194304] 0 2024-04-23T10:20:51.944 INFO:tasks.workunit.client.0.smithi029.stdout:2/49: rename d1/d4/f9 to d1/fc 0 2024-04-23T10:20:51.945 INFO:tasks.workunit.client.0.smithi029.stdout:2/50: chown c0 259783 1 2024-04-23T10:20:51.946 INFO:tasks.workunit.client.0.smithi029.stdout:7/46: write d5/d8/fc [897038,65858] 0 2024-04-23T10:20:51.953 INFO:tasks.workunit.client.0.smithi029.stdout:7/47: creat d5/ff x:0 0 0 2024-04-23T10:20:51.957 INFO:tasks.workunit.client.0.smithi029.stdout:0/32: dwrite d0/f4 [0,4194304] 0 2024-04-23T10:20:51.958 INFO:tasks.workunit.client.0.smithi029.stdout:1/42: dwrite d5/fc [0,4194304] 0 2024-04-23T10:20:51.959 INFO:tasks.workunit.client.0.smithi029.stdout:7/48: creat d5/d8/f10 x:0 0 0 2024-04-23T10:20:51.960 INFO:tasks.workunit.client.0.smithi029.stdout:2/51: dread d1/fc [0,4194304] 0 2024-04-23T10:20:51.960 INFO:tasks.workunit.client.0.smithi029.stdout:7/49: write d5/fe [512037,36774] 0 2024-04-23T10:20:51.963 INFO:tasks.workunit.client.0.smithi029.stdout:0/33: write d0/f7 [317591,49346] 0 2024-04-23T10:20:51.966 INFO:tasks.workunit.client.0.smithi029.stdout:2/52: rename d1/d4/db to d1/dd 0 2024-04-23T10:20:51.967 INFO:tasks.workunit.client.0.smithi029.stdout:2/53: chown d1/fa 406702 1 2024-04-23T10:20:51.969 INFO:tasks.workunit.client.0.smithi029.stdout:1/43: dread d5/f9 [0,4194304] 0 2024-04-23T10:20:51.970 INFO:tasks.workunit.client.0.smithi029.stdout:7/50: link d5/c6 d5/d8/c11 0 2024-04-23T10:20:51.972 INFO:tasks.workunit.client.0.smithi029.stdout:2/54: creat d1/dd/fe x:0 0 0 2024-04-23T10:20:51.974 INFO:tasks.workunit.client.0.smithi029.stdout:1/44: rename d5/f9 to d5/fd 0 2024-04-23T10:20:51.974 INFO:tasks.workunit.client.0.smithi029.stdout:2/55: write d1/fa [30583,103648] 0 2024-04-23T10:20:51.982 INFO:tasks.workunit.client.0.smithi029.stdout:0/34: write d0/f3 [1112672,46059] 0 2024-04-23T10:20:51.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/35: rmdir d0 39 2024-04-23T10:20:51.990 INFO:tasks.workunit.client.0.smithi029.stdout:1/45: dread d5/fc [0,4194304] 0 2024-04-23T10:20:51.991 INFO:tasks.workunit.client.0.smithi029.stdout:7/51: dwrite d5/d8/f10 [0,4194304] 0 2024-04-23T10:20:51.991 INFO:tasks.workunit.client.0.smithi029.stdout:0/36: creat d0/f8 x:0 0 0 2024-04-23T10:20:51.995 INFO:tasks.workunit.client.0.smithi029.stdout:7/52: write d5/ff [770464,61260] 0 2024-04-23T10:20:51.995 INFO:tasks.workunit.client.0.smithi029.stdout:1/46: write d5/fc [4675794,127410] 0 2024-04-23T10:20:51.995 INFO:tasks.workunit.client.0.smithi029.stdout:2/56: dwrite d1/fa [0,4194304] 0 2024-04-23T10:20:51.995 INFO:tasks.workunit.client.0.smithi029.stdout:0/37: symlink d0/l9 0 2024-04-23T10:20:51.997 INFO:tasks.workunit.client.0.smithi029.stdout:7/53: symlink d5/d9/l12 0 2024-04-23T10:20:52.001 INFO:tasks.workunit.client.0.smithi029.stdout:0/38: link d0/f8 d0/fa 0 2024-04-23T10:20:52.001 INFO:tasks.workunit.client.0.smithi029.stdout:2/57: dread d1/fa [0,4194304] 0 2024-04-23T10:20:52.003 INFO:tasks.workunit.client.0.smithi029.stdout:1/47: dread d5/fc [0,4194304] 0 2024-04-23T10:20:52.005 INFO:tasks.workunit.client.0.smithi029.stdout:2/58: rename d1/fc to d1/dd/ff 0 2024-04-23T10:20:52.010 INFO:tasks.workunit.client.0.smithi029.stdout:7/54: write f1 [1620571,69317] 0 2024-04-23T10:20:52.010 INFO:tasks.workunit.client.0.smithi029.stdout:7/55: stat d5/d8/la 0 2024-04-23T10:20:52.013 INFO:tasks.workunit.client.0.smithi029.stdout:0/39: dread d0/f7 [0,4194304] 0 2024-04-23T10:20:52.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/59: truncate d1/fa 2108091 0 2024-04-23T10:20:52.019 INFO:tasks.workunit.client.0.smithi029.stdout:1/48: dwrite d5/fd [4194304,4194304] 0 2024-04-23T10:20:52.022 INFO:tasks.workunit.client.0.smithi029.stdout:2/60: write d1/fa [779933,74509] 0 2024-04-23T10:20:52.023 INFO:tasks.workunit.client.0.smithi029.stdout:1/49: write d5/fc [1368519,88939] 0 2024-04-23T10:20:52.023 INFO:tasks.workunit.client.0.smithi029.stdout:0/40: dwrite d0/f6 [0,4194304] 0 2024-04-23T10:20:52.024 INFO:tasks.workunit.client.0.smithi029.stdout:2/61: write d1/dd/fe [84793,15455] 0 2024-04-23T10:20:52.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/62: read d1/fa [1409372,62603] 0 2024-04-23T10:20:52.028 INFO:tasks.workunit.client.0.smithi029.stdout:0/41: mkdir d0/db 0 2024-04-23T10:20:52.029 INFO:tasks.workunit.client.0.smithi029.stdout:0/42: dread d0/f7 [0,4194304] 0 2024-04-23T10:20:52.031 INFO:tasks.workunit.client.0.smithi029.stdout:2/63: unlink d1/dd/fe 0 2024-04-23T10:20:52.033 INFO:tasks.workunit.client.0.smithi029.stdout:2/64: chown d1/dd/ff 308981 1 2024-04-23T10:20:52.034 INFO:tasks.workunit.client.0.smithi029.stdout:7/56: dread f1 [0,4194304] 0 2024-04-23T10:20:52.037 INFO:tasks.workunit.client.0.smithi029.stdout:7/57: write d5/d8/fb [507836,67389] 0 2024-04-23T10:20:52.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/50: dwrite d5/fd [0,4194304] 0 2024-04-23T10:20:52.039 INFO:tasks.workunit.client.0.smithi029.stdout:2/65: symlink d1/dd/l10 0 2024-04-23T10:20:52.041 INFO:tasks.workunit.client.0.smithi029.stdout:7/58: rename d5/d9/l12 to d5/l13 0 2024-04-23T10:20:52.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/59: truncate f1 2510869 0 2024-04-23T10:20:52.043 INFO:tasks.workunit.client.0.smithi029.stdout:1/51: mkdir d5/d6/de 0 2024-04-23T10:20:52.043 INFO:tasks.workunit.client.0.smithi029.stdout:7/60: stat d5/d8/fc 0 2024-04-23T10:20:52.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/61: write d5/fe [875913,105486] 0 2024-04-23T10:20:52.050 INFO:tasks.workunit.client.0.smithi029.stdout:0/43: fdatasync d0/f6 0 2024-04-23T10:20:52.051 INFO:tasks.workunit.client.0.smithi029.stdout:7/62: dread f1 [0,4194304] 0 2024-04-23T10:20:52.051 INFO:tasks.workunit.client.0.smithi029.stdout:2/66: fsync d1/fa 0 2024-04-23T10:20:52.054 INFO:tasks.workunit.client.0.smithi029.stdout:2/67: creat d1/d4/f11 x:0 0 0 2024-04-23T10:20:52.054 INFO:tasks.workunit.client.0.smithi029.stdout:1/52: fsync d5/fd 0 2024-04-23T10:20:52.055 INFO:tasks.workunit.client.0.smithi029.stdout:2/68: stat d1/d4/f11 0 2024-04-23T10:20:52.055 INFO:tasks.workunit.client.0.smithi029.stdout:0/44: rmdir d0/db 0 2024-04-23T10:20:52.056 INFO:tasks.workunit.client.0.smithi029.stdout:2/69: readlink d1/d4/l6 0 2024-04-23T10:20:52.056 INFO:tasks.workunit.client.0.smithi029.stdout:0/45: readlink d0/l5 0 2024-04-23T10:20:52.057 INFO:tasks.workunit.client.0.smithi029.stdout:2/70: symlink d1/d4/l12 0 2024-04-23T10:20:52.059 INFO:tasks.workunit.client.0.smithi029.stdout:2/71: chown d1/fa 939799 1 2024-04-23T10:20:52.060 INFO:tasks.workunit.client.0.smithi029.stdout:7/63: truncate d5/d8/fb 483926 0 2024-04-23T10:20:52.063 INFO:tasks.workunit.client.0.smithi029.stdout:2/72: link c0 d1/dd/c13 0 2024-04-23T10:20:52.064 INFO:tasks.workunit.client.0.smithi029.stdout:7/64: write f1 [848690,3810] 0 2024-04-23T10:20:52.065 INFO:tasks.workunit.client.0.smithi029.stdout:0/46: dwrite d0/f6 [0,4194304] 0 2024-04-23T10:20:52.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/53: dwrite d5/fd [0,4194304] 0 2024-04-23T10:20:52.067 INFO:tasks.workunit.client.0.smithi029.stdout:7/65: mknod d5/d8/c14 0 2024-04-23T10:20:52.068 INFO:tasks.workunit.client.0.smithi029.stdout:1/54: unlink c3 0 2024-04-23T10:20:52.069 INFO:tasks.workunit.client.0.smithi029.stdout:0/47: mkdir d0/dc 0 2024-04-23T10:20:52.070 INFO:tasks.workunit.client.0.smithi029.stdout:1/55: creat d5/d6/ff x:0 0 0 2024-04-23T10:20:52.070 INFO:tasks.workunit.client.0.smithi029.stdout:7/66: fdatasync d5/d8/fb 0 2024-04-23T10:20:52.071 INFO:tasks.workunit.client.0.smithi029.stdout:1/56: chown d5/d6/de 0 1 2024-04-23T10:20:52.071 INFO:tasks.workunit.client.0.smithi029.stdout:7/67: stat d5/ff 0 2024-04-23T10:20:52.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/57: read - d5/d6/ff zero size 2024-04-23T10:20:52.072 INFO:tasks.workunit.client.0.smithi029.stdout:0/48: rename d0/f8 to d0/fd 0 2024-04-23T10:20:52.073 INFO:tasks.workunit.client.0.smithi029.stdout:0/49: dread - d0/fd zero size 2024-04-23T10:20:52.073 INFO:tasks.workunit.client.0.smithi029.stdout:7/68: symlink d5/d8/l15 0 2024-04-23T10:20:52.074 INFO:tasks.workunit.client.0.smithi029.stdout:1/58: write d5/fd [9287124,115988] 0 2024-04-23T10:20:52.077 INFO:tasks.workunit.client.0.smithi029.stdout:7/69: write d5/fe [1342796,4439] 0 2024-04-23T10:20:52.082 INFO:tasks.workunit.client.0.smithi029.stdout:1/59: creat d5/f10 x:0 0 0 2024-04-23T10:20:52.083 INFO:tasks.workunit.client.0.smithi029.stdout:1/60: chown d5/d6/de 6 1 2024-04-23T10:20:52.084 INFO:tasks.workunit.client.0.smithi029.stdout:0/50: symlink d0/dc/le 0 2024-04-23T10:20:52.087 INFO:tasks.workunit.client.0.smithi029.stdout:0/51: creat d0/dc/ff x:0 0 0 2024-04-23T10:20:52.093 INFO:tasks.workunit.client.0.smithi029.stdout:0/52: dread d0/f4 [0,4194304] 0 2024-04-23T10:20:52.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/61: getdents d5 0 2024-04-23T10:20:52.094 INFO:tasks.workunit.client.0.smithi029.stdout:7/70: dread d5/d8/fb [0,4194304] 0 2024-04-23T10:20:52.095 INFO:tasks.workunit.client.0.smithi029.stdout:0/53: mknod d0/c10 0 2024-04-23T10:20:52.096 INFO:tasks.workunit.client.0.smithi029.stdout:7/71: symlink d5/l16 0 2024-04-23T10:20:52.097 INFO:tasks.workunit.client.0.smithi029.stdout:1/62: creat d5/d6/f11 x:0 0 0 2024-04-23T10:20:52.097 INFO:tasks.workunit.client.0.smithi029.stdout:0/54: rmdir d0 39 2024-04-23T10:20:52.099 INFO:tasks.workunit.client.0.smithi029.stdout:1/63: read d5/fd [8861320,68836] 0 2024-04-23T10:20:52.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/64: dread - d5/d6/f11 zero size 2024-04-23T10:20:52.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/55: getdents d0/dc 0 2024-04-23T10:20:52.102 INFO:tasks.workunit.client.0.smithi029.stdout:1/65: mknod d5/d6/c12 0 2024-04-23T10:20:52.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/66: creat d5/f13 x:0 0 0 2024-04-23T10:20:52.104 INFO:tasks.workunit.client.0.smithi029.stdout:7/72: dwrite d5/ff [0,4194304] 0 2024-04-23T10:20:52.106 INFO:tasks.workunit.client.0.smithi029.stdout:1/67: fdatasync d5/fd 0 2024-04-23T10:20:52.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/68: mknod d5/d6/de/c14 0 2024-04-23T10:20:52.109 INFO:tasks.workunit.client.0.smithi029.stdout:1/69: mkdir d5/d6/de/d15 0 2024-04-23T10:20:52.110 INFO:tasks.workunit.client.0.smithi029.stdout:1/70: chown d5/d6/ff 0 1 2024-04-23T10:20:52.110 INFO:tasks.workunit.client.0.smithi029.stdout:1/71: write d5/f10 [100013,122022] 0 2024-04-23T10:20:52.111 INFO:tasks.workunit.client.0.smithi029.stdout:1/72: write d5/d6/ff [613818,57681] 0 2024-04-23T10:20:52.122 INFO:tasks.workunit.client.0.smithi029.stdout:1/73: getdents d5/d6/de 0 2024-04-23T10:20:52.123 INFO:tasks.workunit.client.0.smithi029.stdout:1/74: creat d5/d6/f16 x:0 0 0 2024-04-23T10:20:52.123 INFO:tasks.workunit.client.0.smithi029.stdout:1/75: stat d5/d6/de/d15 0 2024-04-23T10:20:52.124 INFO:tasks.workunit.client.0.smithi029.stdout:1/76: rmdir d5/d6/de 39 2024-04-23T10:20:52.133 INFO:tasks.workunit.client.0.smithi029.stdout:1/77: dwrite d5/f13 [0,4194304] 0 2024-04-23T10:20:52.134 INFO:tasks.workunit.client.0.smithi029.stdout:1/78: creat d5/f17 x:0 0 0 2024-04-23T10:20:52.139 INFO:tasks.workunit.client.0.smithi029.stdout:1/79: dread d5/fc [0,4194304] 0 2024-04-23T10:20:52.141 INFO:tasks.workunit.client.0.smithi029.stdout:1/80: mknod d5/d6/c18 0 2024-04-23T10:20:52.144 INFO:tasks.workunit.client.0.smithi029.stdout:1/81: creat d5/d6/f19 x:0 0 0 2024-04-23T10:20:52.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/82: dwrite d5/f10 [0,4194304] 0 2024-04-23T10:20:52.163 INFO:tasks.workunit.client.0.smithi029.stdout:1/83: dwrite d5/f10 [0,4194304] 0 2024-04-23T10:20:52.163 INFO:tasks.workunit.client.0.smithi029.stdout:1/84: stat d5 0 2024-04-23T10:20:52.163 INFO:tasks.workunit.client.0.smithi029.stdout:4/55: sync 2024-04-23T10:20:52.163 INFO:tasks.workunit.client.0.smithi029.stdout:6/27: sync 2024-04-23T10:20:52.164 INFO:tasks.workunit.client.0.smithi029.stdout:1/85: write d5/d6/f19 [243998,71262] 0 2024-04-23T10:20:52.169 INFO:tasks.workunit.client.0.smithi029.stdout:4/56: dread d0/fc [0,4194304] 0 2024-04-23T10:20:52.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/28: link f0 f5 0 2024-04-23T10:20:52.173 INFO:tasks.workunit.client.0.smithi029.stdout:6/29: mknod c6 0 2024-04-23T10:20:52.175 INFO:tasks.workunit.client.0.smithi029.stdout:6/30: mknod c7 0 2024-04-23T10:20:52.178 INFO:tasks.workunit.client.0.smithi029.stdout:4/57: dwrite d0/fd [0,4194304] 0 2024-04-23T10:20:52.185 INFO:tasks.workunit.client.0.smithi029.stdout:4/58: link d0/cb d0/c11 0 2024-04-23T10:20:52.186 INFO:tasks.workunit.client.0.smithi029.stdout:4/59: mkdir d0/d12 0 2024-04-23T10:20:52.187 INFO:tasks.workunit.client.0.smithi029.stdout:4/60: dread - d0/ff zero size 2024-04-23T10:20:52.206 INFO:tasks.workunit.client.0.smithi029.stdout:1/86: read d5/d6/f19 [199487,78895] 0 2024-04-23T10:20:52.210 INFO:tasks.workunit.client.0.smithi029.stdout:1/87: rename d5/f10 to d5/d6/de/d15/f1a 0 2024-04-23T10:20:52.215 INFO:tasks.workunit.client.0.smithi029.stdout:6/31: write f0 [1506029,130171] 0 2024-04-23T10:20:52.216 INFO:tasks.workunit.client.0.smithi029.stdout:4/61: write d0/fc [4656583,62764] 0 2024-04-23T10:20:52.227 INFO:tasks.workunit.client.0.smithi029.stdout:1/88: dwrite d5/d6/f16 [0,4194304] 0 2024-04-23T10:20:52.230 INFO:tasks.workunit.client.0.smithi029.stdout:1/89: write d5/f13 [5107903,101883] 0 2024-04-23T10:20:52.230 INFO:tasks.workunit.client.0.smithi029.stdout:6/32: dwrite f4 [0,4194304] 0 2024-04-23T10:20:52.232 INFO:tasks.workunit.client.0.smithi029.stdout:4/62: dwrite d0/f1 [0,4194304] 0 2024-04-23T10:20:52.232 INFO:tasks.workunit.client.0.smithi029.stdout:6/33: write f4 [4277438,66607] 0 2024-04-23T10:20:52.235 INFO:tasks.workunit.client.0.smithi029.stdout:1/90: creat d5/d6/de/f1b x:0 0 0 2024-04-23T10:20:52.236 INFO:tasks.workunit.client.0.smithi029.stdout:1/91: rmdir d5/d6/de/d15 39 2024-04-23T10:20:52.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/92: symlink d5/l1c 0 2024-04-23T10:20:52.246 INFO:tasks.workunit.client.0.smithi029.stdout:1/93: mknod d5/c1d 0 2024-04-23T10:20:52.249 INFO:tasks.workunit.client.0.smithi029.stdout:6/34: read f0 [1056655,43195] 0 2024-04-23T10:20:52.250 INFO:tasks.workunit.client.0.smithi029.stdout:6/35: fsync f4 0 2024-04-23T10:20:52.251 INFO:tasks.workunit.client.0.smithi029.stdout:6/36: chown f0 22007355 1 2024-04-23T10:20:52.252 INFO:tasks.workunit.client.0.smithi029.stdout:4/63: fdatasync d0/f9 0 2024-04-23T10:20:52.253 INFO:tasks.workunit.client.0.smithi029.stdout:6/37: symlink l8 0 2024-04-23T10:20:52.254 INFO:tasks.workunit.client.0.smithi029.stdout:1/94: fsync d5/d6/de/f1b 0 2024-04-23T10:20:52.256 INFO:tasks.workunit.client.0.smithi029.stdout:4/64: mkdir d0/d12/d13 0 2024-04-23T10:20:52.260 INFO:tasks.workunit.client.0.smithi029.stdout:4/65: rmdir d0/d12 39 2024-04-23T10:20:52.263 INFO:tasks.workunit.client.0.smithi029.stdout:1/95: rename d5/d6/c18 to d5/d6/de/c1e 0 2024-04-23T10:20:52.265 INFO:tasks.workunit.client.0.smithi029.stdout:6/38: dwrite f0 [0,4194304] 0 2024-04-23T10:20:52.269 INFO:tasks.workunit.client.0.smithi029.stdout:4/66: rename d0/f4 to d0/d12/d13/f14 0 2024-04-23T10:20:52.270 INFO:tasks.workunit.client.0.smithi029.stdout:4/67: write d0/fd [1318559,128033] 0 2024-04-23T10:20:52.270 INFO:tasks.workunit.client.0.smithi029.stdout:6/39: mkdir d9 0 2024-04-23T10:20:52.275 INFO:tasks.workunit.client.0.smithi029.stdout:6/40: unlink c3 0 2024-04-23T10:20:52.275 INFO:tasks.workunit.client.0.smithi029.stdout:6/41: chown f0 27 1 2024-04-23T10:20:52.276 INFO:tasks.workunit.client.0.smithi029.stdout:1/96: creat d5/d6/f1f x:0 0 0 2024-04-23T10:20:52.277 INFO:tasks.workunit.client.0.smithi029.stdout:4/68: symlink d0/l15 0 2024-04-23T10:20:52.278 INFO:tasks.workunit.client.0.smithi029.stdout:4/69: write d0/f9 [2473301,5459] 0 2024-04-23T10:20:52.282 INFO:tasks.workunit.client.0.smithi029.stdout:1/97: rename d5/d6/f1f to d5/d6/de/d15/f20 0 2024-04-23T10:20:52.283 INFO:tasks.workunit.client.0.smithi029.stdout:4/70: creat d0/f16 x:0 0 0 2024-04-23T10:20:52.284 INFO:tasks.workunit.client.0.smithi029.stdout:6/42: fsync f5 0 2024-04-23T10:20:52.287 INFO:tasks.workunit.client.0.smithi029.stdout:1/98: unlink d5/d6/de/c1e 0 2024-04-23T10:20:52.291 INFO:tasks.workunit.client.0.smithi029.stdout:4/71: rename d0/f9 to d0/f17 0 2024-04-23T10:20:52.293 INFO:tasks.workunit.client.0.smithi029.stdout:4/72: rename d0/l10 to d0/d12/l18 0 2024-04-23T10:20:52.295 INFO:tasks.workunit.client.0.smithi029.stdout:6/43: dwrite f4 [0,4194304] 0 2024-04-23T10:20:52.295 INFO:tasks.workunit.client.0.smithi029.stdout:1/99: dread d5/fd [4194304,4194304] 0 2024-04-23T10:20:52.296 INFO:tasks.workunit.client.0.smithi029.stdout:6/44: rename d9 to d9/da 22 2024-04-23T10:20:52.296 INFO:tasks.workunit.client.0.smithi029.stdout:4/73: chown d0/c11 24487 1 2024-04-23T10:20:52.297 INFO:tasks.workunit.client.0.smithi029.stdout:6/45: write f0 [1852122,3063] 0 2024-04-23T10:20:52.297 INFO:tasks.workunit.client.0.smithi029.stdout:4/74: truncate d0/fd 5014684 0 2024-04-23T10:20:52.297 INFO:tasks.workunit.client.0.smithi029.stdout:6/46: chown f0 0 1 2024-04-23T10:20:52.297 INFO:tasks.workunit.client.0.smithi029.stdout:6/47: readlink l1 0 2024-04-23T10:20:52.298 INFO:tasks.workunit.client.0.smithi029.stdout:4/75: chown d0/d12/d13 5090441 1 2024-04-23T10:20:52.298 INFO:tasks.workunit.client.0.smithi029.stdout:6/48: write f0 [2549288,94037] 0 2024-04-23T10:20:52.299 INFO:tasks.workunit.client.0.smithi029.stdout:6/49: chown f0 4772589 1 2024-04-23T10:20:52.305 INFO:tasks.workunit.client.0.smithi029.stdout:4/76: dread d0/f17 [0,4194304] 0 2024-04-23T10:20:52.305 INFO:tasks.workunit.client.0.smithi029.stdout:6/50: dread f4 [0,4194304] 0 2024-04-23T10:20:52.305 INFO:tasks.workunit.client.0.smithi029.stdout:4/77: readlink d0/l8 0 2024-04-23T10:20:52.307 INFO:tasks.workunit.client.0.smithi029.stdout:4/78: truncate d0/f1 4884141 0 2024-04-23T10:20:52.310 INFO:tasks.workunit.client.0.smithi029.stdout:1/100: truncate d5/f13 1748263 0 2024-04-23T10:20:52.310 INFO:tasks.workunit.client.0.smithi029.stdout:1/101: fsync d5/f17 0 2024-04-23T10:20:52.311 INFO:tasks.workunit.client.0.smithi029.stdout:4/79: symlink d0/d12/d13/l19 0 2024-04-23T10:20:52.311 INFO:tasks.workunit.client.0.smithi029.stdout:1/102: chown d5/c1d 3327 1 2024-04-23T10:20:52.312 INFO:tasks.workunit.client.0.smithi029.stdout:1/103: dread - d5/d6/de/f1b zero size 2024-04-23T10:20:52.313 INFO:tasks.workunit.client.0.smithi029.stdout:6/51: truncate f5 3819160 0 2024-04-23T10:20:52.314 INFO:tasks.workunit.client.0.smithi029.stdout:1/104: fsync d5/d6/ff 0 2024-04-23T10:20:52.315 INFO:tasks.workunit.client.0.smithi029.stdout:4/80: creat d0/d12/d13/f1a x:0 0 0 2024-04-23T10:20:52.317 INFO:tasks.workunit.client.0.smithi029.stdout:4/81: mkdir d0/d12/d13/d1b 0 2024-04-23T10:20:52.318 INFO:tasks.workunit.client.0.smithi029.stdout:6/52: symlink d9/lb 0 2024-04-23T10:20:52.320 INFO:tasks.workunit.client.0.smithi029.stdout:6/53: mknod d9/cc 0 2024-04-23T10:20:52.321 INFO:tasks.workunit.client.0.smithi029.stdout:4/82: rename d0/d12/d13/f1a to d0/d12/d13/d1b/f1c 0 2024-04-23T10:20:52.321 INFO:tasks.workunit.client.0.smithi029.stdout:4/83: chown d0/f16 3 1 2024-04-23T10:20:52.322 INFO:tasks.workunit.client.0.smithi029.stdout:1/105: creat d5/d6/f21 x:0 0 0 2024-04-23T10:20:52.325 INFO:tasks.workunit.client.0.smithi029.stdout:4/84: rename d0/ff to d0/d12/d13/f1d 0 2024-04-23T10:20:52.327 INFO:tasks.workunit.client.0.smithi029.stdout:1/106: unlink d5/d6/de/f1b 0 2024-04-23T10:20:52.328 INFO:tasks.workunit.client.0.smithi029.stdout:1/107: chown d5/fd 16 1 2024-04-23T10:20:52.335 INFO:tasks.workunit.client.0.smithi029.stdout:4/85: rename d0/d12/l18 to d0/d12/d13/l1e 0 2024-04-23T10:20:52.336 INFO:tasks.workunit.client.0.smithi029.stdout:1/108: dwrite d5/f17 [0,4194304] 0 2024-04-23T10:20:52.339 INFO:tasks.workunit.client.0.smithi029.stdout:4/86: unlink d0/l15 0 2024-04-23T10:20:52.341 INFO:tasks.workunit.client.0.smithi029.stdout:6/54: truncate f0 429977 0 2024-04-23T10:20:52.342 INFO:tasks.workunit.client.0.smithi029.stdout:4/87: mknod d0/d12/c1f 0 2024-04-23T10:20:52.343 INFO:tasks.workunit.client.0.smithi029.stdout:4/88: chown d0 308 1 2024-04-23T10:20:52.343 INFO:tasks.workunit.client.0.smithi029.stdout:1/109: mkdir d5/d6/de/d22 0 2024-04-23T10:20:52.343 INFO:tasks.workunit.client.0.smithi029.stdout:1/110: dread - d5/d6/f11 zero size 2024-04-23T10:20:52.346 INFO:tasks.workunit.client.0.smithi029.stdout:4/89: mkdir d0/d12/d13/d20 0 2024-04-23T10:20:52.346 INFO:tasks.workunit.client.0.smithi029.stdout:4/90: chown d0/f1 59661099 1 2024-04-23T10:20:52.350 INFO:tasks.workunit.client.0.smithi029.stdout:4/91: creat d0/d12/f21 x:0 0 0 2024-04-23T10:20:52.351 INFO:tasks.workunit.client.0.smithi029.stdout:6/55: dwrite f4 [0,4194304] 0 2024-04-23T10:20:52.352 INFO:tasks.workunit.client.0.smithi029.stdout:1/111: creat d5/d6/de/d22/f23 x:0 0 0 2024-04-23T10:20:52.354 INFO:tasks.workunit.client.0.smithi029.stdout:4/92: creat d0/d12/f22 x:0 0 0 2024-04-23T10:20:52.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/56: read f5 [140390,122820] 0 2024-04-23T10:20:52.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/57: chown d9/lb 3958747 1 2024-04-23T10:20:52.362 INFO:tasks.workunit.client.0.smithi029.stdout:1/112: dread d5/f13 [0,4194304] 0 2024-04-23T10:20:52.363 INFO:tasks.workunit.client.0.smithi029.stdout:4/93: truncate d0/f6 587560 0 2024-04-23T10:20:52.366 INFO:tasks.workunit.client.0.smithi029.stdout:6/58: unlink d9/cc 0 2024-04-23T10:20:52.369 INFO:tasks.workunit.client.0.smithi029.stdout:4/94: dread d0/d12/d13/f14 [0,4194304] 0 2024-04-23T10:20:52.370 INFO:tasks.workunit.client.0.smithi029.stdout:6/59: mknod d9/cd 0 2024-04-23T10:20:52.372 INFO:tasks.workunit.client.0.smithi029.stdout:4/95: mknod d0/d12/d13/d1b/c23 0 2024-04-23T10:20:52.374 INFO:tasks.workunit.client.0.smithi029.stdout:6/60: rename f0 to d9/fe 0 2024-04-23T10:20:52.374 INFO:tasks.workunit.client.0.smithi029.stdout:1/113: link d5/d6/c12 d5/c24 0 2024-04-23T10:20:52.376 INFO:tasks.workunit.client.0.smithi029.stdout:6/61: unlink d9/cd 0 2024-04-23T10:20:52.379 INFO:tasks.workunit.client.0.smithi029.stdout:1/114: rename d5/f13 to d5/d6/de/d22/f25 0 2024-04-23T10:20:52.379 INFO:tasks.workunit.client.0.smithi029.stdout:4/96: dwrite d0/fa [0,4194304] 0 2024-04-23T10:20:52.379 INFO:tasks.workunit.client.0.smithi029.stdout:6/62: mkdir d9/df 0 2024-04-23T10:20:52.383 INFO:tasks.workunit.client.0.smithi029.stdout:6/63: creat d9/f10 x:0 0 0 2024-04-23T10:20:52.384 INFO:tasks.workunit.client.0.smithi029.stdout:4/97: symlink d0/d12/d13/d1b/l24 0 2024-04-23T10:20:52.395 INFO:tasks.workunit.client.0.smithi029.stdout:4/98: dwrite d0/d12/f22 [0,4194304] 0 2024-04-23T10:20:52.395 INFO:tasks.workunit.client.0.smithi029.stdout:6/64: truncate d9/fe 310187 0 2024-04-23T10:20:52.397 INFO:tasks.workunit.client.0.smithi029.stdout:1/115: truncate d5/f17 2457101 0 2024-04-23T10:20:52.399 INFO:tasks.workunit.client.0.smithi029.stdout:1/116: creat d5/d6/de/d15/f26 x:0 0 0 2024-04-23T10:20:52.407 INFO:tasks.workunit.client.0.smithi029.stdout:4/99: truncate d0/fa 900357 0 2024-04-23T10:20:52.409 INFO:tasks.workunit.client.0.smithi029.stdout:1/117: mkdir d5/d6/de/d27 0 2024-04-23T10:20:52.411 INFO:tasks.workunit.client.0.smithi029.stdout:6/65: write d9/fe [1205400,61314] 0 2024-04-23T10:20:52.415 INFO:tasks.workunit.client.0.smithi029.stdout:1/118: symlink d5/d6/l28 0 2024-04-23T10:20:52.417 INFO:tasks.workunit.client.0.smithi029.stdout:4/100: dwrite d0/fd [0,4194304] 0 2024-04-23T10:20:52.419 INFO:tasks.workunit.client.0.smithi029.stdout:6/66: mkdir d9/df/d11 0 2024-04-23T10:20:52.425 INFO:tasks.workunit.client.0.smithi029.stdout:4/101: dwrite d0/fd [0,4194304] 0 2024-04-23T10:20:52.435 INFO:tasks.workunit.client.0.smithi029.stdout:4/102: dread d0/fa [0,4194304] 0 2024-04-23T10:20:52.438 INFO:tasks.workunit.client.0.smithi029.stdout:4/103: write d0/f1 [5117937,81285] 0 2024-04-23T10:20:52.439 INFO:tasks.workunit.client.0.smithi029.stdout:4/104: write d0/d12/f22 [4840001,19810] 0 2024-04-23T10:20:52.444 INFO:tasks.workunit.client.0.smithi029.stdout:6/67: rmdir d9/df/d11 0 2024-04-23T10:20:52.444 INFO:tasks.workunit.client.0.smithi029.stdout:6/68: fsync d9/f10 0 2024-04-23T10:20:52.451 INFO:tasks.workunit.client.0.smithi029.stdout:6/69: truncate f4 2723359 0 2024-04-23T10:20:52.452 INFO:tasks.workunit.client.0.smithi029.stdout:4/105: creat d0/f25 x:0 0 0 2024-04-23T10:20:52.453 INFO:tasks.workunit.client.0.smithi029.stdout:4/106: chown d0/cb 178864 1 2024-04-23T10:20:52.453 INFO:tasks.workunit.client.0.smithi029.stdout:4/107: dread - d0/d12/f21 zero size 2024-04-23T10:20:52.457 INFO:tasks.workunit.client.0.smithi029.stdout:6/70: dwrite d9/fe [0,4194304] 0 2024-04-23T10:20:52.460 INFO:tasks.workunit.client.0.smithi029.stdout:4/108: rename d0/d12/f21 to d0/d12/d13/f26 0 2024-04-23T10:20:52.460 INFO:tasks.workunit.client.0.smithi029.stdout:4/109: stat d0/d12/d13/d1b/l24 0 2024-04-23T10:20:52.460 INFO:tasks.workunit.client.0.smithi029.stdout:6/71: mkdir d9/d12 0 2024-04-23T10:20:52.462 INFO:tasks.workunit.client.0.smithi029.stdout:6/72: unlink l8 0 2024-04-23T10:20:52.465 INFO:tasks.workunit.client.0.smithi029.stdout:4/110: unlink d0/d12/d13/l19 0 2024-04-23T10:20:52.466 INFO:tasks.workunit.client.0.smithi029.stdout:4/111: dread - d0/fe zero size 2024-04-23T10:20:52.468 INFO:tasks.workunit.client.0.smithi029.stdout:6/73: rename f5 to d9/df/f13 0 2024-04-23T10:20:52.472 INFO:tasks.workunit.client.0.smithi029.stdout:6/74: mkdir d9/d12/d14 0 2024-04-23T10:20:52.472 INFO:tasks.workunit.client.0.smithi029.stdout:6/75: readlink d9/lb 0 2024-04-23T10:20:52.474 INFO:tasks.workunit.client.0.smithi029.stdout:4/112: link d0/fa d0/f27 0 2024-04-23T10:20:52.479 INFO:tasks.workunit.client.0.smithi029.stdout:6/76: getdents d9/d12/d14 0 2024-04-23T10:20:52.480 INFO:tasks.workunit.client.0.smithi029.stdout:4/113: dread d0/fd [0,4194304] 0 2024-04-23T10:20:52.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/77: chown d9/fe 0 1 2024-04-23T10:20:52.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/114: fsync d0/d12/d13/d1b/f1c 0 2024-04-23T10:20:52.482 INFO:tasks.workunit.client.0.smithi029.stdout:6/78: creat d9/d12/d14/f15 x:0 0 0 2024-04-23T10:20:52.483 INFO:tasks.workunit.client.0.smithi029.stdout:4/115: chown d0/f6 561704 1 2024-04-23T10:20:52.484 INFO:tasks.workunit.client.0.smithi029.stdout:6/79: write d9/df/f13 [4898836,72421] 0 2024-04-23T10:20:52.485 INFO:tasks.workunit.client.0.smithi029.stdout:4/116: write d0/d12/d13/f26 [1007208,68835] 0 2024-04-23T10:20:52.492 INFO:tasks.workunit.client.0.smithi029.stdout:6/80: rename d9/d12/d14 to d9/df/d16 0 2024-04-23T10:20:52.492 INFO:tasks.workunit.client.0.smithi029.stdout:4/117: write d0/f27 [1811401,114041] 0 2024-04-23T10:20:52.492 INFO:tasks.workunit.client.0.smithi029.stdout:6/81: fdatasync d9/fe 0 2024-04-23T10:20:52.493 INFO:tasks.workunit.client.0.smithi029.stdout:4/118: dread - d0/f25 zero size 2024-04-23T10:20:52.496 INFO:tasks.workunit.client.0.smithi029.stdout:6/82: link l1 d9/d12/l17 0 2024-04-23T10:20:52.497 INFO:tasks.workunit.client.0.smithi029.stdout:4/119: dread d0/f17 [4194304,4194304] 0 2024-04-23T10:20:52.499 INFO:tasks.workunit.client.0.smithi029.stdout:6/83: creat d9/f18 x:0 0 0 2024-04-23T10:20:52.500 INFO:tasks.workunit.client.0.smithi029.stdout:4/120: mknod d0/d12/d13/d20/c28 0 2024-04-23T10:20:52.504 INFO:tasks.workunit.client.0.smithi029.stdout:6/84: getdents d9/df/d16 0 2024-04-23T10:20:52.504 INFO:tasks.workunit.client.0.smithi029.stdout:6/85: stat d9/df/d16 0 2024-04-23T10:20:52.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/121: dwrite d0/f17 [0,4194304] 0 2024-04-23T10:20:52.512 INFO:tasks.workunit.client.0.smithi029.stdout:6/86: write f4 [2919833,112149] 0 2024-04-23T10:20:52.517 INFO:tasks.workunit.client.0.smithi029.stdout:6/87: dread - d9/df/d16/f15 zero size 2024-04-23T10:20:52.517 INFO:tasks.workunit.client.0.smithi029.stdout:6/88: write f4 [1222691,313] 0 2024-04-23T10:20:52.518 INFO:tasks.workunit.client.0.smithi029.stdout:4/122: dwrite d0/f1 [4194304,4194304] 0 2024-04-23T10:20:52.520 INFO:tasks.workunit.client.0.smithi029.stdout:6/89: unlink c7 0 2024-04-23T10:20:52.521 INFO:tasks.workunit.client.0.smithi029.stdout:6/90: chown d9/lb 497897042 1 2024-04-23T10:20:52.522 INFO:tasks.workunit.client.0.smithi029.stdout:4/123: mknod d0/d12/d13/d20/c29 0 2024-04-23T10:20:52.524 INFO:tasks.workunit.client.0.smithi029.stdout:6/91: symlink d9/df/d16/l19 0 2024-04-23T10:20:52.524 INFO:tasks.workunit.client.0.smithi029.stdout:6/92: chown d9/lb 6 1 2024-04-23T10:20:52.526 INFO:tasks.workunit.client.0.smithi029.stdout:6/93: creat d9/df/d16/f1a x:0 0 0 2024-04-23T10:20:52.528 INFO:tasks.workunit.client.0.smithi029.stdout:4/124: link d0/fe d0/d12/d13/d1b/f2a 0 2024-04-23T10:20:52.530 INFO:tasks.workunit.client.0.smithi029.stdout:6/94: unlink d9/df/d16/l19 0 2024-04-23T10:20:52.535 INFO:tasks.workunit.client.0.smithi029.stdout:4/125: dwrite d0/fa [0,4194304] 0 2024-04-23T10:20:52.538 INFO:tasks.workunit.client.0.smithi029.stdout:4/126: creat d0/d12/f2b x:0 0 0 2024-04-23T10:20:52.540 INFO:tasks.workunit.client.0.smithi029.stdout:6/95: link d9/f18 d9/df/d16/f1b 0 2024-04-23T10:20:52.541 INFO:tasks.workunit.client.0.smithi029.stdout:4/127: symlink d0/d12/d13/d20/l2c 0 2024-04-23T10:20:52.547 INFO:tasks.workunit.client.0.smithi029.stdout:4/128: rename d0/d12/f22 to d0/d12/d13/f2d 0 2024-04-23T10:20:52.549 INFO:tasks.workunit.client.0.smithi029.stdout:4/129: readlink d0/d12/d13/l1e 0 2024-04-23T10:20:52.551 INFO:tasks.workunit.client.0.smithi029.stdout:6/96: getdents d9 0 2024-04-23T10:20:52.552 INFO:tasks.workunit.client.0.smithi029.stdout:6/97: write d9/fe [1019613,125737] 0 2024-04-23T10:20:52.568 INFO:tasks.workunit.client.0.smithi029.stdout:6/98: creat d9/df/d16/f1c x:0 0 0 2024-04-23T10:20:52.569 INFO:tasks.workunit.client.0.smithi029.stdout:4/130: dwrite d0/d12/d13/d1b/f2a [0,4194304] 0 2024-04-23T10:20:52.571 INFO:tasks.workunit.client.0.smithi029.stdout:6/99: write d9/df/d16/f1c [799633,26979] 0 2024-04-23T10:20:52.577 INFO:tasks.workunit.client.0.smithi029.stdout:3/90: sync 2024-04-23T10:20:52.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/120: sync 2024-04-23T10:20:52.580 INFO:tasks.workunit.client.0.smithi029.stdout:3/91: write d3/fd [653802,115966] 0 2024-04-23T10:20:52.581 INFO:tasks.workunit.client.0.smithi029.stdout:4/131: unlink d0/f25 0 2024-04-23T10:20:52.584 INFO:tasks.workunit.client.0.smithi029.stdout:6/100: dwrite f4 [0,4194304] 0 2024-04-23T10:20:52.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/132: dwrite d0/d12/d13/d1b/f2a [0,4194304] 0 2024-04-23T10:20:52.596 INFO:tasks.workunit.client.0.smithi029.stdout:4/133: truncate d0/d12/d13/f14 1326612 0 2024-04-23T10:20:52.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/101: write d9/df/d16/f1b [408436,71534] 0 2024-04-23T10:20:52.605 INFO:tasks.workunit.client.0.smithi029.stdout:5/121: truncate d0/db/f18 3690053 0 2024-04-23T10:20:52.607 INFO:tasks.workunit.client.0.smithi029.stdout:4/134: creat d0/d12/d13/d1b/f2e x:0 0 0 2024-04-23T10:20:52.608 INFO:tasks.workunit.client.0.smithi029.stdout:6/102: symlink d9/df/d16/l1d 0 2024-04-23T10:20:52.609 INFO:tasks.workunit.client.0.smithi029.stdout:5/122: mkdir d0/d2b 0 2024-04-23T10:20:52.610 INFO:tasks.workunit.client.0.smithi029.stdout:4/135: symlink d0/d12/d13/d1b/l2f 0 2024-04-23T10:20:52.614 INFO:tasks.workunit.client.0.smithi029.stdout:4/136: unlink d0/d12/d13/d20/l2c 0 2024-04-23T10:20:52.615 INFO:tasks.workunit.client.0.smithi029.stdout:6/103: dwrite d9/df/d16/f1c [0,4194304] 0 2024-04-23T10:20:52.619 INFO:tasks.workunit.client.0.smithi029.stdout:4/137: fsync d0/d12/d13/d1b/f2e 0 2024-04-23T10:20:52.623 INFO:tasks.workunit.client.0.smithi029.stdout:6/104: link d9/f18 d9/df/d16/f1e 0 2024-04-23T10:20:52.623 INFO:tasks.workunit.client.0.smithi029.stdout:6/105: readlink d9/df/d16/l1d 0 2024-04-23T10:20:52.624 INFO:tasks.workunit.client.0.smithi029.stdout:6/106: stat d9/df/d16/f1c 0 2024-04-23T10:20:52.627 INFO:tasks.workunit.client.0.smithi029.stdout:6/107: mkdir d9/df/d16/d1f 0 2024-04-23T10:20:52.631 INFO:tasks.workunit.client.0.smithi029.stdout:5/123: dwrite d0/db/f18 [0,4194304] 0 2024-04-23T10:20:52.634 INFO:tasks.workunit.client.0.smithi029.stdout:6/108: rename c6 to d9/c20 0 2024-04-23T10:20:52.636 INFO:tasks.workunit.client.0.smithi029.stdout:4/138: truncate d0/d12/d13/d1b/f2a 813964 0 2024-04-23T10:20:52.636 INFO:tasks.workunit.client.0.smithi029.stdout:5/124: truncate d0/f17 1038355 0 2024-04-23T10:20:52.637 INFO:tasks.workunit.client.0.smithi029.stdout:6/109: readlink l1 0 2024-04-23T10:20:52.638 INFO:tasks.workunit.client.0.smithi029.stdout:5/125: creat d0/f2c x:0 0 0 2024-04-23T10:20:52.638 INFO:tasks.workunit.client.0.smithi029.stdout:4/139: rmdir d0/d12/d13/d20 39 2024-04-23T10:20:52.639 INFO:tasks.workunit.client.0.smithi029.stdout:4/140: readlink d0/d12/d13/l1e 0 2024-04-23T10:20:52.639 INFO:tasks.workunit.client.0.smithi029.stdout:6/110: creat d9/df/d16/d1f/f21 x:0 0 0 2024-04-23T10:20:52.640 INFO:tasks.workunit.client.0.smithi029.stdout:5/126: mknod d0/db/d29/c2d 0 2024-04-23T10:20:52.641 INFO:tasks.workunit.client.0.smithi029.stdout:4/141: symlink d0/d12/l30 0 2024-04-23T10:20:52.644 INFO:tasks.workunit.client.0.smithi029.stdout:5/127: mkdir d0/dc/d10/d26/d2e 0 2024-04-23T10:20:52.646 INFO:tasks.workunit.client.0.smithi029.stdout:5/128: rmdir d0/d13 39 2024-04-23T10:20:52.648 INFO:tasks.workunit.client.0.smithi029.stdout:6/111: dwrite d9/df/d16/f1c [0,4194304] 0 2024-04-23T10:20:52.649 INFO:tasks.workunit.client.0.smithi029.stdout:5/129: unlink d0/d13/f20 0 2024-04-23T10:20:52.650 INFO:tasks.workunit.client.0.smithi029.stdout:6/112: read d9/df/d16/f1c [3867671,122568] 0 2024-04-23T10:20:52.651 INFO:tasks.workunit.client.0.smithi029.stdout:4/142: dwrite d0/fa [0,4194304] 0 2024-04-23T10:20:52.654 INFO:tasks.workunit.client.0.smithi029.stdout:5/130: fdatasync d0/d13/f25 0 2024-04-23T10:20:52.661 INFO:tasks.workunit.client.0.smithi029.stdout:4/143: unlink d0/d12/d13/d20/c29 0 2024-04-23T10:20:52.663 INFO:tasks.workunit.client.0.smithi029.stdout:6/113: rename d9/df/d16/d1f/f21 to d9/df/f22 0 2024-04-23T10:20:52.669 INFO:tasks.workunit.client.0.smithi029.stdout:6/114: dread d9/df/f13 [0,4194304] 0 2024-04-23T10:20:52.676 INFO:tasks.workunit.client.0.smithi029.stdout:5/131: truncate d0/f12 2570952 0 2024-04-23T10:20:52.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/115: dwrite d9/df/d16/f1c [0,4194304] 0 2024-04-23T10:20:52.680 INFO:tasks.workunit.client.0.smithi029.stdout:4/144: truncate d0/fe 1163785 0 2024-04-23T10:20:52.681 INFO:tasks.workunit.client.0.smithi029.stdout:4/145: stat d0/d12/d13/d1b/l2f 0 2024-04-23T10:20:52.683 INFO:tasks.workunit.client.0.smithi029.stdout:6/116: creat d9/df/f23 x:0 0 0 2024-04-23T10:20:52.683 INFO:tasks.workunit.client.0.smithi029.stdout:4/146: rename d0 to d0/d12/d13/d20/d31 22 2024-04-23T10:20:52.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/117: dread - d9/df/f23 zero size 2024-04-23T10:20:52.686 INFO:tasks.workunit.client.0.smithi029.stdout:4/147: mkdir d0/d12/d32 0 2024-04-23T10:20:52.688 INFO:tasks.workunit.client.0.smithi029.stdout:5/132: dwrite d0/f19 [0,4194304] 0 2024-04-23T10:20:52.688 INFO:tasks.workunit.client.0.smithi029.stdout:6/118: creat d9/df/d16/f24 x:0 0 0 2024-04-23T10:20:52.690 INFO:tasks.workunit.client.0.smithi029.stdout:6/119: truncate d9/df/d16/f1a 162296 0 2024-04-23T10:20:52.693 INFO:tasks.workunit.client.0.smithi029.stdout:6/120: mkdir d9/df/d25 0 2024-04-23T10:20:52.696 INFO:tasks.workunit.client.0.smithi029.stdout:4/148: link d0/d12/d13/d1b/c23 d0/d12/d13/c33 0 2024-04-23T10:20:52.699 INFO:tasks.workunit.client.0.smithi029.stdout:5/133: dread d0/db/f22 [0,4194304] 0 2024-04-23T10:20:52.699 INFO:tasks.workunit.client.0.smithi029.stdout:6/121: unlink d9/df/d16/f15 0 2024-04-23T10:20:52.700 INFO:tasks.workunit.client.0.smithi029.stdout:6/122: fdatasync f4 0 2024-04-23T10:20:52.700 INFO:tasks.workunit.client.0.smithi029.stdout:4/149: mkdir d0/d12/d13/d34 0 2024-04-23T10:20:52.704 INFO:tasks.workunit.client.0.smithi029.stdout:4/150: read d0/d12/d13/f14 [70055,3717] 0 2024-04-23T10:20:52.706 INFO:tasks.workunit.client.0.smithi029.stdout:5/134: dread d0/d13/f25 [0,4194304] 0 2024-04-23T10:20:52.709 INFO:tasks.workunit.client.0.smithi029.stdout:5/135: creat d0/f2f x:0 0 0 2024-04-23T10:20:52.712 INFO:tasks.workunit.client.0.smithi029.stdout:4/151: dwrite d0/d12/f2b [0,4194304] 0 2024-04-23T10:20:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:6/123: truncate d9/df/d16/f1c 310570 0 2024-04-23T10:20:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:5/136: rmdir d0/dc/d10/d26/d2e 0 2024-04-23T10:20:52.718 INFO:tasks.workunit.client.0.smithi029.stdout:5/137: rename d0/dc/d10/l27 to d0/d2b/l30 0 2024-04-23T10:20:52.719 INFO:tasks.workunit.client.0.smithi029.stdout:4/152: rmdir d0/d12/d32 0 2024-04-23T10:20:52.721 INFO:tasks.workunit.client.0.smithi029.stdout:5/138: unlink d0/d13/c15 0 2024-04-23T10:20:52.723 INFO:tasks.workunit.client.0.smithi029.stdout:6/124: read d9/df/d16/f1c [262629,115361] 0 2024-04-23T10:20:52.726 INFO:tasks.workunit.client.0.smithi029.stdout:5/139: creat d0/f31 x:0 0 0 2024-04-23T10:20:52.726 INFO:tasks.workunit.client.0.smithi029.stdout:5/140: chown d0/db/d29 32116928 1 2024-04-23T10:20:52.726 INFO:tasks.workunit.client.0.smithi029.stdout:5/141: truncate d0/f2c 334655 0 2024-04-23T10:20:52.727 INFO:tasks.workunit.client.0.smithi029.stdout:6/125: mknod d9/df/c26 0 2024-04-23T10:20:52.727 INFO:tasks.workunit.client.0.smithi029.stdout:5/142: chown d0/dc/d10/l11 172786650 1 2024-04-23T10:20:52.729 INFO:tasks.workunit.client.0.smithi029.stdout:4/153: truncate d0/fd 3792088 0 2024-04-23T10:20:52.730 INFO:tasks.workunit.client.0.smithi029.stdout:6/126: mkdir d9/df/d16/d1f/d27 0 2024-04-23T10:20:52.732 INFO:tasks.workunit.client.0.smithi029.stdout:6/127: mknod d9/d12/c28 0 2024-04-23T10:20:52.732 INFO:tasks.workunit.client.0.smithi029.stdout:5/143: dread d0/db/f22 [0,4194304] 0 2024-04-23T10:20:52.734 INFO:tasks.workunit.client.0.smithi029.stdout:4/154: dread d0/d12/d13/f2d [0,4194304] 0 2024-04-23T10:20:52.735 INFO:tasks.workunit.client.0.smithi029.stdout:5/144: write d0/f19 [2240779,35637] 0 2024-04-23T10:20:52.735 INFO:tasks.workunit.client.0.smithi029.stdout:6/128: getdents d9/df/d16/d1f/d27 0 2024-04-23T10:20:52.737 INFO:tasks.workunit.client.0.smithi029.stdout:4/155: dread d0/d12/d13/f14 [0,4194304] 0 2024-04-23T10:20:52.737 INFO:tasks.workunit.client.0.smithi029.stdout:6/129: truncate d9/df/f23 57319 0 2024-04-23T10:20:52.738 INFO:tasks.workunit.client.0.smithi029.stdout:5/145: creat d0/db/f32 x:0 0 0 2024-04-23T10:20:52.739 INFO:tasks.workunit.client.0.smithi029.stdout:4/156: creat d0/d12/d13/d1b/f35 x:0 0 0 2024-04-23T10:20:52.740 INFO:tasks.workunit.client.0.smithi029.stdout:4/157: chown d0/f16 15238779 1 2024-04-23T10:20:52.740 INFO:tasks.workunit.client.0.smithi029.stdout:5/146: symlink d0/d2b/l33 0 2024-04-23T10:20:52.740 INFO:tasks.workunit.client.0.smithi029.stdout:4/158: chown d0/d12/d13/f14 327 1 2024-04-23T10:20:52.742 INFO:tasks.workunit.client.0.smithi029.stdout:6/130: rename d9/df/d16/f1b to d9/f29 0 2024-04-23T10:20:52.743 INFO:tasks.workunit.client.0.smithi029.stdout:6/131: stat f4 0 2024-04-23T10:20:52.747 INFO:tasks.workunit.client.0.smithi029.stdout:5/147: dwrite d0/f31 [0,4194304] 0 2024-04-23T10:20:52.748 INFO:tasks.workunit.client.0.smithi029.stdout:5/148: write d0/f19 [1583867,85399] 0 2024-04-23T10:20:52.750 INFO:tasks.workunit.client.0.smithi029.stdout:6/132: link d9/fe d9/df/d16/f2a 0 2024-04-23T10:20:52.758 INFO:tasks.workunit.client.0.smithi029.stdout:4/159: truncate d0/fc 6602263 0 2024-04-23T10:20:52.760 INFO:tasks.workunit.client.0.smithi029.stdout:6/133: mknod d9/df/d16/d1f/d27/c2b 0 2024-04-23T10:20:52.760 INFO:tasks.workunit.client.0.smithi029.stdout:5/149: dwrite d0/f2c [0,4194304] 0 2024-04-23T10:20:52.761 INFO:tasks.workunit.client.0.smithi029.stdout:5/150: chown d0/fe 41880 1 2024-04-23T10:20:52.761 INFO:tasks.workunit.client.0.smithi029.stdout:5/151: chown d0 6 1 2024-04-23T10:20:52.762 INFO:tasks.workunit.client.0.smithi029.stdout:4/160: unlink d0/d12/d13/f2d 0 2024-04-23T10:20:52.762 INFO:tasks.workunit.client.0.smithi029.stdout:5/152: read - d0/db/f32 zero size 2024-04-23T10:20:52.763 INFO:tasks.workunit.client.0.smithi029.stdout:6/134: mkdir d9/df/d16/d1f/d2c 0 2024-04-23T10:20:52.765 INFO:tasks.workunit.client.0.smithi029.stdout:5/153: fdatasync d0/db/f16 0 2024-04-23T10:20:52.766 INFO:tasks.workunit.client.0.smithi029.stdout:4/161: dread d0/fe [0,4194304] 0 2024-04-23T10:20:52.768 INFO:tasks.workunit.client.0.smithi029.stdout:5/154: mknod d0/dc/d10/c34 0 2024-04-23T10:20:52.768 INFO:tasks.workunit.client.0.smithi029.stdout:5/155: fsync d0/f19 0 2024-04-23T10:20:52.770 INFO:tasks.workunit.client.0.smithi029.stdout:4/162: rename d0/d12/d13/d34 to d0/d12/d13/d1b/d36 0 2024-04-23T10:20:52.786 INFO:tasks.workunit.client.0.smithi029.stdout:6/135: dwrite d9/df/d16/f1e [0,4194304] 0 2024-04-23T10:20:52.786 INFO:tasks.workunit.client.0.smithi029.stdout:6/136: stat d9/df/f22 0 2024-04-23T10:20:52.787 INFO:tasks.workunit.client.0.smithi029.stdout:6/137: chown d9/d12 1805664 1 2024-04-23T10:20:52.789 INFO:tasks.workunit.client.0.smithi029.stdout:6/138: fsync d9/df/d16/f2a 0 2024-04-23T10:20:52.789 INFO:tasks.workunit.client.0.smithi029.stdout:5/156: write d0/f12 [1986879,14079] 0 2024-04-23T10:20:52.790 INFO:tasks.workunit.client.0.smithi029.stdout:5/157: fsync d0/f2c 0 2024-04-23T10:20:52.793 INFO:tasks.workunit.client.0.smithi029.stdout:6/139: mkdir d9/df/d16/d1f/d27/d2d 0 2024-04-23T10:20:52.798 INFO:tasks.workunit.client.0.smithi029.stdout:6/140: unlink d9/df/f23 0 2024-04-23T10:20:52.801 INFO:tasks.workunit.client.0.smithi029.stdout:4/163: dwrite d0/fd [0,4194304] 0 2024-04-23T10:20:52.801 INFO:tasks.workunit.client.0.smithi029.stdout:5/158: dwrite d0/d13/f25 [0,4194304] 0 2024-04-23T10:20:52.802 INFO:tasks.workunit.client.0.smithi029.stdout:5/159: readlink d0/d13/l1f 0 2024-04-23T10:20:52.803 INFO:tasks.workunit.client.0.smithi029.stdout:4/164: fsync d0/d12/d13/d1b/f35 0 2024-04-23T10:20:52.803 INFO:tasks.workunit.client.0.smithi029.stdout:6/141: rename d9/df/d16/f1c to d9/df/d16/f2e 0 2024-04-23T10:20:52.803 INFO:tasks.workunit.client.0.smithi029.stdout:5/160: write d0/f31 [657237,80899] 0 2024-04-23T10:20:52.809 INFO:tasks.workunit.client.0.smithi029.stdout:6/142: symlink d9/l2f 0 2024-04-23T10:20:52.809 INFO:tasks.workunit.client.0.smithi029.stdout:4/165: truncate d0/f1 5900174 0 2024-04-23T10:20:52.809 INFO:tasks.workunit.client.0.smithi029.stdout:4/166: write d0/d12/f2b [3155404,110150] 0 2024-04-23T10:20:52.811 INFO:tasks.workunit.client.0.smithi029.stdout:5/161: rename d0/dc to d0/d35 0 2024-04-23T10:20:52.813 INFO:tasks.workunit.client.0.smithi029.stdout:4/167: symlink d0/d12/d13/d1b/d36/l37 0 2024-04-23T10:20:52.819 INFO:tasks.workunit.client.0.smithi029.stdout:6/143: dwrite d9/df/d16/f24 [0,4194304] 0 2024-04-23T10:20:52.819 INFO:tasks.workunit.client.0.smithi029.stdout:4/168: dread - d0/d12/d13/d1b/f2e zero size 2024-04-23T10:20:52.820 INFO:tasks.workunit.client.0.smithi029.stdout:5/162: rename d0/l14 to d0/db/l36 0 2024-04-23T10:20:52.824 INFO:tasks.workunit.client.0.smithi029.stdout:5/163: symlink d0/db/d29/l37 0 2024-04-23T10:20:52.824 INFO:tasks.workunit.client.0.smithi029.stdout:6/144: mknod d9/df/d16/d1f/d27/d2d/c30 0 2024-04-23T10:20:52.825 INFO:tasks.workunit.client.0.smithi029.stdout:4/169: dread d0/d12/d13/d1b/f2a [0,4194304] 0 2024-04-23T10:20:52.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/145: mknod d9/d12/c31 0 2024-04-23T10:20:52.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/146: dread - d9/f10 zero size 2024-04-23T10:20:52.830 INFO:tasks.workunit.client.0.smithi029.stdout:6/147: creat d9/d12/f32 x:0 0 0 2024-04-23T10:20:52.835 INFO:tasks.workunit.client.0.smithi029.stdout:4/170: unlink d0/fc 0 2024-04-23T10:20:52.835 INFO:tasks.workunit.client.0.smithi029.stdout:5/164: dwrite d0/f31 [0,4194304] 0 2024-04-23T10:20:52.838 INFO:tasks.workunit.client.0.smithi029.stdout:5/165: mkdir d0/d35/d38 0 2024-04-23T10:20:52.840 INFO:tasks.workunit.client.0.smithi029.stdout:4/171: dread d0/fd [0,4194304] 0 2024-04-23T10:20:52.841 INFO:tasks.workunit.client.0.smithi029.stdout:4/172: write d0/fa [1596106,78434] 0 2024-04-23T10:20:52.842 INFO:tasks.workunit.client.0.smithi029.stdout:4/173: chown d0/d12/d13/d1b 327 1 2024-04-23T10:20:52.843 INFO:tasks.workunit.client.0.smithi029.stdout:4/174: dread - d0/d12/d13/d1b/f2e zero size 2024-04-23T10:20:52.844 INFO:tasks.workunit.client.0.smithi029.stdout:6/148: rename d9/d12 to d9/df/d16/d1f/d27/d33 0 2024-04-23T10:20:52.846 INFO:tasks.workunit.client.0.smithi029.stdout:4/175: symlink d0/d12/l38 0 2024-04-23T10:20:53.048 INFO:tasks.workunit.client.0.smithi029.stdout:8/101: sync 2024-04-23T10:20:53.083 INFO:tasks.workunit.client.0.smithi029.stdout:6/149: mkdir d9/df/d16/d34 0 2024-04-23T10:20:53.085 INFO:tasks.workunit.client.0.smithi029.stdout:5/166: truncate d0/f31 9560 0 2024-04-23T10:20:53.085 INFO:tasks.workunit.client.0.smithi029.stdout:8/102: readlink d3/l16 0 2024-04-23T10:20:53.088 INFO:tasks.workunit.client.0.smithi029.stdout:8/103: rmdir d3 39 2024-04-23T10:20:53.088 INFO:tasks.workunit.client.0.smithi029.stdout:4/176: dread d0/d12/d13/f14 [0,4194304] 0 2024-04-23T10:20:53.091 INFO:tasks.workunit.client.0.smithi029.stdout:5/167: mkdir d0/d35/d38/d39 0 2024-04-23T10:20:53.092 INFO:tasks.workunit.client.0.smithi029.stdout:8/104: chown d3/fb 19316115 1 2024-04-23T10:20:53.092 INFO:tasks.workunit.client.0.smithi029.stdout:4/177: readlink d0/d12/d13/d1b/l2f 0 2024-04-23T10:20:53.095 INFO:tasks.workunit.client.0.smithi029.stdout:4/178: write d0/f27 [441771,72618] 0 2024-04-23T10:20:53.095 INFO:tasks.workunit.client.0.smithi029.stdout:8/105: write d3/f19 [1720583,56211] 0 2024-04-23T10:20:53.096 INFO:tasks.workunit.client.0.smithi029.stdout:6/150: link d9/df/d16/d1f/d27/d2d/c30 d9/c35 0 2024-04-23T10:20:53.102 INFO:tasks.workunit.client.0.smithi029.stdout:8/106: dread - d3/fa zero size 2024-04-23T10:20:53.128 INFO:tasks.workunit.client.0.smithi029.stdout:5/168: link d0/db/d29/l37 d0/db/l3a 0 2024-04-23T10:20:53.133 INFO:tasks.workunit.client.0.smithi029.stdout:4/179: rename d0/f16 to d0/d12/d13/d1b/f39 0 2024-04-23T10:20:53.137 INFO:tasks.workunit.client.0.smithi029.stdout:4/180: dread d0/fe [0,4194304] 0 2024-04-23T10:20:53.149 INFO:tasks.workunit.client.0.smithi029.stdout:5/169: write d0/f31 [1056232,366] 0 2024-04-23T10:20:53.150 INFO:tasks.workunit.client.0.smithi029.stdout:5/170: readlink d0/l24 0 2024-04-23T10:20:53.153 INFO:tasks.workunit.client.0.smithi029.stdout:4/181: symlink d0/d12/d13/d1b/d36/l3a 0 2024-04-23T10:20:53.157 INFO:tasks.workunit.client.0.smithi029.stdout:6/151: write d9/df/f13 [1367026,119632] 0 2024-04-23T10:20:53.162 INFO:tasks.workunit.client.0.smithi029.stdout:5/171: mknod d0/d35/d38/d39/c3b 0 2024-04-23T10:20:53.171 INFO:tasks.workunit.client.0.smithi029.stdout:4/182: creat d0/f3b x:0 0 0 2024-04-23T10:20:53.174 INFO:tasks.workunit.client.0.smithi029.stdout:4/183: rmdir d0/d12/d13/d20 39 2024-04-23T10:20:53.179 INFO:tasks.workunit.client.0.smithi029.stdout:4/184: mkdir d0/d3c 0 2024-04-23T10:20:53.186 INFO:tasks.workunit.client.0.smithi029.stdout:8/107: write d3/fa [803064,97388] 0 2024-04-23T10:20:53.186 INFO:tasks.workunit.client.0.smithi029.stdout:4/185: truncate d0/d12/d13/d1b/f2e 661155 0 2024-04-23T10:20:53.189 INFO:tasks.workunit.client.0.smithi029.stdout:5/172: fdatasync d0/f31 0 2024-04-23T10:20:53.193 INFO:tasks.workunit.client.0.smithi029.stdout:4/186: dread d0/d12/d13/f14 [0,4194304] 0 2024-04-23T10:20:53.194 INFO:tasks.workunit.client.0.smithi029.stdout:4/187: stat d0/cb 0 2024-04-23T10:20:53.198 INFO:tasks.workunit.client.0.smithi029.stdout:4/188: dread d0/d12/d13/d1b/f2a [0,4194304] 0 2024-04-23T10:20:53.198 INFO:tasks.workunit.client.0.smithi029.stdout:6/152: truncate d9/fe 370043 0 2024-04-23T10:20:53.199 INFO:tasks.workunit.client.0.smithi029.stdout:5/173: link d0/db/c1a d0/db/c3c 0 2024-04-23T10:20:53.210 INFO:tasks.workunit.client.0.smithi029.stdout:8/108: rmdir d3 39 2024-04-23T10:20:53.214 INFO:tasks.workunit.client.0.smithi029.stdout:4/189: write d0/d12/d13/f14 [1283929,18214] 0 2024-04-23T10:20:53.215 INFO:tasks.workunit.client.0.smithi029.stdout:5/174: write d0/db/f22 [5143058,30610] 0 2024-04-23T10:20:53.217 INFO:tasks.workunit.client.0.smithi029.stdout:8/109: rename d3/f13 to d3/f22 0 2024-04-23T10:20:53.222 INFO:tasks.workunit.client.0.smithi029.stdout:6/153: truncate d9/f29 3203665 0 2024-04-23T10:20:53.223 INFO:tasks.workunit.client.0.smithi029.stdout:5/175: mkdir d0/db/d3d 0 2024-04-23T10:20:53.227 INFO:tasks.workunit.client.0.smithi029.stdout:5/176: mkdir d0/d35/d38/d3e 0 2024-04-23T10:20:53.230 INFO:tasks.workunit.client.0.smithi029.stdout:4/190: write d0/f6 [1498309,71727] 0 2024-04-23T10:20:53.231 INFO:tasks.workunit.client.0.smithi029.stdout:5/177: mkdir d0/d35/d38/d39/d3f 0 2024-04-23T10:20:53.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/178: unlink d0/d2b/l33 0 2024-04-23T10:20:53.247 INFO:tasks.workunit.client.0.smithi029.stdout:5/179: link d0/fe d0/f40 0 2024-04-23T10:20:53.249 INFO:tasks.workunit.client.0.smithi029.stdout:4/191: dwrite d0/d12/f2b [0,4194304] 0 2024-04-23T10:20:53.251 INFO:tasks.workunit.client.0.smithi029.stdout:5/180: creat d0/d2b/f41 x:0 0 0 2024-04-23T10:20:53.252 INFO:tasks.workunit.client.0.smithi029.stdout:6/154: dwrite d9/f29 [0,4194304] 0 2024-04-23T10:20:53.253 INFO:tasks.workunit.client.0.smithi029.stdout:4/192: chown d0/f17 336918125 1 2024-04-23T10:20:53.254 INFO:tasks.workunit.client.0.smithi029.stdout:8/110: dread d3/f7 [0,4194304] 0 2024-04-23T10:20:53.262 INFO:tasks.workunit.client.0.smithi029.stdout:8/111: dread - d3/f11 zero size 2024-04-23T10:20:53.262 INFO:tasks.workunit.client.0.smithi029.stdout:5/181: rename d0/db/f18 to d0/d35/d10/f42 0 2024-04-23T10:20:53.262 INFO:tasks.workunit.client.0.smithi029.stdout:6/155: mkdir d9/df/d16/d34/d36 0 2024-04-23T10:20:53.264 INFO:tasks.workunit.client.0.smithi029.stdout:5/182: creat d0/d13/f43 x:0 0 0 2024-04-23T10:20:53.266 INFO:tasks.workunit.client.0.smithi029.stdout:4/193: rename d0/f1 to d0/d12/d13/d20/f3d 0 2024-04-23T10:20:53.267 INFO:tasks.workunit.client.0.smithi029.stdout:8/112: rename d3/f17 to d3/f23 0 2024-04-23T10:20:53.267 INFO:tasks.workunit.client.0.smithi029.stdout:4/194: dread - d0/f3b zero size 2024-04-23T10:20:53.268 INFO:tasks.workunit.client.0.smithi029.stdout:6/156: symlink d9/df/d16/d1f/l37 0 2024-04-23T10:20:53.270 INFO:tasks.workunit.client.0.smithi029.stdout:5/183: creat d0/d13/f44 x:0 0 0 2024-04-23T10:20:53.273 INFO:tasks.workunit.client.0.smithi029.stdout:8/113: rename d3/l15 to d3/l24 0 2024-04-23T10:20:53.276 INFO:tasks.workunit.client.0.smithi029.stdout:6/157: creat d9/df/d16/d1f/f38 x:0 0 0 2024-04-23T10:20:53.277 INFO:tasks.workunit.client.0.smithi029.stdout:6/158: write d9/f29 [983084,59103] 0 2024-04-23T10:20:53.278 INFO:tasks.workunit.client.0.smithi029.stdout:6/159: read d9/df/f13 [178006,47963] 0 2024-04-23T10:20:53.278 INFO:tasks.workunit.client.0.smithi029.stdout:5/184: rename d0/db/f16 to d0/d35/d10/d26/f45 0 2024-04-23T10:20:53.282 INFO:tasks.workunit.client.0.smithi029.stdout:6/160: mknod d9/df/d16/d1f/c39 0 2024-04-23T10:20:53.286 INFO:tasks.workunit.client.0.smithi029.stdout:5/185: creat d0/d13/f46 x:0 0 0 2024-04-23T10:20:53.287 INFO:tasks.workunit.client.0.smithi029.stdout:5/186: write d0/d13/f44 [251855,26225] 0 2024-04-23T10:20:53.288 INFO:tasks.workunit.client.0.smithi029.stdout:6/161: mknod d9/df/d16/d34/c3a 0 2024-04-23T10:20:53.290 INFO:tasks.workunit.client.0.smithi029.stdout:8/114: link d3/ce d3/c25 0 2024-04-23T10:20:53.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/187: dread d0/d13/f44 [0,4194304] 0 2024-04-23T10:20:53.298 INFO:tasks.workunit.client.0.smithi029.stdout:6/162: link d9/df/d16/d1f/d27/c2b d9/df/d16/d1f/d27/d33/c3b 0 2024-04-23T10:20:53.300 INFO:tasks.workunit.client.0.smithi029.stdout:6/163: symlink d9/df/d16/d1f/d27/l3c 0 2024-04-23T10:20:53.302 INFO:tasks.workunit.client.0.smithi029.stdout:8/115: getdents d3 0 2024-04-23T10:20:53.305 INFO:tasks.workunit.client.0.smithi029.stdout:8/116: creat d3/f26 x:0 0 0 2024-04-23T10:20:53.305 INFO:tasks.workunit.client.0.smithi029.stdout:5/188: write d0/d35/f1c [894547,35431] 0 2024-04-23T10:20:53.306 INFO:tasks.workunit.client.0.smithi029.stdout:8/117: readlink d3/l20 0 2024-04-23T10:20:53.309 INFO:tasks.workunit.client.0.smithi029.stdout:8/118: symlink d3/l27 0 2024-04-23T10:20:53.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/189: symlink d0/d35/d38/d39/d3f/l47 0 2024-04-23T10:20:53.311 INFO:tasks.workunit.client.0.smithi029.stdout:8/119: write d3/f1e [269271,49430] 0 2024-04-23T10:20:53.311 INFO:tasks.workunit.client.0.smithi029.stdout:6/164: dwrite d9/df/d16/f1a [0,4194304] 0 2024-04-23T10:20:53.315 INFO:tasks.workunit.client.0.smithi029.stdout:5/190: mknod d0/d35/d38/d3e/c48 0 2024-04-23T10:20:53.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/191: stat d0/d35/d38/d3e/c48 0 2024-04-23T10:20:53.318 INFO:tasks.workunit.client.0.smithi029.stdout:5/192: mkdir d0/d35/d49 0 2024-04-23T10:20:53.320 INFO:tasks.workunit.client.0.smithi029.stdout:8/120: dread f1 [0,4194304] 0 2024-04-23T10:20:53.321 INFO:tasks.workunit.client.0.smithi029.stdout:5/193: creat d0/d13/f4a x:0 0 0 2024-04-23T10:20:53.323 INFO:tasks.workunit.client.0.smithi029.stdout:8/121: mknod d3/c28 0 2024-04-23T10:20:53.324 INFO:tasks.workunit.client.0.smithi029.stdout:6/165: dwrite d9/df/d16/d1f/f38 [0,4194304] 0 2024-04-23T10:20:53.328 INFO:tasks.workunit.client.0.smithi029.stdout:8/122: rmdir d3 39 2024-04-23T10:20:53.330 INFO:tasks.workunit.client.0.smithi029.stdout:6/166: creat d9/df/f3d x:0 0 0 2024-04-23T10:20:53.340 INFO:tasks.workunit.client.0.smithi029.stdout:5/194: dread d0/f17 [0,4194304] 0 2024-04-23T10:20:53.340 INFO:tasks.workunit.client.0.smithi029.stdout:6/167: dwrite d9/df/d16/f1a [0,4194304] 0 2024-04-23T10:20:53.341 INFO:tasks.workunit.client.0.smithi029.stdout:8/123: fdatasync d3/f11 0 2024-04-23T10:20:53.346 INFO:tasks.workunit.client.0.smithi029.stdout:6/168: mknod d9/df/d16/d1f/d27/c3e 0 2024-04-23T10:20:53.347 INFO:tasks.workunit.client.0.smithi029.stdout:6/169: write f4 [2414319,76360] 0 2024-04-23T10:20:53.351 INFO:tasks.workunit.client.0.smithi029.stdout:8/124: dwrite d3/f1f [0,4194304] 0 2024-04-23T10:20:53.355 INFO:tasks.workunit.client.0.smithi029.stdout:8/125: dread d3/fd [0,4194304] 0 2024-04-23T10:20:53.355 INFO:tasks.workunit.client.0.smithi029.stdout:5/195: link d0/db/f32 d0/d35/d38/f4b 0 2024-04-23T10:20:53.358 INFO:tasks.workunit.client.0.smithi029.stdout:8/126: creat d3/f29 x:0 0 0 2024-04-23T10:20:53.359 INFO:tasks.workunit.client.0.smithi029.stdout:8/127: chown d3/cc 1711138932 1 2024-04-23T10:20:53.362 INFO:tasks.workunit.client.0.smithi029.stdout:8/128: dread - d3/f29 zero size 2024-04-23T10:20:53.362 INFO:tasks.workunit.client.0.smithi029.stdout:8/129: stat f1 0 2024-04-23T10:20:53.366 INFO:tasks.workunit.client.0.smithi029.stdout:5/196: write d0/d35/d10/d26/f45 [5467441,101532] 0 2024-04-23T10:20:53.368 INFO:tasks.workunit.client.0.smithi029.stdout:6/170: dwrite d9/df/f13 [0,4194304] 0 2024-04-23T10:20:53.374 INFO:tasks.workunit.client.0.smithi029.stdout:5/197: dread d0/d13/f25 [0,4194304] 0 2024-04-23T10:20:53.379 INFO:tasks.workunit.client.0.smithi029.stdout:6/171: dwrite d9/df/d16/f24 [0,4194304] 0 2024-04-23T10:20:53.382 INFO:tasks.workunit.client.0.smithi029.stdout:8/130: getdents d3 0 2024-04-23T10:20:53.382 INFO:tasks.workunit.client.0.smithi029.stdout:5/198: fdatasync d0/d13/f25 0 2024-04-23T10:20:53.384 INFO:tasks.workunit.client.0.smithi029.stdout:6/172: creat d9/df/d16/d34/f3f x:0 0 0 2024-04-23T10:20:53.385 INFO:tasks.workunit.client.0.smithi029.stdout:6/173: fdatasync d9/f18 0 2024-04-23T10:20:53.387 INFO:tasks.workunit.client.0.smithi029.stdout:5/199: symlink d0/l4c 0 2024-04-23T10:20:53.388 INFO:tasks.workunit.client.0.smithi029.stdout:8/131: write d3/f23 [733110,128556] 0 2024-04-23T10:20:53.388 INFO:tasks.workunit.client.0.smithi029.stdout:8/132: dread - d3/f26 zero size 2024-04-23T10:20:53.389 INFO:tasks.workunit.client.0.smithi029.stdout:6/174: symlink d9/df/d16/d1f/l40 0 2024-04-23T10:20:53.393 INFO:tasks.workunit.client.0.smithi029.stdout:6/175: write d9/df/d16/f1a [4263142,11723] 0 2024-04-23T10:20:53.394 INFO:tasks.workunit.client.0.smithi029.stdout:6/176: read d9/fe [3220848,93835] 0 2024-04-23T10:20:53.396 INFO:tasks.workunit.client.0.smithi029.stdout:6/177: chown d9/df/d16/d34/c3a 542073 1 2024-04-23T10:20:53.398 INFO:tasks.workunit.client.0.smithi029.stdout:5/200: dwrite d0/d35/d10/d26/f45 [0,4194304] 0 2024-04-23T10:20:53.400 INFO:tasks.workunit.client.0.smithi029.stdout:6/178: mkdir d9/df/d41 0 2024-04-23T10:20:53.405 INFO:tasks.workunit.client.0.smithi029.stdout:8/133: dwrite f1 [0,4194304] 0 2024-04-23T10:20:53.406 INFO:tasks.workunit.client.0.smithi029.stdout:8/134: chown d3/c28 53567289 1 2024-04-23T10:20:53.408 INFO:tasks.workunit.client.0.smithi029.stdout:6/179: dwrite d9/df/d16/f24 [0,4194304] 0 2024-04-23T10:20:53.410 INFO:tasks.workunit.client.0.smithi029.stdout:8/135: mknod d3/c2a 0 2024-04-23T10:20:53.412 INFO:tasks.workunit.client.0.smithi029.stdout:6/180: chown d9/df/f3d 43332772 1 2024-04-23T10:20:53.415 INFO:tasks.workunit.client.0.smithi029.stdout:6/181: chown d9/df/d16/d1f/l40 453650 1 2024-04-23T10:20:53.416 INFO:tasks.workunit.client.0.smithi029.stdout:8/136: mknod d3/c2b 0 2024-04-23T10:20:53.416 INFO:tasks.workunit.client.0.smithi029.stdout:8/137: fdatasync d3/f19 0 2024-04-23T10:20:53.416 INFO:tasks.workunit.client.0.smithi029.stdout:8/138: chown f1 59 1 2024-04-23T10:20:53.417 INFO:tasks.workunit.client.0.smithi029.stdout:5/201: getdents d0/d35 0 2024-04-23T10:20:53.425 INFO:tasks.workunit.client.0.smithi029.stdout:5/202: dwrite d0/f31 [0,4194304] 0 2024-04-23T10:20:53.429 INFO:tasks.workunit.client.0.smithi029.stdout:8/139: mknod d3/c2c 0 2024-04-23T10:20:53.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/203: rename d0/d35/d38/d39/c3b to d0/d35/c4d 0 2024-04-23T10:20:53.435 INFO:tasks.workunit.client.0.smithi029.stdout:5/204: creat d0/d35/d38/d3e/f4e x:0 0 0 2024-04-23T10:20:53.439 INFO:tasks.workunit.client.0.smithi029.stdout:5/205: rename d0/d2b/f41 to d0/db/d3d/f4f 0 2024-04-23T10:20:53.445 INFO:tasks.workunit.client.0.smithi029.stdout:8/140: getdents d3 0 2024-04-23T10:20:53.446 INFO:tasks.workunit.client.0.smithi029.stdout:5/206: mkdir d0/d35/d38/d39/d3f/d50 0 2024-04-23T10:20:53.447 INFO:tasks.workunit.client.0.smithi029.stdout:5/207: read - d0/f2f zero size 2024-04-23T10:20:53.449 INFO:tasks.workunit.client.0.smithi029.stdout:5/208: rename d0/d13 to d0/d35/d38/d51 0 2024-04-23T10:20:53.450 INFO:tasks.workunit.client.0.smithi029.stdout:8/141: getdents d3 0 2024-04-23T10:20:53.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/209: mknod d0/d2b/c52 0 2024-04-23T10:20:53.453 INFO:tasks.workunit.client.0.smithi029.stdout:8/142: creat d3/f2d x:0 0 0 2024-04-23T10:20:53.454 INFO:tasks.workunit.client.0.smithi029.stdout:5/210: creat d0/d35/d10/f53 x:0 0 0 2024-04-23T10:20:53.455 INFO:tasks.workunit.client.0.smithi029.stdout:5/211: fsync d0/d35/f1c 0 2024-04-23T10:20:53.456 INFO:tasks.workunit.client.0.smithi029.stdout:8/143: rename d3/c1b to d3/c2e 0 2024-04-23T10:20:53.457 INFO:tasks.workunit.client.0.smithi029.stdout:8/144: truncate d3/f1e 1307753 0 2024-04-23T10:20:53.460 INFO:tasks.workunit.client.0.smithi029.stdout:8/145: mkdir d3/d2f 0 2024-04-23T10:20:53.462 INFO:tasks.workunit.client.0.smithi029.stdout:5/212: dwrite d0/d35/d10/f53 [0,4194304] 0 2024-04-23T10:20:53.465 INFO:tasks.workunit.client.0.smithi029.stdout:8/146: creat d3/f30 x:0 0 0 2024-04-23T10:20:53.465 INFO:tasks.workunit.client.0.smithi029.stdout:8/147: truncate d3/f1e 1779645 0 2024-04-23T10:20:53.474 INFO:tasks.workunit.client.0.smithi029.stdout:8/148: dwrite d3/f23 [0,4194304] 0 2024-04-23T10:20:53.476 INFO:tasks.workunit.client.0.smithi029.stdout:5/213: dwrite d0/d35/d38/f4b [0,4194304] 0 2024-04-23T10:20:53.493 INFO:tasks.workunit.client.0.smithi029.stdout:8/149: dread d3/f19 [0,4194304] 0 2024-04-23T10:20:53.499 INFO:tasks.workunit.client.0.smithi029.stdout:8/150: dwrite d3/fa [0,4194304] 0 2024-04-23T10:20:53.501 INFO:tasks.workunit.client.0.smithi029.stdout:8/151: write d3/f29 [876812,18662] 0 2024-04-23T10:20:53.505 INFO:tasks.workunit.client.0.smithi029.stdout:5/214: link d0/db/f32 d0/d35/d49/f54 0 2024-04-23T10:20:53.506 INFO:tasks.workunit.client.0.smithi029.stdout:8/152: truncate d3/f22 3752796 0 2024-04-23T10:20:53.506 INFO:tasks.workunit.client.0.smithi029.stdout:8/153: readlink d3/l24 0 2024-04-23T10:20:53.507 INFO:tasks.workunit.client.0.smithi029.stdout:8/154: write f1 [5678698,117085] 0 2024-04-23T10:20:53.508 INFO:tasks.workunit.client.0.smithi029.stdout:8/155: write d3/fb [1075654,24695] 0 2024-04-23T10:20:53.514 INFO:tasks.workunit.client.0.smithi029.stdout:5/215: rename d0/d35/d10/f53 to d0/d35/d38/d39/d3f/f55 0 2024-04-23T10:20:53.518 INFO:tasks.workunit.client.0.smithi029.stdout:5/216: dread d0/d35/d38/f4b [0,4194304] 0 2024-04-23T10:20:53.521 INFO:tasks.workunit.client.0.smithi029.stdout:5/217: dread d0/d35/d38/d51/f25 [0,4194304] 0 2024-04-23T10:20:53.524 INFO:tasks.workunit.client.0.smithi029.stdout:8/156: creat d3/f31 x:0 0 0 2024-04-23T10:20:53.534 INFO:tasks.workunit.client.0.smithi029.stdout:5/218: link d0/d35/d38/f4b d0/d35/d38/d3e/f56 0 2024-04-23T10:20:53.535 INFO:tasks.workunit.client.0.smithi029.stdout:5/219: read d0/d35/d38/f4b [1814656,119805] 0 2024-04-23T10:20:53.542 INFO:tasks.workunit.client.0.smithi029.stdout:8/157: truncate d3/f1e 457329 0 2024-04-23T10:20:53.542 INFO:tasks.workunit.client.0.smithi029.stdout:2/73: sync 2024-04-23T10:20:53.542 INFO:tasks.workunit.client.0.smithi029.stdout:9/137: sync 2024-04-23T10:20:53.545 INFO:tasks.workunit.client.0.smithi029.stdout:2/74: unlink d1/fa 0 2024-04-23T10:20:53.546 INFO:tasks.workunit.client.0.smithi029.stdout:8/158: mknod d3/d2f/c32 0 2024-04-23T10:20:53.548 INFO:tasks.workunit.client.0.smithi029.stdout:2/75: symlink d1/l14 0 2024-04-23T10:20:53.549 INFO:tasks.workunit.client.0.smithi029.stdout:5/220: creat d0/f57 x:0 0 0 2024-04-23T10:20:53.552 INFO:tasks.workunit.client.0.smithi029.stdout:2/76: symlink d1/d4/l15 0 2024-04-23T10:20:53.553 INFO:tasks.workunit.client.0.smithi029.stdout:8/159: dwrite d3/f29 [0,4194304] 0 2024-04-23T10:20:53.553 INFO:tasks.workunit.client.0.smithi029.stdout:5/221: creat d0/db/d29/f58 x:0 0 0 2024-04-23T10:20:53.554 INFO:tasks.workunit.client.0.smithi029.stdout:5/222: fsync d0/db/f22 0 2024-04-23T10:20:53.555 INFO:tasks.workunit.client.0.smithi029.stdout:5/223: fdatasync d0/db/f22 0 2024-04-23T10:20:53.556 INFO:tasks.workunit.client.0.smithi029.stdout:9/138: getdents d0/d7 0 2024-04-23T10:20:53.557 INFO:tasks.workunit.client.0.smithi029.stdout:2/77: mknod d1/c16 0 2024-04-23T10:20:53.558 INFO:tasks.workunit.client.0.smithi029.stdout:8/160: rename d3/f31 to d3/f33 0 2024-04-23T10:20:53.562 INFO:tasks.workunit.client.0.smithi029.stdout:5/224: creat d0/d35/d38/d3e/f59 x:0 0 0 2024-04-23T10:20:53.562 INFO:tasks.workunit.client.0.smithi029.stdout:5/225: dread - d0/d35/d38/d3e/f59 zero size 2024-04-23T10:20:53.563 INFO:tasks.workunit.client.0.smithi029.stdout:2/78: rmdir d1/d4 39 2024-04-23T10:20:53.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/226: rmdir d0/db/d3d 39 2024-04-23T10:20:53.567 INFO:tasks.workunit.client.0.smithi029.stdout:2/79: stat d1/d4/l12 0 2024-04-23T10:20:53.567 INFO:tasks.workunit.client.0.smithi029.stdout:8/161: dwrite d3/f19 [0,4194304] 0 2024-04-23T10:20:53.568 INFO:tasks.workunit.client.0.smithi029.stdout:2/80: write d1/d4/f11 [680822,124913] 0 2024-04-23T10:20:53.568 INFO:tasks.workunit.client.0.smithi029.stdout:8/162: chown d3/f23 269088 1 2024-04-23T10:20:53.571 INFO:tasks.workunit.client.0.smithi029.stdout:9/139: rename d0/d7/f22 to d0/f2d 0 2024-04-23T10:20:53.574 INFO:tasks.workunit.client.0.smithi029.stdout:5/227: write d0/d35/d10/f42 [2967423,42879] 0 2024-04-23T10:20:53.577 INFO:tasks.workunit.client.0.smithi029.stdout:9/140: dread d0/f1c [0,4194304] 0 2024-04-23T10:20:53.582 INFO:tasks.workunit.client.0.smithi029.stdout:2/81: rename d1/l14 to d1/dd/l17 0 2024-04-23T10:20:53.583 INFO:tasks.workunit.client.0.smithi029.stdout:2/82: fsync d1/d4/f11 0 2024-04-23T10:20:53.585 INFO:tasks.workunit.client.0.smithi029.stdout:8/163: dwrite d3/f33 [0,4194304] 0 2024-04-23T10:20:53.585 INFO:tasks.workunit.client.0.smithi029.stdout:8/164: readlink d3/l27 0 2024-04-23T10:20:53.587 INFO:tasks.workunit.client.0.smithi029.stdout:9/141: readlink d0/d1b/l2a 0 2024-04-23T10:20:53.590 INFO:tasks.workunit.client.0.smithi029.stdout:5/228: mkdir d0/d35/d38/d39/d3f/d50/d5a 0 2024-04-23T10:20:53.596 INFO:tasks.workunit.client.0.smithi029.stdout:9/142: symlink d0/d1b/d24/l2e 0 2024-04-23T10:20:53.601 INFO:tasks.workunit.client.0.smithi029.stdout:9/143: read d0/d7/d6/fc [2262,50003] 0 2024-04-23T10:20:53.607 INFO:tasks.workunit.client.0.smithi029.stdout:2/83: rename d1/dd/c13 to d1/c18 0 2024-04-23T10:20:53.609 INFO:tasks.workunit.client.0.smithi029.stdout:9/144: dwrite d0/d7/d1d/f20 [0,4194304] 0 2024-04-23T10:20:53.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/229: dwrite d0/f17 [0,4194304] 0 2024-04-23T10:20:53.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/165: getdents d3 0 2024-04-23T10:20:53.613 INFO:tasks.workunit.client.0.smithi029.stdout:5/230: chown d0/d35/c1b 3628583 1 2024-04-23T10:20:53.616 INFO:tasks.workunit.client.0.smithi029.stdout:2/84: creat d1/d4/f19 x:0 0 0 2024-04-23T10:20:53.616 INFO:tasks.workunit.client.0.smithi029.stdout:9/145: truncate d0/f1c 4870610 0 2024-04-23T10:20:53.617 INFO:tasks.workunit.client.0.smithi029.stdout:5/231: fsync d0/d35/d38/f4b 0 2024-04-23T10:20:53.625 INFO:tasks.workunit.client.0.smithi029.stdout:8/166: truncate d3/f33 4001078 0 2024-04-23T10:20:53.626 INFO:tasks.workunit.client.0.smithi029.stdout:5/232: rmdir d0/d35 39 2024-04-23T10:20:53.629 INFO:tasks.workunit.client.0.smithi029.stdout:9/146: link d0/d7/l5 d0/d1b/d24/l2f 0 2024-04-23T10:20:53.630 INFO:tasks.workunit.client.0.smithi029.stdout:2/85: getdents d1/d4 0 2024-04-23T10:20:53.630 INFO:tasks.workunit.client.0.smithi029.stdout:8/167: dread d3/f19 [0,4194304] 0 2024-04-23T10:20:53.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/86: symlink d1/d4/l1a 0 2024-04-23T10:20:53.637 INFO:tasks.workunit.client.0.smithi029.stdout:9/147: dread d0/d7/d1d/f20 [0,4194304] 0 2024-04-23T10:20:53.637 INFO:tasks.workunit.client.0.smithi029.stdout:5/233: dwrite d0/d35/d10/f42 [0,4194304] 0 2024-04-23T10:20:53.640 INFO:tasks.workunit.client.0.smithi029.stdout:8/168: rename d3/c18 to d3/c34 0 2024-04-23T10:20:53.641 INFO:tasks.workunit.client.0.smithi029.stdout:5/234: mkdir d0/d35/d10/d5b 0 2024-04-23T10:20:53.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/87: mknod d1/c1b 0 2024-04-23T10:20:53.644 INFO:tasks.workunit.client.0.smithi029.stdout:2/88: write d1/d4/f19 [999299,98058] 0 2024-04-23T10:20:53.646 INFO:tasks.workunit.client.0.smithi029.stdout:8/169: rmdir d3/d2f 39 2024-04-23T10:20:53.650 INFO:tasks.workunit.client.0.smithi029.stdout:2/89: stat c0 0 2024-04-23T10:20:53.652 INFO:tasks.workunit.client.0.smithi029.stdout:9/148: dread d0/d7/f18 [0,4194304] 0 2024-04-23T10:20:53.656 INFO:tasks.workunit.client.0.smithi029.stdout:8/170: dwrite d3/fa [0,4194304] 0 2024-04-23T10:20:53.658 INFO:tasks.workunit.client.0.smithi029.stdout:9/149: symlink d0/d7/d1d/l30 0 2024-04-23T10:20:53.661 INFO:tasks.workunit.client.0.smithi029.stdout:5/235: rename d0/db/l36 to d0/db/d3d/l5c 0 2024-04-23T10:20:53.664 INFO:tasks.workunit.client.0.smithi029.stdout:9/150: rmdir d0/d7/d1d 39 2024-04-23T10:20:53.666 INFO:tasks.workunit.client.0.smithi029.stdout:5/236: write d0/d35/d38/d51/f44 [470976,118859] 0 2024-04-23T10:20:53.667 INFO:tasks.workunit.client.0.smithi029.stdout:5/237: chown d0/d35/d38/d51/l23 0 1 2024-04-23T10:20:53.672 INFO:tasks.workunit.client.0.smithi029.stdout:8/171: creat d3/d2f/f35 x:0 0 0 2024-04-23T10:20:53.676 INFO:tasks.workunit.client.0.smithi029.stdout:9/151: creat d0/d1b/f31 x:0 0 0 2024-04-23T10:20:53.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/90: link d1/c18 d1/c1c 0 2024-04-23T10:20:53.679 INFO:tasks.workunit.client.0.smithi029.stdout:5/238: dwrite d0/d35/d38/d51/f25 [4194304,4194304] 0 2024-04-23T10:20:53.680 INFO:tasks.workunit.client.0.smithi029.stdout:8/172: fdatasync d3/f14 0 2024-04-23T10:20:53.682 INFO:tasks.workunit.client.0.smithi029.stdout:8/173: write d3/fb [1826155,101269] 0 2024-04-23T10:20:53.685 INFO:tasks.workunit.client.0.smithi029.stdout:5/239: creat d0/db/d3d/f5d x:0 0 0 2024-04-23T10:20:53.686 INFO:tasks.workunit.client.0.smithi029.stdout:9/152: chown d0/d7/d1d/f20 150760 1 2024-04-23T10:20:53.690 INFO:tasks.workunit.client.0.smithi029.stdout:5/240: dread d0/d35/d49/f54 [0,4194304] 0 2024-04-23T10:20:53.693 INFO:tasks.workunit.client.0.smithi029.stdout:2/91: rename d1/d4/f19 to d1/dd/f1d 0 2024-04-23T10:20:53.693 INFO:tasks.workunit.client.0.smithi029.stdout:8/174: mkdir d3/d2f/d36 0 2024-04-23T10:20:53.704 INFO:tasks.workunit.client.0.smithi029.stdout:8/175: dwrite d3/f33 [4194304,4194304] 0 2024-04-23T10:20:53.704 INFO:tasks.workunit.client.0.smithi029.stdout:2/92: dread d1/dd/f1d [0,4194304] 0 2024-04-23T10:20:53.707 INFO:tasks.workunit.client.0.smithi029.stdout:2/93: creat d1/d4/f1e x:0 0 0 2024-04-23T10:20:53.708 INFO:tasks.workunit.client.0.smithi029.stdout:5/241: truncate d0/d35/d38/d3e/f56 2738764 0 2024-04-23T10:20:53.709 INFO:tasks.workunit.client.0.smithi029.stdout:8/176: rename d3/l27 to d3/d2f/d36/l37 0 2024-04-23T10:20:53.711 INFO:tasks.workunit.client.0.smithi029.stdout:9/153: creat d0/d7/f32 x:0 0 0 2024-04-23T10:20:53.718 INFO:tasks.workunit.client.0.smithi029.stdout:2/94: dwrite d1/dd/ff [0,4194304] 0 2024-04-23T10:20:53.718 INFO:tasks.workunit.client.0.smithi029.stdout:2/95: chown d1/c1b 4820 1 2024-04-23T10:20:53.722 INFO:tasks.workunit.client.0.smithi029.stdout:2/96: write d1/dd/f1d [1486446,23539] 0 2024-04-23T10:20:53.724 INFO:tasks.workunit.client.0.smithi029.stdout:5/242: rename d0/d2b/l30 to d0/d35/d38/d51/l5e 0 2024-04-23T10:20:53.726 INFO:tasks.workunit.client.0.smithi029.stdout:5/243: chown d0/d35/f1c 6637 1 2024-04-23T10:20:53.728 INFO:tasks.workunit.client.0.smithi029.stdout:8/177: mkdir d3/d38 0 2024-04-23T10:20:53.730 INFO:tasks.workunit.client.0.smithi029.stdout:2/97: mkdir d1/d4/d1f 0 2024-04-23T10:20:53.730 INFO:tasks.workunit.client.0.smithi029.stdout:2/98: stat d1/d4/d1f 0 2024-04-23T10:20:53.730 INFO:tasks.workunit.client.0.smithi029.stdout:2/99: write d1/d4/f1e [18707,64770] 0 2024-04-23T10:20:53.731 INFO:tasks.workunit.client.0.smithi029.stdout:2/100: write d1/dd/ff [1810110,10140] 0 2024-04-23T10:20:53.733 INFO:tasks.workunit.client.0.smithi029.stdout:8/178: chown d3/c34 613073 1 2024-04-23T10:20:53.735 INFO:tasks.workunit.client.0.smithi029.stdout:5/244: symlink d0/db/l5f 0 2024-04-23T10:20:53.736 INFO:tasks.workunit.client.0.smithi029.stdout:2/101: symlink d1/dd/l20 0 2024-04-23T10:20:53.738 INFO:tasks.workunit.client.0.smithi029.stdout:8/179: creat d3/d2f/f39 x:0 0 0 2024-04-23T10:20:53.738 INFO:tasks.workunit.client.0.smithi029.stdout:8/180: dread - d3/d2f/f39 zero size 2024-04-23T10:20:53.741 INFO:tasks.workunit.client.0.smithi029.stdout:8/181: creat d3/d2f/d36/f3a x:0 0 0 2024-04-23T10:20:53.741 INFO:tasks.workunit.client.0.smithi029.stdout:8/182: chown d3/l16 74244 1 2024-04-23T10:20:53.743 INFO:tasks.workunit.client.0.smithi029.stdout:5/245: symlink d0/db/l60 0 2024-04-23T10:20:53.744 INFO:tasks.workunit.client.0.smithi029.stdout:2/102: symlink d1/l21 0 2024-04-23T10:20:53.746 INFO:tasks.workunit.client.0.smithi029.stdout:8/183: creat d3/d2f/d36/f3b x:0 0 0 2024-04-23T10:20:53.748 INFO:tasks.workunit.client.0.smithi029.stdout:2/103: rename d1/d4/d1f to d1/dd/d22 0 2024-04-23T10:20:53.749 INFO:tasks.workunit.client.0.smithi029.stdout:2/104: chown d1/dd/l20 3 1 2024-04-23T10:20:53.749 INFO:tasks.workunit.client.0.smithi029.stdout:8/184: symlink d3/d2f/d36/l3c 0 2024-04-23T10:20:53.749 INFO:tasks.workunit.client.0.smithi029.stdout:2/105: chown d1/dd 184 1 2024-04-23T10:20:53.749 INFO:tasks.workunit.client.0.smithi029.stdout:2/106: chown d1/c16 359120833 1 2024-04-23T10:20:53.750 INFO:tasks.workunit.client.0.smithi029.stdout:2/107: truncate d1/d4/f11 1606547 0 2024-04-23T10:20:53.755 INFO:tasks.workunit.client.0.smithi029.stdout:5/246: rmdir d0/d35/d10/d5b 0 2024-04-23T10:20:53.759 INFO:tasks.workunit.client.0.smithi029.stdout:5/247: creat d0/d35/d10/f61 x:0 0 0 2024-04-23T10:20:53.770 INFO:tasks.workunit.client.0.smithi029.stdout:8/185: dwrite d3/fd [0,4194304] 0 2024-04-23T10:20:53.776 INFO:tasks.workunit.client.0.smithi029.stdout:2/108: link d1/d4/l6 d1/d4/l23 0 2024-04-23T10:20:53.778 INFO:tasks.workunit.client.0.smithi029.stdout:8/186: dwrite d3/d2f/f35 [0,4194304] 0 2024-04-23T10:20:53.785 INFO:tasks.workunit.client.0.smithi029.stdout:5/248: dread d0/db/f32 [0,4194304] 0 2024-04-23T10:20:53.786 INFO:tasks.workunit.client.0.smithi029.stdout:2/109: dwrite d1/d4/f11 [0,4194304] 0 2024-04-23T10:20:53.789 INFO:tasks.workunit.client.0.smithi029.stdout:8/187: rename d3/fb to d3/d38/f3d 0 2024-04-23T10:20:53.789 INFO:tasks.workunit.client.0.smithi029.stdout:2/110: write d1/dd/f1d [1658054,91404] 0 2024-04-23T10:20:53.793 INFO:tasks.workunit.client.0.smithi029.stdout:8/188: write d3/f26 [436380,96064] 0 2024-04-23T10:20:53.793 INFO:tasks.workunit.client.0.smithi029.stdout:8/189: stat d3/f2d 0 2024-04-23T10:20:53.811 INFO:tasks.workunit.client.0.smithi029.stdout:5/249: dread d0/f12 [0,4194304] 0 2024-04-23T10:20:53.813 INFO:tasks.workunit.client.0.smithi029.stdout:2/111: mknod d1/c24 0 2024-04-23T10:20:53.813 INFO:tasks.workunit.client.0.smithi029.stdout:2/112: readlink d1/d4/l15 0 2024-04-23T10:20:53.815 INFO:tasks.workunit.client.0.smithi029.stdout:5/250: mknod d0/d35/d38/d39/d3f/d50/c62 0 2024-04-23T10:20:53.815 INFO:tasks.workunit.client.0.smithi029.stdout:2/113: dread d1/d4/f1e [0,4194304] 0 2024-04-23T10:20:53.816 INFO:tasks.workunit.client.0.smithi029.stdout:5/251: write d0/d35/f1c [466560,91448] 0 2024-04-23T10:20:53.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/114: truncate d1/dd/f1d 2631796 0 2024-04-23T10:20:53.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/115: dread d1/d4/f1e [0,4194304] 0 2024-04-23T10:20:53.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/116: stat d1/dd/d22 0 2024-04-23T10:20:53.823 INFO:tasks.workunit.client.0.smithi029.stdout:5/252: dwrite d0/d35/f1c [0,4194304] 0 2024-04-23T10:20:53.824 INFO:tasks.workunit.client.0.smithi029.stdout:5/253: truncate d0/d35/d10/f61 440870 0 2024-04-23T10:20:53.831 INFO:tasks.workunit.client.0.smithi029.stdout:5/254: dwrite d0/db/f22 [4194304,4194304] 0 2024-04-23T10:20:53.832 INFO:tasks.workunit.client.0.smithi029.stdout:5/255: write d0/d35/d38/d51/f43 [730040,8759] 0 2024-04-23T10:20:53.835 INFO:tasks.workunit.client.0.smithi029.stdout:2/117: chown d1/d4/l23 313 1 2024-04-23T10:20:53.837 INFO:tasks.workunit.client.0.smithi029.stdout:8/190: getdents d3/d38 0 2024-04-23T10:20:53.838 INFO:tasks.workunit.client.0.smithi029.stdout:5/256: symlink d0/d35/d38/d3e/l63 0 2024-04-23T10:20:53.840 INFO:tasks.workunit.client.0.smithi029.stdout:2/118: dread d1/d4/f1e [0,4194304] 0 2024-04-23T10:20:53.842 INFO:tasks.workunit.client.0.smithi029.stdout:8/191: write d3/d38/f3d [1476922,3950] 0 2024-04-23T10:20:53.843 INFO:tasks.workunit.client.0.smithi029.stdout:5/257: fdatasync d0/d35/d38/f4b 0 2024-04-23T10:20:53.845 INFO:tasks.workunit.client.0.smithi029.stdout:5/258: read - d0/d35/d38/d3e/f59 zero size 2024-04-23T10:20:53.846 INFO:tasks.workunit.client.0.smithi029.stdout:2/119: mkdir d1/d4/d25 0 2024-04-23T10:20:53.847 INFO:tasks.workunit.client.0.smithi029.stdout:8/192: rmdir d3/d38 39 2024-04-23T10:20:53.855 INFO:tasks.workunit.client.0.smithi029.stdout:8/193: dwrite d3/fa [0,4194304] 0 2024-04-23T10:20:53.927 INFO:tasks.workunit.client.0.smithi029.stdout:0/56: sync 2024-04-23T10:20:53.934 INFO:tasks.workunit.client.0.smithi029.stdout:2/120: rename d1/c1c to d1/dd/c26 0 2024-04-23T10:20:53.936 INFO:tasks.workunit.client.0.smithi029.stdout:2/121: write d1/dd/f1d [1064638,33888] 0 2024-04-23T10:20:53.936 INFO:tasks.workunit.client.0.smithi029.stdout:0/57: rmdir d0/dc 39 2024-04-23T10:20:53.942 INFO:tasks.workunit.client.0.smithi029.stdout:0/58: write d0/dc/ff [130788,117781] 0 2024-04-23T10:20:53.947 INFO:tasks.workunit.client.0.smithi029.stdout:2/122: mknod d1/dd/d22/c27 0 2024-04-23T10:20:53.951 INFO:tasks.workunit.client.0.smithi029.stdout:5/259: getdents d0/d35 0 2024-04-23T10:20:53.964 INFO:tasks.workunit.client.0.smithi029.stdout:0/59: creat d0/dc/f11 x:0 0 0 2024-04-23T10:20:53.967 INFO:tasks.workunit.client.0.smithi029.stdout:2/123: rmdir d1/d4 39 2024-04-23T10:20:53.971 INFO:tasks.workunit.client.0.smithi029.stdout:5/260: dread d0/d35/d38/d51/f25 [0,4194304] 0 2024-04-23T10:20:53.977 INFO:tasks.workunit.client.0.smithi029.stdout:2/124: rmdir d1/dd/d22 39 2024-04-23T10:20:53.981 INFO:tasks.workunit.client.0.smithi029.stdout:0/60: dwrite d0/f6 [0,4194304] 0 2024-04-23T10:20:53.991 INFO:tasks.workunit.client.0.smithi029.stdout:0/61: mknod d0/dc/c12 0 2024-04-23T10:20:53.993 INFO:tasks.workunit.client.0.smithi029.stdout:0/62: truncate d0/dc/f11 225711 0 2024-04-23T10:20:53.997 INFO:tasks.workunit.client.0.smithi029.stdout:5/261: getdents d0/d35/d38/d39/d3f/d50/d5a 0 2024-04-23T10:20:54.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/125: rename d1/d4/l15 to d1/d4/l28 0 2024-04-23T10:20:54.018 INFO:tasks.workunit.client.0.smithi029.stdout:5/262: dwrite d0/d35/d38/d51/f46 [0,4194304] 0 2024-04-23T10:20:54.021 INFO:tasks.workunit.client.0.smithi029.stdout:5/263: write d0/f2c [201191,86200] 0 2024-04-23T10:20:54.033 INFO:tasks.workunit.client.0.smithi029.stdout:0/63: symlink d0/l13 0 2024-04-23T10:20:54.038 INFO:tasks.workunit.client.0.smithi029.stdout:5/264: truncate d0/d35/d49/f54 2819478 0 2024-04-23T10:20:54.043 INFO:tasks.workunit.client.0.smithi029.stdout:2/126: mknod d1/dd/d22/c29 0 2024-04-23T10:20:54.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/127: chown d1/c1b 161001 1 2024-04-23T10:20:54.047 INFO:tasks.workunit.client.0.smithi029.stdout:2/128: write d1/dd/ff [1746061,93668] 0 2024-04-23T10:20:54.049 INFO:tasks.workunit.client.0.smithi029.stdout:2/129: readlink d1/d4/l12 0 2024-04-23T10:20:54.058 INFO:tasks.workunit.client.0.smithi029.stdout:5/265: chown d0/d35/d10/l11 154077 1 2024-04-23T10:20:54.072 INFO:tasks.workunit.client.0.smithi029.stdout:2/130: mknod d1/d4/d25/c2a 0 2024-04-23T10:20:54.077 INFO:tasks.workunit.client.0.smithi029.stdout:0/64: dwrite d0/fa [0,4194304] 0 2024-04-23T10:20:54.080 INFO:tasks.workunit.client.0.smithi029.stdout:5/266: mknod d0/db/c64 0 2024-04-23T10:20:54.082 INFO:tasks.workunit.client.0.smithi029.stdout:5/267: fdatasync d0/db/f22 0 2024-04-23T10:20:54.087 INFO:tasks.workunit.client.0.smithi029.stdout:0/65: rename d0/l5 to d0/dc/l14 0 2024-04-23T10:20:54.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/131: truncate d1/dd/f1d 621235 0 2024-04-23T10:20:54.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/132: write d1/dd/ff [2119073,42699] 0 2024-04-23T10:20:54.112 INFO:tasks.workunit.client.0.smithi029.stdout:0/66: dwrite d0/dc/ff [0,4194304] 0 2024-04-23T10:20:54.223 INFO:tasks.workunit.client.0.smithi029.stdout:2/133: rmdir d1/d4/d25 39 2024-04-23T10:20:54.285 INFO:tasks.workunit.client.0.smithi029.stdout:0/67: creat d0/dc/f15 x:0 0 0 2024-04-23T10:20:54.285 INFO:tasks.workunit.client.0.smithi029.stdout:7/73: sync 2024-04-23T10:20:54.289 INFO:tasks.workunit.client.0.smithi029.stdout:7/74: creat d5/f17 x:0 0 0 2024-04-23T10:20:54.296 INFO:tasks.workunit.client.0.smithi029.stdout:7/75: link d5/f17 d5/f18 0 2024-04-23T10:20:54.298 INFO:tasks.workunit.client.0.smithi029.stdout:7/76: fsync d5/d8/fc 0 2024-04-23T10:20:54.300 INFO:tasks.workunit.client.0.smithi029.stdout:0/68: dwrite d0/f7 [0,4194304] 0 2024-04-23T10:20:54.306 INFO:tasks.workunit.client.0.smithi029.stdout:7/77: mknod d5/d9/c19 0 2024-04-23T10:20:54.310 INFO:tasks.workunit.client.0.smithi029.stdout:0/69: creat d0/dc/f16 x:0 0 0 2024-04-23T10:20:54.318 INFO:tasks.workunit.client.0.smithi029.stdout:7/78: dwrite f1 [0,4194304] 0 2024-04-23T10:20:54.323 INFO:tasks.workunit.client.0.smithi029.stdout:7/79: mkdir d5/d8/d1a 0 2024-04-23T10:20:54.329 INFO:tasks.workunit.client.0.smithi029.stdout:7/80: creat d5/d8/d1a/f1b x:0 0 0 2024-04-23T10:20:54.334 INFO:tasks.workunit.client.0.smithi029.stdout:7/81: symlink d5/d9/l1c 0 2024-04-23T10:20:54.339 INFO:tasks.workunit.client.0.smithi029.stdout:7/82: dread - d5/f18 zero size 2024-04-23T10:20:54.339 INFO:tasks.workunit.client.0.smithi029.stdout:7/83: write f1 [1869165,3967] 0 2024-04-23T10:20:54.344 INFO:tasks.workunit.client.0.smithi029.stdout:7/84: read d5/d8/f10 [2769353,85575] 0 2024-04-23T10:20:54.351 INFO:tasks.workunit.client.0.smithi029.stdout:7/85: rename d5/d8/la to d5/l1d 0 2024-04-23T10:20:54.355 INFO:tasks.workunit.client.0.smithi029.stdout:7/86: creat d5/d8/d1a/f1e x:0 0 0 2024-04-23T10:20:54.365 INFO:tasks.workunit.client.0.smithi029.stdout:7/87: dwrite d5/d8/d1a/f1e [0,4194304] 0 2024-04-23T10:20:54.376 INFO:tasks.workunit.client.0.smithi029.stdout:7/88: dwrite d5/fe [0,4194304] 0 2024-04-23T10:20:54.380 INFO:tasks.workunit.client.0.smithi029.stdout:7/89: creat d5/f1f x:0 0 0 2024-04-23T10:20:54.461 INFO:tasks.workunit.client.0.smithi029.stdout:1/119: sync 2024-04-23T10:20:54.465 INFO:tasks.workunit.client.0.smithi029.stdout:1/120: write d5/fc [1230293,78192] 0 2024-04-23T10:20:54.466 INFO:tasks.workunit.client.0.smithi029.stdout:1/121: rename d5/d6 to d5/d6/de/d15/d29 22 2024-04-23T10:20:54.467 INFO:tasks.workunit.client.0.smithi029.stdout:1/122: stat d5/d6/ff 0 2024-04-23T10:20:54.468 INFO:tasks.workunit.client.0.smithi029.stdout:1/123: dread - d5/d6/f21 zero size 2024-04-23T10:20:54.477 INFO:tasks.workunit.client.0.smithi029.stdout:1/124: getdents d5/d6/de/d15 0 2024-04-23T10:20:54.481 INFO:tasks.workunit.client.0.smithi029.stdout:1/125: dread - d5/d6/de/d22/f23 zero size 2024-04-23T10:20:54.488 INFO:tasks.workunit.client.0.smithi029.stdout:1/126: dread d5/d6/f19 [0,4194304] 0 2024-04-23T10:20:54.489 INFO:tasks.workunit.client.0.smithi029.stdout:1/127: fdatasync d5/fd 0 2024-04-23T10:20:54.495 INFO:tasks.workunit.client.0.smithi029.stdout:1/128: symlink d5/d6/de/d27/l2a 0 2024-04-23T10:20:54.498 INFO:tasks.workunit.client.0.smithi029.stdout:1/129: mknod d5/c2b 0 2024-04-23T10:20:54.502 INFO:tasks.workunit.client.0.smithi029.stdout:1/130: symlink d5/l2c 0 2024-04-23T10:20:54.503 INFO:tasks.workunit.client.0.smithi029.stdout:1/131: stat d5/d6 0 2024-04-23T10:20:54.640 INFO:tasks.workunit.client.0.smithi029.stdout:3/92: sync 2024-04-23T10:20:54.642 INFO:tasks.workunit.client.0.smithi029.stdout:3/93: write d3/fd [1709368,96196] 0 2024-04-23T10:20:54.672 INFO:tasks.workunit.client.0.smithi029.stdout:3/94: dread d3/fd [0,4194304] 0 2024-04-23T10:20:54.676 INFO:tasks.workunit.client.0.smithi029.stdout:3/95: write d3/d10/de/f14 [428390,123931] 0 2024-04-23T10:20:54.690 INFO:tasks.workunit.client.0.smithi029.stdout:3/96: getdents d3/d10/d13 0 2024-04-23T10:20:54.693 INFO:tasks.workunit.client.0.smithi029.stdout:3/97: write d3/d10/de/f12 [261112,98509] 0 2024-04-23T10:20:54.702 INFO:tasks.workunit.client.0.smithi029.stdout:3/98: rename d3/d10/de/f11 to d3/f16 0 2024-04-23T10:20:54.711 INFO:tasks.workunit.client.0.smithi029.stdout:3/99: link d3/c7 d3/d10/d13/c17 0 2024-04-23T10:20:54.819 INFO:tasks.workunit.client.0.smithi029.stdout:6/182: sync 2024-04-23T10:20:54.819 INFO:tasks.workunit.client.0.smithi029.stdout:4/195: sync 2024-04-23T10:20:54.822 INFO:tasks.workunit.client.0.smithi029.stdout:4/196: write d0/d12/f2b [836603,34503] 0 2024-04-23T10:20:54.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/183: creat d9/df/d25/f42 x:0 0 0 2024-04-23T10:20:54.830 INFO:tasks.workunit.client.0.smithi029.stdout:4/197: symlink d0/l3e 0 2024-04-23T10:20:54.836 INFO:tasks.workunit.client.0.smithi029.stdout:4/198: creat d0/f3f x:0 0 0 2024-04-23T10:20:54.839 INFO:tasks.workunit.client.0.smithi029.stdout:4/199: fsync d0/d12/d13/f14 0 2024-04-23T10:20:54.850 INFO:tasks.workunit.client.0.smithi029.stdout:6/184: dwrite d9/df/d16/d34/f3f [0,4194304] 0 2024-04-23T10:20:54.857 INFO:tasks.workunit.client.0.smithi029.stdout:6/185: mknod d9/df/c43 0 2024-04-23T10:20:54.858 INFO:tasks.workunit.client.0.smithi029.stdout:5/268: dread d0/d35/d49/f54 [0,4194304] 0 2024-04-23T10:20:54.864 INFO:tasks.workunit.client.0.smithi029.stdout:6/186: chown d9/df/d16/d1f/d27/l3c 246 1 2024-04-23T10:20:54.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/200: dwrite d0/f3f [0,4194304] 0 2024-04-23T10:20:54.865 INFO:tasks.workunit.client.0.smithi029.stdout:5/269: chown d0/db/c1a 44987996 1 2024-04-23T10:20:54.867 INFO:tasks.workunit.client.0.smithi029.stdout:4/201: rename d0/d12 to d0/d12/d13/d20/d40 22 2024-04-23T10:20:54.869 INFO:tasks.workunit.client.0.smithi029.stdout:5/270: write d0/db/d3d/f5d [47255,62430] 0 2024-04-23T10:20:54.873 INFO:tasks.workunit.client.0.smithi029.stdout:5/271: read d0/d35/d10/f61 [132357,26843] 0 2024-04-23T10:20:54.878 INFO:tasks.workunit.client.0.smithi029.stdout:5/272: write d0/db/d3d/f4f [947905,39166] 0 2024-04-23T10:20:54.882 INFO:tasks.workunit.client.0.smithi029.stdout:5/273: readlink d0/db/d3d/l5c 0 2024-04-23T10:20:54.887 INFO:tasks.workunit.client.0.smithi029.stdout:4/202: dwrite d0/d12/d13/f26 [0,4194304] 0 2024-04-23T10:20:54.896 INFO:tasks.workunit.client.0.smithi029.stdout:4/203: symlink d0/d12/d13/d1b/d36/l41 0 2024-04-23T10:20:54.900 INFO:tasks.workunit.client.0.smithi029.stdout:5/274: creat d0/f65 x:0 0 0 2024-04-23T10:20:54.907 INFO:tasks.workunit.client.0.smithi029.stdout:5/275: dread d0/db/f32 [0,4194304] 0 2024-04-23T10:20:54.908 INFO:tasks.workunit.client.0.smithi029.stdout:4/204: link d0/d12/d13/d1b/f1c d0/d12/d13/f42 0 2024-04-23T10:20:54.912 INFO:tasks.workunit.client.0.smithi029.stdout:5/276: unlink d0/d35/d10/c34 0 2024-04-23T10:20:54.914 INFO:tasks.workunit.client.0.smithi029.stdout:4/205: creat d0/d12/f43 x:0 0 0 2024-04-23T10:20:54.919 INFO:tasks.workunit.client.0.smithi029.stdout:5/277: rename d0/d35/d38/d39/d3f/d50 to d0/d35/d38/d3e/d66 0 2024-04-23T10:20:54.924 INFO:tasks.workunit.client.0.smithi029.stdout:4/206: unlink d0/d12/d13/d1b/f2a 0 2024-04-23T10:20:54.926 INFO:tasks.workunit.client.0.smithi029.stdout:4/207: dread - d0/d12/d13/d1b/f39 zero size 2024-04-23T10:20:54.932 INFO:tasks.workunit.client.0.smithi029.stdout:5/278: rename d0/db/f22 to d0/d35/d49/f67 0 2024-04-23T10:20:54.934 INFO:tasks.workunit.client.0.smithi029.stdout:4/208: symlink d0/d12/l44 0 2024-04-23T10:20:54.942 INFO:tasks.workunit.client.0.smithi029.stdout:8/194: sync 2024-04-23T10:20:54.942 INFO:tasks.workunit.client.0.smithi029.stdout:0/70: sync 2024-04-23T10:20:54.942 INFO:tasks.workunit.client.0.smithi029.stdout:9/154: sync 2024-04-23T10:20:54.943 INFO:tasks.workunit.client.0.smithi029.stdout:2/134: sync 2024-04-23T10:20:54.943 INFO:tasks.workunit.client.0.smithi029.stdout:3/100: sync 2024-04-23T10:20:54.943 INFO:tasks.workunit.client.0.smithi029.stdout:7/90: sync 2024-04-23T10:20:54.943 INFO:tasks.workunit.client.0.smithi029.stdout:1/132: sync 2024-04-23T10:20:54.946 INFO:tasks.workunit.client.0.smithi029.stdout:8/195: fsync d3/fa 0 2024-04-23T10:20:54.952 INFO:tasks.workunit.client.0.smithi029.stdout:3/101: unlink d3/f16 0 2024-04-23T10:20:54.954 INFO:tasks.workunit.client.0.smithi029.stdout:5/279: dwrite d0/f17 [0,4194304] 0 2024-04-23T10:20:54.956 INFO:tasks.workunit.client.0.smithi029.stdout:5/280: stat d0/d35/d10/l11 0 2024-04-23T10:20:54.957 INFO:tasks.workunit.client.0.smithi029.stdout:4/209: dwrite d0/d12/d13/d1b/f2e [0,4194304] 0 2024-04-23T10:20:54.958 INFO:tasks.workunit.client.0.smithi029.stdout:5/281: read - d0/d35/d38/d3e/f4e zero size 2024-04-23T10:20:54.959 INFO:tasks.workunit.client.0.smithi029.stdout:5/282: read - d0/f2f zero size 2024-04-23T10:20:54.960 INFO:tasks.workunit.client.0.smithi029.stdout:9/155: mknod d0/d1b/c33 0 2024-04-23T10:20:54.960 INFO:tasks.workunit.client.0.smithi029.stdout:9/156: dread - d0/f21 zero size 2024-04-23T10:20:54.964 INFO:tasks.workunit.client.0.smithi029.stdout:1/133: symlink d5/l2d 0 2024-04-23T10:20:54.965 INFO:tasks.workunit.client.0.smithi029.stdout:1/134: readlink d5/l2d 0 2024-04-23T10:20:54.969 INFO:tasks.workunit.client.0.smithi029.stdout:1/135: readlink d5/d6/de/d27/l2a 0 2024-04-23T10:20:54.972 INFO:tasks.workunit.client.0.smithi029.stdout:8/196: mkdir d3/d2f/d36/d3e 0 2024-04-23T10:20:54.972 INFO:tasks.workunit.client.0.smithi029.stdout:9/157: dwrite d0/d7/f12 [0,4194304] 0 2024-04-23T10:20:54.973 INFO:tasks.workunit.client.0.smithi029.stdout:7/91: truncate d5/f18 948008 0 2024-04-23T10:20:54.978 INFO:tasks.workunit.client.0.smithi029.stdout:4/210: mkdir d0/d12/d13/d1b/d36/d45 0 2024-04-23T10:20:54.980 INFO:tasks.workunit.client.0.smithi029.stdout:4/211: chown d0/d12/d13/f26 262 1 2024-04-23T10:20:54.982 INFO:tasks.workunit.client.0.smithi029.stdout:4/212: dread - d0/d12/d13/d1b/f39 zero size 2024-04-23T10:20:54.983 INFO:tasks.workunit.client.0.smithi029.stdout:4/213: chown d0/d12/d13/d20 120458 1 2024-04-23T10:20:54.988 INFO:tasks.workunit.client.0.smithi029.stdout:2/135: rename d1/d4/l23 to d1/d4/d25/l2b 0 2024-04-23T10:20:54.990 INFO:tasks.workunit.client.0.smithi029.stdout:9/158: mknod d0/d1b/c34 0 2024-04-23T10:20:54.991 INFO:tasks.workunit.client.0.smithi029.stdout:9/159: fsync d0/d1b/f31 0 2024-04-23T10:20:54.992 INFO:tasks.workunit.client.0.smithi029.stdout:9/160: dread - d0/d7/f32 zero size 2024-04-23T10:20:54.993 INFO:tasks.workunit.client.0.smithi029.stdout:2/136: dread d1/dd/ff [0,4194304] 0 2024-04-23T10:20:54.994 INFO:tasks.workunit.client.0.smithi029.stdout:7/92: symlink d5/d9/l20 0 2024-04-23T10:20:54.995 INFO:tasks.workunit.client.0.smithi029.stdout:2/137: chown d1/c1b 7 1 2024-04-23T10:20:55.000 INFO:tasks.workunit.client.0.smithi029.stdout:4/214: unlink d0/f3b 0 2024-04-23T10:20:55.002 INFO:tasks.workunit.client.0.smithi029.stdout:9/161: dwrite d0/d7/f17 [0,4194304] 0 2024-04-23T10:20:55.005 INFO:tasks.workunit.client.0.smithi029.stdout:8/197: creat d3/d2f/d36/d3e/f3f x:0 0 0 2024-04-23T10:20:55.007 INFO:tasks.workunit.client.0.smithi029.stdout:7/93: creat d5/d8/d1a/f21 x:0 0 0 2024-04-23T10:20:55.008 INFO:tasks.workunit.client.0.smithi029.stdout:0/71: truncate d0/f6 492123 0 2024-04-23T10:20:55.010 INFO:tasks.workunit.client.0.smithi029.stdout:2/138: dread d1/dd/f1d [0,4194304] 0 2024-04-23T10:20:55.010 INFO:tasks.workunit.client.0.smithi029.stdout:0/72: dread d0/dc/f11 [0,4194304] 0 2024-04-23T10:20:55.016 INFO:tasks.workunit.client.0.smithi029.stdout:3/102: truncate d3/fd 442397 0 2024-04-23T10:20:55.019 INFO:tasks.workunit.client.0.smithi029.stdout:1/136: link d5/d6/de/d15/f1a d5/d6/de/f2e 0 2024-04-23T10:20:55.019 INFO:tasks.workunit.client.0.smithi029.stdout:1/137: stat d5/d6 0 2024-04-23T10:20:55.019 INFO:tasks.workunit.client.0.smithi029.stdout:6/187: sync 2024-04-23T10:20:55.020 INFO:tasks.workunit.client.0.smithi029.stdout:1/138: chown d5/d6/ff 650 1 2024-04-23T10:20:55.020 INFO:tasks.workunit.client.0.smithi029.stdout:4/215: rmdir d0/d12/d13/d1b/d36 39 2024-04-23T10:20:55.022 INFO:tasks.workunit.client.0.smithi029.stdout:1/139: write d5/d6/de/d22/f23 [65138,9467] 0 2024-04-23T10:20:55.022 INFO:tasks.workunit.client.0.smithi029.stdout:1/140: chown d5/l1c 55468 1 2024-04-23T10:20:55.023 INFO:tasks.workunit.client.0.smithi029.stdout:1/141: truncate d5/d6/de/d15/f20 7222 0 2024-04-23T10:20:55.024 INFO:tasks.workunit.client.0.smithi029.stdout:9/162: unlink d0/d7/c28 0 2024-04-23T10:20:55.027 INFO:tasks.workunit.client.0.smithi029.stdout:8/198: unlink d3/cc 0 2024-04-23T10:20:55.028 INFO:tasks.workunit.client.0.smithi029.stdout:7/94: mknod d5/c22 0 2024-04-23T10:20:55.030 INFO:tasks.workunit.client.0.smithi029.stdout:5/283: getdents d0/d2b 0 2024-04-23T10:20:55.033 INFO:tasks.workunit.client.0.smithi029.stdout:2/139: creat d1/dd/d22/f2c x:0 0 0 2024-04-23T10:20:55.034 INFO:tasks.workunit.client.0.smithi029.stdout:0/73: unlink d0/dc/ff 0 2024-04-23T10:20:55.038 INFO:tasks.workunit.client.0.smithi029.stdout:6/188: mkdir d9/df/d16/d44 0 2024-04-23T10:20:55.040 INFO:tasks.workunit.client.0.smithi029.stdout:4/216: write d0/d12/d13/d1b/f39 [881494,16783] 0 2024-04-23T10:20:55.042 INFO:tasks.workunit.client.0.smithi029.stdout:4/217: fdatasync d0/d12/d13/d1b/f35 0 2024-04-23T10:20:55.043 INFO:tasks.workunit.client.0.smithi029.stdout:8/199: creat d3/d2f/d36/f40 x:0 0 0 2024-04-23T10:20:55.044 INFO:tasks.workunit.client.0.smithi029.stdout:7/95: creat d5/d8/f23 x:0 0 0 2024-04-23T10:20:55.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/96: chown d5/d9 8337997 1 2024-04-23T10:20:55.050 INFO:tasks.workunit.client.0.smithi029.stdout:0/74: mknod d0/dc/c17 0 2024-04-23T10:20:55.050 INFO:tasks.workunit.client.0.smithi029.stdout:0/75: chown d0 1061163232 1 2024-04-23T10:20:55.054 INFO:tasks.workunit.client.0.smithi029.stdout:1/142: truncate d5/fd 7686305 0 2024-04-23T10:20:55.055 INFO:tasks.workunit.client.0.smithi029.stdout:9/163: dread d0/f1e [0,4194304] 0 2024-04-23T10:20:55.059 INFO:tasks.workunit.client.0.smithi029.stdout:5/284: dwrite d0/f12 [0,4194304] 0 2024-04-23T10:20:55.060 INFO:tasks.workunit.client.0.smithi029.stdout:3/103: dwrite d3/f5 [0,4194304] 0 2024-04-23T10:20:55.061 INFO:tasks.workunit.client.0.smithi029.stdout:6/189: dread d9/df/d16/f2a [0,4194304] 0 2024-04-23T10:20:55.062 INFO:tasks.workunit.client.0.smithi029.stdout:6/190: chown d9/df/d16/f1e 83 1 2024-04-23T10:20:55.063 INFO:tasks.workunit.client.0.smithi029.stdout:6/191: chown d9/df 51110911 1 2024-04-23T10:20:55.065 INFO:tasks.workunit.client.0.smithi029.stdout:7/97: creat d5/f24 x:0 0 0 2024-04-23T10:20:55.066 INFO:tasks.workunit.client.0.smithi029.stdout:8/200: write d3/f22 [4239995,88421] 0 2024-04-23T10:20:55.068 INFO:tasks.workunit.client.0.smithi029.stdout:0/76: dread d0/f6 [0,4194304] 0 2024-04-23T10:20:55.069 INFO:tasks.workunit.client.0.smithi029.stdout:1/143: creat d5/d6/de/d22/f2f x:0 0 0 2024-04-23T10:20:55.069 INFO:tasks.workunit.client.0.smithi029.stdout:9/164: mkdir d0/d7/d1d/d35 0 2024-04-23T10:20:55.074 INFO:tasks.workunit.client.0.smithi029.stdout:4/218: truncate d0/d12/d13/f14 1089156 0 2024-04-23T10:20:55.075 INFO:tasks.workunit.client.0.smithi029.stdout:6/192: rmdir d9/df/d16/d1f/d27 39 2024-04-23T10:20:55.075 INFO:tasks.workunit.client.0.smithi029.stdout:8/201: dread d3/d2f/f35 [0,4194304] 0 2024-04-23T10:20:55.078 INFO:tasks.workunit.client.0.smithi029.stdout:8/202: dread - d3/d2f/f39 zero size 2024-04-23T10:20:55.078 INFO:tasks.workunit.client.0.smithi029.stdout:7/98: creat d5/d8/f25 x:0 0 0 2024-04-23T10:20:55.079 INFO:tasks.workunit.client.0.smithi029.stdout:7/99: dread - d5/d8/d1a/f21 zero size 2024-04-23T10:20:55.080 INFO:tasks.workunit.client.0.smithi029.stdout:3/104: creat d3/d15/f18 x:0 0 0 2024-04-23T10:20:55.081 INFO:tasks.workunit.client.0.smithi029.stdout:3/105: dread - d3/d15/f18 zero size 2024-04-23T10:20:55.082 INFO:tasks.workunit.client.0.smithi029.stdout:9/165: chown d0/d7/l5 4095999 1 2024-04-23T10:20:55.083 INFO:tasks.workunit.client.0.smithi029.stdout:5/285: mkdir d0/db/d68 0 2024-04-23T10:20:55.083 INFO:tasks.workunit.client.0.smithi029.stdout:5/286: chown d0/db/d29 120517634 1 2024-04-23T10:20:55.084 INFO:tasks.workunit.client.0.smithi029.stdout:4/219: rename d0/l3e to d0/d12/l46 0 2024-04-23T10:20:55.090 INFO:tasks.workunit.client.0.smithi029.stdout:8/203: creat d3/d2f/d36/d3e/f41 x:0 0 0 2024-04-23T10:20:55.092 INFO:tasks.workunit.client.0.smithi029.stdout:1/144: link d5/d6/f21 d5/d6/de/d22/f30 0 2024-04-23T10:20:55.092 INFO:tasks.workunit.client.0.smithi029.stdout:4/220: dwrite d0/f27 [4194304,4194304] 0 2024-04-23T10:20:55.093 INFO:tasks.workunit.client.0.smithi029.stdout:0/77: write d0/f6 [926061,36591] 0 2024-04-23T10:20:55.094 INFO:tasks.workunit.client.0.smithi029.stdout:7/100: write d5/d8/f10 [994931,2506] 0 2024-04-23T10:20:55.095 INFO:tasks.workunit.client.0.smithi029.stdout:4/221: chown d0/cb 7720926 1 2024-04-23T10:20:55.095 INFO:tasks.workunit.client.0.smithi029.stdout:7/101: read - d5/d8/d1a/f21 zero size 2024-04-23T10:20:55.096 INFO:tasks.workunit.client.0.smithi029.stdout:5/287: unlink d0/c28 0 2024-04-23T10:20:55.097 INFO:tasks.workunit.client.0.smithi029.stdout:7/102: write d5/fe [2715628,44340] 0 2024-04-23T10:20:55.097 INFO:tasks.workunit.client.0.smithi029.stdout:6/193: rmdir d9/df/d16/d1f/d27/d2d 39 2024-04-23T10:20:55.098 INFO:tasks.workunit.client.0.smithi029.stdout:6/194: fdatasync d9/f18 0 2024-04-23T10:20:55.098 INFO:tasks.workunit.client.0.smithi029.stdout:8/204: readlink d3/d2f/d36/l37 0 2024-04-23T10:20:55.101 INFO:tasks.workunit.client.0.smithi029.stdout:1/145: write d5/d6/de/d22/f30 [6353,129585] 0 2024-04-23T10:20:55.103 INFO:tasks.workunit.client.0.smithi029.stdout:3/106: link d3/f5 d3/d10/f19 0 2024-04-23T10:20:55.105 INFO:tasks.workunit.client.0.smithi029.stdout:9/166: creat d0/d7/d1d/d35/f36 x:0 0 0 2024-04-23T10:20:55.109 INFO:tasks.workunit.client.0.smithi029.stdout:5/288: mknod d0/d35/c69 0 2024-04-23T10:20:55.110 INFO:tasks.workunit.client.0.smithi029.stdout:9/167: dread - d0/d7/d1d/d35/f36 zero size 2024-04-23T10:20:55.111 INFO:tasks.workunit.client.0.smithi029.stdout:7/103: creat d5/d9/f26 x:0 0 0 2024-04-23T10:20:55.112 INFO:tasks.workunit.client.0.smithi029.stdout:1/146: symlink d5/l31 0 2024-04-23T10:20:55.114 INFO:tasks.workunit.client.0.smithi029.stdout:3/107: fdatasync d3/f5 0 2024-04-23T10:20:55.114 INFO:tasks.workunit.client.0.smithi029.stdout:4/222: mknod d0/c47 0 2024-04-23T10:20:55.119 INFO:tasks.workunit.client.0.smithi029.stdout:9/168: mknod d0/d7/d1d/c37 0 2024-04-23T10:20:55.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/205: dwrite d3/d2f/d36/f40 [0,4194304] 0 2024-04-23T10:20:55.120 INFO:tasks.workunit.client.0.smithi029.stdout:6/195: dwrite d9/f10 [0,4194304] 0 2024-04-23T10:20:55.121 INFO:tasks.workunit.client.0.smithi029.stdout:5/289: truncate d0/d35/d38/d3e/f4e 247508 0 2024-04-23T10:20:55.123 INFO:tasks.workunit.client.0.smithi029.stdout:3/108: write d3/d10/f19 [3857650,113024] 0 2024-04-23T10:20:55.123 INFO:tasks.workunit.client.0.smithi029.stdout:1/147: rename d5/l31 to d5/l32 0 2024-04-23T10:20:55.130 INFO:tasks.workunit.client.0.smithi029.stdout:4/223: dread d0/d12/d13/f14 [0,4194304] 0 2024-04-23T10:20:55.135 INFO:tasks.workunit.client.0.smithi029.stdout:0/78: dwrite d0/dc/f11 [0,4194304] 0 2024-04-23T10:20:55.138 INFO:tasks.workunit.client.0.smithi029.stdout:7/104: dwrite d5/ff [0,4194304] 0 2024-04-23T10:20:55.139 INFO:tasks.workunit.client.0.smithi029.stdout:9/169: creat d0/f38 x:0 0 0 2024-04-23T10:20:55.142 INFO:tasks.workunit.client.0.smithi029.stdout:8/206: link d3/f29 d3/f42 0 2024-04-23T10:20:55.146 INFO:tasks.workunit.client.0.smithi029.stdout:9/170: chown d0/d7/d15/f16 39546446 1 2024-04-23T10:20:55.146 INFO:tasks.workunit.client.0.smithi029.stdout:6/196: dread d9/f29 [0,4194304] 0 2024-04-23T10:20:55.146 INFO:tasks.workunit.client.0.smithi029.stdout:0/79: mknod d0/dc/c18 0 2024-04-23T10:20:55.146 INFO:tasks.workunit.client.0.smithi029.stdout:4/224: symlink d0/d12/d13/d1b/l48 0 2024-04-23T10:20:55.146 INFO:tasks.workunit.client.0.smithi029.stdout:7/105: symlink d5/d8/d1a/l27 0 2024-04-23T10:20:55.147 INFO:tasks.workunit.client.0.smithi029.stdout:6/197: stat l1 0 2024-04-23T10:20:55.150 INFO:tasks.workunit.client.0.smithi029.stdout:5/290: dwrite d0/d35/d38/d51/f46 [0,4194304] 0 2024-04-23T10:20:55.150 INFO:tasks.workunit.client.0.smithi029.stdout:9/171: write d0/d7/d6/f23 [627443,126617] 0 2024-04-23T10:20:55.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/80: mknod d0/dc/c19 0 2024-04-23T10:20:55.153 INFO:tasks.workunit.client.0.smithi029.stdout:7/106: write d5/d8/d1a/f1b [775292,80005] 0 2024-04-23T10:20:55.155 INFO:tasks.workunit.client.0.smithi029.stdout:4/225: creat d0/d12/f49 x:0 0 0 2024-04-23T10:20:55.158 INFO:tasks.workunit.client.0.smithi029.stdout:3/109: truncate d3/d10/de/f12 2136215 0 2024-04-23T10:20:55.160 INFO:tasks.workunit.client.0.smithi029.stdout:7/107: chown d5/d9/ld 575 1 2024-04-23T10:20:55.162 INFO:tasks.workunit.client.0.smithi029.stdout:0/81: creat d0/dc/f1a x:0 0 0 2024-04-23T10:20:55.162 INFO:tasks.workunit.client.0.smithi029.stdout:6/198: mknod d9/df/d16/d44/c45 0 2024-04-23T10:20:55.165 INFO:tasks.workunit.client.0.smithi029.stdout:5/291: write d0/d35/d38/d3e/f4e [227482,14869] 0 2024-04-23T10:20:55.165 INFO:tasks.workunit.client.0.smithi029.stdout:9/172: mkdir d0/d1b/d39 0 2024-04-23T10:20:55.168 INFO:tasks.workunit.client.0.smithi029.stdout:1/148: dwrite d5/fd [0,4194304] 0 2024-04-23T10:20:55.168 INFO:tasks.workunit.client.0.smithi029.stdout:8/207: dwrite d3/fa [0,4194304] 0 2024-04-23T10:20:55.168 INFO:tasks.workunit.client.0.smithi029.stdout:0/82: truncate d0/f3 1406914 0 2024-04-23T10:20:55.173 INFO:tasks.workunit.client.0.smithi029.stdout:7/108: creat d5/f28 x:0 0 0 2024-04-23T10:20:55.173 INFO:tasks.workunit.client.0.smithi029.stdout:6/199: creat d9/df/d16/f46 x:0 0 0 2024-04-23T10:20:55.179 INFO:tasks.workunit.client.0.smithi029.stdout:8/208: unlink d3/d2f/d36/l37 0 2024-04-23T10:20:55.181 INFO:tasks.workunit.client.0.smithi029.stdout:5/292: mkdir d0/d6a 0 2024-04-23T10:20:55.181 INFO:tasks.workunit.client.0.smithi029.stdout:7/109: truncate d5/d8/f25 163157 0 2024-04-23T10:20:55.183 INFO:tasks.workunit.client.0.smithi029.stdout:9/173: dread d0/d7/f1a [0,4194304] 0 2024-04-23T10:20:55.185 INFO:tasks.workunit.client.0.smithi029.stdout:0/83: mkdir d0/d1b 0 2024-04-23T10:20:55.189 INFO:tasks.workunit.client.0.smithi029.stdout:1/149: creat d5/d6/de/f33 x:0 0 0 2024-04-23T10:20:55.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/226: dwrite d0/fd [0,4194304] 0 2024-04-23T10:20:55.189 INFO:tasks.workunit.client.0.smithi029.stdout:7/110: chown d5/f24 0 1 2024-04-23T10:20:55.189 INFO:tasks.workunit.client.0.smithi029.stdout:3/110: dwrite d3/d15/f18 [0,4194304] 0 2024-04-23T10:20:55.189 INFO:tasks.workunit.client.0.smithi029.stdout:0/84: truncate d0/f7 4591472 0 2024-04-23T10:20:55.192 INFO:tasks.workunit.client.0.smithi029.stdout:7/111: fsync f1 0 2024-04-23T10:20:55.192 INFO:tasks.workunit.client.0.smithi029.stdout:8/209: mknod d3/d2f/d36/d3e/c43 0 2024-04-23T10:20:55.197 INFO:tasks.workunit.client.0.smithi029.stdout:6/200: dread d9/df/d16/f24 [0,4194304] 0 2024-04-23T10:20:55.197 INFO:tasks.workunit.client.0.smithi029.stdout:0/85: mknod d0/c1c 0 2024-04-23T10:20:55.197 INFO:tasks.workunit.client.0.smithi029.stdout:4/227: truncate d0/fe 840900 0 2024-04-23T10:20:55.198 INFO:tasks.workunit.client.0.smithi029.stdout:9/174: link d0/f2d d0/d7/d1d/d35/f3a 0 2024-04-23T10:20:55.202 INFO:tasks.workunit.client.0.smithi029.stdout:6/201: fdatasync d9/df/d25/f42 0 2024-04-23T10:20:55.203 INFO:tasks.workunit.client.0.smithi029.stdout:3/111: creat d3/d10/d13/f1a x:0 0 0 2024-04-23T10:20:55.206 INFO:tasks.workunit.client.0.smithi029.stdout:1/150: dwrite d5/d6/ff [0,4194304] 0 2024-04-23T10:20:55.207 INFO:tasks.workunit.client.0.smithi029.stdout:6/202: chown d9/df/c43 348734657 1 2024-04-23T10:20:55.208 INFO:tasks.workunit.client.0.smithi029.stdout:9/175: mkdir d0/d7/d1d/d35/d3b 0 2024-04-23T10:20:55.210 INFO:tasks.workunit.client.0.smithi029.stdout:5/293: dwrite d0/d35/d10/d26/f45 [4194304,4194304] 0 2024-04-23T10:20:55.211 INFO:tasks.workunit.client.0.smithi029.stdout:6/203: fdatasync d9/df/d16/f1e 0 2024-04-23T10:20:55.213 INFO:tasks.workunit.client.0.smithi029.stdout:3/112: symlink d3/d10/de/l1b 0 2024-04-23T10:20:55.218 INFO:tasks.workunit.client.0.smithi029.stdout:3/113: write f0 [2277266,59545] 0 2024-04-23T10:20:55.219 INFO:tasks.workunit.client.0.smithi029.stdout:9/176: symlink d0/d7/d1d/l3c 0 2024-04-23T10:20:55.220 INFO:tasks.workunit.client.0.smithi029.stdout:5/294: symlink d0/d35/l6b 0 2024-04-23T10:20:55.221 INFO:tasks.workunit.client.0.smithi029.stdout:4/228: symlink d0/d12/d13/d1b/d36/d45/l4a 0 2024-04-23T10:20:55.229 INFO:tasks.workunit.client.0.smithi029.stdout:3/114: mkdir d3/d10/d13/d1c 0 2024-04-23T10:20:55.230 INFO:tasks.workunit.client.0.smithi029.stdout:7/112: dwrite d5/f18 [0,4194304] 0 2024-04-23T10:20:55.231 INFO:tasks.workunit.client.0.smithi029.stdout:0/86: getdents d0 0 2024-04-23T10:20:55.238 INFO:tasks.workunit.client.0.smithi029.stdout:6/204: dwrite d9/df/d16/d34/f3f [0,4194304] 0 2024-04-23T10:20:55.239 INFO:tasks.workunit.client.0.smithi029.stdout:4/229: symlink d0/l4b 0 2024-04-23T10:20:55.244 INFO:tasks.workunit.client.0.smithi029.stdout:1/151: dread d5/d6/de/d22/f25 [0,4194304] 0 2024-04-23T10:20:55.246 INFO:tasks.workunit.client.0.smithi029.stdout:5/295: getdents d0/d6a 0 2024-04-23T10:20:55.247 INFO:tasks.workunit.client.0.smithi029.stdout:9/177: dwrite d0/d7/fa [4194304,4194304] 0 2024-04-23T10:20:55.255 INFO:tasks.workunit.client.0.smithi029.stdout:6/205: dread d9/fe [0,4194304] 0 2024-04-23T10:20:55.255 INFO:tasks.workunit.client.0.smithi029.stdout:0/87: dwrite d0/fd [0,4194304] 0 2024-04-23T10:20:55.256 INFO:tasks.workunit.client.0.smithi029.stdout:7/113: dwrite d5/d8/f10 [0,4194304] 0 2024-04-23T10:20:55.257 INFO:tasks.workunit.client.0.smithi029.stdout:7/114: dread - d5/d9/f26 zero size 2024-04-23T10:20:55.261 INFO:tasks.workunit.client.0.smithi029.stdout:5/296: unlink d0/d35/d10/f61 0 2024-04-23T10:20:55.261 INFO:tasks.workunit.client.0.smithi029.stdout:9/178: rename d0/d7/d6/fb to d0/d1b/f3d 0 2024-04-23T10:20:55.263 INFO:tasks.workunit.client.0.smithi029.stdout:7/115: mkdir d5/d29 0 2024-04-23T10:20:55.264 INFO:tasks.workunit.client.0.smithi029.stdout:1/152: mkdir d5/d6/d34 0 2024-04-23T10:20:55.264 INFO:tasks.workunit.client.0.smithi029.stdout:0/88: symlink d0/d1b/l1d 0 2024-04-23T10:20:55.265 INFO:tasks.workunit.client.0.smithi029.stdout:9/179: write d0/d1b/f31 [884018,86473] 0 2024-04-23T10:20:55.267 INFO:tasks.workunit.client.0.smithi029.stdout:9/180: stat d0/d7/d1d/f1f 0 2024-04-23T10:20:55.272 INFO:tasks.workunit.client.0.smithi029.stdout:5/297: dread d0/d35/d38/d3e/f4e [0,4194304] 0 2024-04-23T10:20:55.272 INFO:tasks.workunit.client.0.smithi029.stdout:6/206: link d9/df/d16/d34/c3a d9/df/d25/c47 0 2024-04-23T10:20:55.272 INFO:tasks.workunit.client.0.smithi029.stdout:0/89: creat d0/dc/f1e x:0 0 0 2024-04-23T10:20:55.274 INFO:tasks.workunit.client.0.smithi029.stdout:6/207: chown d9/df/d16 39126 1 2024-04-23T10:20:55.276 INFO:tasks.workunit.client.0.smithi029.stdout:9/181: mknod d0/d1b/c3e 0 2024-04-23T10:20:55.278 INFO:tasks.workunit.client.0.smithi029.stdout:3/115: dread d3/f8 [0,4194304] 0 2024-04-23T10:20:55.278 INFO:tasks.workunit.client.0.smithi029.stdout:0/90: mknod d0/c1f 0 2024-04-23T10:20:55.285 INFO:tasks.workunit.client.0.smithi029.stdout:1/153: dwrite d5/d6/de/d15/f26 [0,4194304] 0 2024-04-23T10:20:55.289 INFO:tasks.workunit.client.0.smithi029.stdout:3/116: rename d3/d10/f19 to d3/d15/f1d 0 2024-04-23T10:20:55.291 INFO:tasks.workunit.client.0.smithi029.stdout:5/298: dwrite d0/d35/d38/d51/f43 [0,4194304] 0 2024-04-23T10:20:55.294 INFO:tasks.workunit.client.0.smithi029.stdout:6/208: unlink d9/df/d16/d1f/d27/d2d/c30 0 2024-04-23T10:20:55.297 INFO:tasks.workunit.client.0.smithi029.stdout:3/117: write d3/d10/d13/f1a [173049,62909] 0 2024-04-23T10:20:55.298 INFO:tasks.workunit.client.0.smithi029.stdout:9/182: dwrite d0/f1e [0,4194304] 0 2024-04-23T10:20:55.299 INFO:tasks.workunit.client.0.smithi029.stdout:5/299: write d0/d35/d38/d3e/f59 [42319,63218] 0 2024-04-23T10:20:55.305 INFO:tasks.workunit.client.0.smithi029.stdout:9/183: dread - d0/d7/d1d/d35/f36 zero size 2024-04-23T10:20:55.313 INFO:tasks.workunit.client.0.smithi029.stdout:1/154: dwrite d5/d6/de/d15/f26 [0,4194304] 0 2024-04-23T10:20:55.313 INFO:tasks.workunit.client.0.smithi029.stdout:9/184: dread - d0/d7/d1d/f1f zero size 2024-04-23T10:20:55.317 INFO:tasks.workunit.client.0.smithi029.stdout:9/185: dread - d0/d7/d1d/f1f zero size 2024-04-23T10:20:55.322 INFO:tasks.workunit.client.0.smithi029.stdout:6/209: dwrite d9/df/f3d [0,4194304] 0 2024-04-23T10:20:55.323 INFO:tasks.workunit.client.0.smithi029.stdout:5/300: creat d0/d35/d38/d3e/d66/f6c x:0 0 0 2024-04-23T10:20:55.336 INFO:tasks.workunit.client.0.smithi029.stdout:1/155: creat d5/d6/de/d27/f35 x:0 0 0 2024-04-23T10:20:55.336 INFO:tasks.workunit.client.0.smithi029.stdout:3/118: write d3/fd [756435,30969] 0 2024-04-23T10:20:55.340 INFO:tasks.workunit.client.0.smithi029.stdout:6/210: mknod d9/df/d16/d1f/d27/c48 0 2024-04-23T10:20:55.341 INFO:tasks.workunit.client.0.smithi029.stdout:0/91: creat d0/f20 x:0 0 0 2024-04-23T10:20:55.343 INFO:tasks.workunit.client.0.smithi029.stdout:3/119: creat d3/d10/f1e x:0 0 0 2024-04-23T10:20:55.343 INFO:tasks.workunit.client.0.smithi029.stdout:5/301: rename d0/db/d29 to d0/db/d6d 0 2024-04-23T10:20:55.345 INFO:tasks.workunit.client.0.smithi029.stdout:3/120: write f0 [1521724,79390] 0 2024-04-23T10:20:55.346 INFO:tasks.workunit.client.0.smithi029.stdout:1/156: symlink d5/d6/d34/l36 0 2024-04-23T10:20:55.347 INFO:tasks.workunit.client.0.smithi029.stdout:9/186: dwrite d0/f2d [0,4194304] 0 2024-04-23T10:20:55.347 INFO:tasks.workunit.client.0.smithi029.stdout:5/302: write d0/d35/d38/d51/f46 [3494300,40029] 0 2024-04-23T10:20:55.351 INFO:tasks.workunit.client.0.smithi029.stdout:0/92: write d0/f1 [2621309,17188] 0 2024-04-23T10:20:55.353 INFO:tasks.workunit.client.0.smithi029.stdout:3/121: symlink d3/l1f 0 2024-04-23T10:20:55.353 INFO:tasks.workunit.client.0.smithi029.stdout:5/303: symlink d0/d35/d10/d26/l6e 0 2024-04-23T10:20:55.355 INFO:tasks.workunit.client.0.smithi029.stdout:3/122: dread - d3/d10/f1e zero size 2024-04-23T10:20:55.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/211: write d9/df/d16/f1a [3936110,24896] 0 2024-04-23T10:20:55.357 INFO:tasks.workunit.client.0.smithi029.stdout:9/187: mkdir d0/d7/d3f 0 2024-04-23T10:20:55.358 INFO:tasks.workunit.client.0.smithi029.stdout:0/93: write d0/dc/f16 [450339,32049] 0 2024-04-23T10:20:55.359 INFO:tasks.workunit.client.0.smithi029.stdout:9/188: readlink d0/d7/d15/l2c 0 2024-04-23T10:20:55.359 INFO:tasks.workunit.client.0.smithi029.stdout:3/123: chown d3/d10/d13/f1a 171 1 2024-04-23T10:20:55.360 INFO:tasks.workunit.client.0.smithi029.stdout:5/304: mkdir d0/d35/d38/d39/d3f/d6f 0 2024-04-23T10:20:55.360 INFO:tasks.workunit.client.0.smithi029.stdout:3/124: stat d3/f8 0 2024-04-23T10:20:55.360 INFO:tasks.workunit.client.0.smithi029.stdout:9/189: chown d0/d7/l5 4618638 1 2024-04-23T10:20:55.362 INFO:tasks.workunit.client.0.smithi029.stdout:3/125: fdatasync d3/d10/f1e 0 2024-04-23T10:20:55.362 INFO:tasks.workunit.client.0.smithi029.stdout:0/94: mkdir d0/d21 0 2024-04-23T10:20:55.363 INFO:tasks.workunit.client.0.smithi029.stdout:5/305: stat d0/db/d3d/f5d 0 2024-04-23T10:20:55.364 INFO:tasks.workunit.client.0.smithi029.stdout:1/157: truncate d5/d6/de/d15/f26 3269614 0 2024-04-23T10:20:55.365 INFO:tasks.workunit.client.0.smithi029.stdout:9/190: chown d0/d7/d1d/d35/f3a 671 1 2024-04-23T10:20:55.366 INFO:tasks.workunit.client.0.smithi029.stdout:3/126: creat d3/d10/f20 x:0 0 0 2024-04-23T10:20:55.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/95: write d0/f3 [334294,89204] 0 2024-04-23T10:20:55.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/191: chown d0/f21 0 1 2024-04-23T10:20:55.369 INFO:tasks.workunit.client.0.smithi029.stdout:6/212: dread d9/df/f13 [0,4194304] 0 2024-04-23T10:20:55.370 INFO:tasks.workunit.client.0.smithi029.stdout:0/96: unlink d0/dc/c17 0 2024-04-23T10:20:55.371 INFO:tasks.workunit.client.0.smithi029.stdout:1/158: read d5/fd [5356254,124633] 0 2024-04-23T10:20:55.373 INFO:tasks.workunit.client.0.smithi029.stdout:0/97: mknod d0/d21/c22 0 2024-04-23T10:20:55.373 INFO:tasks.workunit.client.0.smithi029.stdout:6/213: readlink d9/df/d16/d1f/d27/l3c 0 2024-04-23T10:20:55.377 INFO:tasks.workunit.client.0.smithi029.stdout:0/98: write d0/f3 [394885,26749] 0 2024-04-23T10:20:55.382 INFO:tasks.workunit.client.0.smithi029.stdout:5/306: dwrite d0/d35/d38/d3e/d66/f6c [0,4194304] 0 2024-04-23T10:20:55.383 INFO:tasks.workunit.client.0.smithi029.stdout:5/307: chown d0/d2b 225695 1 2024-04-23T10:20:55.389 INFO:tasks.workunit.client.0.smithi029.stdout:6/214: getdents d9/df/d25 0 2024-04-23T10:20:55.389 INFO:tasks.workunit.client.0.smithi029.stdout:9/192: dwrite d0/d7/fa [8388608,4194304] 0 2024-04-23T10:20:55.390 INFO:tasks.workunit.client.0.smithi029.stdout:3/127: dread d3/d10/de/f12 [0,4194304] 0 2024-04-23T10:20:55.397 INFO:tasks.workunit.client.0.smithi029.stdout:0/99: dwrite d0/dc/f1e [0,4194304] 0 2024-04-23T10:20:55.402 INFO:tasks.workunit.client.0.smithi029.stdout:5/308: truncate d0/d35/d49/f54 218017 0 2024-04-23T10:20:55.402 INFO:tasks.workunit.client.0.smithi029.stdout:6/215: mkdir d9/df/d41/d49 0 2024-04-23T10:20:55.404 INFO:tasks.workunit.client.0.smithi029.stdout:0/100: creat d0/dc/f23 x:0 0 0 2024-04-23T10:20:55.406 INFO:tasks.workunit.client.0.smithi029.stdout:5/309: stat d0/d35/d49 0 2024-04-23T10:20:55.408 INFO:tasks.workunit.client.0.smithi029.stdout:0/101: write d0/f3 [1031253,76524] 0 2024-04-23T10:20:55.409 INFO:tasks.workunit.client.0.smithi029.stdout:6/216: chown d9/df/d16/d1f/d27 29389 1 2024-04-23T10:20:55.411 INFO:tasks.workunit.client.0.smithi029.stdout:1/159: dwrite d5/d6/de/d15/f20 [0,4194304] 0 2024-04-23T10:20:55.413 INFO:tasks.workunit.client.0.smithi029.stdout:2/140: sync 2024-04-23T10:20:55.414 INFO:tasks.workunit.client.0.smithi029.stdout:1/160: dread - d5/d6/de/d22/f2f zero size 2024-04-23T10:20:55.415 INFO:tasks.workunit.client.0.smithi029.stdout:9/193: dwrite d0/f1e [4194304,4194304] 0 2024-04-23T10:20:55.416 INFO:tasks.workunit.client.0.smithi029.stdout:3/128: link d3/d10/de/f12 d3/d15/f21 0 2024-04-23T10:20:55.419 INFO:tasks.workunit.client.0.smithi029.stdout:0/102: symlink d0/l24 0 2024-04-23T10:20:55.419 INFO:tasks.workunit.client.0.smithi029.stdout:3/129: read d3/f5 [75589,99172] 0 2024-04-23T10:20:55.430 INFO:tasks.workunit.client.0.smithi029.stdout:3/130: mknod d3/d10/d13/d1c/c22 0 2024-04-23T10:20:55.430 INFO:tasks.workunit.client.0.smithi029.stdout:6/217: dread d9/df/d16/f2e [0,4194304] 0 2024-04-23T10:20:55.433 INFO:tasks.workunit.client.0.smithi029.stdout:1/161: dwrite d5/d6/f19 [0,4194304] 0 2024-04-23T10:20:55.438 INFO:tasks.workunit.client.0.smithi029.stdout:1/162: rename d5/fc to d5/f37 0 2024-04-23T10:20:55.441 INFO:tasks.workunit.client.0.smithi029.stdout:6/218: write d9/df/d16/f2a [3580263,40225] 0 2024-04-23T10:20:55.448 INFO:tasks.workunit.client.0.smithi029.stdout:0/103: dread d0/f4 [0,4194304] 0 2024-04-23T10:20:55.449 INFO:tasks.workunit.client.0.smithi029.stdout:6/219: dread d9/f18 [0,4194304] 0 2024-04-23T10:20:55.454 INFO:tasks.workunit.client.0.smithi029.stdout:0/104: rename d0/l2 to d0/dc/l25 0 2024-04-23T10:20:55.456 INFO:tasks.workunit.client.0.smithi029.stdout:1/163: getdents d5 0 2024-04-23T10:20:55.460 INFO:tasks.workunit.client.0.smithi029.stdout:3/131: dread f0 [0,4194304] 0 2024-04-23T10:20:55.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/132: dread d3/f8 [0,4194304] 0 2024-04-23T10:20:55.465 INFO:tasks.workunit.client.0.smithi029.stdout:1/164: dwrite d5/d6/de/d15/f20 [0,4194304] 0 2024-04-23T10:20:55.469 INFO:tasks.workunit.client.0.smithi029.stdout:3/133: creat d3/d10/d13/f23 x:0 0 0 2024-04-23T10:20:55.469 INFO:tasks.workunit.client.0.smithi029.stdout:1/165: rmdir d5/d6/de 39 2024-04-23T10:20:55.470 INFO:tasks.workunit.client.0.smithi029.stdout:1/166: readlink d5/d6/d34/l36 0 2024-04-23T10:20:55.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/134: dwrite d3/d15/f18 [0,4194304] 0 2024-04-23T10:20:55.483 INFO:tasks.workunit.client.0.smithi029.stdout:3/135: rename d3/d10/d13/f23 to d3/d10/de/f24 0 2024-04-23T10:20:55.484 INFO:tasks.workunit.client.0.smithi029.stdout:1/167: mkdir d5/d6/de/d27/d38 0 2024-04-23T10:20:55.486 INFO:tasks.workunit.client.0.smithi029.stdout:3/136: fsync d3/d15/f1d 0 2024-04-23T10:20:55.488 INFO:tasks.workunit.client.0.smithi029.stdout:3/137: creat d3/f25 x:0 0 0 2024-04-23T10:20:55.491 INFO:tasks.workunit.client.0.smithi029.stdout:3/138: creat d3/d10/d13/f26 x:0 0 0 2024-04-23T10:20:55.494 INFO:tasks.workunit.client.0.smithi029.stdout:1/168: link d5/d6/de/d22/f30 d5/d6/f39 0 2024-04-23T10:20:55.495 INFO:tasks.workunit.client.0.smithi029.stdout:3/139: mkdir d3/d10/d27 0 2024-04-23T10:20:55.496 INFO:tasks.workunit.client.0.smithi029.stdout:3/140: fdatasync d3/d15/f18 0 2024-04-23T10:20:55.498 INFO:tasks.workunit.client.0.smithi029.stdout:1/169: mknod d5/d6/c3a 0 2024-04-23T10:20:55.500 INFO:tasks.workunit.client.0.smithi029.stdout:1/170: truncate d5/d6/de/d27/f35 559646 0 2024-04-23T10:20:55.501 INFO:tasks.workunit.client.0.smithi029.stdout:1/171: dread - d5/d6/de/d22/f2f zero size 2024-04-23T10:20:55.503 INFO:tasks.workunit.client.0.smithi029.stdout:3/141: dwrite d3/fd [0,4194304] 0 2024-04-23T10:20:55.514 INFO:tasks.workunit.client.0.smithi029.stdout:3/142: dwrite d3/f5 [0,4194304] 0 2024-04-23T10:20:55.515 INFO:tasks.workunit.client.0.smithi029.stdout:3/143: chown d3/d15 5373560 1 2024-04-23T10:20:55.515 INFO:tasks.workunit.client.0.smithi029.stdout:3/144: fdatasync d3/d10/d13/f1a 0 2024-04-23T10:20:55.526 INFO:tasks.workunit.client.0.smithi029.stdout:1/172: dread d5/d6/de/f2e [0,4194304] 0 2024-04-23T10:20:55.527 INFO:tasks.workunit.client.0.smithi029.stdout:1/173: chown d5/l2d 681165861 1 2024-04-23T10:20:55.527 INFO:tasks.workunit.client.0.smithi029.stdout:1/174: chown d5/d6/de/d27/l2a 0 1 2024-04-23T10:20:55.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/145: mkdir d3/d10/d27/d28 0 2024-04-23T10:20:55.533 INFO:tasks.workunit.client.0.smithi029.stdout:1/175: creat d5/d6/de/d15/f3b x:0 0 0 2024-04-23T10:20:55.534 INFO:tasks.workunit.client.0.smithi029.stdout:1/176: truncate d5/d6/f11 921683 0 2024-04-23T10:20:55.585 INFO:tasks.workunit.client.0.smithi029.stdout:3/146: creat d3/d15/f29 x:0 0 0 2024-04-23T10:20:55.586 INFO:tasks.workunit.client.0.smithi029.stdout:3/147: dread - d3/d10/de/f24 zero size 2024-04-23T10:20:55.619 INFO:tasks.workunit.client.0.smithi029.stdout:3/148: creat d3/f2a x:0 0 0 2024-04-23T10:20:55.621 INFO:tasks.workunit.client.0.smithi029.stdout:3/149: dread - d3/f2a zero size 2024-04-23T10:20:55.832 INFO:tasks.workunit.client.0.smithi029.stdout:9/194: dread d0/d7/f8 [0,4194304] 0 2024-04-23T10:20:55.841 INFO:tasks.workunit.client.0.smithi029.stdout:9/195: read d0/d7/f10 [2234719,39194] 0 2024-04-23T10:20:55.844 INFO:tasks.workunit.client.0.smithi029.stdout:9/196: write d0/f38 [891313,35247] 0 2024-04-23T10:20:55.846 INFO:tasks.workunit.client.0.smithi029.stdout:9/197: truncate d0/d7/f1a 1574568 0 2024-04-23T10:20:55.848 INFO:tasks.workunit.client.0.smithi029.stdout:9/198: fsync d0/d7/f32 0 2024-04-23T10:20:55.850 INFO:tasks.workunit.client.0.smithi029.stdout:9/199: write d0/f11 [979853,92473] 0 2024-04-23T10:20:55.859 INFO:tasks.workunit.client.0.smithi029.stdout:9/200: creat d0/d7/d3f/f40 x:0 0 0 2024-04-23T10:20:55.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/201: creat d0/d7/d3f/f41 x:0 0 0 2024-04-23T10:20:55.867 INFO:tasks.workunit.client.0.smithi029.stdout:9/202: write d0/d7/d1d/d35/f3a [1124359,96764] 0 2024-04-23T10:20:55.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/210: sync 2024-04-23T10:20:55.875 INFO:tasks.workunit.client.0.smithi029.stdout:8/211: truncate d3/f29 1682256 0 2024-04-23T10:20:55.880 INFO:tasks.workunit.client.0.smithi029.stdout:8/212: mkdir d3/d44 0 2024-04-23T10:20:55.893 INFO:tasks.workunit.client.0.smithi029.stdout:8/213: dwrite d3/f33 [0,4194304] 0 2024-04-23T10:20:55.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/203: dread d0/f1c [0,4194304] 0 2024-04-23T10:20:55.898 INFO:tasks.workunit.client.0.smithi029.stdout:8/214: mknod d3/d44/c45 0 2024-04-23T10:20:55.912 INFO:tasks.workunit.client.0.smithi029.stdout:9/204: dwrite d0/d7/d1d/f1f [0,4194304] 0 2024-04-23T10:20:55.914 INFO:tasks.workunit.client.0.smithi029.stdout:8/215: dread d3/d38/f3d [0,4194304] 0 2024-04-23T10:20:55.921 INFO:tasks.workunit.client.0.smithi029.stdout:9/205: rename d0/d1b/f3d to d0/d1b/d39/f42 0 2024-04-23T10:20:55.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/216: creat d3/d2f/d36/f46 x:0 0 0 2024-04-23T10:20:55.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/206: mknod d0/d7/d6/c43 0 2024-04-23T10:20:55.936 INFO:tasks.workunit.client.0.smithi029.stdout:8/217: fdatasync d3/f14 0 2024-04-23T10:20:55.941 INFO:tasks.workunit.client.0.smithi029.stdout:9/207: mkdir d0/d1b/d44 0 2024-04-23T10:20:55.943 INFO:tasks.workunit.client.0.smithi029.stdout:8/218: dread d3/d2f/d36/f40 [0,4194304] 0 2024-04-23T10:20:55.944 INFO:tasks.workunit.client.0.smithi029.stdout:8/219: fdatasync d3/d2f/f39 0 2024-04-23T10:20:55.945 INFO:tasks.workunit.client.0.smithi029.stdout:8/220: dread - d3/f11 zero size 2024-04-23T10:20:55.949 INFO:tasks.workunit.client.0.smithi029.stdout:0/105: dread d0/f7 [0,4194304] 0 2024-04-23T10:20:55.954 INFO:tasks.workunit.client.0.smithi029.stdout:9/208: symlink d0/l45 0 2024-04-23T10:20:55.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/209: mknod d0/c46 0 2024-04-23T10:20:55.963 INFO:tasks.workunit.client.0.smithi029.stdout:9/210: link d0/d7/d1d/f1f d0/d7/d6/f47 0 2024-04-23T10:20:55.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/211: readlink d0/d7/d1d/l30 0 2024-04-23T10:20:55.973 INFO:tasks.workunit.client.0.smithi029.stdout:8/221: dread d3/f19 [0,4194304] 0 2024-04-23T10:20:55.973 INFO:tasks.workunit.client.0.smithi029.stdout:8/222: readlink d3/l1c 0 2024-04-23T10:20:55.976 INFO:tasks.workunit.client.0.smithi029.stdout:8/223: mknod d3/d38/c47 0 2024-04-23T10:20:55.982 INFO:tasks.workunit.client.0.smithi029.stdout:9/212: dread d0/d1b/d39/f42 [0,4194304] 0 2024-04-23T10:20:55.988 INFO:tasks.workunit.client.0.smithi029.stdout:9/213: link d0/d7/f10 d0/d7/d3f/f48 0 2024-04-23T10:20:55.989 INFO:tasks.workunit.client.0.smithi029.stdout:9/214: chown d0/d7/d6/f23 3 1 2024-04-23T10:20:55.990 INFO:tasks.workunit.client.0.smithi029.stdout:9/215: dread - d0/d7/d1d/d35/f36 zero size 2024-04-23T10:20:55.991 INFO:tasks.workunit.client.0.smithi029.stdout:9/216: chown d0/d1b/c33 129896 1 2024-04-23T10:20:55.995 INFO:tasks.workunit.client.0.smithi029.stdout:9/217: mkdir d0/d1b/d44/d49 0 2024-04-23T10:20:55.996 INFO:tasks.workunit.client.0.smithi029.stdout:9/218: chown d0/d1b 2351 1 2024-04-23T10:20:56.000 INFO:tasks.workunit.client.0.smithi029.stdout:9/219: mknod d0/c4a 0 2024-04-23T10:20:56.035 INFO:tasks.workunit.client.0.smithi029.stdout:9/220: dread d0/d7/d3f/f48 [0,4194304] 0 2024-04-23T10:20:56.054 INFO:tasks.workunit.client.0.smithi029.stdout:9/221: dwrite d0/d7/d1d/d35/f36 [0,4194304] 0 2024-04-23T10:20:56.062 INFO:tasks.workunit.client.0.smithi029.stdout:9/222: write d0/d7/d15/f16 [404954,12575] 0 2024-04-23T10:20:56.067 INFO:tasks.workunit.client.0.smithi029.stdout:9/223: mknod d0/d1b/d44/d49/c4b 0 2024-04-23T10:20:56.090 INFO:tasks.workunit.client.0.smithi029.stdout:9/224: dwrite d0/d7/d6/f47 [0,4194304] 0 2024-04-23T10:20:56.094 INFO:tasks.workunit.client.0.smithi029.stdout:9/225: write d0/d7/d3f/f40 [636933,80425] 0 2024-04-23T10:20:56.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/226: stat d0/d1b/d24/c29 0 2024-04-23T10:20:56.209 INFO:tasks.workunit.client.0.smithi029.stdout:2/141: sync 2024-04-23T10:20:56.209 INFO:tasks.workunit.client.0.smithi029.stdout:1/177: sync 2024-04-23T10:20:56.209 INFO:tasks.workunit.client.0.smithi029.stdout:3/150: sync 2024-04-23T10:20:56.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/310: sync 2024-04-23T10:20:56.209 INFO:tasks.workunit.client.0.smithi029.stdout:0/106: sync 2024-04-23T10:20:56.209 INFO:tasks.workunit.client.0.smithi029.stdout:6/220: sync 2024-04-23T10:20:56.209 INFO:tasks.workunit.client.0.smithi029.stdout:7/116: sync 2024-04-23T10:20:56.210 INFO:tasks.workunit.client.0.smithi029.stdout:4/230: sync 2024-04-23T10:20:56.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/117: write d5/d8/f25 [519985,42253] 0 2024-04-23T10:20:56.216 INFO:tasks.workunit.client.0.smithi029.stdout:3/151: creat d3/d10/f2b x:0 0 0 2024-04-23T10:20:56.216 INFO:tasks.workunit.client.0.smithi029.stdout:1/178: truncate d5/d6/de/d15/f20 4761003 0 2024-04-23T10:20:56.219 INFO:tasks.workunit.client.0.smithi029.stdout:0/107: mkdir d0/dc/d26 0 2024-04-23T10:20:56.223 INFO:tasks.workunit.client.0.smithi029.stdout:8/224: sync 2024-04-23T10:20:56.223 INFO:tasks.workunit.client.0.smithi029.stdout:9/227: sync 2024-04-23T10:20:56.226 INFO:tasks.workunit.client.0.smithi029.stdout:9/228: chown d0/d1b/l25 5988 1 2024-04-23T10:20:56.228 INFO:tasks.workunit.client.0.smithi029.stdout:5/311: dwrite d0/d35/d38/d3e/f59 [0,4194304] 0 2024-04-23T10:20:56.229 INFO:tasks.workunit.client.0.smithi029.stdout:2/142: dwrite d1/dd/d22/f2c [0,4194304] 0 2024-04-23T10:20:56.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/118: rmdir d5/d8/d1a 39 2024-04-23T10:20:56.234 INFO:tasks.workunit.client.0.smithi029.stdout:3/152: mknod d3/d10/d27/c2c 0 2024-04-23T10:20:56.238 INFO:tasks.workunit.client.0.smithi029.stdout:0/108: mkdir d0/dc/d27 0 2024-04-23T10:20:56.244 INFO:tasks.workunit.client.0.smithi029.stdout:5/312: dwrite d0/f2c [4194304,4194304] 0 2024-04-23T10:20:56.246 INFO:tasks.workunit.client.0.smithi029.stdout:6/221: creat d9/df/d16/d1f/d2c/f4a x:0 0 0 2024-04-23T10:20:56.247 INFO:tasks.workunit.client.0.smithi029.stdout:7/119: dwrite d5/f1f [0,4194304] 0 2024-04-23T10:20:56.253 INFO:tasks.workunit.client.0.smithi029.stdout:4/231: write d0/d12/d13/f42 [513198,72764] 0 2024-04-23T10:20:56.254 INFO:tasks.workunit.client.0.smithi029.stdout:9/229: creat d0/d7/d3f/f4c x:0 0 0 2024-04-23T10:20:56.261 INFO:tasks.workunit.client.0.smithi029.stdout:4/232: chown d0/l8 873 1 2024-04-23T10:20:56.267 INFO:tasks.workunit.client.0.smithi029.stdout:3/153: mknod d3/d10/de/c2d 0 2024-04-23T10:20:56.273 INFO:tasks.workunit.client.0.smithi029.stdout:0/109: fsync d0/f7 0 2024-04-23T10:20:56.275 INFO:tasks.workunit.client.0.smithi029.stdout:3/154: dread d3/d10/d13/f1a [0,4194304] 0 2024-04-23T10:20:56.281 INFO:tasks.workunit.client.0.smithi029.stdout:2/143: write d1/d4/f1e [1113988,81634] 0 2024-04-23T10:20:56.283 INFO:tasks.workunit.client.0.smithi029.stdout:2/144: chown d1/d4/l1a 224020634 1 2024-04-23T10:20:56.284 INFO:tasks.workunit.client.0.smithi029.stdout:6/222: dread d9/fe [0,4194304] 0 2024-04-23T10:20:56.284 INFO:tasks.workunit.client.0.smithi029.stdout:8/225: link d3/f1f d3/d38/f48 0 2024-04-23T10:20:56.291 INFO:tasks.workunit.client.0.smithi029.stdout:0/110: rename d0/f3 to d0/dc/d26/f28 0 2024-04-23T10:20:56.292 INFO:tasks.workunit.client.0.smithi029.stdout:5/313: dread d0/f19 [4194304,4194304] 0 2024-04-23T10:20:56.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/155: mkdir d3/d10/de/d2e 0 2024-04-23T10:20:56.293 INFO:tasks.workunit.client.0.smithi029.stdout:8/226: dwrite d3/f2d [0,4194304] 0 2024-04-23T10:20:56.294 INFO:tasks.workunit.client.0.smithi029.stdout:1/179: link d5/d6/de/d15/f3b d5/d6/de/f3c 0 2024-04-23T10:20:56.296 INFO:tasks.workunit.client.0.smithi029.stdout:7/120: creat d5/d29/f2a x:0 0 0 2024-04-23T10:20:56.296 INFO:tasks.workunit.client.0.smithi029.stdout:8/227: read d3/fd [2084282,12606] 0 2024-04-23T10:20:56.296 INFO:tasks.workunit.client.0.smithi029.stdout:6/223: readlink d9/l2f 0 2024-04-23T10:20:56.298 INFO:tasks.workunit.client.0.smithi029.stdout:7/121: write d5/d9/f26 [106929,82462] 0 2024-04-23T10:20:56.301 INFO:tasks.workunit.client.0.smithi029.stdout:8/228: dread d3/d38/f3d [0,4194304] 0 2024-04-23T10:20:56.306 INFO:tasks.workunit.client.0.smithi029.stdout:8/229: fsync d3/d2f/d36/f3a 0 2024-04-23T10:20:56.308 INFO:tasks.workunit.client.0.smithi029.stdout:1/180: dwrite d5/d6/de/d22/f2f [0,4194304] 0 2024-04-23T10:20:56.314 INFO:tasks.workunit.client.0.smithi029.stdout:0/111: dwrite d0/fd [0,4194304] 0 2024-04-23T10:20:56.315 INFO:tasks.workunit.client.0.smithi029.stdout:0/112: chown d0/dc/f15 7640 1 2024-04-23T10:20:56.316 INFO:tasks.workunit.client.0.smithi029.stdout:7/122: creat d5/d9/f2b x:0 0 0 2024-04-23T10:20:56.323 INFO:tasks.workunit.client.0.smithi029.stdout:6/224: dwrite d9/f29 [4194304,4194304] 0 2024-04-23T10:20:56.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/113: dwrite d0/dc/f23 [0,4194304] 0 2024-04-23T10:20:56.326 INFO:tasks.workunit.client.0.smithi029.stdout:3/156: creat d3/d10/de/d2e/f2f x:0 0 0 2024-04-23T10:20:56.342 INFO:tasks.workunit.client.0.smithi029.stdout:1/181: unlink d5/d6/de/d15/f20 0 2024-04-23T10:20:56.346 INFO:tasks.workunit.client.0.smithi029.stdout:9/230: getdents d0/d1b/d39 0 2024-04-23T10:20:56.352 INFO:tasks.workunit.client.0.smithi029.stdout:2/145: rename d1/dd/l20 to d1/l2d 0 2024-04-23T10:20:56.358 INFO:tasks.workunit.client.0.smithi029.stdout:8/230: dwrite d3/d2f/f35 [0,4194304] 0 2024-04-23T10:20:56.361 INFO:tasks.workunit.client.0.smithi029.stdout:7/123: link d5/d8/f25 d5/f2c 0 2024-04-23T10:20:56.364 INFO:tasks.workunit.client.0.smithi029.stdout:6/225: mknod d9/df/d16/d1f/c4b 0 2024-04-23T10:20:56.364 INFO:tasks.workunit.client.0.smithi029.stdout:1/182: write d5/f17 [2584441,112559] 0 2024-04-23T10:20:56.365 INFO:tasks.workunit.client.0.smithi029.stdout:6/226: read - d9/df/f22 zero size 2024-04-23T10:20:56.369 INFO:tasks.workunit.client.0.smithi029.stdout:0/114: link d0/dc/f1a d0/dc/d27/f29 0 2024-04-23T10:20:56.369 INFO:tasks.workunit.client.0.smithi029.stdout:5/314: link d0/d35/d38/d3e/f56 d0/d35/d38/d3e/f70 0 2024-04-23T10:20:56.369 INFO:tasks.workunit.client.0.smithi029.stdout:3/157: fdatasync d3/d10/de/f12 0 2024-04-23T10:20:56.370 INFO:tasks.workunit.client.0.smithi029.stdout:9/231: creat d0/d7/d1d/d35/d3b/f4d x:0 0 0 2024-04-23T10:20:56.371 INFO:tasks.workunit.client.0.smithi029.stdout:7/124: symlink d5/d9/l2d 0 2024-04-23T10:20:56.377 INFO:tasks.workunit.client.0.smithi029.stdout:9/232: dread d0/f1e [0,4194304] 0 2024-04-23T10:20:56.378 INFO:tasks.workunit.client.0.smithi029.stdout:1/183: symlink d5/d6/de/d27/l3d 0 2024-04-23T10:20:56.380 INFO:tasks.workunit.client.0.smithi029.stdout:8/231: write d3/d2f/d36/f40 [4821033,25407] 0 2024-04-23T10:20:56.381 INFO:tasks.workunit.client.0.smithi029.stdout:8/232: chown d3/c2e 1366655 1 2024-04-23T10:20:56.382 INFO:tasks.workunit.client.0.smithi029.stdout:4/233: sync 2024-04-23T10:20:56.385 INFO:tasks.workunit.client.0.smithi029.stdout:2/146: truncate d1/dd/d22/f2c 1885731 0 2024-04-23T10:20:56.388 INFO:tasks.workunit.client.0.smithi029.stdout:9/233: dwrite d0/d7/d6/f23 [0,4194304] 0 2024-04-23T10:20:56.389 INFO:tasks.workunit.client.0.smithi029.stdout:1/184: fsync d5/d6/de/f2e 0 2024-04-23T10:20:56.391 INFO:tasks.workunit.client.0.smithi029.stdout:0/115: unlink d0/l13 0 2024-04-23T10:20:56.392 INFO:tasks.workunit.client.0.smithi029.stdout:8/233: creat d3/d38/f49 x:0 0 0 2024-04-23T10:20:56.394 INFO:tasks.workunit.client.0.smithi029.stdout:8/234: chown d3/l20 19 1 2024-04-23T10:20:56.394 INFO:tasks.workunit.client.0.smithi029.stdout:4/234: symlink d0/d12/l4c 0 2024-04-23T10:20:56.394 INFO:tasks.workunit.client.0.smithi029.stdout:6/227: dread d9/df/d16/d1f/f38 [0,4194304] 0 2024-04-23T10:20:56.396 INFO:tasks.workunit.client.0.smithi029.stdout:5/315: getdents d0/d35/d38/d39/d3f/d6f 0 2024-04-23T10:20:56.396 INFO:tasks.workunit.client.0.smithi029.stdout:5/316: stat d0/f65 0 2024-04-23T10:20:56.399 INFO:tasks.workunit.client.0.smithi029.stdout:7/125: dwrite d5/d8/fb [0,4194304] 0 2024-04-23T10:20:56.403 INFO:tasks.workunit.client.0.smithi029.stdout:9/234: unlink d0/f1c 0 2024-04-23T10:20:56.404 INFO:tasks.workunit.client.0.smithi029.stdout:1/185: mkdir d5/d3e 0 2024-04-23T10:20:56.405 INFO:tasks.workunit.client.0.smithi029.stdout:1/186: readlink d5/d6/l28 0 2024-04-23T10:20:56.406 INFO:tasks.workunit.client.0.smithi029.stdout:1/187: chown d5/d6/ff 1883659 1 2024-04-23T10:20:56.410 INFO:tasks.workunit.client.0.smithi029.stdout:0/116: creat d0/dc/f2a x:0 0 0 2024-04-23T10:20:56.411 INFO:tasks.workunit.client.0.smithi029.stdout:8/235: creat d3/d2f/d36/f4a x:0 0 0 2024-04-23T10:20:56.411 INFO:tasks.workunit.client.0.smithi029.stdout:9/235: dread d0/d7/d1d/d35/f3a [0,4194304] 0 2024-04-23T10:20:56.411 INFO:tasks.workunit.client.0.smithi029.stdout:6/228: mkdir d9/df/d16/d44/d4c 0 2024-04-23T10:20:56.412 INFO:tasks.workunit.client.0.smithi029.stdout:9/236: chown d0/d7/d1d 98399 1 2024-04-23T10:20:56.413 INFO:tasks.workunit.client.0.smithi029.stdout:3/158: link d3/l4 d3/d10/d13/d1c/l30 0 2024-04-23T10:20:56.413 INFO:tasks.workunit.client.0.smithi029.stdout:3/159: readlink d3/l4 0 2024-04-23T10:20:56.414 INFO:tasks.workunit.client.0.smithi029.stdout:5/317: dread d0/d35/d38/d51/f44 [0,4194304] 0 2024-04-23T10:20:56.420 INFO:tasks.workunit.client.0.smithi029.stdout:8/236: unlink d3/d38/f48 0 2024-04-23T10:20:56.421 INFO:tasks.workunit.client.0.smithi029.stdout:2/147: creat d1/f2e x:0 0 0 2024-04-23T10:20:56.421 INFO:tasks.workunit.client.0.smithi029.stdout:6/229: mknod d9/df/c4d 0 2024-04-23T10:20:56.422 INFO:tasks.workunit.client.0.smithi029.stdout:9/237: symlink d0/d1b/l4e 0 2024-04-23T10:20:56.422 INFO:tasks.workunit.client.0.smithi029.stdout:3/160: write f0 [475850,33160] 0 2024-04-23T10:20:56.423 INFO:tasks.workunit.client.0.smithi029.stdout:5/318: creat d0/d35/d10/f71 x:0 0 0 2024-04-23T10:20:56.423 INFO:tasks.workunit.client.0.smithi029.stdout:3/161: readlink d3/l4 0 2024-04-23T10:20:56.424 INFO:tasks.workunit.client.0.smithi029.stdout:7/126: link d5/f28 d5/d9/f2e 0 2024-04-23T10:20:56.425 INFO:tasks.workunit.client.0.smithi029.stdout:7/127: chown d5/f28 10707931 1 2024-04-23T10:20:56.425 INFO:tasks.workunit.client.0.smithi029.stdout:7/128: fsync d5/d9/f2b 0 2024-04-23T10:20:56.427 INFO:tasks.workunit.client.0.smithi029.stdout:2/148: mknod d1/d4/d25/c2f 0 2024-04-23T10:20:56.428 INFO:tasks.workunit.client.0.smithi029.stdout:9/238: fdatasync d0/d7/d6/fe 0 2024-04-23T10:20:56.429 INFO:tasks.workunit.client.0.smithi029.stdout:5/319: mkdir d0/db/d6d/d72 0 2024-04-23T10:20:56.429 INFO:tasks.workunit.client.0.smithi029.stdout:1/188: link d5/d6/d34/l36 d5/d6/de/d27/d38/l3f 0 2024-04-23T10:20:56.430 INFO:tasks.workunit.client.0.smithi029.stdout:8/237: symlink d3/l4b 0 2024-04-23T10:20:56.431 INFO:tasks.workunit.client.0.smithi029.stdout:0/117: creat d0/f2b x:0 0 0 2024-04-23T10:20:56.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/149: rmdir d1/dd 39 2024-04-23T10:20:56.434 INFO:tasks.workunit.client.0.smithi029.stdout:3/162: dwrite d3/f5 [0,4194304] 0 2024-04-23T10:20:56.435 INFO:tasks.workunit.client.0.smithi029.stdout:3/163: write d3/d15/f18 [2648375,937] 0 2024-04-23T10:20:56.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/238: creat d3/d2f/f4c x:0 0 0 2024-04-23T10:20:56.438 INFO:tasks.workunit.client.0.smithi029.stdout:0/118: mknod d0/d21/c2c 0 2024-04-23T10:20:56.441 INFO:tasks.workunit.client.0.smithi029.stdout:9/239: write d0/d7/f10 [646772,10203] 0 2024-04-23T10:20:56.443 INFO:tasks.workunit.client.0.smithi029.stdout:9/240: fsync d0/d1b/f31 0 2024-04-23T10:20:56.445 INFO:tasks.workunit.client.0.smithi029.stdout:1/189: rename d5/d6/de/f3c to d5/d6/f40 0 2024-04-23T10:20:56.447 INFO:tasks.workunit.client.0.smithi029.stdout:6/230: write d9/df/d16/f2a [3199097,97983] 0 2024-04-23T10:20:56.448 INFO:tasks.workunit.client.0.smithi029.stdout:0/119: creat d0/d1b/f2d x:0 0 0 2024-04-23T10:20:56.450 INFO:tasks.workunit.client.0.smithi029.stdout:1/190: write d5/d6/de/f33 [381573,19380] 0 2024-04-23T10:20:56.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/120: fdatasync d0/fd 0 2024-04-23T10:20:56.450 INFO:tasks.workunit.client.0.smithi029.stdout:9/241: truncate d0/d7/f17 4423033 0 2024-04-23T10:20:56.454 INFO:tasks.workunit.client.0.smithi029.stdout:7/129: rename d5/l13 to d5/d8/d1a/l2f 0 2024-04-23T10:20:56.455 INFO:tasks.workunit.client.0.smithi029.stdout:2/150: link d1/d4/d25/c2f d1/dd/d22/c30 0 2024-04-23T10:20:56.456 INFO:tasks.workunit.client.0.smithi029.stdout:6/231: creat d9/df/d16/d1f/d27/d33/f4e x:0 0 0 2024-04-23T10:20:56.457 INFO:tasks.workunit.client.0.smithi029.stdout:7/130: fdatasync d5/d9/f2b 0 2024-04-23T10:20:56.458 INFO:tasks.workunit.client.0.smithi029.stdout:9/242: mkdir d0/d1b/d39/d4f 0 2024-04-23T10:20:56.458 INFO:tasks.workunit.client.0.smithi029.stdout:5/320: dwrite d0/d35/d38/d51/f25 [0,4194304] 0 2024-04-23T10:20:56.459 INFO:tasks.workunit.client.0.smithi029.stdout:1/191: creat d5/d3e/f41 x:0 0 0 2024-04-23T10:20:56.463 INFO:tasks.workunit.client.0.smithi029.stdout:9/243: write d0/d7/d15/f16 [582839,99374] 0 2024-04-23T10:20:56.463 INFO:tasks.workunit.client.0.smithi029.stdout:7/131: truncate d5/f24 737145 0 2024-04-23T10:20:56.464 INFO:tasks.workunit.client.0.smithi029.stdout:1/192: stat d5/d6/de/d22/f25 0 2024-04-23T10:20:56.487 INFO:tasks.workunit.client.0.smithi029.stdout:8/239: dwrite d3/f11 [0,4194304] 0 2024-04-23T10:20:56.488 INFO:tasks.workunit.client.0.smithi029.stdout:7/132: stat d5/d8/f25 0 2024-04-23T10:20:56.490 INFO:tasks.workunit.client.0.smithi029.stdout:9/244: chown d0/d1b/d24/c29 1 1 2024-04-23T10:20:56.491 INFO:tasks.workunit.client.0.smithi029.stdout:2/151: write d1/dd/d22/f2c [2285022,39691] 0 2024-04-23T10:20:56.492 INFO:tasks.workunit.client.0.smithi029.stdout:0/121: dwrite d0/d1b/f2d [0,4194304] 0 2024-04-23T10:20:56.493 INFO:tasks.workunit.client.0.smithi029.stdout:7/133: creat d5/f30 x:0 0 0 2024-04-23T10:20:56.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/240: creat d3/d38/f4d x:0 0 0 2024-04-23T10:20:56.496 INFO:tasks.workunit.client.0.smithi029.stdout:1/193: rename d5/l2c to d5/d6/de/d27/l42 0 2024-04-23T10:20:56.499 INFO:tasks.workunit.client.0.smithi029.stdout:8/241: mknod d3/d2f/d36/d3e/c4e 0 2024-04-23T10:20:56.500 INFO:tasks.workunit.client.0.smithi029.stdout:2/152: mkdir d1/d31 0 2024-04-23T10:20:56.503 INFO:tasks.workunit.client.0.smithi029.stdout:9/245: rename d0/d7/d15 to d0/d1b/d39/d50 0 2024-04-23T10:20:56.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/321: truncate d0/d35/d38/d3e/f59 439942 0 2024-04-23T10:20:56.507 INFO:tasks.workunit.client.0.smithi029.stdout:2/153: mknod d1/d4/d25/c32 0 2024-04-23T10:20:56.509 INFO:tasks.workunit.client.0.smithi029.stdout:0/122: rename d0/f20 to d0/dc/d26/f2e 0 2024-04-23T10:20:56.509 INFO:tasks.workunit.client.0.smithi029.stdout:7/134: rename d5/d8/d1a to d5/d8/d1a/d31 22 2024-04-23T10:20:56.509 INFO:tasks.workunit.client.0.smithi029.stdout:9/246: creat d0/d7/d1d/d35/d3b/f51 x:0 0 0 2024-04-23T10:20:56.512 INFO:tasks.workunit.client.0.smithi029.stdout:2/154: mknod d1/dd/d22/c33 0 2024-04-23T10:20:56.512 INFO:tasks.workunit.client.0.smithi029.stdout:9/247: stat d0/d7/d1d/d35/d3b/f4d 0 2024-04-23T10:20:56.513 INFO:tasks.workunit.client.0.smithi029.stdout:1/194: link d5/lb d5/d6/de/l43 0 2024-04-23T10:20:56.515 INFO:tasks.workunit.client.0.smithi029.stdout:8/242: getdents d3/d44 0 2024-04-23T10:20:56.515 INFO:tasks.workunit.client.0.smithi029.stdout:2/155: mknod d1/d4/d25/c34 0 2024-04-23T10:20:56.515 INFO:tasks.workunit.client.0.smithi029.stdout:1/195: read d5/d6/f19 [948610,98917] 0 2024-04-23T10:20:56.517 INFO:tasks.workunit.client.0.smithi029.stdout:7/135: creat d5/d8/f32 x:0 0 0 2024-04-23T10:20:56.518 INFO:tasks.workunit.client.0.smithi029.stdout:1/196: fdatasync d5/d6/ff 0 2024-04-23T10:20:56.519 INFO:tasks.workunit.client.0.smithi029.stdout:5/322: dwrite d0/d35/d10/f71 [0,4194304] 0 2024-04-23T10:20:56.519 INFO:tasks.workunit.client.0.smithi029.stdout:8/243: write d3/d2f/d36/d3e/f41 [317188,83910] 0 2024-04-23T10:20:56.525 INFO:tasks.workunit.client.0.smithi029.stdout:0/123: creat d0/f2f x:0 0 0 2024-04-23T10:20:56.526 INFO:tasks.workunit.client.0.smithi029.stdout:9/248: rename d0/d7/cd to d0/d7/c52 0 2024-04-23T10:20:56.530 INFO:tasks.workunit.client.0.smithi029.stdout:5/323: creat d0/d35/d38/d39/f73 x:0 0 0 2024-04-23T10:20:56.530 INFO:tasks.workunit.client.0.smithi029.stdout:0/124: write d0/f7 [2696928,83732] 0 2024-04-23T10:20:56.532 INFO:tasks.workunit.client.0.smithi029.stdout:0/125: read d0/f4 [2844137,129747] 0 2024-04-23T10:20:56.535 INFO:tasks.workunit.client.0.smithi029.stdout:2/156: mknod d1/d31/c35 0 2024-04-23T10:20:56.536 INFO:tasks.workunit.client.0.smithi029.stdout:1/197: link d5/d6/de/f33 d5/d6/de/d27/d38/f44 0 2024-04-23T10:20:56.541 INFO:tasks.workunit.client.0.smithi029.stdout:9/249: link d0/d1b/d39/d50/f16 d0/d7/d3f/f53 0 2024-04-23T10:20:56.542 INFO:tasks.workunit.client.0.smithi029.stdout:0/126: creat d0/dc/d27/f30 x:0 0 0 2024-04-23T10:20:56.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/324: dwrite d0/f2f [0,4194304] 0 2024-04-23T10:20:56.545 INFO:tasks.workunit.client.0.smithi029.stdout:1/198: rename d5/d6/f39 to d5/d6/de/d22/f45 0 2024-04-23T10:20:56.545 INFO:tasks.workunit.client.0.smithi029.stdout:9/250: read d0/d7/d3f/f40 [112503,84080] 0 2024-04-23T10:20:56.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/136: dread d5/d8/fc [0,4194304] 0 2024-04-23T10:20:56.549 INFO:tasks.workunit.client.0.smithi029.stdout:0/127: rename d0/dc/f2a to d0/dc/d27/f31 0 2024-04-23T10:20:56.550 INFO:tasks.workunit.client.0.smithi029.stdout:9/251: fsync d0/d7/d3f/f40 0 2024-04-23T10:20:56.552 INFO:tasks.workunit.client.0.smithi029.stdout:2/157: link d1/d4/l6 d1/d31/l36 0 2024-04-23T10:20:56.556 INFO:tasks.workunit.client.0.smithi029.stdout:0/128: write d0/dc/f11 [2641674,122946] 0 2024-04-23T10:20:56.557 INFO:tasks.workunit.client.0.smithi029.stdout:9/252: creat d0/d1b/d44/d49/f54 x:0 0 0 2024-04-23T10:20:56.559 INFO:tasks.workunit.client.0.smithi029.stdout:5/325: getdents d0/d35/d38 0 2024-04-23T10:20:56.563 INFO:tasks.workunit.client.0.smithi029.stdout:0/129: chown d0/dc/l14 61170480 1 2024-04-23T10:20:56.564 INFO:tasks.workunit.client.0.smithi029.stdout:7/137: dwrite d5/f18 [0,4194304] 0 2024-04-23T10:20:56.567 INFO:tasks.workunit.client.0.smithi029.stdout:2/158: dwrite d1/dd/d22/f2c [0,4194304] 0 2024-04-23T10:20:56.573 INFO:tasks.workunit.client.0.smithi029.stdout:1/199: dwrite d5/d6/f19 [0,4194304] 0 2024-04-23T10:20:56.577 INFO:tasks.workunit.client.0.smithi029.stdout:0/130: readlink d0/l9 0 2024-04-23T10:20:56.578 INFO:tasks.workunit.client.0.smithi029.stdout:7/138: rename d5/d8/f10 to d5/d9/f33 0 2024-04-23T10:20:56.578 INFO:tasks.workunit.client.0.smithi029.stdout:2/159: symlink d1/d31/l37 0 2024-04-23T10:20:56.579 INFO:tasks.workunit.client.0.smithi029.stdout:5/326: dwrite d0/f12 [0,4194304] 0 2024-04-23T10:20:56.580 INFO:tasks.workunit.client.0.smithi029.stdout:1/200: creat d5/d6/de/d27/f46 x:0 0 0 2024-04-23T10:20:56.582 INFO:tasks.workunit.client.0.smithi029.stdout:7/139: chown d5/d8/d1a/f21 15685756 1 2024-04-23T10:20:56.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/327: unlink d0/l2a 0 2024-04-23T10:20:56.591 INFO:tasks.workunit.client.0.smithi029.stdout:7/140: symlink d5/l34 0 2024-04-23T10:20:56.591 INFO:tasks.workunit.client.0.smithi029.stdout:0/131: dread d0/f7 [0,4194304] 0 2024-04-23T10:20:56.593 INFO:tasks.workunit.client.0.smithi029.stdout:9/253: write d0/d7/f8 [1863338,45231] 0 2024-04-23T10:20:56.594 INFO:tasks.workunit.client.0.smithi029.stdout:1/201: read d5/d6/de/f33 [125519,79988] 0 2024-04-23T10:20:56.595 INFO:tasks.workunit.client.0.smithi029.stdout:1/202: stat d5/d6/de/c14 0 2024-04-23T10:20:56.596 INFO:tasks.workunit.client.0.smithi029.stdout:7/141: symlink d5/d8/d1a/l35 0 2024-04-23T10:20:56.601 INFO:tasks.workunit.client.0.smithi029.stdout:7/142: fsync d5/d9/f26 0 2024-04-23T10:20:56.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/132: rename d0/dc/l25 to d0/d21/l32 0 2024-04-23T10:20:56.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/203: mkdir d5/d6/de/d27/d38/d47 0 2024-04-23T10:20:56.607 INFO:tasks.workunit.client.0.smithi029.stdout:9/254: dread d0/d1b/f31 [0,4194304] 0 2024-04-23T10:20:56.608 INFO:tasks.workunit.client.0.smithi029.stdout:1/204: write d5/d6/f16 [2841002,75417] 0 2024-04-23T10:20:56.609 INFO:tasks.workunit.client.0.smithi029.stdout:5/328: rename d0/f17 to d0/d35/d38/d39/d3f/f74 0 2024-04-23T10:20:56.610 INFO:tasks.workunit.client.0.smithi029.stdout:1/205: chown d5/d6/de/d22/f23 356835 1 2024-04-23T10:20:56.611 INFO:tasks.workunit.client.0.smithi029.stdout:7/143: creat d5/d8/f36 x:0 0 0 2024-04-23T10:20:56.613 INFO:tasks.workunit.client.0.smithi029.stdout:7/144: truncate d5/fe 5073209 0 2024-04-23T10:20:56.614 INFO:tasks.workunit.client.0.smithi029.stdout:9/255: rename d0/f2d to d0/d7/d6/f55 0 2024-04-23T10:20:56.615 INFO:tasks.workunit.client.0.smithi029.stdout:9/256: write d0/d7/f10 [375926,8346] 0 2024-04-23T10:20:56.615 INFO:tasks.workunit.client.0.smithi029.stdout:1/206: fsync d5/d6/f40 0 2024-04-23T10:20:56.618 INFO:tasks.workunit.client.0.smithi029.stdout:7/145: creat d5/d29/f37 x:0 0 0 2024-04-23T10:20:56.619 INFO:tasks.workunit.client.0.smithi029.stdout:2/160: dread d1/d4/f11 [0,4194304] 0 2024-04-23T10:20:56.619 INFO:tasks.workunit.client.0.smithi029.stdout:7/146: write f1 [1924874,98702] 0 2024-04-23T10:20:56.620 INFO:tasks.workunit.client.0.smithi029.stdout:5/329: creat d0/f75 x:0 0 0 2024-04-23T10:20:56.624 INFO:tasks.workunit.client.0.smithi029.stdout:7/147: creat d5/d29/f38 x:0 0 0 2024-04-23T10:20:56.626 INFO:tasks.workunit.client.0.smithi029.stdout:5/330: mknod d0/d35/d49/c76 0 2024-04-23T10:20:56.628 INFO:tasks.workunit.client.0.smithi029.stdout:9/257: dwrite d0/d7/f12 [0,4194304] 0 2024-04-23T10:20:56.629 INFO:tasks.workunit.client.0.smithi029.stdout:2/161: getdents d1/dd/d22 0 2024-04-23T10:20:56.632 INFO:tasks.workunit.client.0.smithi029.stdout:2/162: creat d1/d4/d25/f38 x:0 0 0 2024-04-23T10:20:56.633 INFO:tasks.workunit.client.0.smithi029.stdout:9/258: chown d0/d1b/d24 7543 1 2024-04-23T10:20:56.633 INFO:tasks.workunit.client.0.smithi029.stdout:0/133: truncate d0/f6 457233 0 2024-04-23T10:20:56.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/163: stat d1/d4/d25/f38 0 2024-04-23T10:20:56.637 INFO:tasks.workunit.client.0.smithi029.stdout:2/164: rmdir d1/dd/d22 39 2024-04-23T10:20:56.639 INFO:tasks.workunit.client.0.smithi029.stdout:7/148: dwrite d5/ff [4194304,4194304] 0 2024-04-23T10:20:56.640 INFO:tasks.workunit.client.0.smithi029.stdout:9/259: rename d0/d7/d1d/c37 to d0/d1b/d39/d50/c56 0 2024-04-23T10:20:56.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/165: truncate d1/d4/d25/f38 703050 0 2024-04-23T10:20:56.643 INFO:tasks.workunit.client.0.smithi029.stdout:0/134: link d0/d1b/f2d d0/dc/d26/f33 0 2024-04-23T10:20:56.643 INFO:tasks.workunit.client.0.smithi029.stdout:7/149: symlink d5/d8/l39 0 2024-04-23T10:20:56.644 INFO:tasks.workunit.client.0.smithi029.stdout:2/166: symlink d1/d4/d25/l39 0 2024-04-23T10:20:56.644 INFO:tasks.workunit.client.0.smithi029.stdout:0/135: readlink d0/dc/l14 0 2024-04-23T10:20:56.645 INFO:tasks.workunit.client.0.smithi029.stdout:7/150: dread - d5/d8/f23 zero size 2024-04-23T10:20:56.645 INFO:tasks.workunit.client.0.smithi029.stdout:2/167: dread - d1/f2e zero size 2024-04-23T10:20:56.646 INFO:tasks.workunit.client.0.smithi029.stdout:2/168: readlink d1/d31/l37 0 2024-04-23T10:20:56.646 INFO:tasks.workunit.client.0.smithi029.stdout:0/136: mknod d0/dc/c34 0 2024-04-23T10:20:56.647 INFO:tasks.workunit.client.0.smithi029.stdout:1/207: dread d5/d6/ff [0,4194304] 0 2024-04-23T10:20:56.647 INFO:tasks.workunit.client.0.smithi029.stdout:7/151: creat d5/d9/f3a x:0 0 0 2024-04-23T10:20:56.651 INFO:tasks.workunit.client.0.smithi029.stdout:7/152: write d5/f17 [3718999,125261] 0 2024-04-23T10:20:56.651 INFO:tasks.workunit.client.0.smithi029.stdout:0/137: dread d0/f7 [4194304,4194304] 0 2024-04-23T10:20:56.653 INFO:tasks.workunit.client.0.smithi029.stdout:1/208: chown d5/d6/de/d22/f23 970 1 2024-04-23T10:20:56.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/153: dread - d5/d9/f2e zero size 2024-04-23T10:20:56.656 INFO:tasks.workunit.client.0.smithi029.stdout:9/260: dwrite d0/d7/d3f/f41 [0,4194304] 0 2024-04-23T10:20:56.660 INFO:tasks.workunit.client.0.smithi029.stdout:7/154: creat d5/d29/f3b x:0 0 0 2024-04-23T10:20:56.663 INFO:tasks.workunit.client.0.smithi029.stdout:9/261: rename d0/f38 to d0/d7/d1d/f57 0 2024-04-23T10:20:56.664 INFO:tasks.workunit.client.0.smithi029.stdout:2/169: dwrite d1/d4/f11 [4194304,4194304] 0 2024-04-23T10:20:56.670 INFO:tasks.workunit.client.0.smithi029.stdout:5/331: write d0/d35/d49/f54 [1101797,69715] 0 2024-04-23T10:20:56.671 INFO:tasks.workunit.client.0.smithi029.stdout:9/262: mknod d0/d1b/d39/d4f/c58 0 2024-04-23T10:20:56.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/209: link d5/d6/de/c14 d5/d6/c48 0 2024-04-23T10:20:56.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/332: dread - d0/db/d6d/f58 zero size 2024-04-23T10:20:56.681 INFO:tasks.workunit.client.0.smithi029.stdout:5/333: chown d0/d35/d38/f4b 180 1 2024-04-23T10:20:56.686 INFO:tasks.workunit.client.0.smithi029.stdout:2/170: getdents d1/d4/d25 0 2024-04-23T10:20:56.688 INFO:tasks.workunit.client.0.smithi029.stdout:0/138: dread d0/f1 [0,4194304] 0 2024-04-23T10:20:56.690 INFO:tasks.workunit.client.0.smithi029.stdout:1/210: dread d5/d6/de/d22/f30 [0,4194304] 0 2024-04-23T10:20:56.690 INFO:tasks.workunit.client.0.smithi029.stdout:0/139: dread - d0/dc/d27/f29 zero size 2024-04-23T10:20:56.692 INFO:tasks.workunit.client.0.smithi029.stdout:5/334: creat d0/d35/d38/d3e/d66/d5a/f77 x:0 0 0 2024-04-23T10:20:56.692 INFO:tasks.workunit.client.0.smithi029.stdout:7/155: dread f1 [0,4194304] 0 2024-04-23T10:20:56.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/211: chown d5/d6/c3a 2123 1 2024-04-23T10:20:56.693 INFO:tasks.workunit.client.0.smithi029.stdout:5/335: write d0/db/d3d/f5d [310511,61215] 0 2024-04-23T10:20:56.695 INFO:tasks.workunit.client.0.smithi029.stdout:0/140: symlink d0/dc/l35 0 2024-04-23T10:20:56.696 INFO:tasks.workunit.client.0.smithi029.stdout:7/156: chown d5/l1d 594 1 2024-04-23T10:20:56.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/171: mknod d1/dd/d22/c3a 0 2024-04-23T10:20:56.698 INFO:tasks.workunit.client.0.smithi029.stdout:2/172: write d1/d4/f1e [863026,77019] 0 2024-04-23T10:20:56.698 INFO:tasks.workunit.client.0.smithi029.stdout:7/157: symlink d5/d8/d1a/l3c 0 2024-04-23T10:20:56.699 INFO:tasks.workunit.client.0.smithi029.stdout:2/173: chown d1/d4/d25/f38 430607141 1 2024-04-23T10:20:56.699 INFO:tasks.workunit.client.0.smithi029.stdout:1/212: rename d5/d6/c3a to d5/d6/c49 0 2024-04-23T10:20:56.701 INFO:tasks.workunit.client.0.smithi029.stdout:2/174: mkdir d1/d4/d25/d3b 0 2024-04-23T10:20:56.702 INFO:tasks.workunit.client.0.smithi029.stdout:7/158: symlink d5/d8/l3d 0 2024-04-23T10:20:56.702 INFO:tasks.workunit.client.0.smithi029.stdout:2/175: write d1/dd/d22/f2c [709884,65503] 0 2024-04-23T10:20:56.703 INFO:tasks.workunit.client.0.smithi029.stdout:7/159: mknod d5/d29/c3e 0 2024-04-23T10:20:56.704 INFO:tasks.workunit.client.0.smithi029.stdout:7/160: chown d5/c22 1383243802 1 2024-04-23T10:20:56.705 INFO:tasks.workunit.client.0.smithi029.stdout:7/161: dread - d5/d8/f36 zero size 2024-04-23T10:20:56.705 INFO:tasks.workunit.client.0.smithi029.stdout:2/176: symlink d1/dd/l3c 0 2024-04-23T10:20:56.706 INFO:tasks.workunit.client.0.smithi029.stdout:7/162: rmdir d5 39 2024-04-23T10:20:56.707 INFO:tasks.workunit.client.0.smithi029.stdout:2/177: mkdir d1/d31/d3d 0 2024-04-23T10:20:56.712 INFO:tasks.workunit.client.0.smithi029.stdout:2/178: dread d1/dd/d22/f2c [0,4194304] 0 2024-04-23T10:20:56.714 INFO:tasks.workunit.client.0.smithi029.stdout:7/163: dwrite d5/d8/f32 [0,4194304] 0 2024-04-23T10:20:56.864 INFO:tasks.workunit.client.0.smithi029.stdout:4/235: sync 2024-04-23T10:20:56.867 INFO:tasks.workunit.client.0.smithi029.stdout:7/164: creat d5/d9/f3f x:0 0 0 2024-04-23T10:20:56.868 INFO:tasks.workunit.client.0.smithi029.stdout:7/165: fdatasync d5/d9/f3a 0 2024-04-23T10:20:56.879 INFO:tasks.workunit.client.0.smithi029.stdout:4/236: link d0/d12/d13/c33 d0/d12/d13/c4d 0 2024-04-23T10:20:56.887 INFO:tasks.workunit.client.0.smithi029.stdout:2/179: rename d1/d4/d25 to d1/d3e 0 2024-04-23T10:20:56.893 INFO:tasks.workunit.client.0.smithi029.stdout:7/166: getdents d5/d9 0 2024-04-23T10:20:56.896 INFO:tasks.workunit.client.0.smithi029.stdout:2/180: dread d1/d4/f11 [4194304,4194304] 0 2024-04-23T10:20:56.897 INFO:tasks.workunit.client.0.smithi029.stdout:2/181: dread - d1/f2e zero size 2024-04-23T10:20:56.906 INFO:tasks.workunit.client.0.smithi029.stdout:2/182: rename d1/d4/l28 to d1/l3f 0 2024-04-23T10:20:56.910 INFO:tasks.workunit.client.0.smithi029.stdout:2/183: symlink d1/d31/d3d/l40 0 2024-04-23T10:20:56.915 INFO:tasks.workunit.client.0.smithi029.stdout:2/184: rename d1/dd/ff to d1/d31/d3d/f41 0 2024-04-23T10:20:56.923 INFO:tasks.workunit.client.0.smithi029.stdout:2/185: rename d1/d31/l37 to d1/d4/l42 0 2024-04-23T10:20:56.927 INFO:tasks.workunit.client.0.smithi029.stdout:2/186: symlink d1/d4/l43 0 2024-04-23T10:20:56.933 INFO:tasks.workunit.client.0.smithi029.stdout:2/187: creat d1/d4/f44 x:0 0 0 2024-04-23T10:20:56.946 INFO:tasks.workunit.client.0.smithi029.stdout:2/188: link d1/d31/l36 d1/dd/l45 0 2024-04-23T10:20:56.950 INFO:tasks.workunit.client.0.smithi029.stdout:4/237: dwrite d0/d12/d13/f14 [0,4194304] 0 2024-04-23T10:20:56.954 INFO:tasks.workunit.client.0.smithi029.stdout:4/238: chown d0/f27 128074975 1 2024-04-23T10:20:56.956 INFO:tasks.workunit.client.0.smithi029.stdout:2/189: mknod d1/d31/c46 0 2024-04-23T10:20:56.957 INFO:tasks.workunit.client.0.smithi029.stdout:7/167: dwrite d5/f2c [0,4194304] 0 2024-04-23T10:20:56.958 INFO:tasks.workunit.client.0.smithi029.stdout:2/190: read - d1/f2e zero size 2024-04-23T10:20:56.961 INFO:tasks.workunit.client.0.smithi029.stdout:2/191: chown d1/dd/d22/c27 34 1 2024-04-23T10:20:56.966 INFO:tasks.workunit.client.0.smithi029.stdout:4/239: symlink d0/d12/d13/d1b/d36/d45/l4e 0 2024-04-23T10:20:56.974 INFO:tasks.workunit.client.0.smithi029.stdout:2/192: mkdir d1/dd/d47 0 2024-04-23T10:20:56.978 INFO:tasks.workunit.client.0.smithi029.stdout:2/193: dread - d1/d4/f44 zero size 2024-04-23T10:20:56.985 INFO:tasks.workunit.client.0.smithi029.stdout:7/168: truncate d5/f1f 1603225 0 2024-04-23T10:20:56.986 INFO:tasks.workunit.client.0.smithi029.stdout:7/169: chown d5 1984831 1 2024-04-23T10:20:56.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/194: symlink d1/dd/l48 0 2024-04-23T10:20:56.988 INFO:tasks.workunit.client.0.smithi029.stdout:4/240: getdents d0/d12/d13/d1b/d36/d45 0 2024-04-23T10:20:56.990 INFO:tasks.workunit.client.0.smithi029.stdout:2/195: rmdir d1/d31 39 2024-04-23T10:20:56.995 INFO:tasks.workunit.client.0.smithi029.stdout:7/170: getdents d5/d29 0 2024-04-23T10:20:56.998 INFO:tasks.workunit.client.0.smithi029.stdout:4/241: truncate d0/d12/d13/d20/f3d 3674438 0 2024-04-23T10:20:57.005 INFO:tasks.workunit.client.0.smithi029.stdout:7/171: rename d5/l1d to d5/d9/l40 0 2024-04-23T10:20:57.009 INFO:tasks.workunit.client.0.smithi029.stdout:2/196: write d1/dd/f1d [539851,17336] 0 2024-04-23T10:20:57.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/172: creat d5/f41 x:0 0 0 2024-04-23T10:20:57.020 INFO:tasks.workunit.client.0.smithi029.stdout:2/197: unlink d1/dd/l10 0 2024-04-23T10:20:57.022 INFO:tasks.workunit.client.0.smithi029.stdout:2/198: chown d1/dd/d22 2537 1 2024-04-23T10:20:57.024 INFO:tasks.workunit.client.0.smithi029.stdout:2/199: write d1/d4/f1e [882996,19313] 0 2024-04-23T10:20:57.029 INFO:tasks.workunit.client.0.smithi029.stdout:7/173: symlink d5/d8/l42 0 2024-04-23T10:20:57.030 INFO:tasks.workunit.client.0.smithi029.stdout:7/174: dread - d5/d29/f37 zero size 2024-04-23T10:20:57.031 INFO:tasks.workunit.client.0.smithi029.stdout:2/200: chown d1/d31/d3d/l40 1482182 1 2024-04-23T10:20:57.032 INFO:tasks.workunit.client.0.smithi029.stdout:7/175: dread - d5/d8/d1a/f21 zero size 2024-04-23T10:20:57.037 INFO:tasks.workunit.client.0.smithi029.stdout:4/242: dread d0/f27 [0,4194304] 0 2024-04-23T10:20:57.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/201: creat d1/dd/f49 x:0 0 0 2024-04-23T10:20:57.039 INFO:tasks.workunit.client.0.smithi029.stdout:7/176: link d5/d8/fb d5/d8/f43 0 2024-04-23T10:20:57.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/177: read - d5/d9/f2b zero size 2024-04-23T10:20:57.041 INFO:tasks.workunit.client.0.smithi029.stdout:4/243: mkdir d0/d12/d13/d1b/d36/d45/d4f 0 2024-04-23T10:20:57.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/178: dread - d5/d8/d1a/f21 zero size 2024-04-23T10:20:57.043 INFO:tasks.workunit.client.0.smithi029.stdout:4/244: chown d0/d12/d13/d1b/d36/d45/l4a 20939993 1 2024-04-23T10:20:57.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/202: getdents d1/d31/d3d 0 2024-04-23T10:20:57.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/179: write d5/d9/f33 [3371114,1052] 0 2024-04-23T10:20:57.045 INFO:tasks.workunit.client.0.smithi029.stdout:4/245: write d0/fd [695554,128600] 0 2024-04-23T10:20:57.048 INFO:tasks.workunit.client.0.smithi029.stdout:4/246: write d0/f6 [153419,115474] 0 2024-04-23T10:20:57.049 INFO:tasks.workunit.client.0.smithi029.stdout:4/247: readlink d0/d12/l4c 0 2024-04-23T10:20:57.050 INFO:tasks.workunit.client.0.smithi029.stdout:4/248: stat d0/f3f 0 2024-04-23T10:20:57.052 INFO:tasks.workunit.client.0.smithi029.stdout:4/249: dread - d0/d12/f43 zero size 2024-04-23T10:20:57.052 INFO:tasks.workunit.client.0.smithi029.stdout:7/180: symlink d5/d8/l44 0 2024-04-23T10:20:57.056 INFO:tasks.workunit.client.0.smithi029.stdout:2/203: dread d1/d4/f11 [4194304,4194304] 0 2024-04-23T10:20:57.059 INFO:tasks.workunit.client.0.smithi029.stdout:2/204: creat d1/d3e/f4a x:0 0 0 2024-04-23T10:20:57.064 INFO:tasks.workunit.client.0.smithi029.stdout:2/205: rename d1/d3e/c32 to d1/d31/d3d/c4b 0 2024-04-23T10:20:57.064 INFO:tasks.workunit.client.0.smithi029.stdout:7/181: dwrite d5/d8/d1a/f21 [0,4194304] 0 2024-04-23T10:20:57.066 INFO:tasks.workunit.client.0.smithi029.stdout:2/206: chown d1/dd/d22/c27 4614 1 2024-04-23T10:20:57.068 INFO:tasks.workunit.client.0.smithi029.stdout:7/182: chown d5/d8/d1a/l2f 3791 1 2024-04-23T10:20:57.068 INFO:tasks.workunit.client.0.smithi029.stdout:7/183: dread - d5/f41 zero size 2024-04-23T10:20:57.070 INFO:tasks.workunit.client.0.smithi029.stdout:7/184: write d5/d8/d1a/f1b [809712,10151] 0 2024-04-23T10:20:57.072 INFO:tasks.workunit.client.0.smithi029.stdout:2/207: link d1/dd/d22/f2c d1/d3e/f4c 0 2024-04-23T10:20:57.073 INFO:tasks.workunit.client.0.smithi029.stdout:2/208: stat d1/d31/d3d 0 2024-04-23T10:20:57.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/209: chown d1/f2e 40679325 1 2024-04-23T10:20:57.076 INFO:tasks.workunit.client.0.smithi029.stdout:7/185: mknod d5/d8/d1a/c45 0 2024-04-23T10:20:57.078 INFO:tasks.workunit.client.0.smithi029.stdout:7/186: truncate d5/d8/f23 8736 0 2024-04-23T10:20:57.080 INFO:tasks.workunit.client.0.smithi029.stdout:2/210: dread d1/d3e/f4c [0,4194304] 0 2024-04-23T10:20:57.081 INFO:tasks.workunit.client.0.smithi029.stdout:7/187: creat d5/d8/d1a/f46 x:0 0 0 2024-04-23T10:20:57.087 INFO:tasks.workunit.client.0.smithi029.stdout:7/188: truncate d5/f1f 2263722 0 2024-04-23T10:20:57.089 INFO:tasks.workunit.client.0.smithi029.stdout:7/189: chown d5/f18 176826313 1 2024-04-23T10:20:57.093 INFO:tasks.workunit.client.0.smithi029.stdout:2/211: dwrite d1/d3e/f38 [0,4194304] 0 2024-04-23T10:20:57.095 INFO:tasks.workunit.client.0.smithi029.stdout:2/212: fsync d1/d3e/f4c 0 2024-04-23T10:20:57.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/213: read - d1/d3e/f4a zero size 2024-04-23T10:20:57.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/214: mknod d1/d3e/d3b/c4d 0 2024-04-23T10:20:57.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/215: fsync d1/dd/f1d 0 2024-04-23T10:20:57.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/216: dread - d1/d4/f44 zero size 2024-04-23T10:20:57.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/217: link d1/d4/f11 d1/dd/f4e 0 2024-04-23T10:20:57.107 INFO:tasks.workunit.client.0.smithi029.stdout:7/190: dwrite d5/d9/f2e [0,4194304] 0 2024-04-23T10:20:57.112 INFO:tasks.workunit.client.0.smithi029.stdout:7/191: creat d5/f47 x:0 0 0 2024-04-23T10:20:57.120 INFO:tasks.workunit.client.0.smithi029.stdout:2/218: dwrite d1/dd/f4e [0,4194304] 0 2024-04-23T10:20:57.122 INFO:tasks.workunit.client.0.smithi029.stdout:2/219: readlink d1/d4/l12 0 2024-04-23T10:20:57.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/192: dwrite d5/d29/f37 [0,4194304] 0 2024-04-23T10:20:57.126 INFO:tasks.workunit.client.0.smithi029.stdout:2/220: getdents d1/dd 0 2024-04-23T10:20:57.128 INFO:tasks.workunit.client.0.smithi029.stdout:7/193: rename d5/d8/d1a to d5/d8/d1a/d48 22 2024-04-23T10:20:57.129 INFO:tasks.workunit.client.0.smithi029.stdout:7/194: write d5/f18 [4959318,108794] 0 2024-04-23T10:20:57.134 INFO:tasks.workunit.client.0.smithi029.stdout:2/221: unlink d1/dd/d22/c33 0 2024-04-23T10:20:57.135 INFO:tasks.workunit.client.0.smithi029.stdout:6/232: sync 2024-04-23T10:20:57.135 INFO:tasks.workunit.client.0.smithi029.stdout:3/164: sync 2024-04-23T10:20:57.135 INFO:tasks.workunit.client.0.smithi029.stdout:2/222: stat d1/d4/f44 0 2024-04-23T10:20:57.137 INFO:tasks.workunit.client.0.smithi029.stdout:2/223: chown d1/dd/l17 0 1 2024-04-23T10:20:57.137 INFO:tasks.workunit.client.0.smithi029.stdout:6/233: read d9/df/d16/f1e [7776275,122537] 0 2024-04-23T10:20:57.139 INFO:tasks.workunit.client.0.smithi029.stdout:2/224: write d1/d3e/f38 [1996095,79211] 0 2024-04-23T10:20:57.139 INFO:tasks.workunit.client.0.smithi029.stdout:7/195: truncate d5/d8/fc 3838697 0 2024-04-23T10:20:57.141 INFO:tasks.workunit.client.0.smithi029.stdout:6/234: read d9/df/d16/f1a [3352217,71202] 0 2024-04-23T10:20:57.142 INFO:tasks.workunit.client.0.smithi029.stdout:3/165: rename d3/d10/d13 to d3/d10/d27/d31 0 2024-04-23T10:20:57.143 INFO:tasks.workunit.client.0.smithi029.stdout:3/166: stat d3/d15/f29 0 2024-04-23T10:20:57.144 INFO:tasks.workunit.client.0.smithi029.stdout:6/235: readlink d9/df/d16/d1f/d27/l3c 0 2024-04-23T10:20:57.148 INFO:tasks.workunit.client.0.smithi029.stdout:3/167: truncate d3/d10/de/f24 681989 0 2024-04-23T10:20:57.148 INFO:tasks.workunit.client.0.smithi029.stdout:7/196: creat d5/d9/f49 x:0 0 0 2024-04-23T10:20:57.150 INFO:tasks.workunit.client.0.smithi029.stdout:3/168: chown d3/d10/de/l1b 8868506 1 2024-04-23T10:20:57.152 INFO:tasks.workunit.client.0.smithi029.stdout:6/236: symlink d9/df/d25/l4f 0 2024-04-23T10:20:57.153 INFO:tasks.workunit.client.0.smithi029.stdout:2/225: dwrite d1/dd/f49 [0,4194304] 0 2024-04-23T10:20:57.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/237: read d9/fe [323980,112301] 0 2024-04-23T10:20:57.156 INFO:tasks.workunit.client.0.smithi029.stdout:7/197: mkdir d5/d29/d4a 0 2024-04-23T10:20:57.157 INFO:tasks.workunit.client.0.smithi029.stdout:3/169: rmdir d3/d10/de/d2e 39 2024-04-23T10:20:57.159 INFO:tasks.workunit.client.0.smithi029.stdout:7/198: mknod d5/d8/d1a/c4b 0 2024-04-23T10:20:57.161 INFO:tasks.workunit.client.0.smithi029.stdout:2/226: rename c0 to d1/d31/d3d/c4f 0 2024-04-23T10:20:57.162 INFO:tasks.workunit.client.0.smithi029.stdout:2/227: fdatasync d1/d4/f11 0 2024-04-23T10:20:57.163 INFO:tasks.workunit.client.0.smithi029.stdout:7/199: creat d5/d8/d1a/f4c x:0 0 0 2024-04-23T10:20:57.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/170: mknod d3/d10/d27/d28/c32 0 2024-04-23T10:20:57.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/171: readlink d3/l4 0 2024-04-23T10:20:57.165 INFO:tasks.workunit.client.0.smithi029.stdout:2/228: mkdir d1/d31/d50 0 2024-04-23T10:20:57.166 INFO:tasks.workunit.client.0.smithi029.stdout:7/200: mkdir d5/d8/d1a/d4d 0 2024-04-23T10:20:57.168 INFO:tasks.workunit.client.0.smithi029.stdout:2/229: creat d1/dd/f51 x:0 0 0 2024-04-23T10:20:57.169 INFO:tasks.workunit.client.0.smithi029.stdout:7/201: mknod d5/d9/c4e 0 2024-04-23T10:20:57.171 INFO:tasks.workunit.client.0.smithi029.stdout:2/230: creat d1/d3e/d3b/f52 x:0 0 0 2024-04-23T10:20:57.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/238: truncate d9/df/d16/f24 3480444 0 2024-04-23T10:20:57.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/172: dwrite d3/fd [0,4194304] 0 2024-04-23T10:20:57.177 INFO:tasks.workunit.client.0.smithi029.stdout:7/202: dread d5/d9/f2e [0,4194304] 0 2024-04-23T10:20:57.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/173: rename d3/d10/de/f24 to d3/d10/d27/d31/d1c/f33 0 2024-04-23T10:20:57.183 INFO:tasks.workunit.client.0.smithi029.stdout:6/239: link d9/df/d16/d1f/l40 d9/df/d16/d1f/d2c/l50 0 2024-04-23T10:20:57.184 INFO:tasks.workunit.client.0.smithi029.stdout:3/174: readlink d3/d10/de/l1b 0 2024-04-23T10:20:57.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/231: creat d1/dd/d47/f53 x:0 0 0 2024-04-23T10:20:57.186 INFO:tasks.workunit.client.0.smithi029.stdout:6/240: read d9/df/f13 [2675462,7323] 0 2024-04-23T10:20:57.186 INFO:tasks.workunit.client.0.smithi029.stdout:7/203: dread d5/d8/d1a/f21 [0,4194304] 0 2024-04-23T10:20:57.186 INFO:tasks.workunit.client.0.smithi029.stdout:2/232: dread - d1/d3e/f4a zero size 2024-04-23T10:20:57.187 INFO:tasks.workunit.client.0.smithi029.stdout:3/175: truncate d3/f8 2023035 0 2024-04-23T10:20:57.187 INFO:tasks.workunit.client.0.smithi029.stdout:7/204: write d5/f47 [213713,109249] 0 2024-04-23T10:20:57.193 INFO:tasks.workunit.client.0.smithi029.stdout:2/233: fsync d1/d31/d3d/f41 0 2024-04-23T10:20:57.194 INFO:tasks.workunit.client.0.smithi029.stdout:7/205: stat d5/f1f 0 2024-04-23T10:20:57.194 INFO:tasks.workunit.client.0.smithi029.stdout:2/234: readlink d1/d4/l6 0 2024-04-23T10:20:57.196 INFO:tasks.workunit.client.0.smithi029.stdout:6/241: link d9/df/d16/d34/f3f d9/df/d16/d34/f51 0 2024-04-23T10:20:57.197 INFO:tasks.workunit.client.0.smithi029.stdout:7/206: creat d5/f4f x:0 0 0 2024-04-23T10:20:57.198 INFO:tasks.workunit.client.0.smithi029.stdout:2/235: rmdir d1/d3e 39 2024-04-23T10:20:57.199 INFO:tasks.workunit.client.0.smithi029.stdout:6/242: symlink d9/df/d16/l52 0 2024-04-23T10:20:57.203 INFO:tasks.workunit.client.0.smithi029.stdout:7/207: getdents d5/d8 0 2024-04-23T10:20:57.204 INFO:tasks.workunit.client.0.smithi029.stdout:6/243: creat d9/df/d16/d1f/d27/d33/f53 x:0 0 0 2024-04-23T10:20:57.204 INFO:tasks.workunit.client.0.smithi029.stdout:7/208: fdatasync d5/d29/f37 0 2024-04-23T10:20:57.205 INFO:tasks.workunit.client.0.smithi029.stdout:3/176: dwrite d3/d15/f21 [0,4194304] 0 2024-04-23T10:20:57.205 INFO:tasks.workunit.client.0.smithi029.stdout:2/236: link d1/d3e/f4a d1/dd/d22/f54 0 2024-04-23T10:20:57.208 INFO:tasks.workunit.client.0.smithi029.stdout:7/209: write f1 [2401062,77309] 0 2024-04-23T10:20:57.209 INFO:tasks.workunit.client.0.smithi029.stdout:2/237: symlink d1/d31/l55 0 2024-04-23T10:20:57.210 INFO:tasks.workunit.client.0.smithi029.stdout:6/244: symlink d9/df/d16/d34/d36/l54 0 2024-04-23T10:20:57.211 INFO:tasks.workunit.client.0.smithi029.stdout:3/177: mknod d3/d10/de/d2e/c34 0 2024-04-23T10:20:57.215 INFO:tasks.workunit.client.0.smithi029.stdout:3/178: mknod d3/d10/d27/d31/d1c/c35 0 2024-04-23T10:20:57.222 INFO:tasks.workunit.client.0.smithi029.stdout:7/210: dwrite d5/d29/f38 [0,4194304] 0 2024-04-23T10:20:57.222 INFO:tasks.workunit.client.0.smithi029.stdout:2/238: dwrite d1/dd/d22/f2c [0,4194304] 0 2024-04-23T10:20:57.226 INFO:tasks.workunit.client.0.smithi029.stdout:3/179: dread d3/d15/f1d [0,4194304] 0 2024-04-23T10:20:57.226 INFO:tasks.workunit.client.0.smithi029.stdout:2/239: dread - d1/dd/f51 zero size 2024-04-23T10:20:57.227 INFO:tasks.workunit.client.0.smithi029.stdout:3/180: fsync d3/f25 0 2024-04-23T10:20:57.227 INFO:tasks.workunit.client.0.smithi029.stdout:3/181: read - d3/f2a zero size 2024-04-23T10:20:57.228 INFO:tasks.workunit.client.0.smithi029.stdout:2/240: write d1/d3e/f38 [2987707,58864] 0 2024-04-23T10:20:57.230 INFO:tasks.workunit.client.0.smithi029.stdout:3/182: write d3/d15/f18 [320027,94991] 0 2024-04-23T10:20:57.231 INFO:tasks.workunit.client.0.smithi029.stdout:3/183: readlink d3/l4 0 2024-04-23T10:20:57.232 INFO:tasks.workunit.client.0.smithi029.stdout:3/184: chown c1 0 1 2024-04-23T10:20:57.237 INFO:tasks.workunit.client.0.smithi029.stdout:2/241: symlink d1/l56 0 2024-04-23T10:20:57.243 INFO:tasks.workunit.client.0.smithi029.stdout:2/242: unlink d1/l56 0 2024-04-23T10:20:57.243 INFO:tasks.workunit.client.0.smithi029.stdout:6/245: dread d9/df/d16/f24 [0,4194304] 0 2024-04-23T10:20:57.243 INFO:tasks.workunit.client.0.smithi029.stdout:7/211: dwrite d5/d29/f37 [0,4194304] 0 2024-04-23T10:20:57.246 INFO:tasks.workunit.client.0.smithi029.stdout:6/246: write d9/df/d16/f46 [955541,121856] 0 2024-04-23T10:20:57.250 INFO:tasks.workunit.client.0.smithi029.stdout:7/212: rename d5/d9/c19 to d5/d29/d4a/c50 0 2024-04-23T10:20:57.252 INFO:tasks.workunit.client.0.smithi029.stdout:6/247: symlink d9/df/d16/d44/d4c/l55 0 2024-04-23T10:20:57.252 INFO:tasks.workunit.client.0.smithi029.stdout:3/185: dwrite d3/fd [0,4194304] 0 2024-04-23T10:20:57.252 INFO:tasks.workunit.client.0.smithi029.stdout:7/213: read - d5/f30 zero size 2024-04-23T10:20:57.254 INFO:tasks.workunit.client.0.smithi029.stdout:6/248: chown d9/df/d16/l1d 3985611 1 2024-04-23T10:20:57.256 INFO:tasks.workunit.client.0.smithi029.stdout:6/249: chown d9/df/d16/l52 74311794 1 2024-04-23T10:20:57.258 INFO:tasks.workunit.client.0.smithi029.stdout:2/243: dwrite d1/d4/f11 [4194304,4194304] 0 2024-04-23T10:20:57.260 INFO:tasks.workunit.client.0.smithi029.stdout:3/186: rename d3/d10/d27/d31/d1c to d3/d10/de/d2e/d36 0 2024-04-23T10:20:57.260 INFO:tasks.workunit.client.0.smithi029.stdout:6/250: creat d9/df/d16/f56 x:0 0 0 2024-04-23T10:20:57.265 INFO:tasks.workunit.client.0.smithi029.stdout:2/244: write d1/d4/f1e [750062,55965] 0 2024-04-23T10:20:57.265 INFO:tasks.workunit.client.0.smithi029.stdout:6/251: chown d9/df/d16/d1f/d27/d33/f32 18849952 1 2024-04-23T10:20:57.276 INFO:tasks.workunit.client.0.smithi029.stdout:7/214: dwrite d5/d9/f2b [0,4194304] 0 2024-04-23T10:20:57.280 INFO:tasks.workunit.client.0.smithi029.stdout:7/215: read d5/d8/f25 [1228902,24836] 0 2024-04-23T10:20:57.282 INFO:tasks.workunit.client.0.smithi029.stdout:3/187: dwrite d3/d15/f1d [0,4194304] 0 2024-04-23T10:20:57.282 INFO:tasks.workunit.client.0.smithi029.stdout:2/245: dwrite d1/dd/d47/f53 [0,4194304] 0 2024-04-23T10:20:57.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/246: truncate d1/dd/d22/f54 940685 0 2024-04-23T10:20:57.285 INFO:tasks.workunit.client.0.smithi029.stdout:2/247: dread - d1/d4/f44 zero size 2024-04-23T10:20:57.285 INFO:tasks.workunit.client.0.smithi029.stdout:6/252: write d9/df/d16/f1e [4147019,78724] 0 2024-04-23T10:20:57.294 INFO:tasks.workunit.client.0.smithi029.stdout:7/216: mkdir d5/d8/d51 0 2024-04-23T10:20:57.296 INFO:tasks.workunit.client.0.smithi029.stdout:2/248: chown d1/l3f 47672 1 2024-04-23T10:20:57.297 INFO:tasks.workunit.client.0.smithi029.stdout:3/188: mknod d3/d10/de/c37 0 2024-04-23T10:20:57.301 INFO:tasks.workunit.client.0.smithi029.stdout:3/189: creat d3/d10/de/d2e/d36/f38 x:0 0 0 2024-04-23T10:20:57.302 INFO:tasks.workunit.client.0.smithi029.stdout:2/249: symlink d1/d31/d3d/l57 0 2024-04-23T10:20:57.303 INFO:tasks.workunit.client.0.smithi029.stdout:6/253: creat d9/df/d16/d1f/d27/f57 x:0 0 0 2024-04-23T10:20:57.304 INFO:tasks.workunit.client.0.smithi029.stdout:6/254: stat d9/df/c43 0 2024-04-23T10:20:57.306 INFO:tasks.workunit.client.0.smithi029.stdout:6/255: dread - d9/df/d16/f56 zero size 2024-04-23T10:20:57.309 INFO:tasks.workunit.client.0.smithi029.stdout:7/217: unlink d5/d8/d1a/f4c 0 2024-04-23T10:20:57.311 INFO:tasks.workunit.client.0.smithi029.stdout:7/218: read d5/d9/f2e [1917901,53214] 0 2024-04-23T10:20:57.311 INFO:tasks.workunit.client.0.smithi029.stdout:3/190: link d3/d10/de/f14 d3/d10/de/d2e/d36/f39 0 2024-04-23T10:20:57.314 INFO:tasks.workunit.client.0.smithi029.stdout:3/191: creat d3/d10/d27/f3a x:0 0 0 2024-04-23T10:20:57.315 INFO:tasks.workunit.client.0.smithi029.stdout:6/256: dread d9/df/d16/f46 [0,4194304] 0 2024-04-23T10:20:57.315 INFO:tasks.workunit.client.0.smithi029.stdout:2/250: truncate d1/d3e/f4c 3934497 0 2024-04-23T10:20:57.316 INFO:tasks.workunit.client.0.smithi029.stdout:3/192: write d3/d10/f2b [151149,38584] 0 2024-04-23T10:20:57.317 INFO:tasks.workunit.client.0.smithi029.stdout:3/193: dread - d3/d15/f29 zero size 2024-04-23T10:20:57.318 INFO:tasks.workunit.client.0.smithi029.stdout:6/257: mkdir d9/df/d16/d1f/d27/d2d/d58 0 2024-04-23T10:20:57.320 INFO:tasks.workunit.client.0.smithi029.stdout:3/194: symlink d3/d10/d27/d31/l3b 0 2024-04-23T10:20:57.321 INFO:tasks.workunit.client.0.smithi029.stdout:3/195: symlink d3/d10/d27/l3c 0 2024-04-23T10:20:57.321 INFO:tasks.workunit.client.0.smithi029.stdout:2/251: link d1/l2d d1/d3e/l58 0 2024-04-23T10:20:57.322 INFO:tasks.workunit.client.0.smithi029.stdout:3/196: fsync d3/d10/de/f12 0 2024-04-23T10:20:57.322 INFO:tasks.workunit.client.0.smithi029.stdout:2/252: dread - d1/d3e/d3b/f52 zero size 2024-04-23T10:20:57.323 INFO:tasks.workunit.client.0.smithi029.stdout:6/258: dread d9/df/d16/d1f/f38 [0,4194304] 0 2024-04-23T10:20:57.324 INFO:tasks.workunit.client.0.smithi029.stdout:6/259: fsync d9/df/d16/f56 0 2024-04-23T10:20:57.328 INFO:tasks.workunit.client.0.smithi029.stdout:6/260: symlink d9/df/d16/d1f/d27/d2d/d58/l59 0 2024-04-23T10:20:57.331 INFO:tasks.workunit.client.0.smithi029.stdout:3/197: dwrite d3/d10/f20 [0,4194304] 0 2024-04-23T10:20:57.332 INFO:tasks.workunit.client.0.smithi029.stdout:6/261: creat d9/df/d16/d1f/d27/d2d/d58/f5a x:0 0 0 2024-04-23T10:20:57.334 INFO:tasks.workunit.client.0.smithi029.stdout:3/198: symlink d3/d10/l3d 0 2024-04-23T10:20:57.335 INFO:tasks.workunit.client.0.smithi029.stdout:2/253: write d1/dd/d22/f54 [636321,26640] 0 2024-04-23T10:20:57.336 INFO:tasks.workunit.client.0.smithi029.stdout:3/199: write d3/fd [219773,18504] 0 2024-04-23T10:20:57.338 INFO:tasks.workunit.client.0.smithi029.stdout:2/254: truncate d1/f2e 345649 0 2024-04-23T10:20:57.339 INFO:tasks.workunit.client.0.smithi029.stdout:3/200: mknod d3/d15/c3e 0 2024-04-23T10:20:57.341 INFO:tasks.workunit.client.0.smithi029.stdout:2/255: mknod d1/d31/d50/c59 0 2024-04-23T10:20:57.341 INFO:tasks.workunit.client.0.smithi029.stdout:3/201: write d3/d10/d27/d31/f26 [339268,12203] 0 2024-04-23T10:20:57.346 INFO:tasks.workunit.client.0.smithi029.stdout:2/256: mkdir d1/d3e/d5a 0 2024-04-23T10:20:57.348 INFO:tasks.workunit.client.0.smithi029.stdout:3/202: mknod d3/d10/d27/c3f 0 2024-04-23T10:20:57.348 INFO:tasks.workunit.client.0.smithi029.stdout:6/262: dwrite d9/df/d16/d1f/d27/d33/f53 [0,4194304] 0 2024-04-23T10:20:57.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/257: chown d1/dd/c26 1957441772 1 2024-04-23T10:20:57.357 INFO:tasks.workunit.client.0.smithi029.stdout:2/258: truncate d1/dd/d47/f53 3995560 0 2024-04-23T10:20:57.362 INFO:tasks.workunit.client.0.smithi029.stdout:6/263: dwrite d9/df/d16/d34/f3f [0,4194304] 0 2024-04-23T10:20:57.366 INFO:tasks.workunit.client.0.smithi029.stdout:2/259: dwrite d1/d4/f11 [4194304,4194304] 0 2024-04-23T10:20:57.368 INFO:tasks.workunit.client.0.smithi029.stdout:2/260: mknod d1/d3e/c5b 0 2024-04-23T10:20:57.371 INFO:tasks.workunit.client.0.smithi029.stdout:2/261: chown d1/d3e/l58 0 1 2024-04-23T10:20:57.376 INFO:tasks.workunit.client.0.smithi029.stdout:6/264: dwrite d9/df/d16/f46 [0,4194304] 0 2024-04-23T10:20:57.377 INFO:tasks.workunit.client.0.smithi029.stdout:2/262: rename d1/l21 to d1/dd/d22/l5c 0 2024-04-23T10:20:57.378 INFO:tasks.workunit.client.0.smithi029.stdout:9/263: sync 2024-04-23T10:20:57.378 INFO:tasks.workunit.client.0.smithi029.stdout:5/336: sync 2024-04-23T10:20:57.378 INFO:tasks.workunit.client.0.smithi029.stdout:8/244: sync 2024-04-23T10:20:57.380 INFO:tasks.workunit.client.0.smithi029.stdout:9/264: fsync d0/d7/d1d/d35/d3b/f51 0 2024-04-23T10:20:57.381 INFO:tasks.workunit.client.0.smithi029.stdout:6/265: mkdir d9/d5b 0 2024-04-23T10:20:57.382 INFO:tasks.workunit.client.0.smithi029.stdout:8/245: truncate d3/fd 4186165 0 2024-04-23T10:20:57.383 INFO:tasks.workunit.client.0.smithi029.stdout:2/263: unlink d1/d31/d3d/c4b 0 2024-04-23T10:20:57.385 INFO:tasks.workunit.client.0.smithi029.stdout:5/337: rename d0/db to d0/d35/d38/d3e/d66/d5a/d78 0 2024-04-23T10:20:57.389 INFO:tasks.workunit.client.0.smithi029.stdout:2/264: creat d1/dd/d47/f5d x:0 0 0 2024-04-23T10:20:57.392 INFO:tasks.workunit.client.0.smithi029.stdout:9/265: truncate d0/d7/d3f/f53 280241 0 2024-04-23T10:20:57.393 INFO:tasks.workunit.client.0.smithi029.stdout:6/266: mknod d9/df/d16/d44/c5c 0 2024-04-23T10:20:57.393 INFO:tasks.workunit.client.0.smithi029.stdout:9/266: chown d0/d7/d1d/d35/d3b 212317 1 2024-04-23T10:20:57.394 INFO:tasks.workunit.client.0.smithi029.stdout:8/246: truncate d3/f1e 1200802 0 2024-04-23T10:20:57.395 INFO:tasks.workunit.client.0.smithi029.stdout:2/265: unlink d1/d3e/f4a 0 2024-04-23T10:20:57.397 INFO:tasks.workunit.client.0.smithi029.stdout:9/267: fsync d0/d7/d1d/f20 0 2024-04-23T10:20:57.401 INFO:tasks.workunit.client.0.smithi029.stdout:2/266: mknod d1/d31/d3d/c5e 0 2024-04-23T10:20:57.402 INFO:tasks.workunit.client.0.smithi029.stdout:5/338: write d0/fe [1390221,118718] 0 2024-04-23T10:20:57.403 INFO:tasks.workunit.client.0.smithi029.stdout:6/267: link f4 d9/df/d41/d49/f5d 0 2024-04-23T10:20:57.410 INFO:tasks.workunit.client.0.smithi029.stdout:2/267: dwrite d1/d3e/d3b/f52 [0,4194304] 0 2024-04-23T10:20:57.411 INFO:tasks.workunit.client.0.smithi029.stdout:2/268: truncate d1/d4/f1e 1696441 0 2024-04-23T10:20:57.416 INFO:tasks.workunit.client.0.smithi029.stdout:8/247: truncate d3/f33 1829832 0 2024-04-23T10:20:57.417 INFO:tasks.workunit.client.0.smithi029.stdout:2/269: mknod d1/dd/c5f 0 2024-04-23T10:20:57.417 INFO:tasks.workunit.client.0.smithi029.stdout:6/268: link d9/df/d16/d1f/d2c/l50 d9/df/d16/d1f/d27/l5e 0 2024-04-23T10:20:57.419 INFO:tasks.workunit.client.0.smithi029.stdout:2/270: write d1/d4/f1e [1613100,52430] 0 2024-04-23T10:20:57.422 INFO:tasks.workunit.client.0.smithi029.stdout:8/248: link d3/d38/f3d d3/d2f/d36/d3e/f4f 0 2024-04-23T10:20:57.424 INFO:tasks.workunit.client.0.smithi029.stdout:6/269: rename d9/df/d41/d49/f5d to d9/df/d25/f5f 0 2024-04-23T10:20:57.425 INFO:tasks.workunit.client.0.smithi029.stdout:2/271: mkdir d1/dd/d60 0 2024-04-23T10:20:57.426 INFO:tasks.workunit.client.0.smithi029.stdout:6/270: write d9/df/f3d [3295973,66454] 0 2024-04-23T10:20:57.426 INFO:tasks.workunit.client.0.smithi029.stdout:2/272: stat d1/d4/l43 0 2024-04-23T10:20:57.428 INFO:tasks.workunit.client.0.smithi029.stdout:8/249: mkdir d3/d50 0 2024-04-23T10:20:57.432 INFO:tasks.workunit.client.0.smithi029.stdout:8/250: mknod d3/d2f/d36/d3e/c51 0 2024-04-23T10:20:57.433 INFO:tasks.workunit.client.0.smithi029.stdout:8/251: stat d3/d2f/f35 0 2024-04-23T10:20:57.435 INFO:tasks.workunit.client.0.smithi029.stdout:8/252: read d3/f11 [1465892,36919] 0 2024-04-23T10:20:57.435 INFO:tasks.workunit.client.0.smithi029.stdout:6/271: dread d9/df/d16/d34/f51 [0,4194304] 0 2024-04-23T10:20:57.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/273: dwrite d1/dd/f51 [0,4194304] 0 2024-04-23T10:20:57.439 INFO:tasks.workunit.client.0.smithi029.stdout:6/272: write d9/df/d16/d1f/d27/d33/f4e [706191,117066] 0 2024-04-23T10:20:57.442 INFO:tasks.workunit.client.0.smithi029.stdout:6/273: fdatasync f4 0 2024-04-23T10:20:57.450 INFO:tasks.workunit.client.0.smithi029.stdout:8/253: dwrite d3/f14 [0,4194304] 0 2024-04-23T10:20:57.451 INFO:tasks.workunit.client.0.smithi029.stdout:8/254: rename d3/d2f/d36/d3e to d3/d2f/d36/d3e/d52 22 2024-04-23T10:20:57.451 INFO:tasks.workunit.client.0.smithi029.stdout:2/274: fdatasync d1/dd/d22/f54 0 2024-04-23T10:20:57.453 INFO:tasks.workunit.client.0.smithi029.stdout:6/274: creat d9/df/d16/d1f/d27/f60 x:0 0 0 2024-04-23T10:20:57.453 INFO:tasks.workunit.client.0.smithi029.stdout:8/255: mknod d3/c53 0 2024-04-23T10:20:57.455 INFO:tasks.workunit.client.0.smithi029.stdout:6/275: mknod d9/df/d16/d44/d4c/c61 0 2024-04-23T10:20:57.456 INFO:tasks.workunit.client.0.smithi029.stdout:8/256: creat d3/d2f/f54 x:0 0 0 2024-04-23T10:20:57.459 INFO:tasks.workunit.client.0.smithi029.stdout:8/257: write d3/f19 [4427209,94842] 0 2024-04-23T10:20:57.461 INFO:tasks.workunit.client.0.smithi029.stdout:8/258: write d3/d2f/f39 [596612,65824] 0 2024-04-23T10:20:57.462 INFO:tasks.workunit.client.0.smithi029.stdout:8/259: readlink d3/l1d 0 2024-04-23T10:20:57.465 INFO:tasks.workunit.client.0.smithi029.stdout:2/275: dwrite d1/dd/d22/f2c [0,4194304] 0 2024-04-23T10:20:57.466 INFO:tasks.workunit.client.0.smithi029.stdout:6/276: unlink d9/lb 0 2024-04-23T10:20:57.466 INFO:tasks.workunit.client.0.smithi029.stdout:6/277: read d9/df/d16/f2a [2383152,59347] 0 2024-04-23T10:20:57.467 INFO:tasks.workunit.client.0.smithi029.stdout:8/260: rename d3/c28 to d3/d44/c55 0 2024-04-23T10:20:57.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/276: getdents d1/d31/d3d 0 2024-04-23T10:20:57.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/277: fdatasync d1/d3e/f38 0 2024-04-23T10:20:57.480 INFO:tasks.workunit.client.0.smithi029.stdout:2/278: symlink d1/d31/d50/l61 0 2024-04-23T10:20:57.488 INFO:tasks.workunit.client.0.smithi029.stdout:2/279: dwrite d1/d4/f1e [0,4194304] 0 2024-04-23T10:20:57.491 INFO:tasks.workunit.client.0.smithi029.stdout:2/280: creat d1/dd/f62 x:0 0 0 2024-04-23T10:20:57.491 INFO:tasks.workunit.client.0.smithi029.stdout:6/278: dread d9/f10 [0,4194304] 0 2024-04-23T10:20:57.494 INFO:tasks.workunit.client.0.smithi029.stdout:6/279: rmdir d9/df/d16/d1f/d27/d33 39 2024-04-23T10:20:57.497 INFO:tasks.workunit.client.0.smithi029.stdout:2/281: mkdir d1/dd/d47/d63 0 2024-04-23T10:20:57.499 INFO:tasks.workunit.client.0.smithi029.stdout:6/280: creat d9/df/d16/d44/f62 x:0 0 0 2024-04-23T10:20:57.499 INFO:tasks.workunit.client.0.smithi029.stdout:6/281: read - d9/df/d16/d44/f62 zero size 2024-04-23T10:20:57.500 INFO:tasks.workunit.client.0.smithi029.stdout:6/282: dread - d9/df/d16/d44/f62 zero size 2024-04-23T10:20:57.503 INFO:tasks.workunit.client.0.smithi029.stdout:6/283: write d9/f29 [803396,1706] 0 2024-04-23T10:20:57.503 INFO:tasks.workunit.client.0.smithi029.stdout:2/282: getdents d1/dd/d60 0 2024-04-23T10:20:57.511 INFO:tasks.workunit.client.0.smithi029.stdout:2/283: dwrite d1/d3e/f38 [0,4194304] 0 2024-04-23T10:20:57.513 INFO:tasks.workunit.client.0.smithi029.stdout:6/284: read d9/f18 [8015980,17264] 0 2024-04-23T10:20:57.514 INFO:tasks.workunit.client.0.smithi029.stdout:2/284: mkdir d1/dd/d47/d63/d64 0 2024-04-23T10:20:57.516 INFO:tasks.workunit.client.0.smithi029.stdout:6/285: mkdir d9/df/d16/d34/d36/d63 0 2024-04-23T10:20:57.517 INFO:tasks.workunit.client.0.smithi029.stdout:2/285: chown d1/d4/l42 11391952 1 2024-04-23T10:20:57.650 INFO:tasks.workunit.client.0.smithi029.stdout:2/286: symlink d1/dd/d47/d63/d64/l65 0 2024-04-23T10:20:57.654 INFO:tasks.workunit.client.0.smithi029.stdout:2/287: rmdir d1/d31/d3d 39 2024-04-23T10:20:57.656 INFO:tasks.workunit.client.0.smithi029.stdout:2/288: readlink d1/d4/l43 0 2024-04-23T10:20:57.658 INFO:tasks.workunit.client.0.smithi029.stdout:2/289: dread - d1/d4/f44 zero size 2024-04-23T10:20:57.686 INFO:tasks.workunit.client.0.smithi029.stdout:6/286: dwrite d9/df/d16/f1a [0,4194304] 0 2024-04-23T10:20:57.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/213: sync 2024-04-23T10:20:57.692 INFO:tasks.workunit.client.0.smithi029.stdout:4/250: sync 2024-04-23T10:20:57.692 INFO:tasks.workunit.client.0.smithi029.stdout:0/141: sync 2024-04-23T10:20:57.696 INFO:tasks.workunit.client.0.smithi029.stdout:8/261: dread d3/fa [0,4194304] 0 2024-04-23T10:20:57.699 INFO:tasks.workunit.client.0.smithi029.stdout:1/214: symlink d5/d6/de/d27/d38/l4a 0 2024-04-23T10:20:57.701 INFO:tasks.workunit.client.0.smithi029.stdout:4/251: mknod d0/d12/d13/d1b/d36/c50 0 2024-04-23T10:20:57.703 INFO:tasks.workunit.client.0.smithi029.stdout:8/262: unlink d3/l1c 0 2024-04-23T10:20:57.707 INFO:tasks.workunit.client.0.smithi029.stdout:4/252: chown d0/fe 360416126 1 2024-04-23T10:20:57.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/263: dread - d3/d38/f4d zero size 2024-04-23T10:20:57.715 INFO:tasks.workunit.client.0.smithi029.stdout:8/264: mknod d3/d44/c56 0 2024-04-23T10:20:57.717 INFO:tasks.workunit.client.0.smithi029.stdout:0/142: dwrite d0/dc/d27/f30 [0,4194304] 0 2024-04-23T10:20:57.719 INFO:tasks.workunit.client.0.smithi029.stdout:0/143: chown d0/dc 56 1 2024-04-23T10:20:57.721 INFO:tasks.workunit.client.0.smithi029.stdout:4/253: rename d0/d12/d13/l1e to d0/l51 0 2024-04-23T10:20:57.722 INFO:tasks.workunit.client.0.smithi029.stdout:0/144: chown d0/dc/d27/f29 6971 1 2024-04-23T10:20:57.723 INFO:tasks.workunit.client.0.smithi029.stdout:8/265: truncate d3/d2f/d36/d3e/f4f 1116250 0 2024-04-23T10:20:57.726 INFO:tasks.workunit.client.0.smithi029.stdout:6/287: fsync d9/df/d16/f1a 0 2024-04-23T10:20:57.726 INFO:tasks.workunit.client.0.smithi029.stdout:8/266: dread - d3/d2f/f4c zero size 2024-04-23T10:20:57.729 INFO:tasks.workunit.client.0.smithi029.stdout:0/145: creat d0/dc/f36 x:0 0 0 2024-04-23T10:20:57.733 INFO:tasks.workunit.client.0.smithi029.stdout:8/267: symlink d3/d2f/d36/d3e/l57 0 2024-04-23T10:20:57.735 INFO:tasks.workunit.client.0.smithi029.stdout:6/288: creat d9/f64 x:0 0 0 2024-04-23T10:20:57.736 INFO:tasks.workunit.client.0.smithi029.stdout:1/215: write d5/d6/de/d15/f26 [700189,70935] 0 2024-04-23T10:20:57.743 INFO:tasks.workunit.client.0.smithi029.stdout:4/254: rename d0/d12/d13 to d0/d3c/d52 0 2024-04-23T10:20:57.748 INFO:tasks.workunit.client.0.smithi029.stdout:1/216: creat d5/d3e/f4b x:0 0 0 2024-04-23T10:20:57.751 INFO:tasks.workunit.client.0.smithi029.stdout:4/255: mknod d0/d3c/c53 0 2024-04-23T10:20:57.753 INFO:tasks.workunit.client.0.smithi029.stdout:1/217: write d5/d6/de/d22/f23 [85516,4916] 0 2024-04-23T10:20:57.754 INFO:tasks.workunit.client.0.smithi029.stdout:0/146: truncate d0/f7 1000276 0 2024-04-23T10:20:57.782 INFO:tasks.workunit.client.0.smithi029.stdout:4/256: link d0/l8 d0/d3c/d52/d1b/l54 0 2024-04-23T10:20:57.783 INFO:tasks.workunit.client.0.smithi029.stdout:8/268: dread d3/f7 [0,4194304] 0 2024-04-23T10:20:57.785 INFO:tasks.workunit.client.0.smithi029.stdout:0/147: link d0/dc/d27/f30 d0/d1b/f37 0 2024-04-23T10:20:57.785 INFO:tasks.workunit.client.0.smithi029.stdout:6/289: dwrite d9/f10 [0,4194304] 0 2024-04-23T10:20:57.788 INFO:tasks.workunit.client.0.smithi029.stdout:6/290: fsync d9/f64 0 2024-04-23T10:20:57.788 INFO:tasks.workunit.client.0.smithi029.stdout:0/148: dread - d0/dc/f15 zero size 2024-04-23T10:20:57.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/291: write d9/f10 [5071109,110906] 0 2024-04-23T10:20:57.791 INFO:tasks.workunit.client.0.smithi029.stdout:1/218: link d5/lb d5/d6/de/d27/d38/l4c 0 2024-04-23T10:20:57.799 INFO:tasks.workunit.client.0.smithi029.stdout:4/257: symlink d0/d3c/d52/l55 0 2024-04-23T10:20:57.802 INFO:tasks.workunit.client.0.smithi029.stdout:6/292: creat d9/df/d16/d34/f65 x:0 0 0 2024-04-23T10:20:57.806 INFO:tasks.workunit.client.0.smithi029.stdout:8/269: link d3/d2f/d36/d3e/f41 d3/d2f/d36/d3e/f58 0 2024-04-23T10:20:57.811 INFO:tasks.workunit.client.0.smithi029.stdout:1/219: rename d5/l32 to d5/d6/de/d27/d38/l4d 0 2024-04-23T10:20:57.816 INFO:tasks.workunit.client.0.smithi029.stdout:1/220: readlink d5/l2d 0 2024-04-23T10:20:57.818 INFO:tasks.workunit.client.0.smithi029.stdout:6/293: mkdir d9/df/d16/d1f/d27/d2d/d66 0 2024-04-23T10:20:57.823 INFO:tasks.workunit.client.0.smithi029.stdout:4/258: creat d0/d3c/d52/d1b/f56 x:0 0 0 2024-04-23T10:20:57.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/221: mknod d5/d6/de/d27/d38/c4e 0 2024-04-23T10:20:57.825 INFO:tasks.workunit.client.0.smithi029.stdout:4/259: stat d0/d12/f43 0 2024-04-23T10:20:57.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/222: chown d5/d6/de/d15 3 1 2024-04-23T10:20:57.827 INFO:tasks.workunit.client.0.smithi029.stdout:8/270: truncate d3/f1f 3207336 0 2024-04-23T10:20:57.829 INFO:tasks.workunit.client.0.smithi029.stdout:0/149: dread d0/d1b/f2d [0,4194304] 0 2024-04-23T10:20:57.830 INFO:tasks.workunit.client.0.smithi029.stdout:4/260: write d0/d3c/d52/d1b/f2e [4506544,53681] 0 2024-04-23T10:20:57.834 INFO:tasks.workunit.client.0.smithi029.stdout:6/294: rename d9/df/d16/d1f/d27/d33/c28 to d9/df/d16/c67 0 2024-04-23T10:20:57.836 INFO:tasks.workunit.client.0.smithi029.stdout:6/295: chown d9/df/d16/d34/f3f 1164809 1 2024-04-23T10:20:57.840 INFO:tasks.workunit.client.0.smithi029.stdout:8/271: creat d3/d2f/d36/f59 x:0 0 0 2024-04-23T10:20:57.841 INFO:tasks.workunit.client.0.smithi029.stdout:1/223: symlink d5/d6/de/l4f 0 2024-04-23T10:20:57.842 INFO:tasks.workunit.client.0.smithi029.stdout:8/272: fsync d3/d2f/d36/f3a 0 2024-04-23T10:20:57.845 INFO:tasks.workunit.client.0.smithi029.stdout:1/224: symlink d5/d3e/l50 0 2024-04-23T10:20:57.850 INFO:tasks.workunit.client.0.smithi029.stdout:4/261: write d0/f17 [3050167,42257] 0 2024-04-23T10:20:57.851 INFO:tasks.workunit.client.0.smithi029.stdout:1/225: fdatasync d5/d6/de/d15/f1a 0 2024-04-23T10:20:57.854 INFO:tasks.workunit.client.0.smithi029.stdout:0/150: write d0/f7 [36860,47033] 0 2024-04-23T10:20:57.862 INFO:tasks.workunit.client.0.smithi029.stdout:6/296: dwrite d9/df/d16/d34/f3f [0,4194304] 0 2024-04-23T10:20:57.862 INFO:tasks.workunit.client.0.smithi029.stdout:1/226: rename d5/d6/f11 to d5/d6/de/d22/f51 0 2024-04-23T10:20:57.868 INFO:tasks.workunit.client.0.smithi029.stdout:4/262: link d0/f6 d0/d3c/d52/d20/f57 0 2024-04-23T10:20:57.875 INFO:tasks.workunit.client.0.smithi029.stdout:1/227: dwrite d5/d6/de/d22/f23 [0,4194304] 0 2024-04-23T10:20:57.878 INFO:tasks.workunit.client.0.smithi029.stdout:4/263: creat d0/d3c/d52/d1b/d36/d45/f58 x:0 0 0 2024-04-23T10:20:57.880 INFO:tasks.workunit.client.0.smithi029.stdout:8/273: dread d3/d2f/f35 [0,4194304] 0 2024-04-23T10:20:57.880 INFO:tasks.workunit.client.0.smithi029.stdout:6/297: creat d9/df/d16/d34/d36/d63/f68 x:0 0 0 2024-04-23T10:20:57.882 INFO:tasks.workunit.client.0.smithi029.stdout:8/274: write d3/d2f/d36/f4a [661616,81719] 0 2024-04-23T10:20:57.882 INFO:tasks.workunit.client.0.smithi029.stdout:0/151: dwrite d0/dc/f1a [0,4194304] 0 2024-04-23T10:20:57.885 INFO:tasks.workunit.client.0.smithi029.stdout:4/264: mkdir d0/d3c/d59 0 2024-04-23T10:20:57.885 INFO:tasks.workunit.client.0.smithi029.stdout:8/275: read d3/f23 [237099,25196] 0 2024-04-23T10:20:57.889 INFO:tasks.workunit.client.0.smithi029.stdout:6/298: mkdir d9/df/d41/d49/d69 0 2024-04-23T10:20:57.890 INFO:tasks.workunit.client.0.smithi029.stdout:4/265: read d0/d3c/d52/d1b/f39 [177374,5665] 0 2024-04-23T10:20:57.891 INFO:tasks.workunit.client.0.smithi029.stdout:4/266: dread - d0/d3c/d52/d1b/d36/d45/f58 zero size 2024-04-23T10:20:57.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/268: dread d0/f11 [0,4194304] 0 2024-04-23T10:20:57.895 INFO:tasks.workunit.client.0.smithi029.stdout:4/267: truncate d0/d3c/d52/d1b/d36/d45/f58 700212 0 2024-04-23T10:20:57.896 INFO:tasks.workunit.client.0.smithi029.stdout:8/276: mknod d3/d2f/d36/d3e/c5a 0 2024-04-23T10:20:57.898 INFO:tasks.workunit.client.0.smithi029.stdout:8/277: truncate d3/d2f/d36/f3b 29579 0 2024-04-23T10:20:57.898 INFO:tasks.workunit.client.0.smithi029.stdout:6/299: fsync d9/df/f22 0 2024-04-23T10:20:57.901 INFO:tasks.workunit.client.0.smithi029.stdout:0/152: write d0/dc/d27/f30 [1465968,109260] 0 2024-04-23T10:20:57.901 INFO:tasks.workunit.client.0.smithi029.stdout:0/153: dread - d0/f2f zero size 2024-04-23T10:20:57.902 INFO:tasks.workunit.client.0.smithi029.stdout:8/278: symlink d3/d2f/d36/l5b 0 2024-04-23T10:20:57.905 INFO:tasks.workunit.client.0.smithi029.stdout:4/268: mkdir d0/d5a 0 2024-04-23T10:20:57.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/279: creat d3/d38/f5c x:0 0 0 2024-04-23T10:20:57.908 INFO:tasks.workunit.client.0.smithi029.stdout:9/269: link d0/c4a d0/d1b/d39/d50/c59 0 2024-04-23T10:20:57.909 INFO:tasks.workunit.client.0.smithi029.stdout:6/300: link d9/df/d16/d1f/l37 d9/df/l6a 0 2024-04-23T10:20:57.910 INFO:tasks.workunit.client.0.smithi029.stdout:4/269: mkdir d0/d3c/d52/d1b/d5b 0 2024-04-23T10:20:57.911 INFO:tasks.workunit.client.0.smithi029.stdout:0/154: truncate d0/fa 2408467 0 2024-04-23T10:20:57.912 INFO:tasks.workunit.client.0.smithi029.stdout:8/280: chown d3/d2f/d36/d3e/f4f 23962736 1 2024-04-23T10:20:57.912 INFO:tasks.workunit.client.0.smithi029.stdout:9/270: mkdir d0/d1b/d39/d50/d5a 0 2024-04-23T10:20:57.914 INFO:tasks.workunit.client.0.smithi029.stdout:4/270: rename d0/c47 to d0/d12/c5c 0 2024-04-23T10:20:57.915 INFO:tasks.workunit.client.0.smithi029.stdout:0/155: write d0/dc/d26/f2e [393310,2537] 0 2024-04-23T10:20:57.920 INFO:tasks.workunit.client.0.smithi029.stdout:4/271: getdents d0/d3c/d52/d1b/d5b 0 2024-04-23T10:20:57.921 INFO:tasks.workunit.client.0.smithi029.stdout:9/271: rename d0/d7/d6/f23 to d0/f5b 0 2024-04-23T10:20:57.924 INFO:tasks.workunit.client.0.smithi029.stdout:8/281: getdents d3 0 2024-04-23T10:20:57.928 INFO:tasks.workunit.client.0.smithi029.stdout:8/282: getdents d3/d50 0 2024-04-23T10:20:57.937 INFO:tasks.workunit.client.0.smithi029.stdout:9/272: dread d0/d7/d6/fe [0,4194304] 0 2024-04-23T10:20:57.940 INFO:tasks.workunit.client.0.smithi029.stdout:4/272: rename d0/l8 to d0/d3c/d52/l5d 0 2024-04-23T10:20:57.941 INFO:tasks.workunit.client.0.smithi029.stdout:4/273: chown d0/d3c/d52/d1b/f35 211 1 2024-04-23T10:20:57.944 INFO:tasks.workunit.client.0.smithi029.stdout:8/283: rename d3/d2f/d36/d3e/c5a to d3/d2f/c5d 0 2024-04-23T10:20:57.944 INFO:tasks.workunit.client.0.smithi029.stdout:9/273: link d0/d1b/l4e d0/d7/d6/l5c 0 2024-04-23T10:20:57.944 INFO:tasks.workunit.client.0.smithi029.stdout:8/284: dread - d3/d2f/f4c zero size 2024-04-23T10:20:57.945 INFO:tasks.workunit.client.0.smithi029.stdout:9/274: chown d0/d1b/d44/d49/f54 235 1 2024-04-23T10:20:57.945 INFO:tasks.workunit.client.0.smithi029.stdout:9/275: readlink d0/d1b/d39/d50/l2c 0 2024-04-23T10:20:57.947 INFO:tasks.workunit.client.0.smithi029.stdout:9/276: write d0/d7/d1d/f20 [984181,24482] 0 2024-04-23T10:20:57.948 INFO:tasks.workunit.client.0.smithi029.stdout:9/277: write d0/d7/d1d/d35/d3b/f51 [522172,51193] 0 2024-04-23T10:20:57.951 INFO:tasks.workunit.client.0.smithi029.stdout:4/274: creat d0/d3c/d52/d20/f5e x:0 0 0 2024-04-23T10:20:57.953 INFO:tasks.workunit.client.0.smithi029.stdout:9/278: stat d0/d7/d1d/d35/f3a 0 2024-04-23T10:20:57.969 INFO:tasks.workunit.client.0.smithi029.stdout:9/279: dread d0/d7/d6/f55 [0,4194304] 0 2024-04-23T10:20:57.972 INFO:tasks.workunit.client.0.smithi029.stdout:4/275: rename d0/f6 to d0/d12/f5f 0 2024-04-23T10:20:57.974 INFO:tasks.workunit.client.0.smithi029.stdout:9/280: mknod d0/d7/d3f/c5d 0 2024-04-23T10:20:58.041 INFO:tasks.workunit.client.0.smithi029.stdout:4/276: mknod d0/d3c/d52/c60 0 2024-04-23T10:20:58.050 INFO:tasks.workunit.client.0.smithi029.stdout:4/277: link d0/d3c/d52/d1b/l48 d0/d3c/d52/d1b/d36/l61 0 2024-04-23T10:20:58.106 INFO:tasks.workunit.client.0.smithi029.stdout:7/219: sync 2024-04-23T10:20:58.128 INFO:tasks.workunit.client.0.smithi029.stdout:7/220: dwrite d5/d29/f3b [0,4194304] 0 2024-04-23T10:20:58.140 INFO:tasks.workunit.client.0.smithi029.stdout:7/221: read d5/d8/fb [482955,116659] 0 2024-04-23T10:20:58.143 INFO:tasks.workunit.client.0.smithi029.stdout:7/222: fdatasync d5/d9/f33 0 2024-04-23T10:20:58.150 INFO:tasks.workunit.client.0.smithi029.stdout:7/223: chown d5/fe 1 1 2024-04-23T10:20:58.160 INFO:tasks.workunit.client.0.smithi029.stdout:7/224: unlink d5/d9/f3f 0 2024-04-23T10:20:58.163 INFO:tasks.workunit.client.0.smithi029.stdout:7/225: read d5/d8/d1a/f21 [3281112,110626] 0 2024-04-23T10:20:58.169 INFO:tasks.workunit.client.0.smithi029.stdout:7/226: getdents d5/d8/d51 0 2024-04-23T10:20:58.175 INFO:tasks.workunit.client.0.smithi029.stdout:7/227: creat d5/d8/d1a/d4d/f52 x:0 0 0 2024-04-23T10:20:58.180 INFO:tasks.workunit.client.0.smithi029.stdout:7/228: creat d5/d8/d51/f53 x:0 0 0 2024-04-23T10:20:58.181 INFO:tasks.workunit.client.0.smithi029.stdout:7/229: fsync d5/d29/f38 0 2024-04-23T10:20:58.187 INFO:tasks.workunit.client.0.smithi029.stdout:7/230: rename d5/d8/d1a/l35 to d5/d29/l54 0 2024-04-23T10:20:58.205 INFO:tasks.workunit.client.0.smithi029.stdout:7/231: dwrite d5/f30 [0,4194304] 0 2024-04-23T10:20:58.209 INFO:tasks.workunit.client.0.smithi029.stdout:7/232: mkdir d5/d8/d51/d55 0 2024-04-23T10:20:58.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/233: creat d5/d29/d4a/f56 x:0 0 0 2024-04-23T10:20:58.218 INFO:tasks.workunit.client.0.smithi029.stdout:7/234: creat d5/d8/d51/f57 x:0 0 0 2024-04-23T10:20:58.222 INFO:tasks.workunit.client.0.smithi029.stdout:7/235: mkdir d5/d58 0 2024-04-23T10:20:58.224 INFO:tasks.workunit.client.0.smithi029.stdout:7/236: write d5/d29/f3b [3813889,49913] 0 2024-04-23T10:20:58.227 INFO:tasks.workunit.client.0.smithi029.stdout:7/237: dread - d5/d29/d4a/f56 zero size 2024-04-23T10:20:58.234 INFO:tasks.workunit.client.0.smithi029.stdout:7/238: write d5/d8/fb [4705095,3368] 0 2024-04-23T10:20:58.239 INFO:tasks.workunit.client.0.smithi029.stdout:7/239: mkdir d5/d8/d51/d55/d59 0 2024-04-23T10:20:58.241 INFO:tasks.workunit.client.0.smithi029.stdout:7/240: chown d5/d58 300074848 1 2024-04-23T10:20:58.244 INFO:tasks.workunit.client.0.smithi029.stdout:7/241: truncate d5/f2c 5176596 0 2024-04-23T10:20:58.245 INFO:tasks.workunit.client.0.smithi029.stdout:7/242: fsync d5/f24 0 2024-04-23T10:20:58.249 INFO:tasks.workunit.client.0.smithi029.stdout:7/243: write d5/f28 [4211279,72456] 0 2024-04-23T10:20:58.252 INFO:tasks.workunit.client.0.smithi029.stdout:7/244: chown d5/d8/l42 187 1 2024-04-23T10:20:58.254 INFO:tasks.workunit.client.0.smithi029.stdout:7/245: dread - d5/d9/f3a zero size 2024-04-23T10:20:58.256 INFO:tasks.workunit.client.0.smithi029.stdout:7/246: write d5/f47 [859548,8854] 0 2024-04-23T10:20:58.259 INFO:tasks.workunit.client.0.smithi029.stdout:7/247: rmdir d5/d29 39 2024-04-23T10:20:58.270 INFO:tasks.workunit.client.0.smithi029.stdout:7/248: dread d5/f30 [0,4194304] 0 2024-04-23T10:20:58.286 INFO:tasks.workunit.client.0.smithi029.stdout:7/249: dwrite d5/d8/d1a/d4d/f52 [0,4194304] 0 2024-04-23T10:20:58.342 INFO:tasks.workunit.client.0.smithi029.stdout:3/203: sync 2024-04-23T10:20:58.350 INFO:tasks.workunit.client.0.smithi029.stdout:3/204: dread d3/d10/de/f12 [0,4194304] 0 2024-04-23T10:20:58.361 INFO:tasks.workunit.client.0.smithi029.stdout:3/205: dread d3/d10/d27/d31/f26 [0,4194304] 0 2024-04-23T10:20:58.365 INFO:tasks.workunit.client.0.smithi029.stdout:3/206: mkdir d3/d10/de/d2e/d36/d40 0 2024-04-23T10:20:58.370 INFO:tasks.workunit.client.0.smithi029.stdout:3/207: read d3/d10/de/d2e/d36/f33 [584069,107779] 0 2024-04-23T10:20:58.378 INFO:tasks.workunit.client.0.smithi029.stdout:3/208: dread d3/d15/f1d [0,4194304] 0 2024-04-23T10:20:58.448 INFO:tasks.workunit.client.0.smithi029.stdout:3/209: write d3/d10/d27/f3a [990157,3942] 0 2024-04-23T10:20:58.450 INFO:tasks.workunit.client.0.smithi029.stdout:3/210: fsync d3/d10/d27/d31/f1a 0 2024-04-23T10:20:58.452 INFO:tasks.workunit.client.0.smithi029.stdout:3/211: readlink d3/d10/l3d 0 2024-04-23T10:20:58.461 INFO:tasks.workunit.client.0.smithi029.stdout:3/212: getdents d3/d10/d27 0 2024-04-23T10:20:58.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/213: dread - d3/f2a zero size 2024-04-23T10:20:58.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/214: creat d3/d10/de/d2e/d36/d40/f41 x:0 0 0 2024-04-23T10:20:58.473 INFO:tasks.workunit.client.0.smithi029.stdout:3/215: unlink d3/d10/d27/f3a 0 2024-04-23T10:20:58.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/216: creat d3/d10/de/d2e/f42 x:0 0 0 2024-04-23T10:20:58.508 INFO:tasks.workunit.client.0.smithi029.stdout:3/217: dread d3/d15/f18 [0,4194304] 0 2024-04-23T10:20:58.511 INFO:tasks.workunit.client.0.smithi029.stdout:3/218: write d3/d10/f20 [2873090,18768] 0 2024-04-23T10:20:58.517 INFO:tasks.workunit.client.0.smithi029.stdout:3/219: mkdir d3/d10/de/d2e/d36/d40/d43 0 2024-04-23T10:20:58.528 INFO:tasks.workunit.client.0.smithi029.stdout:7/250: dread d5/d9/f33 [0,4194304] 0 2024-04-23T10:20:58.533 INFO:tasks.workunit.client.0.smithi029.stdout:5/339: sync 2024-04-23T10:20:58.533 INFO:tasks.workunit.client.0.smithi029.stdout:2/290: sync 2024-04-23T10:20:58.536 INFO:tasks.workunit.client.0.smithi029.stdout:5/340: write d0/d35/f1c [231383,107190] 0 2024-04-23T10:20:58.542 INFO:tasks.workunit.client.0.smithi029.stdout:2/291: creat d1/d3e/f66 x:0 0 0 2024-04-23T10:20:58.545 INFO:tasks.workunit.client.0.smithi029.stdout:5/341: creat d0/d35/d38/d3e/f79 x:0 0 0 2024-04-23T10:20:58.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/251: write d5/d8/f25 [3212364,8448] 0 2024-04-23T10:20:58.548 INFO:tasks.workunit.client.0.smithi029.stdout:2/292: dread d1/f2e [0,4194304] 0 2024-04-23T10:20:58.550 INFO:tasks.workunit.client.0.smithi029.stdout:2/293: stat d1/f2e 0 2024-04-23T10:20:58.553 INFO:tasks.workunit.client.0.smithi029.stdout:3/220: dread d3/d10/f2b [0,4194304] 0 2024-04-23T10:20:58.555 INFO:tasks.workunit.client.0.smithi029.stdout:2/294: write d1/d3e/f66 [694667,34061] 0 2024-04-23T10:20:58.556 INFO:tasks.workunit.client.0.smithi029.stdout:7/252: mknod d5/d58/c5a 0 2024-04-23T10:20:58.559 INFO:tasks.workunit.client.0.smithi029.stdout:2/295: read - d1/dd/f62 zero size 2024-04-23T10:20:58.565 INFO:tasks.workunit.client.0.smithi029.stdout:2/296: rmdir d1/d31 39 2024-04-23T10:20:58.569 INFO:tasks.workunit.client.0.smithi029.stdout:7/253: creat d5/d29/f5b x:0 0 0 2024-04-23T10:20:58.569 INFO:tasks.workunit.client.0.smithi029.stdout:2/297: rmdir d1 39 2024-04-23T10:20:58.577 INFO:tasks.workunit.client.0.smithi029.stdout:7/254: creat d5/d8/d51/f5c x:0 0 0 2024-04-23T10:20:58.579 INFO:tasks.workunit.client.0.smithi029.stdout:2/298: rename d1/d4/l1a to d1/d3e/l67 0 2024-04-23T10:20:58.580 INFO:tasks.workunit.client.0.smithi029.stdout:3/221: dwrite d3/d10/f20 [4194304,4194304] 0 2024-04-23T10:20:58.590 INFO:tasks.workunit.client.0.smithi029.stdout:7/255: creat d5/d8/d51/d55/d59/f5d x:0 0 0 2024-04-23T10:20:58.593 INFO:tasks.workunit.client.0.smithi029.stdout:3/222: truncate d3/f8 1530102 0 2024-04-23T10:20:58.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/256: symlink d5/d8/d51/d55/l5e 0 2024-04-23T10:20:58.607 INFO:tasks.workunit.client.0.smithi029.stdout:7/257: write d5/d9/f3a [851745,44557] 0 2024-04-23T10:20:58.613 INFO:tasks.workunit.client.0.smithi029.stdout:7/258: mknod d5/d8/d51/d55/d59/c5f 0 2024-04-23T10:20:58.615 INFO:tasks.workunit.client.0.smithi029.stdout:2/299: dwrite d1/d4/f11 [0,4194304] 0 2024-04-23T10:20:58.621 INFO:tasks.workunit.client.0.smithi029.stdout:7/259: symlink d5/d8/d51/l60 0 2024-04-23T10:20:58.623 INFO:tasks.workunit.client.0.smithi029.stdout:2/300: mknod d1/d3e/d3b/c68 0 2024-04-23T10:20:58.624 INFO:tasks.workunit.client.0.smithi029.stdout:7/260: rmdir d5/d8/d1a/d4d 39 2024-04-23T10:20:58.629 INFO:tasks.workunit.client.0.smithi029.stdout:7/261: rmdir d5 39 2024-04-23T10:20:58.637 INFO:tasks.workunit.client.0.smithi029.stdout:2/301: symlink d1/d31/d50/l69 0 2024-04-23T10:20:58.640 INFO:tasks.workunit.client.0.smithi029.stdout:7/262: dread - d5/d8/d51/f57 zero size 2024-04-23T10:20:58.644 INFO:tasks.workunit.client.0.smithi029.stdout:7/263: fdatasync d5/d8/d51/d55/d59/f5d 0 2024-04-23T10:20:58.647 INFO:tasks.workunit.client.0.smithi029.stdout:2/302: rename d1/dd/f4e to d1/dd/d47/f6a 0 2024-04-23T10:20:58.650 INFO:tasks.workunit.client.0.smithi029.stdout:7/264: creat d5/d8/d51/d55/d59/f61 x:0 0 0 2024-04-23T10:20:58.652 INFO:tasks.workunit.client.0.smithi029.stdout:7/265: write f1 [4826714,69393] 0 2024-04-23T10:20:58.652 INFO:tasks.workunit.client.0.smithi029.stdout:2/303: creat d1/dd/d47/d63/d64/f6b x:0 0 0 2024-04-23T10:20:58.658 INFO:tasks.workunit.client.0.smithi029.stdout:2/304: mknod d1/dd/d22/c6c 0 2024-04-23T10:20:58.660 INFO:tasks.workunit.client.0.smithi029.stdout:2/305: chown d1/d3e/l2b 16398160 1 2024-04-23T10:20:58.660 INFO:tasks.workunit.client.0.smithi029.stdout:2/306: fsync d1/d3e/f4c 0 2024-04-23T10:20:58.661 INFO:tasks.workunit.client.0.smithi029.stdout:7/266: getdents d5/d8/d51 0 2024-04-23T10:20:58.662 INFO:tasks.workunit.client.0.smithi029.stdout:2/307: chown d1/d31/d50/c59 774712 1 2024-04-23T10:20:58.666 INFO:tasks.workunit.client.0.smithi029.stdout:2/308: mkdir d1/d3e/d5a/d6d 0 2024-04-23T10:20:58.668 INFO:tasks.workunit.client.0.smithi029.stdout:2/309: write d1/dd/d47/f5d [951309,123154] 0 2024-04-23T10:20:58.679 INFO:tasks.workunit.client.0.smithi029.stdout:2/310: dwrite d1/dd/d47/f6a [0,4194304] 0 2024-04-23T10:20:58.683 INFO:tasks.workunit.client.0.smithi029.stdout:2/311: creat d1/d3e/d5a/f6e x:0 0 0 2024-04-23T10:20:58.685 INFO:tasks.workunit.client.0.smithi029.stdout:7/267: truncate d5/d9/f2b 1505472 0 2024-04-23T10:20:58.685 INFO:tasks.workunit.client.0.smithi029.stdout:3/223: read d3/d10/de/f14 [67352,15104] 0 2024-04-23T10:20:58.686 INFO:tasks.workunit.client.0.smithi029.stdout:2/312: fdatasync d1/dd/f1d 0 2024-04-23T10:20:58.688 INFO:tasks.workunit.client.0.smithi029.stdout:2/313: chown d1/d3e/c2a 185791 1 2024-04-23T10:20:58.690 INFO:tasks.workunit.client.0.smithi029.stdout:3/224: mknod d3/d10/de/c44 0 2024-04-23T10:20:58.690 INFO:tasks.workunit.client.0.smithi029.stdout:7/268: mknod d5/d29/c62 0 2024-04-23T10:20:58.692 INFO:tasks.workunit.client.0.smithi029.stdout:3/225: chown d3/d15/f29 4185 1 2024-04-23T10:20:58.693 INFO:tasks.workunit.client.0.smithi029.stdout:2/314: creat d1/d3e/d5a/f6f x:0 0 0 2024-04-23T10:20:58.694 INFO:tasks.workunit.client.0.smithi029.stdout:2/315: chown d1/dd/c5f 10063845 1 2024-04-23T10:20:58.696 INFO:tasks.workunit.client.0.smithi029.stdout:7/269: unlink d5/f17 0 2024-04-23T10:20:58.697 INFO:tasks.workunit.client.0.smithi029.stdout:7/270: fdatasync d5/d9/f26 0 2024-04-23T10:20:58.699 INFO:tasks.workunit.client.0.smithi029.stdout:7/271: write d5/d29/f5b [329923,109424] 0 2024-04-23T10:20:58.701 INFO:tasks.workunit.client.0.smithi029.stdout:7/272: write d5/d29/f37 [3773652,42391] 0 2024-04-23T10:20:58.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/316: dwrite d1/dd/f51 [0,4194304] 0 2024-04-23T10:20:58.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/317: dread - d1/dd/d47/d63/d64/f6b zero size 2024-04-23T10:20:58.719 INFO:tasks.workunit.client.0.smithi029.stdout:7/273: dwrite d5/d8/f32 [0,4194304] 0 2024-04-23T10:20:58.719 INFO:tasks.workunit.client.0.smithi029.stdout:2/318: dread d1/dd/d22/f2c [0,4194304] 0 2024-04-23T10:20:58.722 INFO:tasks.workunit.client.0.smithi029.stdout:2/319: write d1/d4/f44 [571571,122802] 0 2024-04-23T10:20:58.723 INFO:tasks.workunit.client.0.smithi029.stdout:2/320: write d1/dd/d22/f54 [993617,99273] 0 2024-04-23T10:20:58.725 INFO:tasks.workunit.client.0.smithi029.stdout:2/321: read d1/d3e/f4c [693286,43397] 0 2024-04-23T10:20:58.731 INFO:tasks.workunit.client.0.smithi029.stdout:6/301: sync 2024-04-23T10:20:58.731 INFO:tasks.workunit.client.0.smithi029.stdout:1/228: sync 2024-04-23T10:20:58.754 INFO:tasks.workunit.client.0.smithi029.stdout:1/229: creat d5/d6/de/d22/f52 x:0 0 0 2024-04-23T10:20:58.755 INFO:tasks.workunit.client.0.smithi029.stdout:2/322: dwrite d1/d3e/f66 [0,4194304] 0 2024-04-23T10:20:58.758 INFO:tasks.workunit.client.0.smithi029.stdout:2/323: write d1/d4/f1e [2374696,112446] 0 2024-04-23T10:20:58.764 INFO:tasks.workunit.client.0.smithi029.stdout:7/274: creat d5/f63 x:0 0 0 2024-04-23T10:20:58.766 INFO:tasks.workunit.client.0.smithi029.stdout:2/324: mknod d1/dd/d60/c70 0 2024-04-23T10:20:58.773 INFO:tasks.workunit.client.0.smithi029.stdout:1/230: dwrite d5/fd [0,4194304] 0 2024-04-23T10:20:58.775 INFO:tasks.workunit.client.0.smithi029.stdout:2/325: dread d1/d3e/f38 [0,4194304] 0 2024-04-23T10:20:58.776 INFO:tasks.workunit.client.0.smithi029.stdout:2/326: fdatasync d1/dd/f51 0 2024-04-23T10:20:58.779 INFO:tasks.workunit.client.0.smithi029.stdout:7/275: link d5/fe d5/d8/d1a/d4d/f64 0 2024-04-23T10:20:58.786 INFO:tasks.workunit.client.0.smithi029.stdout:6/302: dread f4 [0,4194304] 0 2024-04-23T10:20:58.787 INFO:tasks.workunit.client.0.smithi029.stdout:7/276: creat d5/d9/f65 x:0 0 0 2024-04-23T10:20:58.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/303: creat d9/df/d16/d1f/d27/d2d/d58/f6b x:0 0 0 2024-04-23T10:20:58.797 INFO:tasks.workunit.client.0.smithi029.stdout:2/327: dwrite d1/dd/f49 [0,4194304] 0 2024-04-23T10:20:58.798 INFO:tasks.workunit.client.0.smithi029.stdout:7/277: dread d5/f28 [0,4194304] 0 2024-04-23T10:20:58.798 INFO:tasks.workunit.client.0.smithi029.stdout:2/328: chown d1/d4/l43 3578 1 2024-04-23T10:20:58.801 INFO:tasks.workunit.client.0.smithi029.stdout:7/278: creat d5/d8/d51/d55/f66 x:0 0 0 2024-04-23T10:20:58.804 INFO:tasks.workunit.client.0.smithi029.stdout:7/279: dread - d5/f4f zero size 2024-04-23T10:20:58.806 INFO:tasks.workunit.client.0.smithi029.stdout:6/304: dwrite d9/df/d25/f5f [0,4194304] 0 2024-04-23T10:20:58.812 INFO:tasks.workunit.client.0.smithi029.stdout:7/280: rename d5/d8/d1a/f46 to d5/d29/f67 0 2024-04-23T10:20:58.815 INFO:tasks.workunit.client.0.smithi029.stdout:6/305: creat d9/df/d41/f6c x:0 0 0 2024-04-23T10:20:58.821 INFO:tasks.workunit.client.0.smithi029.stdout:6/306: unlink d9/df/d16/d44/d4c/l55 0 2024-04-23T10:20:58.823 INFO:tasks.workunit.client.0.smithi029.stdout:7/281: truncate d5/d29/f38 128178 0 2024-04-23T10:20:58.824 INFO:tasks.workunit.client.0.smithi029.stdout:6/307: mknod d9/df/d16/d1f/d2c/c6d 0 2024-04-23T10:20:58.825 INFO:tasks.workunit.client.0.smithi029.stdout:6/308: read - d9/df/d16/d1f/d2c/f4a zero size 2024-04-23T10:20:58.826 INFO:tasks.workunit.client.0.smithi029.stdout:7/282: read - d5/d8/f36 zero size 2024-04-23T10:20:58.826 INFO:tasks.workunit.client.0.smithi029.stdout:6/309: stat d9/df/d16/d44/f62 0 2024-04-23T10:20:58.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/310: dread - d9/df/d16/d44/f62 zero size 2024-04-23T10:20:58.828 INFO:tasks.workunit.client.0.smithi029.stdout:7/283: fsync d5/d8/f23 0 2024-04-23T10:20:58.829 INFO:tasks.workunit.client.0.smithi029.stdout:7/284: write d5/d8/fb [1209605,28377] 0 2024-04-23T10:20:58.834 INFO:tasks.workunit.client.0.smithi029.stdout:7/285: fsync d5/f2c 0 2024-04-23T10:20:58.835 INFO:tasks.workunit.client.0.smithi029.stdout:7/286: stat d5/d9/ld 0 2024-04-23T10:20:58.835 INFO:tasks.workunit.client.0.smithi029.stdout:7/287: dread - d5/f4f zero size 2024-04-23T10:20:58.838 INFO:tasks.workunit.client.0.smithi029.stdout:7/288: readlink d5/d8/l15 0 2024-04-23T10:20:58.842 INFO:tasks.workunit.client.0.smithi029.stdout:6/311: dwrite d9/df/d16/f24 [0,4194304] 0 2024-04-23T10:20:58.842 INFO:tasks.workunit.client.0.smithi029.stdout:7/289: symlink d5/d8/d1a/l68 0 2024-04-23T10:20:58.846 INFO:tasks.workunit.client.0.smithi029.stdout:6/312: creat d9/df/d16/d34/d36/f6e x:0 0 0 2024-04-23T10:20:58.847 INFO:tasks.workunit.client.0.smithi029.stdout:7/290: mknod d5/d58/c69 0 2024-04-23T10:20:58.849 INFO:tasks.workunit.client.0.smithi029.stdout:6/313: creat d9/df/d41/d49/d69/f6f x:0 0 0 2024-04-23T10:20:58.850 INFO:tasks.workunit.client.0.smithi029.stdout:6/314: chown d9/df/d16/c67 2023925 1 2024-04-23T10:20:58.852 INFO:tasks.workunit.client.0.smithi029.stdout:6/315: write d9/df/d16/d1f/d27/f57 [163747,36372] 0 2024-04-23T10:20:58.852 INFO:tasks.workunit.client.0.smithi029.stdout:7/291: getdents d5/d29 0 2024-04-23T10:20:58.859 INFO:tasks.workunit.client.0.smithi029.stdout:6/316: creat d9/df/d16/d1f/d27/f70 x:0 0 0 2024-04-23T10:20:58.861 INFO:tasks.workunit.client.0.smithi029.stdout:7/292: link d5/d8/c11 d5/d8/d51/d55/c6a 0 2024-04-23T10:20:58.861 INFO:tasks.workunit.client.0.smithi029.stdout:5/342: dread d0/d35/d10/f71 [0,4194304] 0 2024-04-23T10:20:58.862 INFO:tasks.workunit.client.0.smithi029.stdout:7/293: chown d5/fe 166 1 2024-04-23T10:20:58.862 INFO:tasks.workunit.client.0.smithi029.stdout:6/317: creat d9/d5b/f71 x:0 0 0 2024-04-23T10:20:58.863 INFO:tasks.workunit.client.0.smithi029.stdout:7/294: dread - d5/f41 zero size 2024-04-23T10:20:58.864 INFO:tasks.workunit.client.0.smithi029.stdout:7/295: read - d5/d8/d51/f5c zero size 2024-04-23T10:20:58.865 INFO:tasks.workunit.client.0.smithi029.stdout:5/343: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/f7a x:0 0 0 2024-04-23T10:20:58.866 INFO:tasks.workunit.client.0.smithi029.stdout:5/344: chown d0/d35/d38/d3e/d66/d5a/d78/f32 25532 1 2024-04-23T10:20:58.867 INFO:tasks.workunit.client.0.smithi029.stdout:5/345: read - d0/d35/d38/d3e/f79 zero size 2024-04-23T10:20:58.868 INFO:tasks.workunit.client.0.smithi029.stdout:5/346: chown d0/d35/d10/f71 230537 1 2024-04-23T10:20:58.869 INFO:tasks.workunit.client.0.smithi029.stdout:6/318: getdents d9/df/d16/d1f/d27/d2d 0 2024-04-23T10:20:58.870 INFO:tasks.workunit.client.0.smithi029.stdout:5/347: write d0/d35/d38/d3e/d66/d5a/d78/d3d/f4f [1656797,8810] 0 2024-04-23T10:20:58.876 INFO:tasks.workunit.client.0.smithi029.stdout:5/348: link d0/d35/d38/d3e/d66/d5a/f77 d0/d35/d38/d39/d3f/f7b 0 2024-04-23T10:20:58.879 INFO:tasks.workunit.client.0.smithi029.stdout:7/296: write d5/f18 [319417,123079] 0 2024-04-23T10:20:58.879 INFO:tasks.workunit.client.0.smithi029.stdout:6/319: dwrite d9/df/d25/f5f [4194304,4194304] 0 2024-04-23T10:20:58.879 INFO:tasks.workunit.client.0.smithi029.stdout:5/349: write d0/d35/d38/d3e/d66/d5a/d78/d6d/f58 [71352,124631] 0 2024-04-23T10:20:58.883 INFO:tasks.workunit.client.0.smithi029.stdout:5/350: chown d0/d35/d38/d3e/d66/d5a/d78/c3c 82045 1 2024-04-23T10:20:58.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/320: rename d9/df/d16/d34/f3f to d9/df/d16/d1f/d27/d33/f72 0 2024-04-23T10:20:58.889 INFO:tasks.workunit.client.0.smithi029.stdout:5/351: mknod d0/d6a/c7c 0 2024-04-23T10:20:58.890 INFO:tasks.workunit.client.0.smithi029.stdout:6/321: readlink d9/df/d16/d1f/d27/l5e 0 2024-04-23T10:20:58.890 INFO:tasks.workunit.client.0.smithi029.stdout:7/297: dwrite d5/d8/d1a/f1b [0,4194304] 0 2024-04-23T10:20:58.892 INFO:tasks.workunit.client.0.smithi029.stdout:7/298: write d5/d8/f25 [3055206,112527] 0 2024-04-23T10:20:58.893 INFO:tasks.workunit.client.0.smithi029.stdout:7/299: write d5/f18 [3714858,6651] 0 2024-04-23T10:20:58.895 INFO:tasks.workunit.client.0.smithi029.stdout:6/322: creat d9/df/f73 x:0 0 0 2024-04-23T10:20:58.898 INFO:tasks.workunit.client.0.smithi029.stdout:6/323: creat d9/df/d25/f74 x:0 0 0 2024-04-23T10:20:58.902 INFO:tasks.workunit.client.0.smithi029.stdout:7/300: mkdir d5/d6b 0 2024-04-23T10:20:58.902 INFO:tasks.workunit.client.0.smithi029.stdout:6/324: mkdir d9/df/d16/d44/d75 0 2024-04-23T10:20:58.905 INFO:tasks.workunit.client.0.smithi029.stdout:7/301: creat d5/d29/f6c x:0 0 0 2024-04-23T10:20:58.908 INFO:tasks.workunit.client.0.smithi029.stdout:7/302: symlink d5/d8/d51/d55/d59/l6d 0 2024-04-23T10:20:58.909 INFO:tasks.workunit.client.0.smithi029.stdout:6/325: link d9/df/d16/d44/c45 d9/df/d16/d44/c76 0 2024-04-23T10:20:58.909 INFO:tasks.workunit.client.0.smithi029.stdout:7/303: rmdir d5/d8/d51/d55/d59 39 2024-04-23T10:20:58.914 INFO:tasks.workunit.client.0.smithi029.stdout:5/352: truncate d0/d35/d38/d51/f46 2126529 0 2024-04-23T10:20:58.915 INFO:tasks.workunit.client.0.smithi029.stdout:7/304: write d5/f30 [2907248,9007] 0 2024-04-23T10:20:58.923 INFO:tasks.workunit.client.0.smithi029.stdout:5/353: dwrite d0/f2c [4194304,4194304] 0 2024-04-23T10:20:58.923 INFO:tasks.workunit.client.0.smithi029.stdout:7/305: rmdir d5/d8/d1a/d4d 39 2024-04-23T10:20:58.923 INFO:tasks.workunit.client.0.smithi029.stdout:6/326: dwrite d9/fe [0,4194304] 0 2024-04-23T10:20:58.928 INFO:tasks.workunit.client.0.smithi029.stdout:5/354: creat d0/d35/d38/d39/d3f/f7d x:0 0 0 2024-04-23T10:20:58.929 INFO:tasks.workunit.client.0.smithi029.stdout:6/327: mknod d9/df/c77 0 2024-04-23T10:20:58.941 INFO:tasks.workunit.client.0.smithi029.stdout:5/355: dwrite d0/d35/f1c [0,4194304] 0 2024-04-23T10:20:58.944 INFO:tasks.workunit.client.0.smithi029.stdout:5/356: truncate d0/d35/d38/d3e/d66/f6c 4334654 0 2024-04-23T10:20:58.945 INFO:tasks.workunit.client.0.smithi029.stdout:6/328: dwrite d9/df/d16/d34/f65 [0,4194304] 0 2024-04-23T10:20:58.946 INFO:tasks.workunit.client.0.smithi029.stdout:7/306: link d5/d8/d51/l60 d5/d8/d51/l6e 0 2024-04-23T10:20:58.949 INFO:tasks.workunit.client.0.smithi029.stdout:6/329: readlink d9/l2f 0 2024-04-23T10:20:58.955 INFO:tasks.workunit.client.0.smithi029.stdout:6/330: rename d9/df/d16/d34/d36/l54 to d9/df/d16/d1f/d2c/l78 0 2024-04-23T10:20:58.962 INFO:tasks.workunit.client.0.smithi029.stdout:7/307: link d5/f18 d5/d8/f6f 0 2024-04-23T10:20:58.963 INFO:tasks.workunit.client.0.smithi029.stdout:5/357: getdents d0/d35/d38 0 2024-04-23T10:20:58.964 INFO:tasks.workunit.client.0.smithi029.stdout:5/358: dread - d0/d35/d38/d39/d3f/f7d zero size 2024-04-23T10:20:58.967 INFO:tasks.workunit.client.0.smithi029.stdout:5/359: symlink d0/d35/d38/l7e 0 2024-04-23T10:20:58.970 INFO:tasks.workunit.client.0.smithi029.stdout:9/281: sync 2024-04-23T10:20:58.970 INFO:tasks.workunit.client.0.smithi029.stdout:0/156: sync 2024-04-23T10:20:58.970 INFO:tasks.workunit.client.0.smithi029.stdout:4/278: sync 2024-04-23T10:20:58.970 INFO:tasks.workunit.client.0.smithi029.stdout:8/285: sync 2024-04-23T10:20:58.992 INFO:tasks.workunit.client.0.smithi029.stdout:6/331: dwrite d9/df/f22 [0,4194304] 0 2024-04-23T10:20:58.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/308: truncate d5/d29/f37 1606212 0 2024-04-23T10:20:58.994 INFO:tasks.workunit.client.0.smithi029.stdout:8/286: symlink d3/l5e 0 2024-04-23T10:20:58.995 INFO:tasks.workunit.client.0.smithi029.stdout:4/279: creat d0/d12/f62 x:0 0 0 2024-04-23T10:20:58.997 INFO:tasks.workunit.client.0.smithi029.stdout:7/309: write d5/d9/f33 [1212000,82930] 0 2024-04-23T10:20:58.997 INFO:tasks.workunit.client.0.smithi029.stdout:6/332: symlink d9/df/d16/d44/d4c/l79 0 2024-04-23T10:20:58.999 INFO:tasks.workunit.client.0.smithi029.stdout:4/280: dread - d0/d3c/d52/f1d zero size 2024-04-23T10:20:59.000 INFO:tasks.workunit.client.0.smithi029.stdout:5/360: truncate d0/d35/d38/d51/f46 1896505 0 2024-04-23T10:20:59.003 INFO:tasks.workunit.client.0.smithi029.stdout:6/333: write d9/df/d16/d1f/f38 [311396,58408] 0 2024-04-23T10:20:59.006 INFO:tasks.workunit.client.0.smithi029.stdout:4/281: rename d0/d12/l38 to d0/d3c/d52/d1b/d5b/l63 0 2024-04-23T10:20:59.008 INFO:tasks.workunit.client.0.smithi029.stdout:7/310: mknod d5/d8/d51/d55/d59/c70 0 2024-04-23T10:20:59.010 INFO:tasks.workunit.client.0.smithi029.stdout:8/287: getdents d3/d2f/d36/d3e 0 2024-04-23T10:20:59.013 INFO:tasks.workunit.client.0.smithi029.stdout:8/288: dread - d3/d2f/d36/f59 zero size 2024-04-23T10:20:59.015 INFO:tasks.workunit.client.0.smithi029.stdout:6/334: mknod d9/df/d16/d44/c7a 0 2024-04-23T10:20:59.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/311: mkdir d5/d71 0 2024-04-23T10:20:59.017 INFO:tasks.workunit.client.0.smithi029.stdout:8/289: truncate d3/f7 2044989 0 2024-04-23T10:20:59.017 INFO:tasks.workunit.client.0.smithi029.stdout:9/282: dread d0/d7/f18 [0,4194304] 0 2024-04-23T10:20:59.018 INFO:tasks.workunit.client.0.smithi029.stdout:7/312: stat d5/f63 0 2024-04-23T10:20:59.019 INFO:tasks.workunit.client.0.smithi029.stdout:5/361: dwrite d0/d35/d38/d39/d3f/f74 [0,4194304] 0 2024-04-23T10:20:59.023 INFO:tasks.workunit.client.0.smithi029.stdout:8/290: truncate d3/d38/f4d 180472 0 2024-04-23T10:20:59.024 INFO:tasks.workunit.client.0.smithi029.stdout:5/362: write d0/d35/d38/d51/f43 [1422340,4986] 0 2024-04-23T10:20:59.028 INFO:tasks.workunit.client.0.smithi029.stdout:4/282: dwrite d0/d3c/d52/f1d [0,4194304] 0 2024-04-23T10:20:59.032 INFO:tasks.workunit.client.0.smithi029.stdout:7/313: getdents d5/d8/d1a 0 2024-04-23T10:20:59.034 INFO:tasks.workunit.client.0.smithi029.stdout:6/335: dread d9/df/d16/d34/f51 [0,4194304] 0 2024-04-23T10:20:59.035 INFO:tasks.workunit.client.0.smithi029.stdout:9/283: dread d0/d7/f1a [0,4194304] 0 2024-04-23T10:20:59.035 INFO:tasks.workunit.client.0.smithi029.stdout:9/284: stat d0/d7/d3f/f41 0 2024-04-23T10:20:59.036 INFO:tasks.workunit.client.0.smithi029.stdout:9/285: chown d0/d7/d1d/f57 2307 1 2024-04-23T10:20:59.038 INFO:tasks.workunit.client.0.smithi029.stdout:7/314: chown d5/d8/l39 3131505 1 2024-04-23T10:20:59.039 INFO:tasks.workunit.client.0.smithi029.stdout:7/315: fdatasync d5/d9/f49 0 2024-04-23T10:20:59.040 INFO:tasks.workunit.client.0.smithi029.stdout:6/336: symlink d9/df/d41/l7b 0 2024-04-23T10:20:59.042 INFO:tasks.workunit.client.0.smithi029.stdout:9/286: symlink d0/d1b/d39/l5e 0 2024-04-23T10:20:59.047 INFO:tasks.workunit.client.0.smithi029.stdout:6/337: fdatasync d9/df/d16/d1f/d27/d33/f32 0 2024-04-23T10:20:59.048 INFO:tasks.workunit.client.0.smithi029.stdout:4/283: link d0/d3c/d52/d1b/d36/l3a d0/d12/l64 0 2024-04-23T10:20:59.048 INFO:tasks.workunit.client.0.smithi029.stdout:7/316: truncate d5/f24 1057658 0 2024-04-23T10:20:59.050 INFO:tasks.workunit.client.0.smithi029.stdout:7/317: dread - d5/d8/d51/d55/d59/f5d zero size 2024-04-23T10:20:59.051 INFO:tasks.workunit.client.0.smithi029.stdout:4/284: mkdir d0/d3c/d52/d1b/d5b/d65 0 2024-04-23T10:20:59.053 INFO:tasks.workunit.client.0.smithi029.stdout:4/285: write d0/d12/f49 [381268,26573] 0 2024-04-23T10:20:59.057 INFO:tasks.workunit.client.0.smithi029.stdout:8/291: dwrite d3/f11 [0,4194304] 0 2024-04-23T10:20:59.057 INFO:tasks.workunit.client.0.smithi029.stdout:0/157: dread d0/f7 [0,4194304] 0 2024-04-23T10:20:59.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/292: chown d3/d2f/d36 40796623 1 2024-04-23T10:20:59.059 INFO:tasks.workunit.client.0.smithi029.stdout:7/318: creat d5/d71/f72 x:0 0 0 2024-04-23T10:20:59.059 INFO:tasks.workunit.client.0.smithi029.stdout:6/338: link d9/df/d16/d1f/d27/l5e d9/df/d16/d34/l7c 0 2024-04-23T10:20:59.060 INFO:tasks.workunit.client.0.smithi029.stdout:7/319: chown d5/d8/l42 991105 1 2024-04-23T10:20:59.061 INFO:tasks.workunit.client.0.smithi029.stdout:8/293: creat d3/d44/f5f x:0 0 0 2024-04-23T10:20:59.061 INFO:tasks.workunit.client.0.smithi029.stdout:8/294: readlink d3/l4b 0 2024-04-23T10:20:59.062 INFO:tasks.workunit.client.0.smithi029.stdout:8/295: chown d3/l24 25474018 1 2024-04-23T10:20:59.062 INFO:tasks.workunit.client.0.smithi029.stdout:0/158: rename d0/fa to d0/d21/f38 0 2024-04-23T10:20:59.065 INFO:tasks.workunit.client.0.smithi029.stdout:8/296: fdatasync d3/fa 0 2024-04-23T10:20:59.066 INFO:tasks.workunit.client.0.smithi029.stdout:0/159: write d0/dc/d27/f30 [4740043,7046] 0 2024-04-23T10:20:59.067 INFO:tasks.workunit.client.0.smithi029.stdout:0/160: truncate d0/dc/f36 346794 0 2024-04-23T10:20:59.073 INFO:tasks.workunit.client.0.smithi029.stdout:8/297: write d3/d2f/f35 [4876554,5670] 0 2024-04-23T10:20:59.075 INFO:tasks.workunit.client.0.smithi029.stdout:0/161: write d0/dc/d26/f33 [4032033,72966] 0 2024-04-23T10:20:59.076 INFO:tasks.workunit.client.0.smithi029.stdout:9/287: dread d0/d1b/f31 [0,4194304] 0 2024-04-23T10:20:59.076 INFO:tasks.workunit.client.0.smithi029.stdout:6/339: truncate d9/df/d16/f24 809047 0 2024-04-23T10:20:59.078 INFO:tasks.workunit.client.0.smithi029.stdout:8/298: unlink d3/d2f/d36/d3e/f58 0 2024-04-23T10:20:59.084 INFO:tasks.workunit.client.0.smithi029.stdout:9/288: rename d0/d1b/d44/d49/f54 to d0/d1b/d39/d4f/f5f 0 2024-04-23T10:20:59.087 INFO:tasks.workunit.client.0.smithi029.stdout:8/299: getdents d3 0 2024-04-23T10:20:59.091 INFO:tasks.workunit.client.0.smithi029.stdout:7/320: dwrite d5/d29/f37 [0,4194304] 0 2024-04-23T10:20:59.092 INFO:tasks.workunit.client.0.smithi029.stdout:9/289: write d0/d1b/d39/d4f/f5f [443675,64627] 0 2024-04-23T10:20:59.094 INFO:tasks.workunit.client.0.smithi029.stdout:0/162: dwrite d0/dc/f16 [0,4194304] 0 2024-04-23T10:20:59.096 INFO:tasks.workunit.client.0.smithi029.stdout:6/340: dwrite d9/df/d16/d1f/f38 [0,4194304] 0 2024-04-23T10:20:59.098 INFO:tasks.workunit.client.0.smithi029.stdout:7/321: fsync d5/f18 0 2024-04-23T10:20:59.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/163: unlink d0/dc/f1e 0 2024-04-23T10:20:59.101 INFO:tasks.workunit.client.0.smithi029.stdout:9/290: rmdir d0/d1b/d39/d50 39 2024-04-23T10:20:59.106 INFO:tasks.workunit.client.0.smithi029.stdout:7/322: readlink d5/d8/d51/d55/d59/l6d 0 2024-04-23T10:20:59.109 INFO:tasks.workunit.client.0.smithi029.stdout:8/300: dwrite d3/d2f/f39 [0,4194304] 0 2024-04-23T10:20:59.116 INFO:tasks.workunit.client.0.smithi029.stdout:9/291: chown d0/d7/l5 2125562048 1 2024-04-23T10:20:59.122 INFO:tasks.workunit.client.0.smithi029.stdout:6/341: dwrite d9/df/f73 [0,4194304] 0 2024-04-23T10:20:59.126 INFO:tasks.workunit.client.0.smithi029.stdout:6/342: write d9/df/d16/f56 [207601,83319] 0 2024-04-23T10:20:59.126 INFO:tasks.workunit.client.0.smithi029.stdout:0/164: creat d0/d21/f39 x:0 0 0 2024-04-23T10:20:59.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/323: read d5/f47 [161353,123658] 0 2024-04-23T10:20:59.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/292: mkdir d0/d1b/d60 0 2024-04-23T10:20:59.135 INFO:tasks.workunit.client.0.smithi029.stdout:8/301: write d3/fd [1118504,13912] 0 2024-04-23T10:20:59.135 INFO:tasks.workunit.client.0.smithi029.stdout:0/165: mkdir d0/dc/d27/d3a 0 2024-04-23T10:20:59.137 INFO:tasks.workunit.client.0.smithi029.stdout:0/166: stat d0/f7 0 2024-04-23T10:20:59.139 INFO:tasks.workunit.client.0.smithi029.stdout:9/293: creat d0/d1b/d24/f61 x:0 0 0 2024-04-23T10:20:59.141 INFO:tasks.workunit.client.0.smithi029.stdout:7/324: link d5/d8/d1a/f21 d5/d8/d51/d55/d59/f73 0 2024-04-23T10:20:59.143 INFO:tasks.workunit.client.0.smithi029.stdout:9/294: dread - d0/d7/d3f/f4c zero size 2024-04-23T10:20:59.143 INFO:tasks.workunit.client.0.smithi029.stdout:7/325: truncate d5/f63 51677 0 2024-04-23T10:20:59.146 INFO:tasks.workunit.client.0.smithi029.stdout:8/302: dread d3/d38/f3d [0,4194304] 0 2024-04-23T10:20:59.146 INFO:tasks.workunit.client.0.smithi029.stdout:7/326: write d5/d9/f65 [432797,46825] 0 2024-04-23T10:20:59.148 INFO:tasks.workunit.client.0.smithi029.stdout:9/295: creat d0/d7/d1d/d35/f62 x:0 0 0 2024-04-23T10:20:59.149 INFO:tasks.workunit.client.0.smithi029.stdout:6/343: dwrite d9/df/d16/f2e [0,4194304] 0 2024-04-23T10:20:59.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/167: getdents d0/d1b 0 2024-04-23T10:20:59.152 INFO:tasks.workunit.client.0.smithi029.stdout:9/296: symlink d0/d1b/d39/d4f/l63 0 2024-04-23T10:20:59.153 INFO:tasks.workunit.client.0.smithi029.stdout:9/297: chown d0/d7/d3f/f48 520433517 1 2024-04-23T10:20:59.154 INFO:tasks.workunit.client.0.smithi029.stdout:9/298: chown d0/d1b/d39/d4f/c58 57 1 2024-04-23T10:20:59.154 INFO:tasks.workunit.client.0.smithi029.stdout:6/344: unlink d9/df/d25/f42 0 2024-04-23T10:20:59.155 INFO:tasks.workunit.client.0.smithi029.stdout:7/327: symlink d5/d8/d51/d55/l74 0 2024-04-23T10:20:59.156 INFO:tasks.workunit.client.0.smithi029.stdout:0/168: creat d0/d1b/f3b x:0 0 0 2024-04-23T10:20:59.156 INFO:tasks.workunit.client.0.smithi029.stdout:7/328: readlink d5/d9/l2d 0 2024-04-23T10:20:59.157 INFO:tasks.workunit.client.0.smithi029.stdout:9/299: creat d0/d1b/d44/d49/f64 x:0 0 0 2024-04-23T10:20:59.159 INFO:tasks.workunit.client.0.smithi029.stdout:8/303: getdents d3/d2f 0 2024-04-23T10:20:59.160 INFO:tasks.workunit.client.0.smithi029.stdout:0/169: creat d0/dc/d27/f3c x:0 0 0 2024-04-23T10:20:59.160 INFO:tasks.workunit.client.0.smithi029.stdout:8/304: write d3/fa [4197338,87762] 0 2024-04-23T10:20:59.162 INFO:tasks.workunit.client.0.smithi029.stdout:6/345: dread d9/df/d25/f5f [4194304,4194304] 0 2024-04-23T10:20:59.163 INFO:tasks.workunit.client.0.smithi029.stdout:8/305: dread - d3/d2f/f4c zero size 2024-04-23T10:20:59.164 INFO:tasks.workunit.client.0.smithi029.stdout:7/329: creat d5/d6b/f75 x:0 0 0 2024-04-23T10:20:59.166 INFO:tasks.workunit.client.0.smithi029.stdout:6/346: fsync d9/df/d25/f74 0 2024-04-23T10:20:59.168 INFO:tasks.workunit.client.0.smithi029.stdout:0/170: fsync d0/dc/d26/f28 0 2024-04-23T10:20:59.168 INFO:tasks.workunit.client.0.smithi029.stdout:8/306: creat d3/d2f/d36/d3e/f60 x:0 0 0 2024-04-23T10:20:59.169 INFO:tasks.workunit.client.0.smithi029.stdout:7/330: creat d5/d8/d1a/f76 x:0 0 0 2024-04-23T10:20:59.169 INFO:tasks.workunit.client.0.smithi029.stdout:8/307: chown d3/cf 2175019 1 2024-04-23T10:20:59.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/171: chown d0/f6 126 1 2024-04-23T10:20:59.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/347: unlink d9/c20 0 2024-04-23T10:20:59.172 INFO:tasks.workunit.client.0.smithi029.stdout:7/331: symlink d5/d58/l77 0 2024-04-23T10:20:59.173 INFO:tasks.workunit.client.0.smithi029.stdout:8/308: rename d3/c9 to d3/d38/c61 0 2024-04-23T10:20:59.173 INFO:tasks.workunit.client.0.smithi029.stdout:8/309: stat d3/c2b 0 2024-04-23T10:20:59.174 INFO:tasks.workunit.client.0.smithi029.stdout:0/172: symlink d0/dc/l3d 0 2024-04-23T10:20:59.175 INFO:tasks.workunit.client.0.smithi029.stdout:8/310: read - d3/d38/f5c zero size 2024-04-23T10:20:59.175 INFO:tasks.workunit.client.0.smithi029.stdout:8/311: fdatasync d3/f26 0 2024-04-23T10:20:59.176 INFO:tasks.workunit.client.0.smithi029.stdout:0/173: dread d0/f7 [0,4194304] 0 2024-04-23T10:20:59.176 INFO:tasks.workunit.client.0.smithi029.stdout:8/312: dread - d3/d2f/f54 zero size 2024-04-23T10:20:59.177 INFO:tasks.workunit.client.0.smithi029.stdout:6/348: creat d9/df/d16/f7d x:0 0 0 2024-04-23T10:20:59.177 INFO:tasks.workunit.client.0.smithi029.stdout:8/313: chown f1 4890 1 2024-04-23T10:20:59.181 INFO:tasks.workunit.client.0.smithi029.stdout:8/314: creat d3/d44/f62 x:0 0 0 2024-04-23T10:20:59.181 INFO:tasks.workunit.client.0.smithi029.stdout:8/315: stat d3/d50 0 2024-04-23T10:20:59.181 INFO:tasks.workunit.client.0.smithi029.stdout:9/300: dread d0/d7/f12 [0,4194304] 0 2024-04-23T10:20:59.182 INFO:tasks.workunit.client.0.smithi029.stdout:9/301: chown d0/c46 7594 1 2024-04-23T10:20:59.183 INFO:tasks.workunit.client.0.smithi029.stdout:6/349: mkdir d9/df/d16/d1f/d27/d2d/d58/d7e 0 2024-04-23T10:20:59.184 INFO:tasks.workunit.client.0.smithi029.stdout:9/302: write d0/d1b/f31 [771747,4557] 0 2024-04-23T10:20:59.185 INFO:tasks.workunit.client.0.smithi029.stdout:7/332: creat d5/d8/d1a/f78 x:0 0 0 2024-04-23T10:20:59.187 INFO:tasks.workunit.client.0.smithi029.stdout:6/350: symlink d9/df/d16/d1f/d27/d2d/l7f 0 2024-04-23T10:20:59.187 INFO:tasks.workunit.client.0.smithi029.stdout:7/333: chown d5/l16 2 1 2024-04-23T10:20:59.188 INFO:tasks.workunit.client.0.smithi029.stdout:9/303: mkdir d0/d1b/d44/d49/d65 0 2024-04-23T10:20:59.189 INFO:tasks.workunit.client.0.smithi029.stdout:7/334: chown d5/d9/f26 2417 1 2024-04-23T10:20:59.191 INFO:tasks.workunit.client.0.smithi029.stdout:9/304: mkdir d0/d7/d6/d66 0 2024-04-23T10:20:59.193 INFO:tasks.workunit.client.0.smithi029.stdout:9/305: readlink d0/d1b/d39/d4f/l63 0 2024-04-23T10:20:59.193 INFO:tasks.workunit.client.0.smithi029.stdout:7/335: creat d5/d8/d51/d55/d59/f79 x:0 0 0 2024-04-23T10:20:59.195 INFO:tasks.workunit.client.0.smithi029.stdout:0/174: dread d0/f4 [0,4194304] 0 2024-04-23T10:20:59.195 INFO:tasks.workunit.client.0.smithi029.stdout:6/351: dread d9/df/f22 [0,4194304] 0 2024-04-23T10:20:59.195 INFO:tasks.workunit.client.0.smithi029.stdout:7/336: read d5/d8/f25 [5071736,65750] 0 2024-04-23T10:20:59.197 INFO:tasks.workunit.client.0.smithi029.stdout:8/316: dread d3/f26 [0,4194304] 0 2024-04-23T10:20:59.197 INFO:tasks.workunit.client.0.smithi029.stdout:6/352: stat d9/df/d16/d1f/f38 0 2024-04-23T10:20:59.198 INFO:tasks.workunit.client.0.smithi029.stdout:8/317: readlink d3/l16 0 2024-04-23T10:20:59.199 INFO:tasks.workunit.client.0.smithi029.stdout:0/175: mkdir d0/d3e 0 2024-04-23T10:20:59.200 INFO:tasks.workunit.client.0.smithi029.stdout:4/286: dread d0/f3f [0,4194304] 0 2024-04-23T10:20:59.200 INFO:tasks.workunit.client.0.smithi029.stdout:0/176: chown d0/d1b/f37 43 1 2024-04-23T10:20:59.200 INFO:tasks.workunit.client.0.smithi029.stdout:8/318: symlink d3/d44/l63 0 2024-04-23T10:20:59.200 INFO:tasks.workunit.client.0.smithi029.stdout:0/177: stat d0/d1b/f3b 0 2024-04-23T10:20:59.201 INFO:tasks.workunit.client.0.smithi029.stdout:9/306: dread d0/d7/d3f/f53 [0,4194304] 0 2024-04-23T10:20:59.201 INFO:tasks.workunit.client.0.smithi029.stdout:7/337: creat d5/d8/d1a/f7a x:0 0 0 2024-04-23T10:20:59.208 INFO:tasks.workunit.client.0.smithi029.stdout:9/307: mkdir d0/d1b/d39/d50/d67 0 2024-04-23T10:20:59.211 INFO:tasks.workunit.client.0.smithi029.stdout:6/353: dwrite d9/fe [0,4194304] 0 2024-04-23T10:20:59.214 INFO:tasks.workunit.client.0.smithi029.stdout:4/287: dwrite d0/d3c/d52/f26 [0,4194304] 0 2024-04-23T10:20:59.214 INFO:tasks.workunit.client.0.smithi029.stdout:6/354: chown d9/df/d16/d44/c5c 0 1 2024-04-23T10:20:59.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/338: dread d5/f18 [4194304,4194304] 0 2024-04-23T10:20:59.216 INFO:tasks.workunit.client.0.smithi029.stdout:7/339: fsync d5/d6b/f75 0 2024-04-23T10:20:59.217 INFO:tasks.workunit.client.0.smithi029.stdout:4/288: truncate d0/d3c/d52/d1b/f35 912703 0 2024-04-23T10:20:59.219 INFO:tasks.workunit.client.0.smithi029.stdout:6/355: unlink d9/df/d16/d1f/c39 0 2024-04-23T10:20:59.227 INFO:tasks.workunit.client.0.smithi029.stdout:9/308: dwrite d0/d7/f1a [0,4194304] 0 2024-04-23T10:20:59.228 INFO:tasks.workunit.client.0.smithi029.stdout:0/178: dwrite d0/dc/d26/f33 [0,4194304] 0 2024-04-23T10:20:59.233 INFO:tasks.workunit.client.0.smithi029.stdout:9/309: mkdir d0/d7/d1d/d35/d3b/d68 0 2024-04-23T10:20:59.236 INFO:tasks.workunit.client.0.smithi029.stdout:0/179: write d0/d1b/f2d [1218647,127884] 0 2024-04-23T10:20:59.241 INFO:tasks.workunit.client.0.smithi029.stdout:4/289: dwrite d0/d3c/d52/d1b/f35 [0,4194304] 0 2024-04-23T10:20:59.244 INFO:tasks.workunit.client.0.smithi029.stdout:6/356: truncate d9/df/d16/d1f/d27/d33/f32 868451 0 2024-04-23T10:20:59.246 INFO:tasks.workunit.client.0.smithi029.stdout:4/290: stat d0/d12/l4c 0 2024-04-23T10:20:59.249 INFO:tasks.workunit.client.0.smithi029.stdout:9/310: symlink d0/d1b/d60/l69 0 2024-04-23T10:20:59.252 INFO:tasks.workunit.client.0.smithi029.stdout:6/357: dread d9/df/d16/d34/f65 [0,4194304] 0 2024-04-23T10:20:59.252 INFO:tasks.workunit.client.0.smithi029.stdout:0/180: creat d0/f3f x:0 0 0 2024-04-23T10:20:59.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/291: mkdir d0/d3c/d52/d1b/d66 0 2024-04-23T10:20:59.255 INFO:tasks.workunit.client.0.smithi029.stdout:3/226: sync 2024-04-23T10:20:59.256 INFO:tasks.workunit.client.0.smithi029.stdout:9/311: creat d0/d1b/d39/d50/f6a x:0 0 0 2024-04-23T10:20:59.257 INFO:tasks.workunit.client.0.smithi029.stdout:6/358: creat d9/df/d41/d49/d69/f80 x:0 0 0 2024-04-23T10:20:59.258 INFO:tasks.workunit.client.0.smithi029.stdout:7/340: dread d5/d8/fc [0,4194304] 0 2024-04-23T10:20:59.258 INFO:tasks.workunit.client.0.smithi029.stdout:3/227: mkdir d3/d45 0 2024-04-23T10:20:59.260 INFO:tasks.workunit.client.0.smithi029.stdout:4/292: rename d0/d12/l30 to d0/d3c/d52/d1b/d36/l67 0 2024-04-23T10:20:59.294 INFO:tasks.workunit.client.0.smithi029.stdout:7/341: rmdir d5/d8/d51/d55/d59 39 2024-04-23T10:20:59.295 INFO:tasks.workunit.client.0.smithi029.stdout:3/228: mkdir d3/d10/de/d2e/d36/d40/d46 0 2024-04-23T10:20:59.296 INFO:tasks.workunit.client.0.smithi029.stdout:4/293: read d0/d12/f2b [2802623,124529] 0 2024-04-23T10:20:59.298 INFO:tasks.workunit.client.0.smithi029.stdout:3/229: write d3/d10/de/d2e/f2f [327330,15943] 0 2024-04-23T10:20:59.299 INFO:tasks.workunit.client.0.smithi029.stdout:7/342: unlink d5/d58/c69 0 2024-04-23T10:20:59.302 INFO:tasks.workunit.client.0.smithi029.stdout:9/312: dwrite d0/d7/d6/fc [0,4194304] 0 2024-04-23T10:20:59.303 INFO:tasks.workunit.client.0.smithi029.stdout:9/313: chown d0/d1b/c33 2427240 1 2024-04-23T10:20:59.304 INFO:tasks.workunit.client.0.smithi029.stdout:4/294: mkdir d0/d3c/d52/d1b/d36/d45/d68 0 2024-04-23T10:20:59.305 INFO:tasks.workunit.client.0.smithi029.stdout:7/343: chown d5/d8/d51/d55/d59/f79 54782573 1 2024-04-23T10:20:59.307 INFO:tasks.workunit.client.0.smithi029.stdout:7/344: write d5/f4f [230098,99204] 0 2024-04-23T10:20:59.307 INFO:tasks.workunit.client.0.smithi029.stdout:3/230: unlink d3/d10/de/c44 0 2024-04-23T10:20:59.310 INFO:tasks.workunit.client.0.smithi029.stdout:7/345: rmdir d5/d29 39 2024-04-23T10:20:59.318 INFO:tasks.workunit.client.0.smithi029.stdout:7/346: unlink d5/f28 0 2024-04-23T10:20:59.318 INFO:tasks.workunit.client.0.smithi029.stdout:6/359: truncate d9/df/d16/d34/f51 2253597 0 2024-04-23T10:20:59.319 INFO:tasks.workunit.client.0.smithi029.stdout:7/347: write d5/d9/f26 [239186,26348] 0 2024-04-23T10:20:59.320 INFO:tasks.workunit.client.0.smithi029.stdout:4/295: dread d0/f17 [0,4194304] 0 2024-04-23T10:20:59.321 INFO:tasks.workunit.client.0.smithi029.stdout:3/231: creat d3/d10/de/f47 x:0 0 0 2024-04-23T10:20:59.323 INFO:tasks.workunit.client.0.smithi029.stdout:6/360: creat d9/df/d41/d49/f81 x:0 0 0 2024-04-23T10:20:59.324 INFO:tasks.workunit.client.0.smithi029.stdout:7/348: creat d5/d9/f7b x:0 0 0 2024-04-23T10:20:59.327 INFO:tasks.workunit.client.0.smithi029.stdout:3/232: read d3/d10/de/d2e/f2f [41729,28269] 0 2024-04-23T10:20:59.327 INFO:tasks.workunit.client.0.smithi029.stdout:4/296: rename d0/d3c/d52/d20/f3d to d0/d12/f69 0 2024-04-23T10:20:59.328 INFO:tasks.workunit.client.0.smithi029.stdout:9/314: dread d0/d1b/d39/f42 [0,4194304] 0 2024-04-23T10:20:59.329 INFO:tasks.workunit.client.0.smithi029.stdout:3/233: mkdir d3/d10/d48 0 2024-04-23T10:20:59.332 INFO:tasks.workunit.client.0.smithi029.stdout:6/361: rename d9/df/d25/f74 to d9/f82 0 2024-04-23T10:20:59.333 INFO:tasks.workunit.client.0.smithi029.stdout:6/362: chown d9/df 12463889 1 2024-04-23T10:20:59.334 INFO:tasks.workunit.client.0.smithi029.stdout:9/315: truncate d0/d1b/d44/d49/f64 107478 0 2024-04-23T10:20:59.335 INFO:tasks.workunit.client.0.smithi029.stdout:3/234: creat d3/d10/d27/f49 x:0 0 0 2024-04-23T10:20:59.335 INFO:tasks.workunit.client.0.smithi029.stdout:7/349: dwrite d5/f4f [0,4194304] 0 2024-04-23T10:20:59.336 INFO:tasks.workunit.client.0.smithi029.stdout:3/235: chown d3/d15 356 1 2024-04-23T10:20:59.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/363: dread - d9/df/d16/d1f/d27/f60 zero size 2024-04-23T10:20:59.338 INFO:tasks.workunit.client.0.smithi029.stdout:9/316: symlink d0/d1b/d39/d4f/l6b 0 2024-04-23T10:20:59.339 INFO:tasks.workunit.client.0.smithi029.stdout:6/364: fdatasync d9/df/d16/f7d 0 2024-04-23T10:20:59.339 INFO:tasks.workunit.client.0.smithi029.stdout:4/297: dread d0/d3c/d52/d1b/f35 [0,4194304] 0 2024-04-23T10:20:59.343 INFO:tasks.workunit.client.0.smithi029.stdout:4/298: dread d0/d3c/d52/f26 [0,4194304] 0 2024-04-23T10:20:59.344 INFO:tasks.workunit.client.0.smithi029.stdout:4/299: fdatasync d0/d3c/d52/d1b/f1c 0 2024-04-23T10:20:59.347 INFO:tasks.workunit.client.0.smithi029.stdout:7/350: fsync d5/d8/d51/d55/d59/f73 0 2024-04-23T10:20:59.352 INFO:tasks.workunit.client.0.smithi029.stdout:3/236: creat d3/d45/f4a x:0 0 0 2024-04-23T10:20:59.360 INFO:tasks.workunit.client.0.smithi029.stdout:3/237: mkdir d3/d15/d4b 0 2024-04-23T10:20:59.361 INFO:tasks.workunit.client.0.smithi029.stdout:3/238: readlink d3/d10/de/l1b 0 2024-04-23T10:20:59.361 INFO:tasks.workunit.client.0.smithi029.stdout:3/239: chown d3/d10/f20 13746752 1 2024-04-23T10:20:59.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/317: getdents d0/d1b/d24 0 2024-04-23T10:20:59.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/318: stat d0/f21 0 2024-04-23T10:20:59.364 INFO:tasks.workunit.client.0.smithi029.stdout:4/300: dread d0/f27 [0,4194304] 0 2024-04-23T10:20:59.365 INFO:tasks.workunit.client.0.smithi029.stdout:3/240: mknod d3/d10/d27/d28/c4c 0 2024-04-23T10:20:59.366 INFO:tasks.workunit.client.0.smithi029.stdout:3/241: stat d3/f2a 0 2024-04-23T10:20:59.366 INFO:tasks.workunit.client.0.smithi029.stdout:7/351: mknod d5/d9/c7c 0 2024-04-23T10:20:59.367 INFO:tasks.workunit.client.0.smithi029.stdout:7/352: chown f1 6 1 2024-04-23T10:20:59.368 INFO:tasks.workunit.client.0.smithi029.stdout:9/319: mkdir d0/d1b/d44/d49/d65/d6c 0 2024-04-23T10:20:59.368 INFO:tasks.workunit.client.0.smithi029.stdout:4/301: mkdir d0/d3c/d52/d1b/d5b/d65/d6a 0 2024-04-23T10:20:59.370 INFO:tasks.workunit.client.0.smithi029.stdout:6/365: dread d9/df/d16/d34/f51 [0,4194304] 0 2024-04-23T10:20:59.374 INFO:tasks.workunit.client.0.smithi029.stdout:4/302: link d0/d3c/d52/f42 d0/d3c/d52/d1b/f6b 0 2024-04-23T10:20:59.375 INFO:tasks.workunit.client.0.smithi029.stdout:6/366: creat d9/df/d41/f83 x:0 0 0 2024-04-23T10:20:59.380 INFO:tasks.workunit.client.0.smithi029.stdout:6/367: mkdir d9/df/d16/d34/d84 0 2024-04-23T10:20:59.381 INFO:tasks.workunit.client.0.smithi029.stdout:3/242: dwrite d3/d45/f4a [0,4194304] 0 2024-04-23T10:20:59.384 INFO:tasks.workunit.client.0.smithi029.stdout:7/353: dwrite d5/d8/f23 [0,4194304] 0 2024-04-23T10:20:59.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/243: dread - d3/f25 zero size 2024-04-23T10:20:59.385 INFO:tasks.workunit.client.0.smithi029.stdout:6/368: chown d9/f18 228 1 2024-04-23T10:20:59.393 INFO:tasks.workunit.client.0.smithi029.stdout:9/320: dwrite d0/f1e [0,4194304] 0 2024-04-23T10:20:59.393 INFO:tasks.workunit.client.0.smithi029.stdout:4/303: dwrite d0/d12/f62 [0,4194304] 0 2024-04-23T10:20:59.399 INFO:tasks.workunit.client.0.smithi029.stdout:7/354: truncate d5/d9/f2b 2533919 0 2024-04-23T10:20:59.400 INFO:tasks.workunit.client.0.smithi029.stdout:6/369: rename d9/df/d16/d1f/d27/f60 to d9/df/d16/d44/d75/f85 0 2024-04-23T10:20:59.401 INFO:tasks.workunit.client.0.smithi029.stdout:4/304: write d0/f17 [1044129,104528] 0 2024-04-23T10:20:59.402 INFO:tasks.workunit.client.0.smithi029.stdout:7/355: unlink f1 0 2024-04-23T10:20:59.407 INFO:tasks.workunit.client.0.smithi029.stdout:3/244: link d3/f8 d3/d10/de/d2e/d36/d40/d46/f4d 0 2024-04-23T10:20:59.410 INFO:tasks.workunit.client.0.smithi029.stdout:9/321: link d0/d1b/c3e d0/d1b/d24/c6d 0 2024-04-23T10:20:59.411 INFO:tasks.workunit.client.0.smithi029.stdout:4/305: creat d0/d3c/d52/d1b/d5b/d65/d6a/f6c x:0 0 0 2024-04-23T10:20:59.411 INFO:tasks.workunit.client.0.smithi029.stdout:9/322: chown d0/f5b 2 1 2024-04-23T10:20:59.412 INFO:tasks.workunit.client.0.smithi029.stdout:7/356: rename d5/d9/f33 to d5/d6b/f7d 0 2024-04-23T10:20:59.412 INFO:tasks.workunit.client.0.smithi029.stdout:3/245: mknod d3/d15/c4e 0 2024-04-23T10:20:59.414 INFO:tasks.workunit.client.0.smithi029.stdout:9/323: write d0/d7/d1d/d35/d3b/f4d [143042,109522] 0 2024-04-23T10:20:59.418 INFO:tasks.workunit.client.0.smithi029.stdout:6/370: dread d9/df/d16/d1f/d27/f57 [0,4194304] 0 2024-04-23T10:20:59.419 INFO:tasks.workunit.client.0.smithi029.stdout:9/324: creat d0/d1b/d24/f6e x:0 0 0 2024-04-23T10:20:59.421 INFO:tasks.workunit.client.0.smithi029.stdout:9/325: readlink d0/d1b/d39/d4f/l63 0 2024-04-23T10:20:59.422 INFO:tasks.workunit.client.0.smithi029.stdout:7/357: rename d5/d9/f49 to d5/d29/d4a/f7e 0 2024-04-23T10:20:59.423 INFO:tasks.workunit.client.0.smithi029.stdout:9/326: unlink d0/d7/f32 0 2024-04-23T10:20:59.424 INFO:tasks.workunit.client.0.smithi029.stdout:7/358: chown d5/d8/d51/d55/d59/f61 75528625 1 2024-04-23T10:20:59.424 INFO:tasks.workunit.client.0.smithi029.stdout:3/246: dwrite d3/d15/f1d [0,4194304] 0 2024-04-23T10:20:59.426 INFO:tasks.workunit.client.0.smithi029.stdout:3/247: chown d3/d10/de/d2e/d36/d40/f41 42494 1 2024-04-23T10:20:59.426 INFO:tasks.workunit.client.0.smithi029.stdout:7/359: fdatasync d5/fe 0 2024-04-23T10:20:59.428 INFO:tasks.workunit.client.0.smithi029.stdout:3/248: read d3/d10/de/d2e/f2f [337432,75210] 0 2024-04-23T10:20:59.431 INFO:tasks.workunit.client.0.smithi029.stdout:3/249: mkdir d3/d45/d4f 0 2024-04-23T10:20:59.434 INFO:tasks.workunit.client.0.smithi029.stdout:4/306: truncate d0/d12/f69 3241921 0 2024-04-23T10:20:59.435 INFO:tasks.workunit.client.0.smithi029.stdout:3/250: truncate d3/d10/d27/f49 549103 0 2024-04-23T10:20:59.435 INFO:tasks.workunit.client.0.smithi029.stdout:9/327: dwrite d0/d7/d1d/f1f [0,4194304] 0 2024-04-23T10:20:59.437 INFO:tasks.workunit.client.0.smithi029.stdout:4/307: write d0/d3c/d52/f14 [465109,100212] 0 2024-04-23T10:20:59.440 INFO:tasks.workunit.client.0.smithi029.stdout:9/328: write d0/d1b/d39/f42 [1157092,24020] 0 2024-04-23T10:20:59.443 INFO:tasks.workunit.client.0.smithi029.stdout:9/329: symlink d0/d1b/d39/d50/l6f 0 2024-04-23T10:20:59.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/330: write d0/d7/d1d/d35/d3b/f4d [990551,27395] 0 2024-04-23T10:20:59.450 INFO:tasks.workunit.client.0.smithi029.stdout:6/371: dwrite d9/df/d16/f1e [4194304,4194304] 0 2024-04-23T10:20:59.454 INFO:tasks.workunit.client.0.smithi029.stdout:9/331: write d0/d7/f10 [3359177,18168] 0 2024-04-23T10:20:59.454 INFO:tasks.workunit.client.0.smithi029.stdout:4/308: dwrite d0/d3c/d52/d1b/f2e [4194304,4194304] 0 2024-04-23T10:20:59.459 INFO:tasks.workunit.client.0.smithi029.stdout:9/332: read d0/d1b/d44/d49/f64 [61240,64250] 0 2024-04-23T10:20:59.460 INFO:tasks.workunit.client.0.smithi029.stdout:4/309: rename d0/d3c/d52/d1b/f56 to d0/d3c/d52/d1b/d5b/d65/f6d 0 2024-04-23T10:20:59.466 INFO:tasks.workunit.client.0.smithi029.stdout:4/310: mkdir d0/d5a/d6e 0 2024-04-23T10:20:59.468 INFO:tasks.workunit.client.0.smithi029.stdout:4/311: rmdir d0/d5a 39 2024-04-23T10:20:59.470 INFO:tasks.workunit.client.0.smithi029.stdout:4/312: readlink d0/d12/l64 0 2024-04-23T10:20:59.477 INFO:tasks.workunit.client.0.smithi029.stdout:3/251: dwrite d3/d10/de/d2e/d36/d40/d46/f4d [0,4194304] 0 2024-04-23T10:20:59.480 INFO:tasks.workunit.client.0.smithi029.stdout:9/333: dwrite d0/d7/d1d/d35/d3b/f4d [0,4194304] 0 2024-04-23T10:20:59.482 INFO:tasks.workunit.client.0.smithi029.stdout:3/252: fdatasync d3/d45/f4a 0 2024-04-23T10:20:59.488 INFO:tasks.workunit.client.0.smithi029.stdout:6/372: dwrite d9/df/d16/d1f/d27/d33/f72 [0,4194304] 0 2024-04-23T10:20:59.490 INFO:tasks.workunit.client.0.smithi029.stdout:6/373: dread - d9/df/d41/d49/d69/f80 zero size 2024-04-23T10:20:59.492 INFO:tasks.workunit.client.0.smithi029.stdout:6/374: read d9/df/d16/d34/f65 [3710745,23643] 0 2024-04-23T10:20:59.494 INFO:tasks.workunit.client.0.smithi029.stdout:3/253: creat d3/d15/d4b/f50 x:0 0 0 2024-04-23T10:20:59.497 INFO:tasks.workunit.client.0.smithi029.stdout:9/334: dwrite d0/d7/f18 [0,4194304] 0 2024-04-23T10:20:59.501 INFO:tasks.workunit.client.0.smithi029.stdout:9/335: read - d0/d1b/d39/d50/f6a zero size 2024-04-23T10:20:59.507 INFO:tasks.workunit.client.0.smithi029.stdout:9/336: getdents d0/d7 0 2024-04-23T10:20:59.508 INFO:tasks.workunit.client.0.smithi029.stdout:9/337: fsync d0/f21 0 2024-04-23T10:20:59.510 INFO:tasks.workunit.client.0.smithi029.stdout:9/338: chown d0/d1b/d39/d4f 0 1 2024-04-23T10:20:59.510 INFO:tasks.workunit.client.0.smithi029.stdout:6/375: dwrite d9/df/d41/d49/d69/f6f [0,4194304] 0 2024-04-23T10:20:59.515 INFO:tasks.workunit.client.0.smithi029.stdout:9/339: rename d0/d7/d1d/d35/d3b/f51 to d0/d7/d6/d66/f70 0 2024-04-23T10:20:59.520 INFO:tasks.workunit.client.0.smithi029.stdout:9/340: mknod d0/d7/d1d/d35/d3b/d68/c71 0 2024-04-23T10:20:59.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/376: dwrite d9/df/d16/f1e [0,4194304] 0 2024-04-23T10:20:59.523 INFO:tasks.workunit.client.0.smithi029.stdout:9/341: write d0/f5b [1862176,64339] 0 2024-04-23T10:20:59.528 INFO:tasks.workunit.client.0.smithi029.stdout:9/342: getdents d0/d1b/d39/d50 0 2024-04-23T10:20:59.529 INFO:tasks.workunit.client.0.smithi029.stdout:9/343: fsync d0/d7/f12 0 2024-04-23T10:20:59.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/254: dread d3/d10/de/f12 [0,4194304] 0 2024-04-23T10:20:59.531 INFO:tasks.workunit.client.0.smithi029.stdout:9/344: chown d0/d7/d3f/f41 5675079 1 2024-04-23T10:20:59.534 INFO:tasks.workunit.client.0.smithi029.stdout:9/345: symlink d0/d7/d1d/l72 0 2024-04-23T10:20:59.540 INFO:tasks.workunit.client.0.smithi029.stdout:3/255: dwrite d3/d15/f29 [0,4194304] 0 2024-04-23T10:20:59.544 INFO:tasks.workunit.client.0.smithi029.stdout:4/313: write d0/d12/f5f [2132492,101100] 0 2024-04-23T10:20:59.545 INFO:tasks.workunit.client.0.smithi029.stdout:9/346: dwrite d0/d1b/d24/f6e [0,4194304] 0 2024-04-23T10:20:59.551 INFO:tasks.workunit.client.0.smithi029.stdout:4/314: creat d0/d3c/d52/d1b/d5b/d65/d6a/f6f x:0 0 0 2024-04-23T10:20:59.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/347: rmdir d0/d1b/d44/d49/d65/d6c 0 2024-04-23T10:20:59.553 INFO:tasks.workunit.client.0.smithi029.stdout:3/256: dwrite d3/d10/de/f12 [0,4194304] 0 2024-04-23T10:20:59.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/257: creat d3/d10/f51 x:0 0 0 2024-04-23T10:20:59.564 INFO:tasks.workunit.client.0.smithi029.stdout:9/348: dwrite d0/d7/f12 [0,4194304] 0 2024-04-23T10:20:59.566 INFO:tasks.workunit.client.0.smithi029.stdout:4/315: dwrite d0/d3c/d52/d1b/f35 [0,4194304] 0 2024-04-23T10:20:59.569 INFO:tasks.workunit.client.0.smithi029.stdout:9/349: mknod d0/d7/d1d/d35/d3b/c73 0 2024-04-23T10:20:59.572 INFO:tasks.workunit.client.0.smithi029.stdout:9/350: creat d0/d7/d1d/f74 x:0 0 0 2024-04-23T10:20:59.578 INFO:tasks.workunit.client.0.smithi029.stdout:3/258: dwrite d3/d10/d27/d31/f26 [0,4194304] 0 2024-04-23T10:20:59.578 INFO:tasks.workunit.client.0.smithi029.stdout:9/351: symlink d0/d7/d1d/d35/d3b/l75 0 2024-04-23T10:20:59.579 INFO:tasks.workunit.client.0.smithi029.stdout:4/316: fsync d0/d3c/d52/f14 0 2024-04-23T10:20:59.584 INFO:tasks.workunit.client.0.smithi029.stdout:4/317: chown d0/d3c/d52/d1b/f39 139330760 1 2024-04-23T10:20:59.591 INFO:tasks.workunit.client.0.smithi029.stdout:3/259: mkdir d3/d15/d4b/d52 0 2024-04-23T10:20:59.593 INFO:tasks.workunit.client.0.smithi029.stdout:4/318: dwrite d0/d12/f49 [0,4194304] 0 2024-04-23T10:20:59.596 INFO:tasks.workunit.client.0.smithi029.stdout:3/260: creat d3/d10/d27/f53 x:0 0 0 2024-04-23T10:20:59.596 INFO:tasks.workunit.client.0.smithi029.stdout:9/352: link d0/d7/d1d/c26 d0/d1b/d39/d50/c76 0 2024-04-23T10:20:59.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/231: sync 2024-04-23T10:20:59.600 INFO:tasks.workunit.client.0.smithi029.stdout:9/353: unlink d0/d7/d1d/l72 0 2024-04-23T10:20:59.607 INFO:tasks.workunit.client.0.smithi029.stdout:1/232: creat d5/f53 x:0 0 0 2024-04-23T10:20:59.607 INFO:tasks.workunit.client.0.smithi029.stdout:4/319: rename d0/d3c/d52/d1b/l54 to d0/d3c/d52/d20/l70 0 2024-04-23T10:20:59.609 INFO:tasks.workunit.client.0.smithi029.stdout:4/320: write d0/d3c/d52/f1d [1508761,48467] 0 2024-04-23T10:20:59.609 INFO:tasks.workunit.client.0.smithi029.stdout:9/354: mknod d0/d7/d1d/d35/c77 0 2024-04-23T10:20:59.609 INFO:tasks.workunit.client.0.smithi029.stdout:3/261: dwrite d3/d10/f51 [0,4194304] 0 2024-04-23T10:20:59.610 INFO:tasks.workunit.client.0.smithi029.stdout:9/355: write d0/d7/fa [9381179,12452] 0 2024-04-23T10:20:59.612 INFO:tasks.workunit.client.0.smithi029.stdout:1/233: unlink d5/d6/c48 0 2024-04-23T10:20:59.619 INFO:tasks.workunit.client.0.smithi029.stdout:4/321: mknod d0/d3c/d52/d20/c71 0 2024-04-23T10:20:59.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/356: rmdir d0/d1b/d60 39 2024-04-23T10:20:59.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/357: fsync d0/d7/d3f/f41 0 2024-04-23T10:20:59.625 INFO:tasks.workunit.client.0.smithi029.stdout:3/262: getdents d3/d10/d27/d31 0 2024-04-23T10:20:59.630 INFO:tasks.workunit.client.0.smithi029.stdout:4/322: dwrite d0/d3c/d52/d20/f57 [0,4194304] 0 2024-04-23T10:20:59.630 INFO:tasks.workunit.client.0.smithi029.stdout:9/358: mknod d0/d1b/d39/c78 0 2024-04-23T10:20:59.637 INFO:tasks.workunit.client.0.smithi029.stdout:1/234: dread d5/d6/f19 [0,4194304] 0 2024-04-23T10:20:59.641 INFO:tasks.workunit.client.0.smithi029.stdout:4/323: dwrite d0/d3c/d52/d1b/d5b/d65/d6a/f6f [0,4194304] 0 2024-04-23T10:20:59.642 INFO:tasks.workunit.client.0.smithi029.stdout:3/263: creat d3/d10/de/f54 x:0 0 0 2024-04-23T10:20:59.645 INFO:tasks.workunit.client.0.smithi029.stdout:1/235: write d5/d6/f19 [490821,59624] 0 2024-04-23T10:20:59.646 INFO:tasks.workunit.client.0.smithi029.stdout:4/324: dread d0/d3c/d52/d1b/d36/d45/f58 [0,4194304] 0 2024-04-23T10:20:59.647 INFO:tasks.workunit.client.0.smithi029.stdout:1/236: readlink d5/d6/de/d27/l3d 0 2024-04-23T10:20:59.647 INFO:tasks.workunit.client.0.smithi029.stdout:9/359: rename d0/d7/d1d/d35/f3a to d0/d1b/d60/f79 0 2024-04-23T10:20:59.647 INFO:tasks.workunit.client.0.smithi029.stdout:4/325: read d0/d3c/d52/d1b/f2e [6829107,72646] 0 2024-04-23T10:20:59.647 INFO:tasks.workunit.client.0.smithi029.stdout:1/237: readlink d5/d6/de/d27/l2a 0 2024-04-23T10:20:59.649 INFO:tasks.workunit.client.0.smithi029.stdout:3/264: creat d3/d10/d27/d31/f55 x:0 0 0 2024-04-23T10:20:59.653 INFO:tasks.workunit.client.0.smithi029.stdout:1/238: creat d5/d3e/f54 x:0 0 0 2024-04-23T10:20:59.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/239: read - d5/d6/de/d22/f52 zero size 2024-04-23T10:20:59.655 INFO:tasks.workunit.client.0.smithi029.stdout:9/360: dread d0/d7/f18 [0,4194304] 0 2024-04-23T10:20:59.657 INFO:tasks.workunit.client.0.smithi029.stdout:3/265: rename d3/d10/l3d to d3/d15/d4b/d52/l56 0 2024-04-23T10:20:59.657 INFO:tasks.workunit.client.0.smithi029.stdout:3/266: fsync d3/fd 0 2024-04-23T10:20:59.659 INFO:tasks.workunit.client.0.smithi029.stdout:9/361: read d0/d7/d3f/f48 [3854037,5698] 0 2024-04-23T10:20:59.659 INFO:tasks.workunit.client.0.smithi029.stdout:1/240: mkdir d5/d6/de/d15/d55 0 2024-04-23T10:20:59.660 INFO:tasks.workunit.client.0.smithi029.stdout:9/362: fdatasync d0/d7/fa 0 2024-04-23T10:20:59.666 INFO:tasks.workunit.client.0.smithi029.stdout:9/363: fsync d0/d7/f10 0 2024-04-23T10:20:59.667 INFO:tasks.workunit.client.0.smithi029.stdout:3/267: dwrite d3/d10/f2b [0,4194304] 0 2024-04-23T10:20:59.668 INFO:tasks.workunit.client.0.smithi029.stdout:1/241: rmdir d5/d6/de/d27 39 2024-04-23T10:20:59.668 INFO:tasks.workunit.client.0.smithi029.stdout:3/268: chown d3/l4 40 1 2024-04-23T10:20:59.671 INFO:tasks.workunit.client.0.smithi029.stdout:3/269: write d3/d10/d27/d31/f26 [2928422,73174] 0 2024-04-23T10:20:59.671 INFO:tasks.workunit.client.0.smithi029.stdout:3/270: dread - d3/d10/de/d2e/d36/f38 zero size 2024-04-23T10:20:59.677 INFO:tasks.workunit.client.0.smithi029.stdout:1/242: creat d5/d6/de/d22/f56 x:0 0 0 2024-04-23T10:20:59.682 INFO:tasks.workunit.client.0.smithi029.stdout:4/326: truncate d0/d12/f49 1402012 0 2024-04-23T10:20:59.689 INFO:tasks.workunit.client.0.smithi029.stdout:3/271: dread d3/d10/de/f14 [0,4194304] 0 2024-04-23T10:20:59.690 INFO:tasks.workunit.client.0.smithi029.stdout:3/272: truncate d3/d10/f1e 1025774 0 2024-04-23T10:20:59.694 INFO:tasks.workunit.client.0.smithi029.stdout:1/243: dread d5/d6/de/d15/f26 [0,4194304] 0 2024-04-23T10:20:59.695 INFO:tasks.workunit.client.0.smithi029.stdout:1/244: chown d5/d6/de/d22/f30 8849093 1 2024-04-23T10:20:59.875 INFO:tasks.workunit.client.0.smithi029.stdout:9/364: write d0/d1b/d60/f79 [3094101,37669] 0 2024-04-23T10:20:59.878 INFO:tasks.workunit.client.0.smithi029.stdout:4/327: dread d0/d12/f49 [0,4194304] 0 2024-04-23T10:20:59.881 INFO:tasks.workunit.client.0.smithi029.stdout:4/328: write d0/d12/f62 [5050090,86908] 0 2024-04-23T10:20:59.884 INFO:tasks.workunit.client.0.smithi029.stdout:9/365: symlink d0/d1b/d44/d49/l7a 0 2024-04-23T10:20:59.890 INFO:tasks.workunit.client.0.smithi029.stdout:1/245: truncate d5/d6/f16 3014527 0 2024-04-23T10:20:59.900 INFO:tasks.workunit.client.0.smithi029.stdout:9/366: link d0/d7/d1d/l30 d0/d1b/d60/l7b 0 2024-04-23T10:20:59.916 INFO:tasks.workunit.client.0.smithi029.stdout:9/367: dwrite d0/d7/d1d/f20 [0,4194304] 0 2024-04-23T10:20:59.920 INFO:tasks.workunit.client.0.smithi029.stdout:9/368: rename d0/d1b to d0/d1b/d7c 22 2024-04-23T10:20:59.926 INFO:tasks.workunit.client.0.smithi029.stdout:9/369: creat d0/d1b/d39/d50/d5a/f7d x:0 0 0 2024-04-23T10:20:59.931 INFO:tasks.workunit.client.0.smithi029.stdout:9/370: symlink d0/d1b/d44/d49/d65/l7e 0 2024-04-23T10:20:59.933 INFO:tasks.workunit.client.0.smithi029.stdout:9/371: fsync d0/d1b/d39/d50/f6a 0 2024-04-23T10:20:59.936 INFO:tasks.workunit.client.0.smithi029.stdout:9/372: write d0/f21 [405987,57582] 0 2024-04-23T10:20:59.938 INFO:tasks.workunit.client.0.smithi029.stdout:9/373: chown d0/f1e 64 1 2024-04-23T10:20:59.954 INFO:tasks.workunit.client.0.smithi029.stdout:9/374: dread d0/d7/d1d/f57 [0,4194304] 0 2024-04-23T10:20:59.955 INFO:tasks.workunit.client.0.smithi029.stdout:9/375: read d0/d7/d1d/f1f [2010668,91937] 0 2024-04-23T10:20:59.960 INFO:tasks.workunit.client.0.smithi029.stdout:9/376: mknod d0/d7/d1d/d35/d3b/c7f 0 2024-04-23T10:20:59.967 INFO:tasks.workunit.client.0.smithi029.stdout:9/377: rename d0/d7/d1d/d35/d3b/f4d to d0/d1b/d39/d50/f80 0 2024-04-23T10:20:59.980 INFO:tasks.workunit.client.0.smithi029.stdout:4/329: write d0/d3c/d52/d1b/f1c [862187,10953] 0 2024-04-23T10:20:59.982 INFO:tasks.workunit.client.0.smithi029.stdout:4/330: fsync d0/d12/f43 0 2024-04-23T10:21:00.027 INFO:tasks.workunit.client.0.smithi029.stdout:9/378: truncate d0/d7/f12 1671219 0 2024-04-23T10:21:00.040 INFO:tasks.workunit.client.0.smithi029.stdout:9/379: rename d0/d1b/d60/f79 to d0/f81 0 2024-04-23T10:21:00.058 INFO:tasks.workunit.client.0.smithi029.stdout:9/380: dwrite d0/d7/fa [4194304,4194304] 0 2024-04-23T10:21:00.066 INFO:tasks.workunit.client.0.smithi029.stdout:9/381: creat d0/d7/d3f/f82 x:0 0 0 2024-04-23T10:21:00.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/382: read - d0/d1b/d39/d50/f6a zero size 2024-04-23T10:21:00.089 INFO:tasks.workunit.client.0.smithi029.stdout:9/383: dread d0/f11 [0,4194304] 0 2024-04-23T10:21:00.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/384: dread d0/d7/f18 [0,4194304] 0 2024-04-23T10:21:00.099 INFO:tasks.workunit.client.0.smithi029.stdout:9/385: symlink d0/d7/d1d/d35/d3b/l83 0 2024-04-23T10:21:00.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/329: sync 2024-04-23T10:21:00.105 INFO:tasks.workunit.client.0.smithi029.stdout:2/330: creat d1/d3e/f71 x:0 0 0 2024-04-23T10:21:00.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/331: getdents d1/d31/d3d 0 2024-04-23T10:21:00.115 INFO:tasks.workunit.client.0.smithi029.stdout:2/332: creat d1/dd/d47/d63/d64/f72 x:0 0 0 2024-04-23T10:21:00.118 INFO:tasks.workunit.client.0.smithi029.stdout:2/333: truncate d1/f2e 179493 0 2024-04-23T10:21:00.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/386: dread d0/f5b [0,4194304] 0 2024-04-23T10:21:00.299 INFO:tasks.workunit.client.0.smithi029.stdout:5/363: sync 2024-04-23T10:21:00.307 INFO:tasks.workunit.client.0.smithi029.stdout:9/387: mknod d0/d1b/d39/c84 0 2024-04-23T10:21:00.332 INFO:tasks.workunit.client.0.smithi029.stdout:5/364: dread d0/d35/d38/d51/f25 [4194304,4194304] 0 2024-04-23T10:21:00.352 INFO:tasks.workunit.client.0.smithi029.stdout:9/388: dwrite d0/d7/d6/f55 [0,4194304] 0 2024-04-23T10:21:00.354 INFO:tasks.workunit.client.0.smithi029.stdout:9/389: fdatasync d0/d7/d1d/f20 0 2024-04-23T10:21:00.357 INFO:tasks.workunit.client.0.smithi029.stdout:5/365: write d0/d35/d38/d3e/f4e [1057755,69246] 0 2024-04-23T10:21:00.360 INFO:tasks.workunit.client.0.smithi029.stdout:5/366: chown d0/d35/d38/d51/l23 126251 1 2024-04-23T10:21:00.363 INFO:tasks.workunit.client.0.smithi029.stdout:5/367: truncate d0/d35/d10/f71 4859391 0 2024-04-23T10:21:00.379 INFO:tasks.workunit.client.0.smithi029.stdout:8/319: sync 2024-04-23T10:21:00.381 INFO:tasks.workunit.client.0.smithi029.stdout:8/320: readlink d3/l5e 0 2024-04-23T10:21:00.382 INFO:tasks.workunit.client.0.smithi029.stdout:8/321: readlink d3/l4b 0 2024-04-23T10:21:00.389 INFO:tasks.workunit.client.0.smithi029.stdout:5/368: dwrite d0/d35/d10/d26/f45 [4194304,4194304] 0 2024-04-23T10:21:00.392 INFO:tasks.workunit.client.0.smithi029.stdout:5/369: chown d0/d35/d38/d3e/d66/d5a/d78/l5f 286 1 2024-04-23T10:21:00.408 INFO:tasks.workunit.client.0.smithi029.stdout:5/370: dwrite d0/f2f [0,4194304] 0 2024-04-23T10:21:00.415 INFO:tasks.workunit.client.0.smithi029.stdout:5/371: truncate d0/d35/d38/d3e/f4e 1341458 0 2024-04-23T10:21:00.449 INFO:tasks.workunit.client.0.smithi029.stdout:1/246: sync 2024-04-23T10:21:00.449 INFO:tasks.workunit.client.0.smithi029.stdout:2/334: sync 2024-04-23T10:21:00.449 INFO:tasks.workunit.client.0.smithi029.stdout:4/331: sync 2024-04-23T10:21:00.449 INFO:tasks.workunit.client.0.smithi029.stdout:7/360: sync 2024-04-23T10:21:00.449 INFO:tasks.workunit.client.0.smithi029.stdout:0/181: sync 2024-04-23T10:21:00.450 INFO:tasks.workunit.client.0.smithi029.stdout:6/377: sync 2024-04-23T10:21:00.450 INFO:tasks.workunit.client.0.smithi029.stdout:3/273: sync 2024-04-23T10:21:00.452 INFO:tasks.workunit.client.0.smithi029.stdout:0/182: read d0/f4 [493281,126026] 0 2024-04-23T10:21:00.454 INFO:tasks.workunit.client.0.smithi029.stdout:4/332: write d0/d3c/d52/d20/f5e [361791,21482] 0 2024-04-23T10:21:00.456 INFO:tasks.workunit.client.0.smithi029.stdout:5/372: rename d0/d35/d38/d51/f43 to d0/d6a/f7f 0 2024-04-23T10:21:00.457 INFO:tasks.workunit.client.0.smithi029.stdout:5/373: chown d0/d35/d38/d3e/d66/d5a 6214456 1 2024-04-23T10:21:00.458 INFO:tasks.workunit.client.0.smithi029.stdout:9/390: link d0/d7/d1d/d35/d3b/d68/c71 d0/d7/d3f/c85 0 2024-04-23T10:21:00.462 INFO:tasks.workunit.client.0.smithi029.stdout:2/335: readlink d1/dd/l3c 0 2024-04-23T10:21:00.463 INFO:tasks.workunit.client.0.smithi029.stdout:2/336: write d1/d3e/d5a/f6f [916435,86146] 0 2024-04-23T10:21:00.474 INFO:tasks.workunit.client.0.smithi029.stdout:7/361: creat d5/d8/d51/f7f x:0 0 0 2024-04-23T10:21:00.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/391: dread d0/d7/d3f/f41 [0,4194304] 0 2024-04-23T10:21:00.479 INFO:tasks.workunit.client.0.smithi029.stdout:3/274: rmdir d3/d10/de/d2e/d36/d40/d46 39 2024-04-23T10:21:00.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/333: creat d0/d3c/d52/d1b/d5b/d65/f72 x:0 0 0 2024-04-23T10:21:00.490 INFO:tasks.workunit.client.0.smithi029.stdout:6/378: dread d9/df/d16/d1f/d27/d33/f53 [0,4194304] 0 2024-04-23T10:21:00.491 INFO:tasks.workunit.client.0.smithi029.stdout:6/379: write d9/df/f13 [351928,26170] 0 2024-04-23T10:21:00.497 INFO:tasks.workunit.client.0.smithi029.stdout:9/392: fdatasync d0/f5b 0 2024-04-23T10:21:00.498 INFO:tasks.workunit.client.0.smithi029.stdout:0/183: write d0/fd [2014055,37815] 0 2024-04-23T10:21:00.500 INFO:tasks.workunit.client.0.smithi029.stdout:0/184: chown d0/d21/c22 75380791 1 2024-04-23T10:21:00.501 INFO:tasks.workunit.client.0.smithi029.stdout:6/380: dread d9/df/d16/f1e [0,4194304] 0 2024-04-23T10:21:00.501 INFO:tasks.workunit.client.0.smithi029.stdout:3/275: rename d3/d10/f1e to d3/d10/de/d2e/d36/d40/d43/f57 0 2024-04-23T10:21:00.503 INFO:tasks.workunit.client.0.smithi029.stdout:5/374: dwrite d0/d35/d10/f42 [0,4194304] 0 2024-04-23T10:21:00.507 INFO:tasks.workunit.client.0.smithi029.stdout:1/247: creat d5/d6/de/d27/d38/d47/f57 x:0 0 0 2024-04-23T10:21:00.510 INFO:tasks.workunit.client.0.smithi029.stdout:9/393: dwrite d0/d7/d3f/f40 [0,4194304] 0 2024-04-23T10:21:00.510 INFO:tasks.workunit.client.0.smithi029.stdout:4/334: write d0/d3c/d52/d1b/f2e [2140927,117455] 0 2024-04-23T10:21:00.511 INFO:tasks.workunit.client.0.smithi029.stdout:9/394: dread - d0/d1b/d39/d50/d5a/f7d zero size 2024-04-23T10:21:00.513 INFO:tasks.workunit.client.0.smithi029.stdout:2/337: truncate d1/d4/f11 8293882 0 2024-04-23T10:21:00.515 INFO:tasks.workunit.client.0.smithi029.stdout:7/362: mkdir d5/d8/d80 0 2024-04-23T10:21:00.517 INFO:tasks.workunit.client.0.smithi029.stdout:0/185: rmdir d0/dc/d26 39 2024-04-23T10:21:00.519 INFO:tasks.workunit.client.0.smithi029.stdout:9/395: dwrite d0/d7/d3f/f48 [0,4194304] 0 2024-04-23T10:21:00.519 INFO:tasks.workunit.client.0.smithi029.stdout:3/276: creat d3/d10/f58 x:0 0 0 2024-04-23T10:21:00.536 INFO:tasks.workunit.client.0.smithi029.stdout:0/186: dread d0/dc/d27/f30 [0,4194304] 0 2024-04-23T10:21:00.537 INFO:tasks.workunit.client.0.smithi029.stdout:4/335: unlink d0/d12/c1f 0 2024-04-23T10:21:00.539 INFO:tasks.workunit.client.0.smithi029.stdout:4/336: write d0/d3c/d52/d1b/d5b/d65/d6a/f6c [521243,45040] 0 2024-04-23T10:21:00.539 INFO:tasks.workunit.client.0.smithi029.stdout:2/338: symlink d1/dd/d47/l73 0 2024-04-23T10:21:00.546 INFO:tasks.workunit.client.0.smithi029.stdout:9/396: creat d0/d1b/d44/f86 x:0 0 0 2024-04-23T10:21:00.547 INFO:tasks.workunit.client.0.smithi029.stdout:3/277: rmdir d3/d10/de/d2e/d36/d40/d46 39 2024-04-23T10:21:00.549 INFO:tasks.workunit.client.0.smithi029.stdout:6/381: link d9/df/d16/d34/f51 d9/d5b/f86 0 2024-04-23T10:21:00.550 INFO:tasks.workunit.client.0.smithi029.stdout:0/187: symlink d0/dc/d27/l40 0 2024-04-23T10:21:00.551 INFO:tasks.workunit.client.0.smithi029.stdout:9/397: fsync d0/d7/d1d/d35/f36 0 2024-04-23T10:21:00.554 INFO:tasks.workunit.client.0.smithi029.stdout:2/339: chown d1/d3e/l67 547373149 1 2024-04-23T10:21:00.554 INFO:tasks.workunit.client.0.smithi029.stdout:1/248: write d5/d6/de/f2e [2243939,29000] 0 2024-04-23T10:21:00.555 INFO:tasks.workunit.client.0.smithi029.stdout:3/278: mkdir d3/d10/de/d2e/d59 0 2024-04-23T10:21:00.556 INFO:tasks.workunit.client.0.smithi029.stdout:4/337: dwrite d0/d3c/d52/d1b/f2e [8388608,4194304] 0 2024-04-23T10:21:00.558 INFO:tasks.workunit.client.0.smithi029.stdout:6/382: read d9/df/d16/f46 [3352500,96899] 0 2024-04-23T10:21:00.559 INFO:tasks.workunit.client.0.smithi029.stdout:7/363: dwrite d5/d8/d1a/d4d/f52 [0,4194304] 0 2024-04-23T10:21:00.559 INFO:tasks.workunit.client.0.smithi029.stdout:9/398: write d0/d1b/d39/d50/f6a [1015776,2812] 0 2024-04-23T10:21:00.563 INFO:tasks.workunit.client.0.smithi029.stdout:2/340: creat d1/d31/d3d/f74 x:0 0 0 2024-04-23T10:21:00.564 INFO:tasks.workunit.client.0.smithi029.stdout:1/249: rename d5/d6/de/d22/f30 to d5/f58 0 2024-04-23T10:21:00.565 INFO:tasks.workunit.client.0.smithi029.stdout:2/341: fsync d1/dd/d22/f54 0 2024-04-23T10:21:00.567 INFO:tasks.workunit.client.0.smithi029.stdout:0/188: creat d0/dc/d26/f41 x:0 0 0 2024-04-23T10:21:00.578 INFO:tasks.workunit.client.0.smithi029.stdout:6/383: symlink d9/df/d16/d1f/d27/d2d/d58/d7e/l87 0 2024-04-23T10:21:00.578 INFO:tasks.workunit.client.0.smithi029.stdout:1/250: dread d5/d6/de/d27/d38/f44 [0,4194304] 0 2024-04-23T10:21:00.579 INFO:tasks.workunit.client.0.smithi029.stdout:7/364: mknod d5/d8/d51/d55/c81 0 2024-04-23T10:21:00.580 INFO:tasks.workunit.client.0.smithi029.stdout:1/251: readlink d5/l1c 0 2024-04-23T10:21:00.580 INFO:tasks.workunit.client.0.smithi029.stdout:0/189: fsync d0/dc/d27/f30 0 2024-04-23T10:21:00.583 INFO:tasks.workunit.client.0.smithi029.stdout:3/279: rename d3/c7 to d3/d10/de/d2e/c5a 0 2024-04-23T10:21:00.585 INFO:tasks.workunit.client.0.smithi029.stdout:6/384: symlink d9/df/d41/d49/d69/l88 0 2024-04-23T10:21:00.586 INFO:tasks.workunit.client.0.smithi029.stdout:7/365: creat d5/d71/f82 x:0 0 0 2024-04-23T10:21:00.586 INFO:tasks.workunit.client.0.smithi029.stdout:9/399: truncate d0/d7/f17 3915069 0 2024-04-23T10:21:00.588 INFO:tasks.workunit.client.0.smithi029.stdout:1/252: creat d5/d6/de/d22/f59 x:0 0 0 2024-04-23T10:21:00.589 INFO:tasks.workunit.client.0.smithi029.stdout:4/338: dwrite d0/d3c/d52/d1b/f39 [0,4194304] 0 2024-04-23T10:21:00.590 INFO:tasks.workunit.client.0.smithi029.stdout:2/342: dwrite d1/d3e/f38 [0,4194304] 0 2024-04-23T10:21:00.590 INFO:tasks.workunit.client.0.smithi029.stdout:7/366: write d5/d8/d51/f57 [407714,93985] 0 2024-04-23T10:21:00.591 INFO:tasks.workunit.client.0.smithi029.stdout:3/280: mkdir d3/d10/de/d2e/d59/d5b 0 2024-04-23T10:21:00.591 INFO:tasks.workunit.client.0.smithi029.stdout:4/339: stat d0/d12/l4c 0 2024-04-23T10:21:00.594 INFO:tasks.workunit.client.0.smithi029.stdout:2/343: write d1/d3e/f38 [4283586,51721] 0 2024-04-23T10:21:00.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/385: mknod d9/c89 0 2024-04-23T10:21:00.599 INFO:tasks.workunit.client.0.smithi029.stdout:2/344: write d1/dd/f51 [2484315,19425] 0 2024-04-23T10:21:00.602 INFO:tasks.workunit.client.0.smithi029.stdout:0/190: truncate d0/fd 803196 0 2024-04-23T10:21:00.602 INFO:tasks.workunit.client.0.smithi029.stdout:3/281: truncate d3/d10/d27/d31/f55 949128 0 2024-04-23T10:21:00.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/191: stat d0/d1b 0 2024-04-23T10:21:00.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/322: sync 2024-04-23T10:21:00.609 INFO:tasks.workunit.client.0.smithi029.stdout:9/400: dwrite d0/d7/d1d/f20 [4194304,4194304] 0 2024-04-23T10:21:00.611 INFO:tasks.workunit.client.0.smithi029.stdout:0/192: mknod d0/d1b/c42 0 2024-04-23T10:21:00.613 INFO:tasks.workunit.client.0.smithi029.stdout:4/340: creat d0/d3c/d52/d1b/d36/d45/d68/f73 x:0 0 0 2024-04-23T10:21:00.617 INFO:tasks.workunit.client.0.smithi029.stdout:4/341: write d0/d3c/d52/d1b/f1c [599069,85541] 0 2024-04-23T10:21:00.617 INFO:tasks.workunit.client.0.smithi029.stdout:3/282: rename d3/d15/f29 to d3/f5c 0 2024-04-23T10:21:00.617 INFO:tasks.workunit.client.0.smithi029.stdout:2/345: dwrite d1/dd/d22/f54 [0,4194304] 0 2024-04-23T10:21:00.619 INFO:tasks.workunit.client.0.smithi029.stdout:7/367: creat d5/d8/d1a/f83 x:0 0 0 2024-04-23T10:21:00.619 INFO:tasks.workunit.client.0.smithi029.stdout:9/401: mknod d0/d7/d1d/c87 0 2024-04-23T10:21:00.621 INFO:tasks.workunit.client.0.smithi029.stdout:9/402: stat d0/d7/d6/f55 0 2024-04-23T10:21:00.621 INFO:tasks.workunit.client.0.smithi029.stdout:2/346: chown d1/d3e 5537793 1 2024-04-23T10:21:00.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/403: chown d0/d1b/d44/f86 8 1 2024-04-23T10:21:00.623 INFO:tasks.workunit.client.0.smithi029.stdout:2/347: dread - d1/dd/d47/d63/d64/f72 zero size 2024-04-23T10:21:00.624 INFO:tasks.workunit.client.0.smithi029.stdout:9/404: write d0/d1b/d24/f61 [997745,62885] 0 2024-04-23T10:21:00.627 INFO:tasks.workunit.client.0.smithi029.stdout:8/323: fsync d3/f29 0 2024-04-23T10:21:00.632 INFO:tasks.workunit.client.0.smithi029.stdout:3/283: creat d3/d15/f5d x:0 0 0 2024-04-23T10:21:00.634 INFO:tasks.workunit.client.0.smithi029.stdout:1/253: write d5/d6/f21 [88625,98041] 0 2024-04-23T10:21:00.636 INFO:tasks.workunit.client.0.smithi029.stdout:9/405: creat d0/d7/d1d/d35/d3b/f88 x:0 0 0 2024-04-23T10:21:00.636 INFO:tasks.workunit.client.0.smithi029.stdout:8/324: rmdir d3/d44 39 2024-04-23T10:21:00.639 INFO:tasks.workunit.client.0.smithi029.stdout:4/342: mkdir d0/d3c/d52/d74 0 2024-04-23T10:21:00.642 INFO:tasks.workunit.client.0.smithi029.stdout:3/284: mkdir d3/d10/d27/d5e 0 2024-04-23T10:21:00.642 INFO:tasks.workunit.client.0.smithi029.stdout:4/343: write d0/d3c/d52/d20/f57 [3101358,58161] 0 2024-04-23T10:21:00.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/193: dread d0/dc/f16 [0,4194304] 0 2024-04-23T10:21:00.649 INFO:tasks.workunit.client.0.smithi029.stdout:6/386: dread d9/fe [0,4194304] 0 2024-04-23T10:21:00.651 INFO:tasks.workunit.client.0.smithi029.stdout:3/285: mkdir d3/d15/d4b/d52/d5f 0 2024-04-23T10:21:00.657 INFO:tasks.workunit.client.0.smithi029.stdout:6/387: unlink d9/df/d16/d44/d4c/c61 0 2024-04-23T10:21:00.659 INFO:tasks.workunit.client.0.smithi029.stdout:8/325: write f1 [4573485,42574] 0 2024-04-23T10:21:00.659 INFO:tasks.workunit.client.0.smithi029.stdout:9/406: write d0/d1b/d44/d49/f64 [1100599,63991] 0 2024-04-23T10:21:00.665 INFO:tasks.workunit.client.0.smithi029.stdout:1/254: dread d5/d6/de/d22/f2f [0,4194304] 0 2024-04-23T10:21:00.666 INFO:tasks.workunit.client.0.smithi029.stdout:4/344: creat d0/d3c/d52/f75 x:0 0 0 2024-04-23T10:21:00.667 INFO:tasks.workunit.client.0.smithi029.stdout:3/286: dwrite d3/d10/d27/d31/f55 [0,4194304] 0 2024-04-23T10:21:00.668 INFO:tasks.workunit.client.0.smithi029.stdout:1/255: fdatasync d5/f17 0 2024-04-23T10:21:00.670 INFO:tasks.workunit.client.0.smithi029.stdout:0/194: dread d0/dc/f11 [0,4194304] 0 2024-04-23T10:21:00.670 INFO:tasks.workunit.client.0.smithi029.stdout:8/326: rmdir d3/d2f 39 2024-04-23T10:21:00.672 INFO:tasks.workunit.client.0.smithi029.stdout:3/287: readlink d3/d10/d27/d31/l3b 0 2024-04-23T10:21:00.672 INFO:tasks.workunit.client.0.smithi029.stdout:9/407: creat d0/d1b/d24/f89 x:0 0 0 2024-04-23T10:21:00.673 INFO:tasks.workunit.client.0.smithi029.stdout:2/348: dwrite d1/d4/f11 [0,4194304] 0 2024-04-23T10:21:00.674 INFO:tasks.workunit.client.0.smithi029.stdout:3/288: chown d3/d10/de/f47 45067 1 2024-04-23T10:21:00.674 INFO:tasks.workunit.client.0.smithi029.stdout:2/349: stat d1/d31/l36 0 2024-04-23T10:21:00.675 INFO:tasks.workunit.client.0.smithi029.stdout:6/388: rename d9/df/d41/d49/d69/f80 to d9/df/d16/d34/d84/f8a 0 2024-04-23T10:21:00.676 INFO:tasks.workunit.client.0.smithi029.stdout:2/350: dread - d1/d31/d3d/f74 zero size 2024-04-23T10:21:00.678 INFO:tasks.workunit.client.0.smithi029.stdout:4/345: symlink d0/d3c/d52/d1b/d36/d45/l76 0 2024-04-23T10:21:00.687 INFO:tasks.workunit.client.0.smithi029.stdout:0/195: unlink d0/f7 0 2024-04-23T10:21:00.689 INFO:tasks.workunit.client.0.smithi029.stdout:0/196: chown d0/dc/d27 794572392 1 2024-04-23T10:21:00.690 INFO:tasks.workunit.client.0.smithi029.stdout:6/389: unlink d9/df/d41/d49/d69/l88 0 2024-04-23T10:21:00.693 INFO:tasks.workunit.client.0.smithi029.stdout:6/390: dread - d9/df/d16/d1f/d2c/f4a zero size 2024-04-23T10:21:00.693 INFO:tasks.workunit.client.0.smithi029.stdout:3/289: dwrite d3/d10/d27/d31/f55 [0,4194304] 0 2024-04-23T10:21:00.696 INFO:tasks.workunit.client.0.smithi029.stdout:2/351: mkdir d1/d3e/d3b/d75 0 2024-04-23T10:21:00.700 INFO:tasks.workunit.client.0.smithi029.stdout:9/408: link d0/d1b/f31 d0/d1b/d44/d49/d65/f8a 0 2024-04-23T10:21:00.700 INFO:tasks.workunit.client.0.smithi029.stdout:1/256: write d5/d6/f16 [1062854,85018] 0 2024-04-23T10:21:00.703 INFO:tasks.workunit.client.0.smithi029.stdout:4/346: creat d0/d3c/d52/d74/f77 x:0 0 0 2024-04-23T10:21:00.703 INFO:tasks.workunit.client.0.smithi029.stdout:9/409: write d0/d7/f8 [1351791,70167] 0 2024-04-23T10:21:00.703 INFO:tasks.workunit.client.0.smithi029.stdout:2/352: truncate d1/d31/d3d/f41 4993952 0 2024-04-23T10:21:00.704 INFO:tasks.workunit.client.0.smithi029.stdout:0/197: rename d0/fd to d0/dc/d27/d3a/f43 0 2024-04-23T10:21:00.705 INFO:tasks.workunit.client.0.smithi029.stdout:1/257: creat d5/d6/de/d22/f5a x:0 0 0 2024-04-23T10:21:00.708 INFO:tasks.workunit.client.0.smithi029.stdout:9/410: creat d0/d1b/d39/d50/d5a/f8b x:0 0 0 2024-04-23T10:21:00.708 INFO:tasks.workunit.client.0.smithi029.stdout:3/290: link d3/d10/d27/l3c d3/d10/de/l60 0 2024-04-23T10:21:00.710 INFO:tasks.workunit.client.0.smithi029.stdout:9/411: readlink d0/d7/d1d/d35/d3b/l75 0 2024-04-23T10:21:00.711 INFO:tasks.workunit.client.0.smithi029.stdout:3/291: write d3/d10/d27/f53 [749220,89863] 0 2024-04-23T10:21:00.713 INFO:tasks.workunit.client.0.smithi029.stdout:1/258: link d5/d6/ff d5/d6/de/d22/f5b 0 2024-04-23T10:21:00.714 INFO:tasks.workunit.client.0.smithi029.stdout:8/327: dwrite d3/f1f [0,4194304] 0 2024-04-23T10:21:00.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/347: dread d0/d12/f5f [0,4194304] 0 2024-04-23T10:21:00.718 INFO:tasks.workunit.client.0.smithi029.stdout:4/348: write d0/d3c/d52/d1b/f2e [12759994,33305] 0 2024-04-23T10:21:00.719 INFO:tasks.workunit.client.0.smithi029.stdout:6/391: truncate f4 5220551 0 2024-04-23T10:21:00.721 INFO:tasks.workunit.client.0.smithi029.stdout:8/328: unlink d3/ce 0 2024-04-23T10:21:00.721 INFO:tasks.workunit.client.0.smithi029.stdout:3/292: mknod d3/d10/d27/c61 0 2024-04-23T10:21:00.721 INFO:tasks.workunit.client.0.smithi029.stdout:6/392: chown d9/df/d16/d1f/d27/d2d 8326 1 2024-04-23T10:21:00.722 INFO:tasks.workunit.client.0.smithi029.stdout:4/349: fsync d0/d3c/d52/d1b/d5b/d65/d6a/f6c 0 2024-04-23T10:21:00.723 INFO:tasks.workunit.client.0.smithi029.stdout:1/259: rename d5/d6/de/d27/d38/c4e to d5/d6/d34/c5c 0 2024-04-23T10:21:00.726 INFO:tasks.workunit.client.0.smithi029.stdout:8/329: rmdir d3/d2f 39 2024-04-23T10:21:00.726 INFO:tasks.workunit.client.0.smithi029.stdout:4/350: read d0/d12/f49 [122488,47195] 0 2024-04-23T10:21:00.732 INFO:tasks.workunit.client.0.smithi029.stdout:6/393: rename l1 to d9/df/d16/d34/l8b 0 2024-04-23T10:21:00.734 INFO:tasks.workunit.client.0.smithi029.stdout:9/412: dwrite d0/d7/d6/f47 [0,4194304] 0 2024-04-23T10:21:00.738 INFO:tasks.workunit.client.0.smithi029.stdout:8/330: unlink d3/d44/f5f 0 2024-04-23T10:21:00.739 INFO:tasks.workunit.client.0.smithi029.stdout:9/413: creat d0/d7/d3f/f8c x:0 0 0 2024-04-23T10:21:00.739 INFO:tasks.workunit.client.0.smithi029.stdout:3/293: dwrite d3/f5c [0,4194304] 0 2024-04-23T10:21:00.744 INFO:tasks.workunit.client.0.smithi029.stdout:3/294: dread - d3/d10/de/d2e/f42 zero size 2024-04-23T10:21:00.746 INFO:tasks.workunit.client.0.smithi029.stdout:1/260: dwrite d5/f37 [0,4194304] 0 2024-04-23T10:21:00.748 INFO:tasks.workunit.client.0.smithi029.stdout:5/375: dread d0/f2c [4194304,4194304] 0 2024-04-23T10:21:00.752 INFO:tasks.workunit.client.0.smithi029.stdout:3/295: unlink d3/d10/de/f47 0 2024-04-23T10:21:00.752 INFO:tasks.workunit.client.0.smithi029.stdout:8/331: creat d3/d50/f64 x:0 0 0 2024-04-23T10:21:00.754 INFO:tasks.workunit.client.0.smithi029.stdout:9/414: rename d0/d1b/d39/d4f/l6b to d0/d1b/d24/l8d 0 2024-04-23T10:21:00.760 INFO:tasks.workunit.client.0.smithi029.stdout:8/332: mknod d3/c65 0 2024-04-23T10:21:00.760 INFO:tasks.workunit.client.0.smithi029.stdout:8/333: dread - d3/d50/f64 zero size 2024-04-23T10:21:00.764 INFO:tasks.workunit.client.0.smithi029.stdout:3/296: creat d3/d15/d4b/d52/d5f/f62 x:0 0 0 2024-04-23T10:21:00.764 INFO:tasks.workunit.client.0.smithi029.stdout:9/415: symlink d0/d1b/l8e 0 2024-04-23T10:21:00.766 INFO:tasks.workunit.client.0.smithi029.stdout:3/297: truncate d3/d45/f4a 4933151 0 2024-04-23T10:21:00.767 INFO:tasks.workunit.client.0.smithi029.stdout:8/334: dread - d3/d2f/d36/d3e/f3f zero size 2024-04-23T10:21:00.771 INFO:tasks.workunit.client.0.smithi029.stdout:3/298: link d3/d10/d27/d31/f1a d3/f63 0 2024-04-23T10:21:00.773 INFO:tasks.workunit.client.0.smithi029.stdout:3/299: fsync d3/d10/f58 0 2024-04-23T10:21:00.778 INFO:tasks.workunit.client.0.smithi029.stdout:1/261: dwrite d5/d6/de/d22/f25 [0,4194304] 0 2024-04-23T10:21:00.779 INFO:tasks.workunit.client.0.smithi029.stdout:9/416: dwrite d0/d7/d1d/f1f [0,4194304] 0 2024-04-23T10:21:00.781 INFO:tasks.workunit.client.0.smithi029.stdout:5/376: dwrite d0/d35/d38/d51/f44 [0,4194304] 0 2024-04-23T10:21:00.786 INFO:tasks.workunit.client.0.smithi029.stdout:4/351: dread d0/d3c/d52/f1d [0,4194304] 0 2024-04-23T10:21:00.789 INFO:tasks.workunit.client.0.smithi029.stdout:9/417: creat d0/d7/d1d/d35/d3b/d68/f8f x:0 0 0 2024-04-23T10:21:00.790 INFO:tasks.workunit.client.0.smithi029.stdout:5/377: dread - d0/d35/d38/d39/d3f/f7d zero size 2024-04-23T10:21:00.794 INFO:tasks.workunit.client.0.smithi029.stdout:3/300: getdents d3/d10/de 0 2024-04-23T10:21:00.796 INFO:tasks.workunit.client.0.smithi029.stdout:4/352: creat d0/d3c/d52/d1b/d36/d45/f78 x:0 0 0 2024-04-23T10:21:00.799 INFO:tasks.workunit.client.0.smithi029.stdout:3/301: creat d3/d10/d27/d28/f64 x:0 0 0 2024-04-23T10:21:00.800 INFO:tasks.workunit.client.0.smithi029.stdout:4/353: truncate d0/d3c/d52/f75 362191 0 2024-04-23T10:21:00.801 INFO:tasks.workunit.client.0.smithi029.stdout:9/418: mknod d0/d1b/d39/d50/d67/c90 0 2024-04-23T10:21:00.801 INFO:tasks.workunit.client.0.smithi029.stdout:4/354: chown d0/d3c/d52/d1b/d36/d45/f58 18082494 1 2024-04-23T10:21:00.803 INFO:tasks.workunit.client.0.smithi029.stdout:3/302: mkdir d3/d10/de/d2e/d36/d40/d46/d65 0 2024-04-23T10:21:00.804 INFO:tasks.workunit.client.0.smithi029.stdout:9/419: creat d0/d7/d1d/d35/d3b/d68/f91 x:0 0 0 2024-04-23T10:21:00.806 INFO:tasks.workunit.client.0.smithi029.stdout:4/355: link d0/l51 d0/d12/l79 0 2024-04-23T10:21:00.809 INFO:tasks.workunit.client.0.smithi029.stdout:4/356: write d0/d12/f2b [4707881,103015] 0 2024-04-23T10:21:00.815 INFO:tasks.workunit.client.0.smithi029.stdout:1/262: write d5/d6/de/d27/d38/f44 [535313,114791] 0 2024-04-23T10:21:00.816 INFO:tasks.workunit.client.0.smithi029.stdout:3/303: dwrite d3/d10/de/f54 [0,4194304] 0 2024-04-23T10:21:00.820 INFO:tasks.workunit.client.0.smithi029.stdout:4/357: rmdir d0/d3c/d59 0 2024-04-23T10:21:00.820 INFO:tasks.workunit.client.0.smithi029.stdout:9/420: dwrite d0/d1b/d39/d50/d5a/f7d [0,4194304] 0 2024-04-23T10:21:00.823 INFO:tasks.workunit.client.0.smithi029.stdout:3/304: creat d3/d15/f66 x:0 0 0 2024-04-23T10:21:00.824 INFO:tasks.workunit.client.0.smithi029.stdout:4/358: chown d0/d12/c5c 99 1 2024-04-23T10:21:00.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/263: mknod d5/d6/de/c5d 0 2024-04-23T10:21:00.824 INFO:tasks.workunit.client.0.smithi029.stdout:3/305: rmdir d3/d10/d27 39 2024-04-23T10:21:00.827 INFO:tasks.workunit.client.0.smithi029.stdout:9/421: getdents d0/d1b/d39/d50/d5a 0 2024-04-23T10:21:00.830 INFO:tasks.workunit.client.0.smithi029.stdout:1/264: creat d5/d6/de/d22/f5e x:0 0 0 2024-04-23T10:21:00.830 INFO:tasks.workunit.client.0.smithi029.stdout:3/306: symlink d3/d45/d4f/l67 0 2024-04-23T10:21:00.835 INFO:tasks.workunit.client.0.smithi029.stdout:1/265: creat d5/d6/de/d22/f5f x:0 0 0 2024-04-23T10:21:00.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/359: dwrite d0/d3c/d52/f75 [0,4194304] 0 2024-04-23T10:21:00.838 INFO:tasks.workunit.client.0.smithi029.stdout:1/266: write d5/d6/de/d22/f2f [2833659,79987] 0 2024-04-23T10:21:00.841 INFO:tasks.workunit.client.0.smithi029.stdout:1/267: truncate d5/d6/de/d22/f5a 897969 0 2024-04-23T10:21:00.846 INFO:tasks.workunit.client.0.smithi029.stdout:1/268: mknod d5/d6/de/d22/c60 0 2024-04-23T10:21:00.847 INFO:tasks.workunit.client.0.smithi029.stdout:6/394: dread d9/f10 [0,4194304] 0 2024-04-23T10:21:00.848 INFO:tasks.workunit.client.0.smithi029.stdout:3/307: dwrite d3/d10/d27/d31/f55 [0,4194304] 0 2024-04-23T10:21:00.851 INFO:tasks.workunit.client.0.smithi029.stdout:4/360: dwrite d0/d3c/d52/d1b/d5b/d65/d6a/f6c [0,4194304] 0 2024-04-23T10:21:00.851 INFO:tasks.workunit.client.0.smithi029.stdout:6/395: rmdir d9/df/d16/d34/d36 39 2024-04-23T10:21:00.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/361: read d0/d12/f5f [1456682,99443] 0 2024-04-23T10:21:00.856 INFO:tasks.workunit.client.0.smithi029.stdout:3/308: dread d3/d10/de/d2e/d36/d40/d43/f57 [0,4194304] 0 2024-04-23T10:21:00.857 INFO:tasks.workunit.client.0.smithi029.stdout:6/396: symlink d9/df/d16/d1f/d27/d2d/d58/d7e/l8c 0 2024-04-23T10:21:00.857 INFO:tasks.workunit.client.0.smithi029.stdout:3/309: fdatasync f0 0 2024-04-23T10:21:00.859 INFO:tasks.workunit.client.0.smithi029.stdout:1/269: getdents d5/d6/de/d27 0 2024-04-23T10:21:00.860 INFO:tasks.workunit.client.0.smithi029.stdout:6/397: stat d9/df/d25/c47 0 2024-04-23T10:21:00.861 INFO:tasks.workunit.client.0.smithi029.stdout:3/310: creat d3/d10/d27/f68 x:0 0 0 2024-04-23T10:21:00.862 INFO:tasks.workunit.client.0.smithi029.stdout:1/270: readlink d5/d6/de/d27/d38/l3f 0 2024-04-23T10:21:00.863 INFO:tasks.workunit.client.0.smithi029.stdout:6/398: truncate d9/f29 4854154 0 2024-04-23T10:21:00.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/399: write d9/df/d16/d44/f62 [391119,24244] 0 2024-04-23T10:21:00.866 INFO:tasks.workunit.client.0.smithi029.stdout:6/400: fsync d9/df/d16/d1f/f38 0 2024-04-23T10:21:00.867 INFO:tasks.workunit.client.0.smithi029.stdout:3/311: link d3/d10/f51 d3/f69 0 2024-04-23T10:21:00.868 INFO:tasks.workunit.client.0.smithi029.stdout:3/312: chown d3/d45 109667319 1 2024-04-23T10:21:00.872 INFO:tasks.workunit.client.0.smithi029.stdout:6/401: creat d9/df/d16/d34/d84/f8d x:0 0 0 2024-04-23T10:21:00.873 INFO:tasks.workunit.client.0.smithi029.stdout:3/313: mknod d3/d10/de/d2e/d59/c6a 0 2024-04-23T10:21:00.873 INFO:tasks.workunit.client.0.smithi029.stdout:1/271: dread d5/d6/f19 [0,4194304] 0 2024-04-23T10:21:00.877 INFO:tasks.workunit.client.0.smithi029.stdout:5/378: dread d0/d35/d38/d3e/d66/f6c [0,4194304] 0 2024-04-23T10:21:00.877 INFO:tasks.workunit.client.0.smithi029.stdout:6/402: symlink d9/df/d16/d1f/d27/d2d/d66/l8e 0 2024-04-23T10:21:00.877 INFO:tasks.workunit.client.0.smithi029.stdout:9/422: truncate d0/d7/d3f/f40 517906 0 2024-04-23T10:21:00.882 INFO:tasks.workunit.client.0.smithi029.stdout:9/423: mkdir d0/d1b/d39/d4f/d92 0 2024-04-23T10:21:00.883 INFO:tasks.workunit.client.0.smithi029.stdout:3/314: dwrite d3/d10/f2b [0,4194304] 0 2024-04-23T10:21:00.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/272: dwrite d5/d6/de/d22/f25 [0,4194304] 0 2024-04-23T10:21:00.887 INFO:tasks.workunit.client.0.smithi029.stdout:5/379: link d0/d35/d38/d39/f73 d0/d35/d38/d3e/d66/d5a/f80 0 2024-04-23T10:21:00.888 INFO:tasks.workunit.client.0.smithi029.stdout:1/273: dread - d5/d3e/f54 zero size 2024-04-23T10:21:00.888 INFO:tasks.workunit.client.0.smithi029.stdout:5/380: readlink d0/l5 0 2024-04-23T10:21:00.888 INFO:tasks.workunit.client.0.smithi029.stdout:3/315: mkdir d3/d45/d4f/d6b 0 2024-04-23T10:21:00.889 INFO:tasks.workunit.client.0.smithi029.stdout:3/316: fdatasync d3/d15/d4b/d52/d5f/f62 0 2024-04-23T10:21:00.891 INFO:tasks.workunit.client.0.smithi029.stdout:5/381: write d0/d35/d38/d51/f44 [2249616,114541] 0 2024-04-23T10:21:00.894 INFO:tasks.workunit.client.0.smithi029.stdout:3/317: mknod d3/d10/de/c6c 0 2024-04-23T10:21:00.896 INFO:tasks.workunit.client.0.smithi029.stdout:5/382: write d0/d35/d38/d3e/d66/f6c [4175237,52746] 0 2024-04-23T10:21:00.903 INFO:tasks.workunit.client.0.smithi029.stdout:9/424: dwrite d0/d1b/d39/d50/d5a/f8b [0,4194304] 0 2024-04-23T10:21:00.906 INFO:tasks.workunit.client.0.smithi029.stdout:6/403: fsync d9/df/d16/d44/f62 0 2024-04-23T10:21:00.909 INFO:tasks.workunit.client.0.smithi029.stdout:3/318: creat d3/d10/f6d x:0 0 0 2024-04-23T10:21:00.911 INFO:tasks.workunit.client.0.smithi029.stdout:6/404: dread - d9/df/d41/f83 zero size 2024-04-23T10:21:00.912 INFO:tasks.workunit.client.0.smithi029.stdout:1/274: dwrite d5/d6/de/d27/d38/d47/f57 [0,4194304] 0 2024-04-23T10:21:00.916 INFO:tasks.workunit.client.0.smithi029.stdout:6/405: write d9/df/f13 [4209569,55416] 0 2024-04-23T10:21:00.916 INFO:tasks.workunit.client.0.smithi029.stdout:9/425: read d0/d7/f12 [1638622,97368] 0 2024-04-23T10:21:00.922 INFO:tasks.workunit.client.0.smithi029.stdout:3/319: link d3/d15/f18 d3/d45/d4f/f6e 0 2024-04-23T10:21:00.924 INFO:tasks.workunit.client.0.smithi029.stdout:9/426: rmdir d0/d1b/d39/d4f 39 2024-04-23T10:21:00.926 INFO:tasks.workunit.client.0.smithi029.stdout:3/320: write d3/d45/d4f/f6e [1246173,85076] 0 2024-04-23T10:21:00.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/427: symlink d0/d7/d3f/l93 0 2024-04-23T10:21:00.928 INFO:tasks.workunit.client.0.smithi029.stdout:9/428: chown d0/d1b/d44/d49/c4b 321644 1 2024-04-23T10:21:00.930 INFO:tasks.workunit.client.0.smithi029.stdout:3/321: readlink d3/d10/de/lf 0 2024-04-23T10:21:00.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/429: creat d0/d7/d6/d66/f94 x:0 0 0 2024-04-23T10:21:00.932 INFO:tasks.workunit.client.0.smithi029.stdout:3/322: write d3/d10/de/d2e/d36/d40/d46/f4d [1886067,8208] 0 2024-04-23T10:21:00.933 INFO:tasks.workunit.client.0.smithi029.stdout:9/430: unlink d0/d1b/d24/l2f 0 2024-04-23T10:21:00.934 INFO:tasks.workunit.client.0.smithi029.stdout:3/323: rmdir d3/d10/de/d2e/d36/d40 39 2024-04-23T10:21:00.936 INFO:tasks.workunit.client.0.smithi029.stdout:3/324: write d3/d10/f2b [3941983,60262] 0 2024-04-23T10:21:00.939 INFO:tasks.workunit.client.0.smithi029.stdout:3/325: creat d3/d10/d27/f6f x:0 0 0 2024-04-23T10:21:00.939 INFO:tasks.workunit.client.0.smithi029.stdout:5/383: fsync d0/d35/d10/f71 0 2024-04-23T10:21:00.941 INFO:tasks.workunit.client.0.smithi029.stdout:5/384: truncate d0/d35/d38/d3e/f70 1732381 0 2024-04-23T10:21:00.942 INFO:tasks.workunit.client.0.smithi029.stdout:3/326: creat d3/d15/d4b/d52/f70 x:0 0 0 2024-04-23T10:21:00.942 INFO:tasks.workunit.client.0.smithi029.stdout:6/406: write d9/d5b/f86 [1628378,67618] 0 2024-04-23T10:21:00.944 INFO:tasks.workunit.client.0.smithi029.stdout:9/431: read d0/f21 [222574,102811] 0 2024-04-23T10:21:00.944 INFO:tasks.workunit.client.0.smithi029.stdout:1/275: truncate d5/d6/de/d22/f25 2384233 0 2024-04-23T10:21:00.945 INFO:tasks.workunit.client.0.smithi029.stdout:1/276: chown d5/d6/de/d22/f5b 699 1 2024-04-23T10:21:00.946 INFO:tasks.workunit.client.0.smithi029.stdout:3/327: creat d3/d15/d4b/f71 x:0 0 0 2024-04-23T10:21:00.947 INFO:tasks.workunit.client.0.smithi029.stdout:3/328: fdatasync d3/d15/d4b/f71 0 2024-04-23T10:21:00.950 INFO:tasks.workunit.client.0.smithi029.stdout:5/385: rmdir d0/d35/d38/d39/d3f/d6f 0 2024-04-23T10:21:00.953 INFO:tasks.workunit.client.0.smithi029.stdout:1/277: rmdir d5/d6/de/d15/d55 0 2024-04-23T10:21:00.953 INFO:tasks.workunit.client.0.smithi029.stdout:9/432: dwrite d0/d1b/d24/f89 [0,4194304] 0 2024-04-23T10:21:00.954 INFO:tasks.workunit.client.0.smithi029.stdout:1/278: write d5/f53 [63346,8334] 0 2024-04-23T10:21:00.956 INFO:tasks.workunit.client.0.smithi029.stdout:1/279: stat d5/d6/d34/l36 0 2024-04-23T10:21:00.957 INFO:tasks.workunit.client.0.smithi029.stdout:3/329: rename d3/d10/d27 to d3/d10/de/d2e/d36/d40/d46/d72 0 2024-04-23T10:21:00.964 INFO:tasks.workunit.client.0.smithi029.stdout:5/386: dwrite d0/d35/d10/f71 [4194304,4194304] 0 2024-04-23T10:21:00.964 INFO:tasks.workunit.client.0.smithi029.stdout:1/280: read d5/d6/de/d22/f5b [1999440,46259] 0 2024-04-23T10:21:00.965 INFO:tasks.workunit.client.0.smithi029.stdout:1/281: readlink d5/l1c 0 2024-04-23T10:21:00.966 INFO:tasks.workunit.client.0.smithi029.stdout:9/433: dread d0/d7/d6/f47 [0,4194304] 0 2024-04-23T10:21:00.968 INFO:tasks.workunit.client.0.smithi029.stdout:1/282: dread - d5/d3e/f54 zero size 2024-04-23T10:21:00.973 INFO:tasks.workunit.client.0.smithi029.stdout:3/330: dwrite d3/d10/de/d2e/d36/d40/d46/d72/f6f [0,4194304] 0 2024-04-23T10:21:00.973 INFO:tasks.workunit.client.0.smithi029.stdout:5/387: rename d0/d35/d38/d3e/f59 to d0/f81 0 2024-04-23T10:21:00.975 INFO:tasks.workunit.client.0.smithi029.stdout:9/434: getdents d0/d1b/d39 0 2024-04-23T10:21:00.975 INFO:tasks.workunit.client.0.smithi029.stdout:3/331: truncate d3/f2a 602674 0 2024-04-23T10:21:00.980 INFO:tasks.workunit.client.0.smithi029.stdout:9/435: mknod d0/d1b/d39/d4f/c95 0 2024-04-23T10:21:00.980 INFO:tasks.workunit.client.0.smithi029.stdout:5/388: creat d0/d35/d38/d3e/d66/f82 x:0 0 0 2024-04-23T10:21:00.981 INFO:tasks.workunit.client.0.smithi029.stdout:3/332: symlink d3/d10/d48/l73 0 2024-04-23T10:21:00.984 INFO:tasks.workunit.client.0.smithi029.stdout:5/389: rmdir d0/d35/d49 39 2024-04-23T10:21:00.985 INFO:tasks.workunit.client.0.smithi029.stdout:3/333: stat d3/d10/f58 0 2024-04-23T10:21:00.986 INFO:tasks.workunit.client.0.smithi029.stdout:1/283: dwrite d5/d6/f40 [0,4194304] 0 2024-04-23T10:21:00.986 INFO:tasks.workunit.client.0.smithi029.stdout:9/436: rmdir d0/d7/d1d/d35/d3b/d68 39 2024-04-23T10:21:00.987 INFO:tasks.workunit.client.0.smithi029.stdout:5/390: write d0/d35/d38/d3e/f70 [1788499,40434] 0 2024-04-23T10:21:00.989 INFO:tasks.workunit.client.0.smithi029.stdout:9/437: rmdir d0/d7/d6 39 2024-04-23T10:21:00.992 INFO:tasks.workunit.client.0.smithi029.stdout:5/391: mkdir d0/d35/d83 0 2024-04-23T10:21:00.993 INFO:tasks.workunit.client.0.smithi029.stdout:9/438: creat d0/d7/d3f/f96 x:0 0 0 2024-04-23T10:21:00.995 INFO:tasks.workunit.client.0.smithi029.stdout:1/284: creat d5/d6/f61 x:0 0 0 2024-04-23T10:21:00.995 INFO:tasks.workunit.client.0.smithi029.stdout:9/439: write d0/d1b/d39/d50/d5a/f7d [2563294,87726] 0 2024-04-23T10:21:00.997 INFO:tasks.workunit.client.0.smithi029.stdout:3/334: link d3/d10/de/f14 d3/d45/d4f/d6b/f74 0 2024-04-23T10:21:00.999 INFO:tasks.workunit.client.0.smithi029.stdout:3/335: fdatasync d3/d10/f2b 0 2024-04-23T10:21:01.002 INFO:tasks.workunit.client.0.smithi029.stdout:9/440: creat d0/d1b/d39/f97 x:0 0 0 2024-04-23T10:21:01.005 INFO:tasks.workunit.client.0.smithi029.stdout:5/392: creat d0/d35/d49/f84 x:0 0 0 2024-04-23T10:21:01.006 INFO:tasks.workunit.client.0.smithi029.stdout:1/285: dwrite d5/d6/de/d15/f3b [0,4194304] 0 2024-04-23T10:21:01.007 INFO:tasks.workunit.client.0.smithi029.stdout:5/393: dread - d0/f75 zero size 2024-04-23T10:21:01.009 INFO:tasks.workunit.client.0.smithi029.stdout:5/394: read d0/d35/d10/d26/f45 [6280432,49918] 0 2024-04-23T10:21:01.010 INFO:tasks.workunit.client.0.smithi029.stdout:3/336: dwrite d3/d10/de/d2e/d36/d40/d46/f4d [4194304,4194304] 0 2024-04-23T10:21:01.015 INFO:tasks.workunit.client.0.smithi029.stdout:3/337: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d75 0 2024-04-23T10:21:01.095 INFO:tasks.workunit.client.0.smithi029.stdout:3/338: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d28/d76 0 2024-04-23T10:21:01.101 INFO:tasks.workunit.client.0.smithi029.stdout:9/441: link d0/d1b/l25 d0/d1b/l98 0 2024-04-23T10:21:01.104 INFO:tasks.workunit.client.0.smithi029.stdout:3/339: symlink d3/d10/de/d2e/d36/d40/l77 0 2024-04-23T10:21:01.107 INFO:tasks.workunit.client.0.smithi029.stdout:9/442: fdatasync d0/f11 0 2024-04-23T10:21:01.109 INFO:tasks.workunit.client.0.smithi029.stdout:9/443: truncate d0/d7/f18 4438780 0 2024-04-23T10:21:01.114 INFO:tasks.workunit.client.0.smithi029.stdout:9/444: write d0/d7/d1d/f1f [3929029,60508] 0 2024-04-23T10:21:01.129 INFO:tasks.workunit.client.0.smithi029.stdout:3/340: truncate d3/f8 6956337 0 2024-04-23T10:21:01.130 INFO:tasks.workunit.client.0.smithi029.stdout:3/341: chown d3/d15/d4b 1403243561 1 2024-04-23T10:21:01.131 INFO:tasks.workunit.client.0.smithi029.stdout:9/445: stat d0/d1b/c3e 0 2024-04-23T10:21:01.135 INFO:tasks.workunit.client.0.smithi029.stdout:3/342: write d3/d10/de/f54 [2550214,45656] 0 2024-04-23T10:21:01.138 INFO:tasks.workunit.client.0.smithi029.stdout:3/343: read d3/f2a [102180,21816] 0 2024-04-23T10:21:01.140 INFO:tasks.workunit.client.0.smithi029.stdout:9/446: truncate d0/f5b 3347130 0 2024-04-23T10:21:01.145 INFO:tasks.workunit.client.0.smithi029.stdout:9/447: write d0/d7/d3f/f96 [853916,3803] 0 2024-04-23T10:21:01.149 INFO:tasks.workunit.client.0.smithi029.stdout:3/344: mknod d3/d10/de/d2e/c78 0 2024-04-23T10:21:01.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/345: creat d3/d10/f79 x:0 0 0 2024-04-23T10:21:01.168 INFO:tasks.workunit.client.0.smithi029.stdout:9/448: truncate d0/f1e 3207414 0 2024-04-23T10:21:01.173 INFO:tasks.workunit.client.0.smithi029.stdout:3/346: creat d3/d10/f7a x:0 0 0 2024-04-23T10:21:01.175 INFO:tasks.workunit.client.0.smithi029.stdout:9/449: chown d0/d7/d1d/d35/d3b/d68 20044 1 2024-04-23T10:21:01.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/407: dread d9/df/f3d [0,4194304] 0 2024-04-23T10:21:01.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/347: getdents d3/d10/de 0 2024-04-23T10:21:01.182 INFO:tasks.workunit.client.0.smithi029.stdout:9/450: creat d0/d7/f99 x:0 0 0 2024-04-23T10:21:01.188 INFO:tasks.workunit.client.0.smithi029.stdout:6/408: symlink d9/df/d16/d34/l8f 0 2024-04-23T10:21:01.189 INFO:tasks.workunit.client.0.smithi029.stdout:6/409: chown d9/l2f 6541 1 2024-04-23T10:21:01.192 INFO:tasks.workunit.client.0.smithi029.stdout:3/348: link d3/f69 d3/d45/f7b 0 2024-04-23T10:21:01.192 INFO:tasks.workunit.client.0.smithi029.stdout:6/410: write d9/df/d16/f2e [789691,32106] 0 2024-04-23T10:21:01.193 INFO:tasks.workunit.client.0.smithi029.stdout:9/451: symlink d0/d1b/d39/d4f/d92/l9a 0 2024-04-23T10:21:01.200 INFO:tasks.workunit.client.0.smithi029.stdout:9/452: unlink d0/d7/fa 0 2024-04-23T10:21:01.203 INFO:tasks.workunit.client.0.smithi029.stdout:6/411: mkdir d9/df/d16/d44/d75/d90 0 2024-04-23T10:21:01.209 INFO:tasks.workunit.client.0.smithi029.stdout:3/349: mknod d3/d10/de/d2e/d36/d40/d46/d72/d28/c7c 0 2024-04-23T10:21:01.210 INFO:tasks.workunit.client.0.smithi029.stdout:3/350: dread - d3/d10/de/d2e/f42 zero size 2024-04-23T10:21:01.212 INFO:tasks.workunit.client.0.smithi029.stdout:9/453: creat d0/d7/d1d/f9b x:0 0 0 2024-04-23T10:21:01.216 INFO:tasks.workunit.client.0.smithi029.stdout:3/351: symlink d3/d15/d4b/l7d 0 2024-04-23T10:21:01.219 INFO:tasks.workunit.client.0.smithi029.stdout:9/454: creat d0/d1b/d39/d4f/f9c x:0 0 0 2024-04-23T10:21:01.221 INFO:tasks.workunit.client.0.smithi029.stdout:3/352: unlink d3/d15/c4e 0 2024-04-23T10:21:01.224 INFO:tasks.workunit.client.0.smithi029.stdout:6/412: creat d9/df/d16/d34/f91 x:0 0 0 2024-04-23T10:21:01.226 INFO:tasks.workunit.client.0.smithi029.stdout:6/413: read - d9/df/d16/d1f/d27/d2d/d58/f5a zero size 2024-04-23T10:21:01.226 INFO:tasks.workunit.client.0.smithi029.stdout:9/455: creat d0/d7/d1d/f9d x:0 0 0 2024-04-23T10:21:01.228 INFO:tasks.workunit.client.0.smithi029.stdout:9/456: fdatasync d0/d7/f1a 0 2024-04-23T10:21:01.228 INFO:tasks.workunit.client.0.smithi029.stdout:3/353: chown d3/d10/de/d2e/d36/d40/d46/f4d 128149 1 2024-04-23T10:21:01.228 INFO:tasks.workunit.client.0.smithi029.stdout:6/414: write d9/d5b/f71 [825014,34411] 0 2024-04-23T10:21:01.231 INFO:tasks.workunit.client.0.smithi029.stdout:9/457: truncate d0/d7/d3f/f8c 742906 0 2024-04-23T10:21:01.237 INFO:tasks.workunit.client.0.smithi029.stdout:6/415: creat d9/f92 x:0 0 0 2024-04-23T10:21:01.239 INFO:tasks.workunit.client.0.smithi029.stdout:6/416: fsync d9/d5b/f86 0 2024-04-23T10:21:01.240 INFO:tasks.workunit.client.0.smithi029.stdout:9/458: symlink d0/d1b/d39/d50/d5a/l9e 0 2024-04-23T10:21:01.244 INFO:tasks.workunit.client.0.smithi029.stdout:3/354: creat d3/d10/de/d2e/d36/d40/f7e x:0 0 0 2024-04-23T10:21:01.246 INFO:tasks.workunit.client.0.smithi029.stdout:6/417: write d9/df/d16/d44/d75/f85 [146847,99877] 0 2024-04-23T10:21:01.246 INFO:tasks.workunit.client.0.smithi029.stdout:3/355: write d3/d10/f7a [295227,92996] 0 2024-04-23T10:21:01.247 INFO:tasks.workunit.client.0.smithi029.stdout:9/459: mknod d0/d1b/d39/d50/d5a/c9f 0 2024-04-23T10:21:01.253 INFO:tasks.workunit.client.0.smithi029.stdout:3/356: creat d3/d10/de/d2e/d36/d40/d46/f7f x:0 0 0 2024-04-23T10:21:01.255 INFO:tasks.workunit.client.0.smithi029.stdout:6/418: creat d9/df/d16/d34/f93 x:0 0 0 2024-04-23T10:21:01.258 INFO:tasks.workunit.client.0.smithi029.stdout:6/419: chown d9/df/l6a 3886 1 2024-04-23T10:21:01.262 INFO:tasks.workunit.client.0.smithi029.stdout:6/420: readlink d9/df/d16/d44/d4c/l79 0 2024-04-23T10:21:01.263 INFO:tasks.workunit.client.0.smithi029.stdout:3/357: write d3/f8 [6427856,68476] 0 2024-04-23T10:21:01.264 INFO:tasks.workunit.client.0.smithi029.stdout:9/460: dwrite d0/d1b/d39/d4f/f9c [0,4194304] 0 2024-04-23T10:21:01.265 INFO:tasks.workunit.client.0.smithi029.stdout:6/421: symlink d9/df/l94 0 2024-04-23T10:21:01.269 INFO:tasks.workunit.client.0.smithi029.stdout:3/358: mknod d3/d10/de/d2e/d59/c80 0 2024-04-23T10:21:01.270 INFO:tasks.workunit.client.0.smithi029.stdout:9/461: dread d0/d7/d3f/f40 [0,4194304] 0 2024-04-23T10:21:01.274 INFO:tasks.workunit.client.0.smithi029.stdout:9/462: mknod d0/d1b/d24/ca0 0 2024-04-23T10:21:01.277 INFO:tasks.workunit.client.0.smithi029.stdout:3/359: creat d3/d10/de/d2e/d36/d40/d46/d65/f81 x:0 0 0 2024-04-23T10:21:01.281 INFO:tasks.workunit.client.0.smithi029.stdout:6/422: dwrite d9/df/d16/d1f/d27/f70 [0,4194304] 0 2024-04-23T10:21:01.282 INFO:tasks.workunit.client.0.smithi029.stdout:3/360: write d3/d10/de/d2e/d36/d40/d46/d72/f68 [713092,43302] 0 2024-04-23T10:21:01.284 INFO:tasks.workunit.client.0.smithi029.stdout:3/361: chown d3/d10/de/d2e/d36/d40/d46 28669 1 2024-04-23T10:21:01.285 INFO:tasks.workunit.client.0.smithi029.stdout:9/463: link d0/d1b/d44/d49/l7a d0/d7/la1 0 2024-04-23T10:21:01.287 INFO:tasks.workunit.client.0.smithi029.stdout:6/423: mkdir d9/df/d16/d1f/d27/d2d/d66/d95 0 2024-04-23T10:21:01.291 INFO:tasks.workunit.client.0.smithi029.stdout:9/464: rmdir d0/d7/d6 39 2024-04-23T10:21:01.296 INFO:tasks.workunit.client.0.smithi029.stdout:6/424: unlink d9/df/d16/d34/d84/f8d 0 2024-04-23T10:21:01.298 INFO:tasks.workunit.client.0.smithi029.stdout:3/362: creat d3/d10/de/d2e/d36/f82 x:0 0 0 2024-04-23T10:21:01.299 INFO:tasks.workunit.client.0.smithi029.stdout:6/425: mknod d9/df/d16/d1f/d2c/c96 0 2024-04-23T10:21:01.300 INFO:tasks.workunit.client.0.smithi029.stdout:9/465: creat d0/fa2 x:0 0 0 2024-04-23T10:21:01.304 INFO:tasks.workunit.client.0.smithi029.stdout:9/466: rmdir d0/d7/d1d/d35/d3b/d68 39 2024-04-23T10:21:01.306 INFO:tasks.workunit.client.0.smithi029.stdout:6/426: getdents d9/df/d16/d1f/d27/d2d 0 2024-04-23T10:21:01.306 INFO:tasks.workunit.client.0.smithi029.stdout:9/467: fsync d0/d7/d6/f47 0 2024-04-23T10:21:01.306 INFO:tasks.workunit.client.0.smithi029.stdout:6/427: chown d9/df/d41 146 1 2024-04-23T10:21:01.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/428: fdatasync d9/df/d16/d34/f91 0 2024-04-23T10:21:01.309 INFO:tasks.workunit.client.0.smithi029.stdout:9/468: creat d0/d7/d6/fa3 x:0 0 0 2024-04-23T10:21:01.310 INFO:tasks.workunit.client.0.smithi029.stdout:9/469: chown d0/d7/d6/d66 765665454 1 2024-04-23T10:21:01.314 INFO:tasks.workunit.client.0.smithi029.stdout:6/429: dread d9/f10 [0,4194304] 0 2024-04-23T10:21:01.315 INFO:tasks.workunit.client.0.smithi029.stdout:9/470: unlink d0/d7/d6/f55 0 2024-04-23T10:21:01.317 INFO:tasks.workunit.client.0.smithi029.stdout:6/430: truncate d9/df/d16/d1f/d27/d2d/d58/f5a 376996 0 2024-04-23T10:21:01.318 INFO:tasks.workunit.client.0.smithi029.stdout:9/471: mknod d0/d1b/ca4 0 2024-04-23T10:21:01.319 INFO:tasks.workunit.client.0.smithi029.stdout:3/363: dread d3/d15/f1d [0,4194304] 0 2024-04-23T10:21:01.319 INFO:tasks.workunit.client.0.smithi029.stdout:9/472: fsync d0/d1b/d44/d49/f64 0 2024-04-23T10:21:01.320 INFO:tasks.workunit.client.0.smithi029.stdout:6/431: creat d9/df/d16/d44/d4c/f97 x:0 0 0 2024-04-23T10:21:01.321 INFO:tasks.workunit.client.0.smithi029.stdout:3/364: chown d3/d10/de/d2e/d36/d40/d46/d72/d31/f55 0 1 2024-04-23T10:21:01.322 INFO:tasks.workunit.client.0.smithi029.stdout:9/473: rmdir d0/d7 39 2024-04-23T10:21:01.325 INFO:tasks.workunit.client.0.smithi029.stdout:6/432: creat d9/df/d16/d1f/d27/d2d/d66/d95/f98 x:0 0 0 2024-04-23T10:21:01.329 INFO:tasks.workunit.client.0.smithi029.stdout:9/474: rename d0/d7/d3f/c85 to d0/d1b/ca5 0 2024-04-23T10:21:01.329 INFO:tasks.workunit.client.0.smithi029.stdout:3/365: dwrite d3/d10/de/f54 [0,4194304] 0 2024-04-23T10:21:01.330 INFO:tasks.workunit.client.0.smithi029.stdout:9/475: dread - d0/d7/f99 zero size 2024-04-23T10:21:01.331 INFO:tasks.workunit.client.0.smithi029.stdout:9/476: read - d0/d7/d1d/f9d zero size 2024-04-23T10:21:01.333 INFO:tasks.workunit.client.0.smithi029.stdout:9/477: write d0/d1b/d39/d50/d5a/f8b [1398963,4865] 0 2024-04-23T10:21:01.334 INFO:tasks.workunit.client.0.smithi029.stdout:6/433: link d9/df/d16/d1f/d27/d2d/d66/l8e d9/df/d41/d49/d69/l99 0 2024-04-23T10:21:01.336 INFO:tasks.workunit.client.0.smithi029.stdout:9/478: write d0/d7/d1d/d35/f36 [3343758,67126] 0 2024-04-23T10:21:01.339 INFO:tasks.workunit.client.0.smithi029.stdout:6/434: mknod d9/df/d16/d34/d84/c9a 0 2024-04-23T10:21:01.343 INFO:tasks.workunit.client.0.smithi029.stdout:9/479: dread d0/f21 [0,4194304] 0 2024-04-23T10:21:01.343 INFO:tasks.workunit.client.0.smithi029.stdout:6/435: mknod d9/df/d16/d44/d4c/c9b 0 2024-04-23T10:21:01.344 INFO:tasks.workunit.client.0.smithi029.stdout:9/480: chown d0/d1b/c34 655842 1 2024-04-23T10:21:01.346 INFO:tasks.workunit.client.0.smithi029.stdout:6/436: stat d9/df/d16/f24 0 2024-04-23T10:21:01.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/481: fsync d0/d7/d6/d66/f70 0 2024-04-23T10:21:01.351 INFO:tasks.workunit.client.0.smithi029.stdout:6/437: symlink d9/df/d16/d1f/d2c/l9c 0 2024-04-23T10:21:01.353 INFO:tasks.workunit.client.0.smithi029.stdout:9/482: creat d0/d1b/d39/d50/d5a/fa6 x:0 0 0 2024-04-23T10:21:01.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/483: symlink d0/d1b/d39/d4f/la7 0 2024-04-23T10:21:01.358 INFO:tasks.workunit.client.0.smithi029.stdout:9/484: write d0/d7/d1d/d35/d3b/d68/f91 [766011,8462] 0 2024-04-23T10:21:01.371 INFO:tasks.workunit.client.0.smithi029.stdout:9/485: dread d0/f21 [0,4194304] 0 2024-04-23T10:21:01.372 INFO:tasks.workunit.client.0.smithi029.stdout:3/366: dwrite d3/f63 [0,4194304] 0 2024-04-23T10:21:01.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/367: creat d3/d10/de/d2e/d36/d40/d46/f83 x:0 0 0 2024-04-23T10:21:01.377 INFO:tasks.workunit.client.0.smithi029.stdout:9/486: chown d0/d1b/d39/d50/c59 4 1 2024-04-23T10:21:01.379 INFO:tasks.workunit.client.0.smithi029.stdout:9/487: symlink d0/d1b/d39/d4f/la8 0 2024-04-23T10:21:01.390 INFO:tasks.workunit.client.0.smithi029.stdout:9/488: dwrite d0/d7/d6/fa3 [0,4194304] 0 2024-04-23T10:21:01.394 INFO:tasks.workunit.client.0.smithi029.stdout:3/368: dread d3/fd [0,4194304] 0 2024-04-23T10:21:01.395 INFO:tasks.workunit.client.0.smithi029.stdout:3/369: dread - d3/d10/de/d2e/f42 zero size 2024-04-23T10:21:01.399 INFO:tasks.workunit.client.0.smithi029.stdout:3/370: truncate d3/d10/de/d2e/d36/d40/d46/d65/f81 822258 0 2024-04-23T10:21:01.401 INFO:tasks.workunit.client.0.smithi029.stdout:9/489: dwrite d0/d7/d1d/f57 [0,4194304] 0 2024-04-23T10:21:01.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/371: read d3/d10/de/d2e/d36/f39 [222835,102606] 0 2024-04-23T10:21:01.407 INFO:tasks.workunit.client.0.smithi029.stdout:3/372: dread - d3/d10/de/d2e/d36/d40/f41 zero size 2024-04-23T10:21:01.411 INFO:tasks.workunit.client.0.smithi029.stdout:9/490: dwrite d0/f21 [0,4194304] 0 2024-04-23T10:21:01.415 INFO:tasks.workunit.client.0.smithi029.stdout:3/373: symlink d3/d10/de/d2e/d59/l84 0 2024-04-23T10:21:01.417 INFO:tasks.workunit.client.0.smithi029.stdout:3/374: write f0 [1733808,7670] 0 2024-04-23T10:21:01.420 INFO:tasks.workunit.client.0.smithi029.stdout:3/375: write d3/d10/de/d2e/f42 [165912,50368] 0 2024-04-23T10:21:01.421 INFO:tasks.workunit.client.0.smithi029.stdout:7/368: sync 2024-04-23T10:21:01.424 INFO:tasks.workunit.client.0.smithi029.stdout:9/491: dwrite d0/d1b/d39/d50/d5a/fa6 [0,4194304] 0 2024-04-23T10:21:01.429 INFO:tasks.workunit.client.0.smithi029.stdout:9/492: mkdir d0/d7/d1d/d35/da9 0 2024-04-23T10:21:01.432 INFO:tasks.workunit.client.0.smithi029.stdout:9/493: mkdir d0/d1b/d39/d50/d67/daa 0 2024-04-23T10:21:01.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/494: chown d0/d1b/d39 12340990 1 2024-04-23T10:21:01.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/495: chown d0/f21 3 1 2024-04-23T10:21:01.435 INFO:tasks.workunit.client.0.smithi029.stdout:9/496: write d0/d7/d1d/d35/f36 [230195,105266] 0 2024-04-23T10:21:01.438 INFO:tasks.workunit.client.0.smithi029.stdout:9/497: creat d0/d7/d1d/d35/fab x:0 0 0 2024-04-23T10:21:01.439 INFO:tasks.workunit.client.0.smithi029.stdout:9/498: dread - d0/d7/d1d/f9d zero size 2024-04-23T10:21:01.444 INFO:tasks.workunit.client.0.smithi029.stdout:9/499: link d0/d1b/c3e d0/d7/d6/cac 0 2024-04-23T10:21:01.445 INFO:tasks.workunit.client.0.smithi029.stdout:9/500: read d0/d7/d6/fa3 [788755,69328] 0 2024-04-23T10:21:01.452 INFO:tasks.workunit.client.0.smithi029.stdout:9/501: dwrite d0/d7/d6/d66/f94 [0,4194304] 0 2024-04-23T10:21:01.456 INFO:tasks.workunit.client.0.smithi029.stdout:9/502: getdents d0/d1b/d44 0 2024-04-23T10:21:01.462 INFO:tasks.workunit.client.0.smithi029.stdout:9/503: dread d0/d1b/d24/f89 [0,4194304] 0 2024-04-23T10:21:01.464 INFO:tasks.workunit.client.0.smithi029.stdout:9/504: symlink d0/d7/d3f/lad 0 2024-04-23T10:21:01.466 INFO:tasks.workunit.client.0.smithi029.stdout:9/505: unlink d0/d7/f99 0 2024-04-23T10:21:01.686 INFO:tasks.workunit.client.0.smithi029.stdout:9/506: getdents d0/d7 0 2024-04-23T10:21:01.707 INFO:tasks.workunit.client.0.smithi029.stdout:5/395: sync 2024-04-23T10:21:01.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/335: sync 2024-04-23T10:21:01.707 INFO:tasks.workunit.client.0.smithi029.stdout:1/286: sync 2024-04-23T10:21:01.707 INFO:tasks.workunit.client.0.smithi029.stdout:0/198: sync 2024-04-23T10:21:01.707 INFO:tasks.workunit.client.0.smithi029.stdout:4/362: sync 2024-04-23T10:21:01.707 INFO:tasks.workunit.client.0.smithi029.stdout:2/353: sync 2024-04-23T10:21:01.708 INFO:tasks.workunit.client.0.smithi029.stdout:1/287: chown d5 168 1 2024-04-23T10:21:01.709 INFO:tasks.workunit.client.0.smithi029.stdout:2/354: dread - d1/dd/f62 zero size 2024-04-23T10:21:01.710 INFO:tasks.workunit.client.0.smithi029.stdout:1/288: fdatasync d5/d3e/f4b 0 2024-04-23T10:21:01.715 INFO:tasks.workunit.client.0.smithi029.stdout:8/336: fsync d3/f29 0 2024-04-23T10:21:01.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/507: dread d0/d7/d3f/f41 [0,4194304] 0 2024-04-23T10:21:01.719 INFO:tasks.workunit.client.0.smithi029.stdout:2/355: creat d1/d31/d50/f76 x:0 0 0 2024-04-23T10:21:01.721 INFO:tasks.workunit.client.0.smithi029.stdout:2/356: write d1/d3e/d5a/f6e [356440,20380] 0 2024-04-23T10:21:01.726 INFO:tasks.workunit.client.0.smithi029.stdout:8/337: chown d3/cf 1354940972 1 2024-04-23T10:21:01.727 INFO:tasks.workunit.client.0.smithi029.stdout:8/338: fdatasync d3/d44/f62 0 2024-04-23T10:21:01.734 INFO:tasks.workunit.client.0.smithi029.stdout:4/363: mkdir d0/d5a/d6e/d7a 0 2024-04-23T10:21:01.738 INFO:tasks.workunit.client.0.smithi029.stdout:2/357: dwrite d1/dd/d47/d63/d64/f72 [0,4194304] 0 2024-04-23T10:21:01.741 INFO:tasks.workunit.client.0.smithi029.stdout:1/289: creat d5/d6/de/f62 x:0 0 0 2024-04-23T10:21:01.745 INFO:tasks.workunit.client.0.smithi029.stdout:1/290: write d5/d6/de/d27/d38/f44 [264011,8702] 0 2024-04-23T10:21:01.746 INFO:tasks.workunit.client.0.smithi029.stdout:9/508: rmdir d0/d1b/d39/d50/d67/daa 0 2024-04-23T10:21:01.750 INFO:tasks.workunit.client.0.smithi029.stdout:2/358: dread d1/d4/f44 [0,4194304] 0 2024-04-23T10:21:01.752 INFO:tasks.workunit.client.0.smithi029.stdout:8/339: creat d3/f66 x:0 0 0 2024-04-23T10:21:01.754 INFO:tasks.workunit.client.0.smithi029.stdout:2/359: fdatasync d1/dd/d47/f5d 0 2024-04-23T10:21:01.755 INFO:tasks.workunit.client.0.smithi029.stdout:2/360: fdatasync d1/d3e/f66 0 2024-04-23T10:21:01.760 INFO:tasks.workunit.client.0.smithi029.stdout:4/364: mkdir d0/d3c/d52/d1b/d36/d45/d4f/d7b 0 2024-04-23T10:21:01.763 INFO:tasks.workunit.client.0.smithi029.stdout:1/291: rmdir d5/d6/de/d27 39 2024-04-23T10:21:01.763 INFO:tasks.workunit.client.0.smithi029.stdout:4/365: readlink d0/d3c/d52/d1b/d36/l37 0 2024-04-23T10:21:01.771 INFO:tasks.workunit.client.0.smithi029.stdout:9/509: dwrite d0/d1b/d39/d50/d5a/fa6 [0,4194304] 0 2024-04-23T10:21:01.771 INFO:tasks.workunit.client.0.smithi029.stdout:2/361: rename d1/d4/f11 to d1/d3e/f77 0 2024-04-23T10:21:01.782 INFO:tasks.workunit.client.0.smithi029.stdout:9/510: symlink d0/d1b/d60/lae 0 2024-04-23T10:21:01.784 INFO:tasks.workunit.client.0.smithi029.stdout:2/362: mkdir d1/dd/d47/d63/d64/d78 0 2024-04-23T10:21:01.784 INFO:tasks.workunit.client.0.smithi029.stdout:4/366: dwrite d0/d3c/d52/f75 [4194304,4194304] 0 2024-04-23T10:21:01.789 INFO:tasks.workunit.client.0.smithi029.stdout:2/363: chown d1/d31/d50/l61 1138 1 2024-04-23T10:21:01.791 INFO:tasks.workunit.client.0.smithi029.stdout:9/511: stat d0/l45 0 2024-04-23T10:21:01.792 INFO:tasks.workunit.client.0.smithi029.stdout:9/512: chown d0/d1b/d39/d50/l27 0 1 2024-04-23T10:21:01.794 INFO:tasks.workunit.client.0.smithi029.stdout:4/367: mkdir d0/d3c/d52/d1b/d5b/d65/d6a/d7c 0 2024-04-23T10:21:01.794 INFO:tasks.workunit.client.0.smithi029.stdout:9/513: write d0/d7/d1d/d35/d3b/d68/f91 [1812009,33451] 0 2024-04-23T10:21:01.796 INFO:tasks.workunit.client.0.smithi029.stdout:2/364: creat d1/d3e/f79 x:0 0 0 2024-04-23T10:21:01.796 INFO:tasks.workunit.client.0.smithi029.stdout:4/368: readlink d0/d3c/d52/d1b/d36/l3a 0 2024-04-23T10:21:01.801 INFO:tasks.workunit.client.0.smithi029.stdout:8/340: truncate d3/f19 1565298 0 2024-04-23T10:21:01.804 INFO:tasks.workunit.client.0.smithi029.stdout:1/292: truncate d5/d6/de/d22/f2f 3453439 0 2024-04-23T10:21:01.807 INFO:tasks.workunit.client.0.smithi029.stdout:1/293: chown d5/d6/de/d22 3 1 2024-04-23T10:21:01.807 INFO:tasks.workunit.client.0.smithi029.stdout:9/514: symlink d0/d1b/laf 0 2024-04-23T10:21:01.809 INFO:tasks.workunit.client.0.smithi029.stdout:4/369: chown d0/d3c/d52/c4d 4472831 1 2024-04-23T10:21:01.810 INFO:tasks.workunit.client.0.smithi029.stdout:2/365: creat d1/d3e/d3b/d75/f7a x:0 0 0 2024-04-23T10:21:01.812 INFO:tasks.workunit.client.0.smithi029.stdout:2/366: readlink d1/d3e/l2b 0 2024-04-23T10:21:01.812 INFO:tasks.workunit.client.0.smithi029.stdout:9/515: write d0/d1b/d24/f89 [4109409,53656] 0 2024-04-23T10:21:01.813 INFO:tasks.workunit.client.0.smithi029.stdout:1/294: mkdir d5/d6/d34/d63 0 2024-04-23T10:21:01.816 INFO:tasks.workunit.client.0.smithi029.stdout:4/370: mknod d0/d5a/c7d 0 2024-04-23T10:21:01.818 INFO:tasks.workunit.client.0.smithi029.stdout:9/516: creat d0/d7/fb0 x:0 0 0 2024-04-23T10:21:01.818 INFO:tasks.workunit.client.0.smithi029.stdout:1/295: dread d5/f58 [0,4194304] 0 2024-04-23T10:21:01.819 INFO:tasks.workunit.client.0.smithi029.stdout:8/341: dwrite d3/d2f/d36/f3a [0,4194304] 0 2024-04-23T10:21:01.821 INFO:tasks.workunit.client.0.smithi029.stdout:1/296: read d5/f37 [2684676,31185] 0 2024-04-23T10:21:01.822 INFO:tasks.workunit.client.0.smithi029.stdout:4/371: fsync d0/fe 0 2024-04-23T10:21:01.825 INFO:tasks.workunit.client.0.smithi029.stdout:8/342: write d3/d38/f4d [458981,18574] 0 2024-04-23T10:21:01.846 INFO:tasks.workunit.client.0.smithi029.stdout:1/297: unlink d5/d6/c49 0 2024-04-23T10:21:01.847 INFO:tasks.workunit.client.0.smithi029.stdout:2/367: link d1/dd/d22/c3a d1/dd/d47/d63/c7b 0 2024-04-23T10:21:01.847 INFO:tasks.workunit.client.0.smithi029.stdout:4/372: dread d0/d3c/d52/d20/f5e [0,4194304] 0 2024-04-23T10:21:01.849 INFO:tasks.workunit.client.0.smithi029.stdout:2/368: stat d1/d31/l36 0 2024-04-23T10:21:01.852 INFO:tasks.workunit.client.0.smithi029.stdout:9/517: rename d0/d1b/d39/d50/d67/c90 to d0/d7/d1d/d35/d3b/cb1 0 2024-04-23T10:21:01.852 INFO:tasks.workunit.client.0.smithi029.stdout:1/298: mknod d5/d6/de/d27/c64 0 2024-04-23T10:21:01.854 INFO:tasks.workunit.client.0.smithi029.stdout:9/518: fdatasync d0/d1b/d44/f86 0 2024-04-23T10:21:01.854 INFO:tasks.workunit.client.0.smithi029.stdout:1/299: dread - d5/d6/f61 zero size 2024-04-23T10:21:01.855 INFO:tasks.workunit.client.0.smithi029.stdout:8/343: dwrite d3/f26 [0,4194304] 0 2024-04-23T10:21:01.855 INFO:tasks.workunit.client.0.smithi029.stdout:4/373: creat d0/d3c/d52/d1b/d36/d45/f7e x:0 0 0 2024-04-23T10:21:01.857 INFO:tasks.workunit.client.0.smithi029.stdout:8/344: stat d3/d2f/d36/d3e/f60 0 2024-04-23T10:21:01.858 INFO:tasks.workunit.client.0.smithi029.stdout:2/369: symlink d1/d4/l7c 0 2024-04-23T10:21:01.860 INFO:tasks.workunit.client.0.smithi029.stdout:2/370: truncate d1/dd/f49 4646100 0 2024-04-23T10:21:01.861 INFO:tasks.workunit.client.0.smithi029.stdout:6/438: sync 2024-04-23T10:21:01.861 INFO:tasks.workunit.client.0.smithi029.stdout:9/519: stat d0/d7/d1d/d35/d3b/d68/c71 0 2024-04-23T10:21:01.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/439: chown d9/df/d16/d44/f62 101718 1 2024-04-23T10:21:01.867 INFO:tasks.workunit.client.0.smithi029.stdout:9/520: chown d0/d7/d6/fe 3 1 2024-04-23T10:21:01.873 INFO:tasks.workunit.client.0.smithi029.stdout:6/440: symlink d9/df/d16/d44/l9d 0 2024-04-23T10:21:01.874 INFO:tasks.workunit.client.0.smithi029.stdout:1/300: dwrite d5/d6/de/d15/f1a [0,4194304] 0 2024-04-23T10:21:01.876 INFO:tasks.workunit.client.0.smithi029.stdout:4/374: link d0/d12/f69 d0/d3c/d52/d1b/d36/d45/d4f/f7f 0 2024-04-23T10:21:01.879 INFO:tasks.workunit.client.0.smithi029.stdout:2/371: dwrite d1/dd/f62 [0,4194304] 0 2024-04-23T10:21:01.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/301: dread d5/d6/de/d27/f35 [0,4194304] 0 2024-04-23T10:21:01.884 INFO:tasks.workunit.client.0.smithi029.stdout:6/441: symlink d9/df/d16/d1f/d27/l9e 0 2024-04-23T10:21:01.888 INFO:tasks.workunit.client.0.smithi029.stdout:4/375: rename d0/d3c/d52/d1b/l48 to d0/d3c/d52/d1b/d66/l80 0 2024-04-23T10:21:01.889 INFO:tasks.workunit.client.0.smithi029.stdout:1/302: chown d5/d6/de/d27/d38/l4c 8293261 1 2024-04-23T10:21:01.889 INFO:tasks.workunit.client.0.smithi029.stdout:6/442: creat d9/d5b/f9f x:0 0 0 2024-04-23T10:21:01.890 INFO:tasks.workunit.client.0.smithi029.stdout:9/521: link d0/d1b/l4e d0/d7/lb2 0 2024-04-23T10:21:01.891 INFO:tasks.workunit.client.0.smithi029.stdout:6/443: dread - d9/f92 zero size 2024-04-23T10:21:01.891 INFO:tasks.workunit.client.0.smithi029.stdout:2/372: getdents d1/dd/d60 0 2024-04-23T10:21:01.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/376: creat d0/d3c/d52/d20/f81 x:0 0 0 2024-04-23T10:21:01.893 INFO:tasks.workunit.client.0.smithi029.stdout:2/373: chown d1/dd/d60/c70 395 1 2024-04-23T10:21:01.894 INFO:tasks.workunit.client.0.smithi029.stdout:9/522: truncate d0/d7/f10 4698870 0 2024-04-23T10:21:01.896 INFO:tasks.workunit.client.0.smithi029.stdout:6/444: mknod d9/df/ca0 0 2024-04-23T10:21:01.897 INFO:tasks.workunit.client.0.smithi029.stdout:9/523: mknod d0/d7/d6/cb3 0 2024-04-23T10:21:01.899 INFO:tasks.workunit.client.0.smithi029.stdout:2/374: read d1/d3e/f66 [2780301,6735] 0 2024-04-23T10:21:01.904 INFO:tasks.workunit.client.0.smithi029.stdout:4/377: rename d0/d3c/d52/d20/l70 to d0/d3c/d52/d1b/d36/d45/d68/l82 0 2024-04-23T10:21:01.904 INFO:tasks.workunit.client.0.smithi029.stdout:2/375: truncate d1/d3e/d5a/f6e 569612 0 2024-04-23T10:21:01.905 INFO:tasks.workunit.client.0.smithi029.stdout:9/524: unlink d0/d1b/l25 0 2024-04-23T10:21:01.906 INFO:tasks.workunit.client.0.smithi029.stdout:8/345: dread d3/f14 [4194304,4194304] 0 2024-04-23T10:21:01.907 INFO:tasks.workunit.client.0.smithi029.stdout:6/445: dwrite d9/df/d41/f6c [0,4194304] 0 2024-04-23T10:21:01.908 INFO:tasks.workunit.client.0.smithi029.stdout:2/376: write d1/d31/d50/f76 [988258,47828] 0 2024-04-23T10:21:01.908 INFO:tasks.workunit.client.0.smithi029.stdout:8/346: fdatasync d3/d2f/d36/f4a 0 2024-04-23T10:21:01.908 INFO:tasks.workunit.client.0.smithi029.stdout:4/378: mknod d0/d5a/c83 0 2024-04-23T10:21:01.909 INFO:tasks.workunit.client.0.smithi029.stdout:6/446: dread - d9/f82 zero size 2024-04-23T10:21:01.909 INFO:tasks.workunit.client.0.smithi029.stdout:2/377: chown d1/d3e/c2a 13696671 1 2024-04-23T10:21:01.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/347: rename d3/fa to d3/f67 0 2024-04-23T10:21:01.925 INFO:tasks.workunit.client.0.smithi029.stdout:2/378: dwrite d1/dd/d47/d63/d64/f6b [0,4194304] 0 2024-04-23T10:21:01.925 INFO:tasks.workunit.client.0.smithi029.stdout:9/525: dwrite d0/d1b/d39/d50/d5a/f8b [0,4194304] 0 2024-04-23T10:21:01.926 INFO:tasks.workunit.client.0.smithi029.stdout:4/379: getdents d0/d3c/d52/d1b/d5b/d65/d6a/d7c 0 2024-04-23T10:21:01.927 INFO:tasks.workunit.client.0.smithi029.stdout:6/447: link d9/f29 d9/df/d16/d44/d75/d90/fa1 0 2024-04-23T10:21:01.929 INFO:tasks.workunit.client.0.smithi029.stdout:8/348: mkdir d3/d2f/d36/d68 0 2024-04-23T10:21:01.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/379: read d1/dd/d22/f2c [1160101,4036] 0 2024-04-23T10:21:01.931 INFO:tasks.workunit.client.0.smithi029.stdout:8/349: dread - d3/d2f/f4c zero size 2024-04-23T10:21:01.931 INFO:tasks.workunit.client.0.smithi029.stdout:4/380: creat d0/d3c/d52/d1b/d36/d45/d68/f84 x:0 0 0 2024-04-23T10:21:01.932 INFO:tasks.workunit.client.0.smithi029.stdout:9/526: fsync d0/d1b/d24/f89 0 2024-04-23T10:21:01.934 INFO:tasks.workunit.client.0.smithi029.stdout:4/381: fsync d0/d3c/d52/f42 0 2024-04-23T10:21:01.935 INFO:tasks.workunit.client.0.smithi029.stdout:2/380: creat d1/d3e/d3b/f7d x:0 0 0 2024-04-23T10:21:01.938 INFO:tasks.workunit.client.0.smithi029.stdout:8/350: symlink d3/d44/l69 0 2024-04-23T10:21:01.939 INFO:tasks.workunit.client.0.smithi029.stdout:6/448: dread d9/d5b/f71 [0,4194304] 0 2024-04-23T10:21:01.940 INFO:tasks.workunit.client.0.smithi029.stdout:2/381: write d1/d3e/f4c [4429614,38448] 0 2024-04-23T10:21:01.946 INFO:tasks.workunit.client.0.smithi029.stdout:8/351: mkdir d3/d50/d6a 0 2024-04-23T10:21:01.949 INFO:tasks.workunit.client.0.smithi029.stdout:4/382: dwrite d0/d3c/d52/d1b/f39 [0,4194304] 0 2024-04-23T10:21:01.950 INFO:tasks.workunit.client.0.smithi029.stdout:6/449: unlink d9/df/d16/d34/l7c 0 2024-04-23T10:21:01.951 INFO:tasks.workunit.client.0.smithi029.stdout:6/450: stat d9/df/d16/f2e 0 2024-04-23T10:21:01.952 INFO:tasks.workunit.client.0.smithi029.stdout:8/352: truncate d3/f23 972600 0 2024-04-23T10:21:01.954 INFO:tasks.workunit.client.0.smithi029.stdout:2/382: link d1/d3e/c5b d1/d4/c7e 0 2024-04-23T10:21:01.957 INFO:tasks.workunit.client.0.smithi029.stdout:4/383: rename d0/d3c/d52/d1b/d36/d45/f7e to d0/d3c/d52/d1b/d5b/d65/f85 0 2024-04-23T10:21:01.965 INFO:tasks.workunit.client.0.smithi029.stdout:6/451: dwrite d9/df/d16/d34/f91 [0,4194304] 0 2024-04-23T10:21:01.966 INFO:tasks.workunit.client.0.smithi029.stdout:2/383: getdents d1/d3e/d3b/d75 0 2024-04-23T10:21:01.972 INFO:tasks.workunit.client.0.smithi029.stdout:8/353: dwrite d3/d44/f62 [0,4194304] 0 2024-04-23T10:21:01.975 INFO:tasks.workunit.client.0.smithi029.stdout:9/527: dread d0/d7/d6/fe [0,4194304] 0 2024-04-23T10:21:01.976 INFO:tasks.workunit.client.0.smithi029.stdout:2/384: creat d1/d3e/d3b/f7f x:0 0 0 2024-04-23T10:21:01.980 INFO:tasks.workunit.client.0.smithi029.stdout:6/452: dread d9/df/d16/d44/d75/f85 [0,4194304] 0 2024-04-23T10:21:01.980 INFO:tasks.workunit.client.0.smithi029.stdout:8/354: symlink d3/d2f/d36/l6b 0 2024-04-23T10:21:01.981 INFO:tasks.workunit.client.0.smithi029.stdout:8/355: stat d3/d44/f62 0 2024-04-23T10:21:01.982 INFO:tasks.workunit.client.0.smithi029.stdout:6/453: chown d9/df/d25/l4f 7898467 1 2024-04-23T10:21:01.982 INFO:tasks.workunit.client.0.smithi029.stdout:9/528: creat d0/d1b/d39/d50/fb4 x:0 0 0 2024-04-23T10:21:01.982 INFO:tasks.workunit.client.0.smithi029.stdout:6/454: dread - d9/f92 zero size 2024-04-23T10:21:01.985 INFO:tasks.workunit.client.0.smithi029.stdout:9/529: write d0/d7/d1d/d35/f62 [597475,53689] 0 2024-04-23T10:21:01.987 INFO:tasks.workunit.client.0.smithi029.stdout:4/384: dread d0/d3c/d52/d1b/d36/d45/d4f/f7f [0,4194304] 0 2024-04-23T10:21:01.990 INFO:tasks.workunit.client.0.smithi029.stdout:2/385: link d1/d3e/d5a/f6e d1/dd/d47/d63/d64/f80 0 2024-04-23T10:21:01.992 INFO:tasks.workunit.client.0.smithi029.stdout:6/455: creat d9/df/d16/d1f/d27/d33/fa2 x:0 0 0 2024-04-23T10:21:01.992 INFO:tasks.workunit.client.0.smithi029.stdout:4/385: mknod d0/d3c/d52/d20/c86 0 2024-04-23T10:21:01.993 INFO:tasks.workunit.client.0.smithi029.stdout:8/356: truncate d3/f23 1202712 0 2024-04-23T10:21:01.995 INFO:tasks.workunit.client.0.smithi029.stdout:8/357: chown d3/d38/f5c 36254 1 2024-04-23T10:21:01.997 INFO:tasks.workunit.client.0.smithi029.stdout:4/386: creat d0/d3c/d52/d1b/d36/d45/d4f/f87 x:0 0 0 2024-04-23T10:21:01.997 INFO:tasks.workunit.client.0.smithi029.stdout:2/386: link d1/d31/d50/c59 d1/d31/d3d/c81 0 2024-04-23T10:21:01.998 INFO:tasks.workunit.client.0.smithi029.stdout:9/530: dwrite d0/f21 [0,4194304] 0 2024-04-23T10:21:02.003 INFO:tasks.workunit.client.0.smithi029.stdout:2/387: creat d1/d31/d50/f82 x:0 0 0 2024-04-23T10:21:02.004 INFO:tasks.workunit.client.0.smithi029.stdout:6/456: dwrite d9/f82 [0,4194304] 0 2024-04-23T10:21:02.005 INFO:tasks.workunit.client.0.smithi029.stdout:9/531: rename d0/d7/d1d/d35/d3b/d68/c71 to d0/d7/d6/cb5 0 2024-04-23T10:21:02.015 INFO:tasks.workunit.client.0.smithi029.stdout:8/358: dread d3/d38/f3d [0,4194304] 0 2024-04-23T10:21:02.015 INFO:tasks.workunit.client.0.smithi029.stdout:4/387: write d0/d12/f49 [1354559,74490] 0 2024-04-23T10:21:02.020 INFO:tasks.workunit.client.0.smithi029.stdout:6/457: creat d9/df/d16/d44/d75/d90/fa3 x:0 0 0 2024-04-23T10:21:02.020 INFO:tasks.workunit.client.0.smithi029.stdout:8/359: fdatasync d3/d2f/d36/f40 0 2024-04-23T10:21:02.022 INFO:tasks.workunit.client.0.smithi029.stdout:4/388: chown d0/d3c/d52/d20/f5e 239 1 2024-04-23T10:21:02.024 INFO:tasks.workunit.client.0.smithi029.stdout:8/360: mknod d3/d44/c6c 0 2024-04-23T10:21:02.025 INFO:tasks.workunit.client.0.smithi029.stdout:2/388: dwrite d1/d4/f1e [0,4194304] 0 2024-04-23T10:21:02.026 INFO:tasks.workunit.client.0.smithi029.stdout:4/389: creat d0/d5a/d6e/f88 x:0 0 0 2024-04-23T10:21:02.030 INFO:tasks.workunit.client.0.smithi029.stdout:2/389: write d1/dd/d22/f54 [2647409,63170] 0 2024-04-23T10:21:02.031 INFO:tasks.workunit.client.0.smithi029.stdout:8/361: creat d3/d2f/d36/d68/f6d x:0 0 0 2024-04-23T10:21:02.033 INFO:tasks.workunit.client.0.smithi029.stdout:4/390: fsync d0/d3c/d52/d1b/d5b/d65/d6a/f6c 0 2024-04-23T10:21:02.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/390: mknod d1/d3e/d3b/c83 0 2024-04-23T10:21:02.038 INFO:tasks.workunit.client.0.smithi029.stdout:8/362: dread - d3/d2f/f54 zero size 2024-04-23T10:21:02.038 INFO:tasks.workunit.client.0.smithi029.stdout:4/391: fsync d0/f27 0 2024-04-23T10:21:02.039 INFO:tasks.workunit.client.0.smithi029.stdout:6/458: dwrite d9/df/f13 [4194304,4194304] 0 2024-04-23T10:21:02.042 INFO:tasks.workunit.client.0.smithi029.stdout:4/392: write d0/d3c/d52/d1b/d36/d45/d68/f84 [883697,130303] 0 2024-04-23T10:21:02.046 INFO:tasks.workunit.client.0.smithi029.stdout:8/363: write d3/d38/f49 [757369,88497] 0 2024-04-23T10:21:02.049 INFO:tasks.workunit.client.0.smithi029.stdout:6/459: rename d9/df/d16/d1f/d27/d2d to d9/df/d16/d1f/d27/d33/da4 0 2024-04-23T10:21:02.049 INFO:tasks.workunit.client.0.smithi029.stdout:8/364: dread - d3/d2f/d36/d3e/f60 zero size 2024-04-23T10:21:02.050 INFO:tasks.workunit.client.0.smithi029.stdout:4/393: fdatasync d0/d3c/d52/d1b/d36/d45/d4f/f7f 0 2024-04-23T10:21:02.051 INFO:tasks.workunit.client.0.smithi029.stdout:9/532: dread d0/d7/f18 [0,4194304] 0 2024-04-23T10:21:02.052 INFO:tasks.workunit.client.0.smithi029.stdout:2/391: dwrite d1/dd/d47/d63/d64/f72 [4194304,4194304] 0 2024-04-23T10:21:02.055 INFO:tasks.workunit.client.0.smithi029.stdout:8/365: symlink d3/d2f/d36/d68/l6e 0 2024-04-23T10:21:02.057 INFO:tasks.workunit.client.0.smithi029.stdout:4/394: mkdir d0/d5a/d6e/d7a/d89 0 2024-04-23T10:21:02.059 INFO:tasks.workunit.client.0.smithi029.stdout:4/395: fsync d0/d3c/d52/d1b/d36/d45/d4f/f7f 0 2024-04-23T10:21:02.060 INFO:tasks.workunit.client.0.smithi029.stdout:4/396: write d0/d12/f43 [173738,15127] 0 2024-04-23T10:21:02.062 INFO:tasks.workunit.client.0.smithi029.stdout:4/397: fdatasync d0/d3c/d52/d1b/f39 0 2024-04-23T10:21:02.068 INFO:tasks.workunit.client.0.smithi029.stdout:4/398: readlink d0/d3c/d52/l5d 0 2024-04-23T10:21:02.069 INFO:tasks.workunit.client.0.smithi029.stdout:6/460: write d9/df/d16/d1f/d27/d33/f32 [169989,12232] 0 2024-04-23T10:21:02.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/392: truncate d1/d3e/d3b/f52 2845499 0 2024-04-23T10:21:02.072 INFO:tasks.workunit.client.0.smithi029.stdout:8/366: dwrite d3/d2f/d36/f3a [0,4194304] 0 2024-04-23T10:21:02.072 INFO:tasks.workunit.client.0.smithi029.stdout:4/399: mkdir d0/d3c/d52/d74/d8a 0 2024-04-23T10:21:02.075 INFO:tasks.workunit.client.0.smithi029.stdout:6/461: mknod d9/df/d16/d1f/d27/d33/da4/ca5 0 2024-04-23T10:21:02.075 INFO:tasks.workunit.client.0.smithi029.stdout:6/462: chown d9/f82 545996 1 2024-04-23T10:21:02.076 INFO:tasks.workunit.client.0.smithi029.stdout:8/367: dread d3/d2f/d36/d3e/f4f [0,4194304] 0 2024-04-23T10:21:02.077 INFO:tasks.workunit.client.0.smithi029.stdout:4/400: rename d0/d3c/d52/c60 to d0/d3c/d52/d1b/d36/c8b 0 2024-04-23T10:21:02.077 INFO:tasks.workunit.client.0.smithi029.stdout:4/401: stat d0/d12 0 2024-04-23T10:21:02.081 INFO:tasks.workunit.client.0.smithi029.stdout:2/393: truncate d1/d4/f44 676083 0 2024-04-23T10:21:02.083 INFO:tasks.workunit.client.0.smithi029.stdout:4/402: symlink d0/l8c 0 2024-04-23T10:21:02.085 INFO:tasks.workunit.client.0.smithi029.stdout:6/463: creat d9/df/d16/d1f/d27/fa6 x:0 0 0 2024-04-23T10:21:02.086 INFO:tasks.workunit.client.0.smithi029.stdout:2/394: creat d1/d3e/d5a/f84 x:0 0 0 2024-04-23T10:21:02.087 INFO:tasks.workunit.client.0.smithi029.stdout:8/368: write d3/d2f/d36/f46 [966729,99312] 0 2024-04-23T10:21:02.089 INFO:tasks.workunit.client.0.smithi029.stdout:6/464: rmdir d9/df/d16/d1f/d27/d33 39 2024-04-23T10:21:02.089 INFO:tasks.workunit.client.0.smithi029.stdout:6/465: chown d9 389 1 2024-04-23T10:21:02.091 INFO:tasks.workunit.client.0.smithi029.stdout:3/376: sync 2024-04-23T10:21:02.091 INFO:tasks.workunit.client.0.smithi029.stdout:7/369: sync 2024-04-23T10:21:02.091 INFO:tasks.workunit.client.0.smithi029.stdout:4/403: dread d0/d3c/d52/d1b/f39 [0,4194304] 0 2024-04-23T10:21:02.095 INFO:tasks.workunit.client.0.smithi029.stdout:3/377: mknod d3/d10/de/d2e/c85 0 2024-04-23T10:21:02.095 INFO:tasks.workunit.client.0.smithi029.stdout:4/404: read d0/d3c/d52/d1b/d36/d45/d4f/f7f [2109711,54475] 0 2024-04-23T10:21:02.097 INFO:tasks.workunit.client.0.smithi029.stdout:7/370: unlink d5/d8/d1a/f1b 0 2024-04-23T10:21:02.100 INFO:tasks.workunit.client.0.smithi029.stdout:4/405: mknod d0/d3c/d52/d74/c8d 0 2024-04-23T10:21:02.103 INFO:tasks.workunit.client.0.smithi029.stdout:2/395: truncate d1/dd/d22/f2c 1483475 0 2024-04-23T10:21:02.105 INFO:tasks.workunit.client.0.smithi029.stdout:6/466: dwrite d9/df/d16/d34/d36/f6e [0,4194304] 0 2024-04-23T10:21:02.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/396: write d1/dd/f1d [67642,76754] 0 2024-04-23T10:21:02.108 INFO:tasks.workunit.client.0.smithi029.stdout:2/397: chown d1/d3e/f71 3012 1 2024-04-23T10:21:02.110 INFO:tasks.workunit.client.0.smithi029.stdout:3/378: truncate d3/d10/de/d2e/d36/d40/d46/d72/d31/f1a 2965170 0 2024-04-23T10:21:02.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/398: creat d1/d3e/d3b/d75/f85 x:0 0 0 2024-04-23T10:21:02.114 INFO:tasks.workunit.client.0.smithi029.stdout:4/406: dwrite d0/d5a/d6e/f88 [0,4194304] 0 2024-04-23T10:21:02.116 INFO:tasks.workunit.client.0.smithi029.stdout:6/467: dwrite d9/df/d16/f56 [0,4194304] 0 2024-04-23T10:21:02.118 INFO:tasks.workunit.client.0.smithi029.stdout:2/399: mknod d1/d3e/c86 0 2024-04-23T10:21:02.120 INFO:tasks.workunit.client.0.smithi029.stdout:6/468: mkdir d9/df/d16/d1f/d27/d33/da4/d66/d95/da7 0 2024-04-23T10:21:02.122 INFO:tasks.workunit.client.0.smithi029.stdout:6/469: write d9/df/d16/d34/f91 [1874954,112180] 0 2024-04-23T10:21:02.125 INFO:tasks.workunit.client.0.smithi029.stdout:6/470: getdents d9/df/d41/d49/d69 0 2024-04-23T10:21:02.125 INFO:tasks.workunit.client.0.smithi029.stdout:6/471: dread - d9/df/d16/d1f/d2c/f4a zero size 2024-04-23T10:21:02.128 INFO:tasks.workunit.client.0.smithi029.stdout:6/472: write d9/df/d16/d34/d84/f8a [653886,41714] 0 2024-04-23T10:21:02.131 INFO:tasks.workunit.client.0.smithi029.stdout:6/473: getdents d9/d5b 0 2024-04-23T10:21:02.132 INFO:tasks.workunit.client.0.smithi029.stdout:6/474: symlink d9/df/d16/d1f/d27/d33/da4/la8 0 2024-04-23T10:21:02.134 INFO:tasks.workunit.client.0.smithi029.stdout:6/475: creat d9/df/d16/d44/d4c/fa9 x:0 0 0 2024-04-23T10:21:02.135 INFO:tasks.workunit.client.0.smithi029.stdout:6/476: fdatasync d9/df/d16/d1f/d27/fa6 0 2024-04-23T10:21:02.137 INFO:tasks.workunit.client.0.smithi029.stdout:6/477: creat d9/df/d16/d1f/d27/d33/da4/d66/d95/faa x:0 0 0 2024-04-23T10:21:02.138 INFO:tasks.workunit.client.0.smithi029.stdout:6/478: write d9/df/d16/d1f/d27/d33/da4/d66/d95/f98 [405434,59775] 0 2024-04-23T10:21:02.141 INFO:tasks.workunit.client.0.smithi029.stdout:6/479: creat d9/df/d16/d1f/d27/d33/da4/d58/fab x:0 0 0 2024-04-23T10:21:02.160 INFO:tasks.workunit.client.0.smithi029.stdout:6/480: creat d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/fac x:0 0 0 2024-04-23T10:21:02.169 INFO:tasks.workunit.client.0.smithi029.stdout:7/371: dread d5/d8/d51/d55/d59/f73 [0,4194304] 0 2024-04-23T10:21:02.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/481: dread d9/fe [4194304,4194304] 0 2024-04-23T10:21:02.171 INFO:tasks.workunit.client.0.smithi029.stdout:4/407: dread d0/d3c/d52/d1b/d36/d45/d68/f84 [0,4194304] 0 2024-04-23T10:21:02.173 INFO:tasks.workunit.client.0.smithi029.stdout:6/482: read d9/df/d16/f56 [2841238,94048] 0 2024-04-23T10:21:02.173 INFO:tasks.workunit.client.0.smithi029.stdout:8/369: dread d3/fd [0,4194304] 0 2024-04-23T10:21:02.174 INFO:tasks.workunit.client.0.smithi029.stdout:4/408: write d0/d3c/d52/f1d [194876,46700] 0 2024-04-23T10:21:02.174 INFO:tasks.workunit.client.0.smithi029.stdout:6/483: rmdir d9/df/d41 39 2024-04-23T10:21:02.176 INFO:tasks.workunit.client.0.smithi029.stdout:8/370: fdatasync d3/d2f/d36/f40 0 2024-04-23T10:21:02.179 INFO:tasks.workunit.client.0.smithi029.stdout:8/371: symlink d3/d44/l6f 0 2024-04-23T10:21:02.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/484: mkdir d9/df/d16/d1f/d27/dad 0 2024-04-23T10:21:02.180 INFO:tasks.workunit.client.0.smithi029.stdout:7/372: dwrite d5/d6b/f75 [0,4194304] 0 2024-04-23T10:21:02.184 INFO:tasks.workunit.client.0.smithi029.stdout:4/409: symlink d0/d3c/d52/d1b/d36/d45/d4f/d7b/l8e 0 2024-04-23T10:21:02.188 INFO:tasks.workunit.client.0.smithi029.stdout:6/485: rename d9/df/d16/d44/d4c/f97 to d9/df/d16/d1f/fae 0 2024-04-23T10:21:02.189 INFO:tasks.workunit.client.0.smithi029.stdout:8/372: getdents d3/d2f/d36/d3e 0 2024-04-23T10:21:02.190 INFO:tasks.workunit.client.0.smithi029.stdout:6/486: stat d9/df/d16/f46 0 2024-04-23T10:21:02.193 INFO:tasks.workunit.client.0.smithi029.stdout:6/487: readlink d9/df/d16/d1f/d27/d33/da4/d58/l59 0 2024-04-23T10:21:02.194 INFO:tasks.workunit.client.0.smithi029.stdout:7/373: dwrite d5/d71/f72 [0,4194304] 0 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:7/374: creat d5/d6b/f84 x:0 0 0 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:8/373: creat d3/d50/d6a/f70 x:0 0 0 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:8/374: rmdir d3/d2f/d36/d68 39 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:4/410: dread d0/fe [0,4194304] 0 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:8/375: dread - d3/d2f/d36/f59 zero size 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:8/376: rmdir d3 39 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:6/488: dread d9/df/d16/f56 [0,4194304] 0 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:4/411: creat d0/d3c/d52/d1b/d36/d45/d68/f8f x:0 0 0 2024-04-23T10:21:02.206 INFO:tasks.workunit.client.0.smithi029.stdout:6/489: mkdir d9/df/d16/daf 0 2024-04-23T10:21:02.207 INFO:tasks.workunit.client.0.smithi029.stdout:6/490: fdatasync d9/f82 0 2024-04-23T10:21:02.207 INFO:tasks.workunit.client.0.smithi029.stdout:8/377: fsync d3/f42 0 2024-04-23T10:21:02.211 INFO:tasks.workunit.client.0.smithi029.stdout:4/412: creat d0/d3c/d52/f90 x:0 0 0 2024-04-23T10:21:02.212 INFO:tasks.workunit.client.0.smithi029.stdout:8/378: mkdir d3/d71 0 2024-04-23T10:21:02.213 INFO:tasks.workunit.client.0.smithi029.stdout:7/375: dwrite d5/f1f [0,4194304] 0 2024-04-23T10:21:02.214 INFO:tasks.workunit.client.0.smithi029.stdout:4/413: mkdir d0/d3c/d52/d74/d91 0 2024-04-23T10:21:02.214 INFO:tasks.workunit.client.0.smithi029.stdout:8/379: symlink d3/d50/d6a/l72 0 2024-04-23T10:21:02.217 INFO:tasks.workunit.client.0.smithi029.stdout:4/414: mkdir d0/d5a/d6e/d7a/d89/d92 0 2024-04-23T10:21:02.219 INFO:tasks.workunit.client.0.smithi029.stdout:8/380: rename d3/c2c to d3/d50/c73 0 2024-04-23T10:21:02.223 INFO:tasks.workunit.client.0.smithi029.stdout:8/381: creat d3/d44/f74 x:0 0 0 2024-04-23T10:21:02.224 INFO:tasks.workunit.client.0.smithi029.stdout:8/382: write d3/d2f/f54 [310546,118921] 0 2024-04-23T10:21:02.225 INFO:tasks.workunit.client.0.smithi029.stdout:7/376: dread d5/d71/f72 [0,4194304] 0 2024-04-23T10:21:02.237 INFO:tasks.workunit.client.0.smithi029.stdout:6/491: dread d9/df/d16/d1f/d27/d33/f72 [0,4194304] 0 2024-04-23T10:21:02.238 INFO:tasks.workunit.client.0.smithi029.stdout:7/377: dwrite d5/d9/f26 [0,4194304] 0 2024-04-23T10:21:02.240 INFO:tasks.workunit.client.0.smithi029.stdout:8/383: dwrite d3/d2f/d36/d3e/f41 [0,4194304] 0 2024-04-23T10:21:02.244 INFO:tasks.workunit.client.0.smithi029.stdout:7/378: write d5/f18 [5207145,95007] 0 2024-04-23T10:21:02.245 INFO:tasks.workunit.client.0.smithi029.stdout:6/492: rename d9/df/d16/d34/d84/c9a to d9/cb0 0 2024-04-23T10:21:02.265 INFO:tasks.workunit.client.0.smithi029.stdout:8/384: dread d3/f67 [0,4194304] 0 2024-04-23T10:21:02.271 INFO:tasks.workunit.client.0.smithi029.stdout:7/379: dread d5/d9/f2e [0,4194304] 0 2024-04-23T10:21:02.272 INFO:tasks.workunit.client.0.smithi029.stdout:6/493: creat d9/df/d16/d34/d36/fb1 x:0 0 0 2024-04-23T10:21:02.272 INFO:tasks.workunit.client.0.smithi029.stdout:7/380: readlink d5/d29/l54 0 2024-04-23T10:21:02.273 INFO:tasks.workunit.client.0.smithi029.stdout:8/385: dwrite d3/f66 [0,4194304] 0 2024-04-23T10:21:02.274 INFO:tasks.workunit.client.0.smithi029.stdout:6/494: read - d9/df/d16/d1f/d27/d33/da4/d58/fab zero size 2024-04-23T10:21:02.276 INFO:tasks.workunit.client.0.smithi029.stdout:7/381: mkdir d5/d71/d85 0 2024-04-23T10:21:02.282 INFO:tasks.workunit.client.0.smithi029.stdout:6/495: dwrite d9/f82 [0,4194304] 0 2024-04-23T10:21:02.282 INFO:tasks.workunit.client.0.smithi029.stdout:7/382: mknod d5/d29/c86 0 2024-04-23T10:21:02.283 INFO:tasks.workunit.client.0.smithi029.stdout:7/383: fsync d5/d8/d1a/f7a 0 2024-04-23T10:21:02.284 INFO:tasks.workunit.client.0.smithi029.stdout:6/496: chown d9/cb0 781860 1 2024-04-23T10:21:02.285 INFO:tasks.workunit.client.0.smithi029.stdout:7/384: chown d5/d9/f26 14756 1 2024-04-23T10:21:02.285 INFO:tasks.workunit.client.0.smithi029.stdout:6/497: write d9/f92 [199571,87664] 0 2024-04-23T10:21:02.289 INFO:tasks.workunit.client.0.smithi029.stdout:7/385: write d5/d6b/f75 [1512909,57324] 0 2024-04-23T10:21:02.290 INFO:tasks.workunit.client.0.smithi029.stdout:6/498: rmdir d9/df/d16/d34/d36/d63 39 2024-04-23T10:21:02.294 INFO:tasks.workunit.client.0.smithi029.stdout:8/386: dread d3/f29 [0,4194304] 0 2024-04-23T10:21:02.298 INFO:tasks.workunit.client.0.smithi029.stdout:7/386: creat d5/d8/d51/d55/f87 x:0 0 0 2024-04-23T10:21:02.298 INFO:tasks.workunit.client.0.smithi029.stdout:6/499: dread d9/df/d16/d1f/d27/d33/f32 [0,4194304] 0 2024-04-23T10:21:02.300 INFO:tasks.workunit.client.0.smithi029.stdout:7/387: stat d5/l34 0 2024-04-23T10:21:02.303 INFO:tasks.workunit.client.0.smithi029.stdout:7/388: fsync d5/d8/d51/d55/f66 0 2024-04-23T10:21:02.307 INFO:tasks.workunit.client.0.smithi029.stdout:8/387: dwrite d3/d44/f74 [0,4194304] 0 2024-04-23T10:21:02.307 INFO:tasks.workunit.client.0.smithi029.stdout:7/389: rename d5/d6b/f84 to d5/d71/d85/f88 0 2024-04-23T10:21:02.309 INFO:tasks.workunit.client.0.smithi029.stdout:7/390: write d5/d8/d1a/f7a [364241,85517] 0 2024-04-23T10:21:02.310 INFO:tasks.workunit.client.0.smithi029.stdout:8/388: mknod d3/d2f/c75 0 2024-04-23T10:21:02.312 INFO:tasks.workunit.client.0.smithi029.stdout:6/500: dwrite d9/d5b/f71 [0,4194304] 0 2024-04-23T10:21:02.315 INFO:tasks.workunit.client.0.smithi029.stdout:7/391: truncate d5/d29/f2a 821834 0 2024-04-23T10:21:02.316 INFO:tasks.workunit.client.0.smithi029.stdout:6/501: stat d9/df/d16/d1f/d27/d33/f72 0 2024-04-23T10:21:02.318 INFO:tasks.workunit.client.0.smithi029.stdout:7/392: creat d5/d71/f89 x:0 0 0 2024-04-23T10:21:02.320 INFO:tasks.workunit.client.0.smithi029.stdout:6/502: chown d9/df/d16/d1f/d27/l3c 161 1 2024-04-23T10:21:02.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/393: read d5/f30 [1251524,27362] 0 2024-04-23T10:21:02.326 INFO:tasks.workunit.client.0.smithi029.stdout:6/503: truncate d9/fe 8941562 0 2024-04-23T10:21:02.327 INFO:tasks.workunit.client.0.smithi029.stdout:7/394: chown d5/d71/d85 3761922 1 2024-04-23T10:21:02.328 INFO:tasks.workunit.client.0.smithi029.stdout:8/389: dwrite d3/f33 [0,4194304] 0 2024-04-23T10:21:02.328 INFO:tasks.workunit.client.0.smithi029.stdout:7/395: stat d5/d29/d4a/f7e 0 2024-04-23T10:21:02.338 INFO:tasks.workunit.client.0.smithi029.stdout:7/396: dwrite d5/d8/f25 [0,4194304] 0 2024-04-23T10:21:02.339 INFO:tasks.workunit.client.0.smithi029.stdout:7/397: dread - d5/d8/d51/d55/f87 zero size 2024-04-23T10:21:02.343 INFO:tasks.workunit.client.0.smithi029.stdout:7/398: rename d5/d6b to d5/d8/d1a/d8a 0 2024-04-23T10:21:02.344 INFO:tasks.workunit.client.0.smithi029.stdout:7/399: write d5/d8/d1a/f76 [940329,49543] 0 2024-04-23T10:21:02.348 INFO:tasks.workunit.client.0.smithi029.stdout:7/400: write d5/d8/f43 [2766224,25246] 0 2024-04-23T10:21:02.469 INFO:tasks.workunit.client.0.smithi029.stdout:5/396: sync 2024-04-23T10:21:02.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/199: sync 2024-04-23T10:21:02.471 INFO:tasks.workunit.client.0.smithi029.stdout:5/397: chown d0/d35/d38/d3e/d66/d5a/d78/c3c 4756 1 2024-04-23T10:21:02.480 INFO:tasks.workunit.client.0.smithi029.stdout:5/398: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85 0 2024-04-23T10:21:02.482 INFO:tasks.workunit.client.0.smithi029.stdout:5/399: chown d0/d35/d38/d39/f73 43 1 2024-04-23T10:21:02.483 INFO:tasks.workunit.client.0.smithi029.stdout:0/200: write d0/f2b [437516,105714] 0 2024-04-23T10:21:02.488 INFO:tasks.workunit.client.0.smithi029.stdout:5/400: creat d0/d35/d38/d39/f86 x:0 0 0 2024-04-23T10:21:02.490 INFO:tasks.workunit.client.0.smithi029.stdout:0/201: mkdir d0/dc/d26/d44 0 2024-04-23T10:21:02.525 INFO:tasks.workunit.client.0.smithi029.stdout:0/202: unlink d0/d21/c2c 0 2024-04-23T10:21:02.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/401: dwrite d0/f2f [0,4194304] 0 2024-04-23T10:21:02.532 INFO:tasks.workunit.client.0.smithi029.stdout:0/203: link d0/f1 d0/dc/d26/d44/f45 0 2024-04-23T10:21:02.555 INFO:tasks.workunit.client.0.smithi029.stdout:0/204: dwrite d0/dc/d26/d44/f45 [0,4194304] 0 2024-04-23T10:21:02.557 INFO:tasks.workunit.client.0.smithi029.stdout:5/402: dread d0/d35/d38/d3e/d66/f6c [0,4194304] 0 2024-04-23T10:21:02.563 INFO:tasks.workunit.client.0.smithi029.stdout:0/205: rename d0/dc/c34 to d0/dc/d26/c46 0 2024-04-23T10:21:02.567 INFO:tasks.workunit.client.0.smithi029.stdout:5/403: rename d0/d35/d38/d39/d3f/f74 to d0/d35/d38/d39/d3f/f87 0 2024-04-23T10:21:02.568 INFO:tasks.workunit.client.0.smithi029.stdout:0/206: fdatasync d0/f4 0 2024-04-23T10:21:02.570 INFO:tasks.workunit.client.0.smithi029.stdout:5/404: chown d0/d35/d38/d3e/d66/d5a/d78/l3a 606 1 2024-04-23T10:21:02.575 INFO:tasks.workunit.client.0.smithi029.stdout:0/207: creat d0/dc/d27/d3a/f47 x:0 0 0 2024-04-23T10:21:02.581 INFO:tasks.workunit.client.0.smithi029.stdout:5/405: rename d0/d35/d38/d3e/d66/d5a/d78/d6d/f7a to d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/f88 0 2024-04-23T10:21:02.585 INFO:tasks.workunit.client.0.smithi029.stdout:0/208: rename d0/dc/d27/d3a/f47 to d0/dc/d27/f48 0 2024-04-23T10:21:02.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/406: mkdir d0/d2b/d89 0 2024-04-23T10:21:02.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/407: truncate d0/d35/d38/d39/f73 529544 0 2024-04-23T10:21:02.594 INFO:tasks.workunit.client.0.smithi029.stdout:0/209: getdents d0 0 2024-04-23T10:21:02.607 INFO:tasks.workunit.client.0.smithi029.stdout:5/408: fsync d0/d35/d38/d39/f73 0 2024-04-23T10:21:02.607 INFO:tasks.workunit.client.0.smithi029.stdout:0/210: dwrite d0/d1b/f2d [0,4194304] 0 2024-04-23T10:21:02.608 INFO:tasks.workunit.client.0.smithi029.stdout:5/409: dread - d0/f65 zero size 2024-04-23T10:21:02.611 INFO:tasks.workunit.client.0.smithi029.stdout:5/410: rmdir d0/d35/d10 39 2024-04-23T10:21:02.614 INFO:tasks.workunit.client.0.smithi029.stdout:5/411: unlink d0/d35/d38/d51/l1f 0 2024-04-23T10:21:02.616 INFO:tasks.workunit.client.0.smithi029.stdout:5/412: write d0/d35/d38/d39/f86 [877158,31443] 0 2024-04-23T10:21:02.627 INFO:tasks.workunit.client.0.smithi029.stdout:5/413: creat d0/d35/d38/d39/f8a x:0 0 0 2024-04-23T10:21:02.634 INFO:tasks.workunit.client.0.smithi029.stdout:5/414: truncate d0/f81 281079 0 2024-04-23T10:21:02.638 INFO:tasks.workunit.client.0.smithi029.stdout:5/415: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/f8b x:0 0 0 2024-04-23T10:21:02.641 INFO:tasks.workunit.client.0.smithi029.stdout:5/416: mkdir d0/d35/d38/d3e/d66/d8c 0 2024-04-23T10:21:02.645 INFO:tasks.workunit.client.0.smithi029.stdout:5/417: unlink d0/d35/c4d 0 2024-04-23T10:21:02.645 INFO:tasks.workunit.client.0.smithi029.stdout:5/418: chown d0/d35/d38/l7e 157 1 2024-04-23T10:21:02.655 INFO:tasks.workunit.client.0.smithi029.stdout:5/419: dwrite d0/d35/d49/f84 [0,4194304] 0 2024-04-23T10:21:02.656 INFO:tasks.workunit.client.0.smithi029.stdout:5/420: stat d0/d35/d38/d3e/d66/d5a/d78 0 2024-04-23T10:21:02.725 INFO:tasks.workunit.client.0.smithi029.stdout:1/303: sync 2024-04-23T10:21:02.726 INFO:tasks.workunit.client.0.smithi029.stdout:1/304: fsync d5/d6/f40 0 2024-04-23T10:21:02.727 INFO:tasks.workunit.client.0.smithi029.stdout:1/305: fdatasync d5/fd 0 2024-04-23T10:21:02.732 INFO:tasks.workunit.client.0.smithi029.stdout:1/306: creat d5/d6/de/d27/d38/f65 x:0 0 0 2024-04-23T10:21:02.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/307: readlink l2 0 2024-04-23T10:21:02.736 INFO:tasks.workunit.client.0.smithi029.stdout:1/308: chown d5/d6/de/d27/l2a 0 1 2024-04-23T10:21:02.740 INFO:tasks.workunit.client.0.smithi029.stdout:1/309: creat d5/f66 x:0 0 0 2024-04-23T10:21:02.744 INFO:tasks.workunit.client.0.smithi029.stdout:1/310: creat d5/d6/de/d27/d38/f67 x:0 0 0 2024-04-23T10:21:02.746 INFO:tasks.workunit.client.0.smithi029.stdout:1/311: write d5/d6/f40 [3824045,10014] 0 2024-04-23T10:21:02.770 INFO:tasks.workunit.client.0.smithi029.stdout:1/312: dwrite d5/d6/de/d22/f2f [0,4194304] 0 2024-04-23T10:21:02.772 INFO:tasks.workunit.client.0.smithi029.stdout:1/313: write d5/d6/f16 [2711451,72751] 0 2024-04-23T10:21:02.784 INFO:tasks.workunit.client.0.smithi029.stdout:1/314: getdents d5 0 2024-04-23T10:21:02.790 INFO:tasks.workunit.client.0.smithi029.stdout:1/315: symlink d5/d6/d34/d63/l68 0 2024-04-23T10:21:02.792 INFO:tasks.workunit.client.0.smithi029.stdout:1/316: fdatasync d5/d6/de/d15/f1a 0 2024-04-23T10:21:02.794 INFO:tasks.workunit.client.0.smithi029.stdout:1/317: write d5/d3e/f4b [635230,129493] 0 2024-04-23T10:21:02.809 INFO:tasks.workunit.client.0.smithi029.stdout:1/318: dwrite d5/d6/de/d22/f5e [0,4194304] 0 2024-04-23T10:21:02.816 INFO:tasks.workunit.client.0.smithi029.stdout:1/319: rename d5/d6/l28 to d5/d6/de/d15/l69 0 2024-04-23T10:21:02.818 INFO:tasks.workunit.client.0.smithi029.stdout:1/320: fsync d5/d6/f16 0 2024-04-23T10:21:02.822 INFO:tasks.workunit.client.0.smithi029.stdout:1/321: mkdir d5/d6/de/d27/d38/d6a 0 2024-04-23T10:21:02.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/322: stat d5/d6/de/d22 0 2024-04-23T10:21:02.829 INFO:tasks.workunit.client.0.smithi029.stdout:1/323: symlink d5/d6/l6b 0 2024-04-23T10:21:02.832 INFO:tasks.workunit.client.0.smithi029.stdout:1/324: mkdir d5/d6/de/d22/d6c 0 2024-04-23T10:21:02.833 INFO:tasks.workunit.client.0.smithi029.stdout:1/325: stat d5/d6 0 2024-04-23T10:21:02.836 INFO:tasks.workunit.client.0.smithi029.stdout:1/326: symlink d5/d6/de/d22/d6c/l6d 0 2024-04-23T10:21:02.841 INFO:tasks.workunit.client.0.smithi029.stdout:1/327: truncate d5/d6/f21 1000495 0 2024-04-23T10:21:02.849 INFO:tasks.workunit.client.0.smithi029.stdout:1/328: rename d5/d6/de/d22/f5a to d5/d6/f6e 0 2024-04-23T10:21:02.855 INFO:tasks.workunit.client.0.smithi029.stdout:1/329: rename d5/d6/de/d27/l2a to d5/d3e/l6f 0 2024-04-23T10:21:02.864 INFO:tasks.workunit.client.0.smithi029.stdout:1/330: truncate d5/d6/de/d15/f1a 284007 0 2024-04-23T10:21:02.876 INFO:tasks.workunit.client.0.smithi029.stdout:1/331: dwrite d5/fd [4194304,4194304] 0 2024-04-23T10:21:02.891 INFO:tasks.workunit.client.0.smithi029.stdout:1/332: dread d5/d3e/f4b [0,4194304] 0 2024-04-23T10:21:02.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/533: sync 2024-04-23T10:21:03.036 INFO:tasks.workunit.client.0.smithi029.stdout:6/504: sync 2024-04-23T10:21:03.036 INFO:tasks.workunit.client.0.smithi029.stdout:4/415: sync 2024-04-23T10:21:03.036 INFO:tasks.workunit.client.0.smithi029.stdout:8/390: sync 2024-04-23T10:21:03.036 INFO:tasks.workunit.client.0.smithi029.stdout:0/211: sync 2024-04-23T10:21:03.036 INFO:tasks.workunit.client.0.smithi029.stdout:3/379: sync 2024-04-23T10:21:03.036 INFO:tasks.workunit.client.0.smithi029.stdout:2/400: sync 2024-04-23T10:21:03.037 INFO:tasks.workunit.client.0.smithi029.stdout:7/401: sync 2024-04-23T10:21:03.037 INFO:tasks.workunit.client.0.smithi029.stdout:5/421: sync 2024-04-23T10:21:03.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/402: chown d5/d8/d1a/d8a/f7d 387 1 2024-04-23T10:21:03.041 INFO:tasks.workunit.client.0.smithi029.stdout:2/401: rmdir d1/dd 39 2024-04-23T10:21:03.043 INFO:tasks.workunit.client.0.smithi029.stdout:5/422: truncate d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/f88 410672 0 2024-04-23T10:21:03.043 INFO:tasks.workunit.client.0.smithi029.stdout:8/391: mkdir d3/d2f/d76 0 2024-04-23T10:21:03.045 INFO:tasks.workunit.client.0.smithi029.stdout:6/505: rmdir d9/df/d25 39 2024-04-23T10:21:03.050 INFO:tasks.workunit.client.0.smithi029.stdout:4/416: creat d0/d3c/d52/d1b/d5b/f93 x:0 0 0 2024-04-23T10:21:03.051 INFO:tasks.workunit.client.0.smithi029.stdout:7/403: fdatasync d5/d9/f65 0 2024-04-23T10:21:03.054 INFO:tasks.workunit.client.0.smithi029.stdout:8/392: write d3/f1f [182664,44717] 0 2024-04-23T10:21:03.055 INFO:tasks.workunit.client.0.smithi029.stdout:6/506: stat d9/df/d41/d49/f81 0 2024-04-23T10:21:03.057 INFO:tasks.workunit.client.0.smithi029.stdout:0/212: dread d0/dc/d26/f28 [0,4194304] 0 2024-04-23T10:21:03.058 INFO:tasks.workunit.client.0.smithi029.stdout:9/534: getdents d0/d7/d6 0 2024-04-23T10:21:03.059 INFO:tasks.workunit.client.0.smithi029.stdout:5/423: rename d0/d35/d38/d3e to d0/d35/d38/d3e/d66/d5a/d78/d8d 22 2024-04-23T10:21:03.060 INFO:tasks.workunit.client.0.smithi029.stdout:5/424: chown d0/l4c 2149735 1 2024-04-23T10:21:03.060 INFO:tasks.workunit.client.0.smithi029.stdout:0/213: truncate d0/d1b/f3b 610686 0 2024-04-23T10:21:03.063 INFO:tasks.workunit.client.0.smithi029.stdout:7/404: mkdir d5/d8/d1a/d8a/d8b 0 2024-04-23T10:21:03.076 INFO:tasks.workunit.client.0.smithi029.stdout:4/417: rename d0/c11 to d0/d3c/d52/d1b/d36/d45/d4f/c94 0 2024-04-23T10:21:03.076 INFO:tasks.workunit.client.0.smithi029.stdout:2/402: dread d1/d3e/f38 [0,4194304] 0 2024-04-23T10:21:03.082 INFO:tasks.workunit.client.0.smithi029.stdout:9/535: dwrite d0/d7/d3f/f96 [0,4194304] 0 2024-04-23T10:21:03.085 INFO:tasks.workunit.client.0.smithi029.stdout:5/425: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/c8e 0 2024-04-23T10:21:03.090 INFO:tasks.workunit.client.0.smithi029.stdout:3/380: getdents d3/d45/d4f 0 2024-04-23T10:21:03.092 INFO:tasks.workunit.client.0.smithi029.stdout:6/507: creat d9/df/d25/fb2 x:0 0 0 2024-04-23T10:21:03.094 INFO:tasks.workunit.client.0.smithi029.stdout:3/381: rename d3/d10/de/d2e/d36/d40/d46/d72/d31 to d3/d10/de/d2e/d36/d40/d46/d72/d31/d86 22 2024-04-23T10:21:03.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/418: dread d0/d3c/d52/f42 [0,4194304] 0 2024-04-23T10:21:03.098 INFO:tasks.workunit.client.0.smithi029.stdout:4/419: chown d0/d3c/d52/d1b/d36/d45/d4f/f87 2 1 2024-04-23T10:21:03.102 INFO:tasks.workunit.client.0.smithi029.stdout:1/333: sync 2024-04-23T10:21:03.105 INFO:tasks.workunit.client.0.smithi029.stdout:7/405: unlink d5/d8/d51/d55/c6a 0 2024-04-23T10:21:03.108 INFO:tasks.workunit.client.0.smithi029.stdout:7/406: chown d5/d8/d51/d55/l5e 35377 1 2024-04-23T10:21:03.110 INFO:tasks.workunit.client.0.smithi029.stdout:0/214: dwrite d0/f6 [0,4194304] 0 2024-04-23T10:21:03.111 INFO:tasks.workunit.client.0.smithi029.stdout:0/215: write d0/f4 [3546008,37057] 0 2024-04-23T10:21:03.112 INFO:tasks.workunit.client.0.smithi029.stdout:0/216: stat d0/c10 0 2024-04-23T10:21:03.113 INFO:tasks.workunit.client.0.smithi029.stdout:0/217: readlink d0/dc/d27/l40 0 2024-04-23T10:21:03.115 INFO:tasks.workunit.client.0.smithi029.stdout:6/508: dread d9/df/f3d [0,4194304] 0 2024-04-23T10:21:03.118 INFO:tasks.workunit.client.0.smithi029.stdout:6/509: truncate d9/df/d16/d1f/d27/fa6 1025281 0 2024-04-23T10:21:03.118 INFO:tasks.workunit.client.0.smithi029.stdout:6/510: chown d9/l2f 1945 1 2024-04-23T10:21:03.133 INFO:tasks.workunit.client.0.smithi029.stdout:8/393: rmdir d3/d2f/d76 0 2024-04-23T10:21:03.136 INFO:tasks.workunit.client.0.smithi029.stdout:3/382: unlink d3/d15/d4b/d52/d5f/f62 0 2024-04-23T10:21:03.140 INFO:tasks.workunit.client.0.smithi029.stdout:4/420: write d0/d3c/d52/d20/f5e [182823,75672] 0 2024-04-23T10:21:03.149 INFO:tasks.workunit.client.0.smithi029.stdout:7/407: readlink d5/d9/l20 0 2024-04-23T10:21:03.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/218: mknod d0/d21/c49 0 2024-04-23T10:21:03.153 INFO:tasks.workunit.client.0.smithi029.stdout:0/219: readlink d0/dc/d27/l40 0 2024-04-23T10:21:03.154 INFO:tasks.workunit.client.0.smithi029.stdout:6/511: creat d9/df/d41/d49/fb3 x:0 0 0 2024-04-23T10:21:03.154 INFO:tasks.workunit.client.0.smithi029.stdout:9/536: truncate d0/f1e 1948972 0 2024-04-23T10:21:03.162 INFO:tasks.workunit.client.0.smithi029.stdout:0/220: dwrite d0/d1b/f2d [4194304,4194304] 0 2024-04-23T10:21:03.164 INFO:tasks.workunit.client.0.smithi029.stdout:4/421: creat d0/d3c/d52/d1b/d5b/d65/d6a/f95 x:0 0 0 2024-04-23T10:21:03.165 INFO:tasks.workunit.client.0.smithi029.stdout:7/408: rmdir d5/d8 39 2024-04-23T10:21:03.165 INFO:tasks.workunit.client.0.smithi029.stdout:4/422: write d0/f27 [8937932,14656] 0 2024-04-23T10:21:03.169 INFO:tasks.workunit.client.0.smithi029.stdout:9/537: rename d0/d1b/d39/d4f/d92 to d0/d1b/d39/d50/d67/db6 0 2024-04-23T10:21:03.172 INFO:tasks.workunit.client.0.smithi029.stdout:5/426: rmdir d0/d35/d38/d3e/d66/d5a/d78/d68 0 2024-04-23T10:21:03.173 INFO:tasks.workunit.client.0.smithi029.stdout:9/538: fsync d0/d7/d3f/f48 0 2024-04-23T10:21:03.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/383: link d3/d15/d4b/f71 d3/d15/d4b/d52/f87 0 2024-04-23T10:21:03.176 INFO:tasks.workunit.client.0.smithi029.stdout:3/384: chown d3 3 1 2024-04-23T10:21:03.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/334: creat d5/f70 x:0 0 0 2024-04-23T10:21:03.177 INFO:tasks.workunit.client.0.smithi029.stdout:0/221: rmdir d0/d21 39 2024-04-23T10:21:03.182 INFO:tasks.workunit.client.0.smithi029.stdout:6/512: dwrite d9/df/f22 [0,4194304] 0 2024-04-23T10:21:03.182 INFO:tasks.workunit.client.0.smithi029.stdout:5/427: dread d0/f2f [0,4194304] 0 2024-04-23T10:21:03.184 INFO:tasks.workunit.client.0.smithi029.stdout:8/394: link d3/f29 d3/d50/f77 0 2024-04-23T10:21:03.189 INFO:tasks.workunit.client.0.smithi029.stdout:7/409: creat d5/d8/d51/f8c x:0 0 0 2024-04-23T10:21:03.191 INFO:tasks.workunit.client.0.smithi029.stdout:1/335: mknod d5/d6/de/d22/c71 0 2024-04-23T10:21:03.195 INFO:tasks.workunit.client.0.smithi029.stdout:6/513: unlink d9/cb0 0 2024-04-23T10:21:03.201 INFO:tasks.workunit.client.0.smithi029.stdout:7/410: dwrite d5/d8/d51/f8c [0,4194304] 0 2024-04-23T10:21:03.201 INFO:tasks.workunit.client.0.smithi029.stdout:9/539: creat d0/d7/d1d/d35/da9/fb7 x:0 0 0 2024-04-23T10:21:03.206 INFO:tasks.workunit.client.0.smithi029.stdout:2/403: write d1/dd/d47/d63/d64/f80 [965359,10557] 0 2024-04-23T10:21:03.206 INFO:tasks.workunit.client.0.smithi029.stdout:1/336: dwrite d5/d6/f61 [0,4194304] 0 2024-04-23T10:21:03.207 INFO:tasks.workunit.client.0.smithi029.stdout:6/514: creat d9/df/d16/d34/d84/fb4 x:0 0 0 2024-04-23T10:21:03.208 INFO:tasks.workunit.client.0.smithi029.stdout:1/337: chown d5/d6/de/d27/f46 0 1 2024-04-23T10:21:03.208 INFO:tasks.workunit.client.0.smithi029.stdout:6/515: truncate d9/d5b/f86 4803004 0 2024-04-23T10:21:03.210 INFO:tasks.workunit.client.0.smithi029.stdout:6/516: chown d9/df/d41/l7b 1 1 2024-04-23T10:21:03.213 INFO:tasks.workunit.client.0.smithi029.stdout:5/428: link d0/d35/d38/d3e/f70 d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/f8f 0 2024-04-23T10:21:03.215 INFO:tasks.workunit.client.0.smithi029.stdout:4/423: getdents d0/d3c/d52/d20 0 2024-04-23T10:21:03.217 INFO:tasks.workunit.client.0.smithi029.stdout:5/429: chown d0/d35/d38/d3e/d66/d5a/f80 83833 1 2024-04-23T10:21:03.217 INFO:tasks.workunit.client.0.smithi029.stdout:2/404: dwrite d1/d4/f1e [0,4194304] 0 2024-04-23T10:21:03.218 INFO:tasks.workunit.client.0.smithi029.stdout:2/405: chown d1/d3e/d3b 30 1 2024-04-23T10:21:03.219 INFO:tasks.workunit.client.0.smithi029.stdout:2/406: readlink d1/l3f 0 2024-04-23T10:21:03.219 INFO:tasks.workunit.client.0.smithi029.stdout:2/407: readlink d1/d31/l36 0 2024-04-23T10:21:03.222 INFO:tasks.workunit.client.0.smithi029.stdout:0/222: creat d0/f4a x:0 0 0 2024-04-23T10:21:03.224 INFO:tasks.workunit.client.0.smithi029.stdout:4/424: mkdir d0/d5a/d96 0 2024-04-23T10:21:03.235 INFO:tasks.workunit.client.0.smithi029.stdout:3/385: creat d3/d10/f88 x:0 0 0 2024-04-23T10:21:03.239 INFO:tasks.workunit.client.0.smithi029.stdout:5/430: dwrite d0/d35/d38/d3e/d66/d5a/d78/f32 [0,4194304] 0 2024-04-23T10:21:03.242 INFO:tasks.workunit.client.0.smithi029.stdout:8/395: rename d3/d2f/c5d to d3/d50/c78 0 2024-04-23T10:21:03.242 INFO:tasks.workunit.client.0.smithi029.stdout:4/425: dwrite d0/d3c/d52/d1b/d5b/d65/f85 [0,4194304] 0 2024-04-23T10:21:03.243 INFO:tasks.workunit.client.0.smithi029.stdout:5/431: read - d0/d35/d38/d39/d3f/f7d zero size 2024-04-23T10:21:03.245 INFO:tasks.workunit.client.0.smithi029.stdout:8/396: read d3/f1f [2272193,65455] 0 2024-04-23T10:21:03.245 INFO:tasks.workunit.client.0.smithi029.stdout:3/386: write d3/d10/de/d2e/d36/f33 [1563330,28172] 0 2024-04-23T10:21:03.246 INFO:tasks.workunit.client.0.smithi029.stdout:9/540: getdents d0/d7/d6/d66 0 2024-04-23T10:21:03.247 INFO:tasks.workunit.client.0.smithi029.stdout:7/411: truncate d5/f18 2198425 0 2024-04-23T10:21:03.248 INFO:tasks.workunit.client.0.smithi029.stdout:9/541: chown d0/d7/d3f 126089 1 2024-04-23T10:21:03.248 INFO:tasks.workunit.client.0.smithi029.stdout:5/432: mknod d0/d35/d38/d3e/d66/c90 0 2024-04-23T10:21:03.251 INFO:tasks.workunit.client.0.smithi029.stdout:1/338: write d5/d6/f21 [373933,31155] 0 2024-04-23T10:21:03.252 INFO:tasks.workunit.client.0.smithi029.stdout:9/542: chown d0/d1b/d39/d50/l27 383 1 2024-04-23T10:21:03.252 INFO:tasks.workunit.client.0.smithi029.stdout:8/397: creat d3/d38/f79 x:0 0 0 2024-04-23T10:21:03.256 INFO:tasks.workunit.client.0.smithi029.stdout:9/543: chown d0/d1b/d39/d50/c59 5152 1 2024-04-23T10:21:03.259 INFO:tasks.workunit.client.0.smithi029.stdout:0/223: rename d0/dc/f1a to d0/dc/d27/d3a/f4b 0 2024-04-23T10:21:03.262 INFO:tasks.workunit.client.0.smithi029.stdout:8/398: mknod d3/d50/d6a/c7a 0 2024-04-23T10:21:03.266 INFO:tasks.workunit.client.0.smithi029.stdout:6/517: dread f4 [0,4194304] 0 2024-04-23T10:21:03.266 INFO:tasks.workunit.client.0.smithi029.stdout:1/339: dwrite d5/d6/de/d22/f5f [0,4194304] 0 2024-04-23T10:21:03.266 INFO:tasks.workunit.client.0.smithi029.stdout:3/387: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89 0 2024-04-23T10:21:03.267 INFO:tasks.workunit.client.0.smithi029.stdout:6/518: readlink d9/df/l6a 0 2024-04-23T10:21:03.268 INFO:tasks.workunit.client.0.smithi029.stdout:9/544: mkdir d0/d7/d1d/d35/d3b/db8 0 2024-04-23T10:21:03.268 INFO:tasks.workunit.client.0.smithi029.stdout:0/224: mkdir d0/dc/d26/d44/d4c 0 2024-04-23T10:21:03.269 INFO:tasks.workunit.client.0.smithi029.stdout:6/519: stat d9/df/d16/d44/c5c 0 2024-04-23T10:21:03.271 INFO:tasks.workunit.client.0.smithi029.stdout:8/399: rename d3/d38/c47 to d3/d44/c7b 0 2024-04-23T10:21:03.274 INFO:tasks.workunit.client.0.smithi029.stdout:9/545: write d0/d7/f1a [2664954,10896] 0 2024-04-23T10:21:03.279 INFO:tasks.workunit.client.0.smithi029.stdout:3/388: mkdir d3/d10/de/d2e/d36/d8a 0 2024-04-23T10:21:03.280 INFO:tasks.workunit.client.0.smithi029.stdout:3/389: chown d3/d10/de/d2e/c78 1 1 2024-04-23T10:21:03.282 INFO:tasks.workunit.client.0.smithi029.stdout:5/433: write d0/f31 [1401899,35913] 0 2024-04-23T10:21:03.283 INFO:tasks.workunit.client.0.smithi029.stdout:9/546: chown d0/d1b/l4e 215 1 2024-04-23T10:21:03.285 INFO:tasks.workunit.client.0.smithi029.stdout:0/225: mknod d0/d21/c4d 0 2024-04-23T10:21:03.286 INFO:tasks.workunit.client.0.smithi029.stdout:1/340: dread d5/d6/ff [0,4194304] 0 2024-04-23T10:21:03.289 INFO:tasks.workunit.client.0.smithi029.stdout:1/341: write d5/d3e/f54 [739410,38341] 0 2024-04-23T10:21:03.291 INFO:tasks.workunit.client.0.smithi029.stdout:7/412: dwrite d5/d8/d1a/f1e [0,4194304] 0 2024-04-23T10:21:03.295 INFO:tasks.workunit.client.0.smithi029.stdout:1/342: rmdir d5/d6/d34/d63 39 2024-04-23T10:21:03.296 INFO:tasks.workunit.client.0.smithi029.stdout:1/343: readlink l2 0 2024-04-23T10:21:03.296 INFO:tasks.workunit.client.0.smithi029.stdout:3/390: link d3/d10/de/d2e/d59/c6a d3/d10/de/d2e/d36/d40/d46/d72/d75/c8b 0 2024-04-23T10:21:03.297 INFO:tasks.workunit.client.0.smithi029.stdout:5/434: link d0/l1 d0/d35/d38/d39/d3f/l91 0 2024-04-23T10:21:03.298 INFO:tasks.workunit.client.0.smithi029.stdout:9/547: dwrite d0/d1b/d39/f97 [0,4194304] 0 2024-04-23T10:21:03.300 INFO:tasks.workunit.client.0.smithi029.stdout:0/226: mkdir d0/d3e/d4e 0 2024-04-23T10:21:03.301 INFO:tasks.workunit.client.0.smithi029.stdout:7/413: mkdir d5/d8/d1a/d8a/d8b/d8d 0 2024-04-23T10:21:03.303 INFO:tasks.workunit.client.0.smithi029.stdout:5/435: unlink d0/d35/d38/d51/f25 0 2024-04-23T10:21:03.304 INFO:tasks.workunit.client.0.smithi029.stdout:3/391: mknod d3/d10/de/d2e/d36/d40/d46/d72/d31/c8c 0 2024-04-23T10:21:03.306 INFO:tasks.workunit.client.0.smithi029.stdout:9/548: symlink d0/d7/d1d/lb9 0 2024-04-23T10:21:03.311 INFO:tasks.workunit.client.0.smithi029.stdout:3/392: symlink d3/d10/de/d2e/d36/d40/d46/d72/l8d 0 2024-04-23T10:21:03.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/436: fdatasync d0/d35/d38/d3e/d66/f6c 0 2024-04-23T10:21:03.312 INFO:tasks.workunit.client.0.smithi029.stdout:9/549: mkdir d0/d7/d6/d66/dba 0 2024-04-23T10:21:03.313 INFO:tasks.workunit.client.0.smithi029.stdout:1/344: rename d5/d6/de/d27/c64 to d5/d6/d34/c72 0 2024-04-23T10:21:03.314 INFO:tasks.workunit.client.0.smithi029.stdout:1/345: fdatasync d5/f17 0 2024-04-23T10:21:03.314 INFO:tasks.workunit.client.0.smithi029.stdout:7/414: mkdir d5/d8/d1a/d8e 0 2024-04-23T10:21:03.317 INFO:tasks.workunit.client.0.smithi029.stdout:7/415: chown d5/d58/l77 276885190 1 2024-04-23T10:21:03.318 INFO:tasks.workunit.client.0.smithi029.stdout:3/393: unlink d3/d10/f88 0 2024-04-23T10:21:03.318 INFO:tasks.workunit.client.0.smithi029.stdout:1/346: write d5/d6/de/d27/d38/d47/f57 [5043539,28698] 0 2024-04-23T10:21:03.318 INFO:tasks.workunit.client.0.smithi029.stdout:0/227: creat d0/f4f x:0 0 0 2024-04-23T10:21:03.318 INFO:tasks.workunit.client.0.smithi029.stdout:9/550: mkdir d0/d7/d3f/dbb 0 2024-04-23T10:21:03.320 INFO:tasks.workunit.client.0.smithi029.stdout:7/416: stat d5/d8/l44 0 2024-04-23T10:21:03.323 INFO:tasks.workunit.client.0.smithi029.stdout:9/551: symlink d0/d1b/d39/d50/d67/db6/lbc 0 2024-04-23T10:21:03.324 INFO:tasks.workunit.client.0.smithi029.stdout:3/394: creat d3/d10/de/d2e/d36/d40/d46/d72/d28/f8e x:0 0 0 2024-04-23T10:21:03.325 INFO:tasks.workunit.client.0.smithi029.stdout:7/417: creat d5/d29/d4a/f8f x:0 0 0 2024-04-23T10:21:03.327 INFO:tasks.workunit.client.0.smithi029.stdout:1/347: link d5/d6/de/f62 d5/d6/de/d27/d38/f73 0 2024-04-23T10:21:03.328 INFO:tasks.workunit.client.0.smithi029.stdout:9/552: mkdir d0/d7/d1d/d35/d3b/d68/dbd 0 2024-04-23T10:21:03.330 INFO:tasks.workunit.client.0.smithi029.stdout:3/395: symlink d3/d10/d48/l8f 0 2024-04-23T10:21:03.330 INFO:tasks.workunit.client.0.smithi029.stdout:0/228: mkdir d0/d3e/d4e/d50 0 2024-04-23T10:21:03.335 INFO:tasks.workunit.client.0.smithi029.stdout:9/553: chown d0/c4a 1841 1 2024-04-23T10:21:03.336 INFO:tasks.workunit.client.0.smithi029.stdout:8/400: dwrite d3/f1e [0,4194304] 0 2024-04-23T10:21:03.337 INFO:tasks.workunit.client.0.smithi029.stdout:5/437: dread d0/f31 [0,4194304] 0 2024-04-23T10:21:03.340 INFO:tasks.workunit.client.0.smithi029.stdout:7/418: dwrite d5/d8/fb [4194304,4194304] 0 2024-04-23T10:21:03.340 INFO:tasks.workunit.client.0.smithi029.stdout:9/554: creat d0/d7/d1d/fbe x:0 0 0 2024-04-23T10:21:03.342 INFO:tasks.workunit.client.0.smithi029.stdout:1/348: rename d5/f53 to d5/d6/f74 0 2024-04-23T10:21:03.343 INFO:tasks.workunit.client.0.smithi029.stdout:7/419: chown d5/d8/d51/d55/d59/f73 58863729 1 2024-04-23T10:21:03.345 INFO:tasks.workunit.client.0.smithi029.stdout:7/420: write d5/d8/f32 [4602427,62856] 0 2024-04-23T10:21:03.350 INFO:tasks.workunit.client.0.smithi029.stdout:9/555: truncate d0/d1b/d44/d49/f64 1966626 0 2024-04-23T10:21:03.356 INFO:tasks.workunit.client.0.smithi029.stdout:8/401: truncate d3/fd 3746225 0 2024-04-23T10:21:03.356 INFO:tasks.workunit.client.0.smithi029.stdout:1/349: creat d5/d6/d34/d63/f75 x:0 0 0 2024-04-23T10:21:03.358 INFO:tasks.workunit.client.0.smithi029.stdout:5/438: link d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/f8f d0/d35/d38/d3e/d66/d5a/f92 0 2024-04-23T10:21:03.360 INFO:tasks.workunit.client.0.smithi029.stdout:3/396: link d3/d10/de/d2e/d59/c6a d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/c90 0 2024-04-23T10:21:03.360 INFO:tasks.workunit.client.0.smithi029.stdout:0/229: getdents d0/dc 0 2024-04-23T10:21:03.360 INFO:tasks.workunit.client.0.smithi029.stdout:9/556: mkdir d0/d1b/d60/dbf 0 2024-04-23T10:21:03.362 INFO:tasks.workunit.client.0.smithi029.stdout:8/402: unlink d3/d2f/d36/d3e/c4e 0 2024-04-23T10:21:03.363 INFO:tasks.workunit.client.0.smithi029.stdout:8/403: write d3/d2f/f39 [5053534,4412] 0 2024-04-23T10:21:03.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/557: chown d0/d1b/c34 28375 1 2024-04-23T10:21:03.365 INFO:tasks.workunit.client.0.smithi029.stdout:3/397: creat d3/d45/d4f/f91 x:0 0 0 2024-04-23T10:21:03.365 INFO:tasks.workunit.client.0.smithi029.stdout:8/404: write d3/d2f/f39 [3601983,74064] 0 2024-04-23T10:21:03.365 INFO:tasks.workunit.client.0.smithi029.stdout:5/439: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d93 0 2024-04-23T10:21:03.369 INFO:tasks.workunit.client.0.smithi029.stdout:1/350: link d5/f70 d5/d6/de/d22/f76 0 2024-04-23T10:21:03.373 INFO:tasks.workunit.client.0.smithi029.stdout:7/421: dread d5/d29/f3b [0,4194304] 0 2024-04-23T10:21:03.376 INFO:tasks.workunit.client.0.smithi029.stdout:8/405: unlink d3/d44/c45 0 2024-04-23T10:21:03.376 INFO:tasks.workunit.client.0.smithi029.stdout:5/440: creat d0/d35/d38/d39/f94 x:0 0 0 2024-04-23T10:21:03.377 INFO:tasks.workunit.client.0.smithi029.stdout:5/441: chown d0/d2b/c52 54186275 1 2024-04-23T10:21:03.377 INFO:tasks.workunit.client.0.smithi029.stdout:0/230: creat d0/f51 x:0 0 0 2024-04-23T10:21:03.378 INFO:tasks.workunit.client.0.smithi029.stdout:9/558: symlink d0/d7/d6/d66/dba/lc0 0 2024-04-23T10:21:03.380 INFO:tasks.workunit.client.0.smithi029.stdout:5/442: truncate d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/f8b 432944 0 2024-04-23T10:21:03.382 INFO:tasks.workunit.client.0.smithi029.stdout:3/398: truncate d3/fd 2748333 0 2024-04-23T10:21:03.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/399: write d3/d10/de/f12 [5199747,67620] 0 2024-04-23T10:21:03.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/400: write d3/d10/f20 [8219012,45037] 0 2024-04-23T10:21:03.387 INFO:tasks.workunit.client.0.smithi029.stdout:5/443: symlink d0/d35/d38/d39/l95 0 2024-04-23T10:21:03.388 INFO:tasks.workunit.client.0.smithi029.stdout:3/401: chown d3/d10/de/d2e 92 1 2024-04-23T10:21:03.388 INFO:tasks.workunit.client.0.smithi029.stdout:9/559: dwrite d0/d7/d1d/d35/f36 [4194304,4194304] 0 2024-04-23T10:21:03.391 INFO:tasks.workunit.client.0.smithi029.stdout:9/560: write d0/d7/d3f/f4c [141878,61410] 0 2024-04-23T10:21:03.391 INFO:tasks.workunit.client.0.smithi029.stdout:0/231: mknod d0/d21/c52 0 2024-04-23T10:21:03.397 INFO:tasks.workunit.client.0.smithi029.stdout:7/422: getdents d5/d9 0 2024-04-23T10:21:03.398 INFO:tasks.workunit.client.0.smithi029.stdout:3/402: read d3/d10/de/d2e/f2f [257281,40162] 0 2024-04-23T10:21:03.399 INFO:tasks.workunit.client.0.smithi029.stdout:0/232: fsync d0/dc/f16 0 2024-04-23T10:21:03.401 INFO:tasks.workunit.client.0.smithi029.stdout:5/444: symlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d93/l96 0 2024-04-23T10:21:03.403 INFO:tasks.workunit.client.0.smithi029.stdout:8/406: dwrite d3/d38/f3d [0,4194304] 0 2024-04-23T10:21:03.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/403: dread - d3/d15/f66 zero size 2024-04-23T10:21:03.405 INFO:tasks.workunit.client.0.smithi029.stdout:5/445: write d0/d35/d38/d39/f86 [1041074,25401] 0 2024-04-23T10:21:03.405 INFO:tasks.workunit.client.0.smithi029.stdout:0/233: write d0/d21/f39 [489745,105091] 0 2024-04-23T10:21:03.406 INFO:tasks.workunit.client.0.smithi029.stdout:7/423: rmdir d5/d8 39 2024-04-23T10:21:03.408 INFO:tasks.workunit.client.0.smithi029.stdout:0/234: stat d0/dc 0 2024-04-23T10:21:03.414 INFO:tasks.workunit.client.0.smithi029.stdout:9/561: dwrite d0/d7/d3f/f40 [0,4194304] 0 2024-04-23T10:21:03.416 INFO:tasks.workunit.client.0.smithi029.stdout:5/446: symlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/l97 0 2024-04-23T10:21:03.421 INFO:tasks.workunit.client.0.smithi029.stdout:9/562: read d0/d7/f10 [1549246,27912] 0 2024-04-23T10:21:03.422 INFO:tasks.workunit.client.0.smithi029.stdout:0/235: read d0/d21/f39 [188122,97676] 0 2024-04-23T10:21:03.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/424: dread d5/d8/f6f [0,4194304] 0 2024-04-23T10:21:03.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/407: dread d3/d44/f62 [0,4194304] 0 2024-04-23T10:21:03.438 INFO:tasks.workunit.client.0.smithi029.stdout:7/425: read d5/d8/f43 [4986451,116192] 0 2024-04-23T10:21:03.439 INFO:tasks.workunit.client.0.smithi029.stdout:9/563: readlink d0/d1b/l98 0 2024-04-23T10:21:03.440 INFO:tasks.workunit.client.0.smithi029.stdout:7/426: rename d5/d9 to d5/d9/d90 22 2024-04-23T10:21:03.441 INFO:tasks.workunit.client.0.smithi029.stdout:7/427: fsync d5/d8/d51/d55/f87 0 2024-04-23T10:21:03.441 INFO:tasks.workunit.client.0.smithi029.stdout:9/564: write d0/d1b/d39/d50/fb4 [175772,86733] 0 2024-04-23T10:21:03.445 INFO:tasks.workunit.client.0.smithi029.stdout:3/404: rmdir d3/d10/de/d2e/d59/d5b 0 2024-04-23T10:21:03.450 INFO:tasks.workunit.client.0.smithi029.stdout:5/447: dread d0/d35/d49/f67 [0,4194304] 0 2024-04-23T10:21:03.452 INFO:tasks.workunit.client.0.smithi029.stdout:8/408: dwrite d3/d2f/d36/d3e/f41 [4194304,4194304] 0 2024-04-23T10:21:03.455 INFO:tasks.workunit.client.0.smithi029.stdout:7/428: truncate d5/f18 135188 0 2024-04-23T10:21:03.457 INFO:tasks.workunit.client.0.smithi029.stdout:0/236: dread d0/d1b/f37 [0,4194304] 0 2024-04-23T10:21:03.457 INFO:tasks.workunit.client.0.smithi029.stdout:8/409: mknod d3/d38/c7c 0 2024-04-23T10:21:03.458 INFO:tasks.workunit.client.0.smithi029.stdout:8/410: dread - d3/d50/f64 zero size 2024-04-23T10:21:03.459 INFO:tasks.workunit.client.0.smithi029.stdout:9/565: creat d0/d7/d3f/dbb/fc1 x:0 0 0 2024-04-23T10:21:03.459 INFO:tasks.workunit.client.0.smithi029.stdout:7/429: fdatasync d5/d9/f2e 0 2024-04-23T10:21:03.460 INFO:tasks.workunit.client.0.smithi029.stdout:7/430: truncate d5/d71/f82 767394 0 2024-04-23T10:21:03.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/405: rename d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/c90 to d3/d10/de/d2e/d36/d8a/c92 0 2024-04-23T10:21:03.462 INFO:tasks.workunit.client.0.smithi029.stdout:0/237: fdatasync d0/dc/d27/f31 0 2024-04-23T10:21:03.463 INFO:tasks.workunit.client.0.smithi029.stdout:8/411: truncate d3/f1f 2580631 0 2024-04-23T10:21:03.465 INFO:tasks.workunit.client.0.smithi029.stdout:5/448: creat d0/d35/d38/d3e/d66/d5a/d78/f98 x:0 0 0 2024-04-23T10:21:03.468 INFO:tasks.workunit.client.0.smithi029.stdout:9/566: rename d0/d7/f10 to d0/d7/d6/d66/dba/fc2 0 2024-04-23T10:21:03.470 INFO:tasks.workunit.client.0.smithi029.stdout:5/449: fsync d0/f31 0 2024-04-23T10:21:03.470 INFO:tasks.workunit.client.0.smithi029.stdout:9/567: write d0/d7/d1d/d35/da9/fb7 [418662,72807] 0 2024-04-23T10:21:03.472 INFO:tasks.workunit.client.0.smithi029.stdout:8/412: mkdir d3/d7d 0 2024-04-23T10:21:03.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/413: dread d3/d2f/f54 [0,4194304] 0 2024-04-23T10:21:03.480 INFO:tasks.workunit.client.0.smithi029.stdout:0/238: link d0/f1 d0/d21/f53 0 2024-04-23T10:21:03.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/239: truncate d0/dc/f36 1344554 0 2024-04-23T10:21:03.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/240: readlink d0/dc/le 0 2024-04-23T10:21:03.489 INFO:tasks.workunit.client.0.smithi029.stdout:0/241: dwrite d0/dc/d26/f28 [0,4194304] 0 2024-04-23T10:21:03.492 INFO:tasks.workunit.client.0.smithi029.stdout:7/431: rename d5/d29/f67 to d5/d8/d1a/f91 0 2024-04-23T10:21:03.521 INFO:tasks.workunit.client.0.smithi029.stdout:5/450: dwrite d0/fe [0,4194304] 0 2024-04-23T10:21:03.521 INFO:tasks.workunit.client.0.smithi029.stdout:8/414: fsync d3/f30 0 2024-04-23T10:21:03.521 INFO:tasks.workunit.client.0.smithi029.stdout:0/242: symlink d0/d3e/d4e/l54 0 2024-04-23T10:21:03.569 INFO:tasks.workunit.client.0.smithi029.stdout:2/408: sync 2024-04-23T10:21:03.588 INFO:tasks.workunit.client.0.smithi029.stdout:8/415: truncate d3/f2d 2646985 0 2024-04-23T10:21:03.594 INFO:tasks.workunit.client.0.smithi029.stdout:0/243: dread d0/f6 [0,4194304] 0 2024-04-23T10:21:03.601 INFO:tasks.workunit.client.0.smithi029.stdout:5/451: dwrite d0/f19 [0,4194304] 0 2024-04-23T10:21:03.603 INFO:tasks.workunit.client.0.smithi029.stdout:8/416: dread d3/f1e [0,4194304] 0 2024-04-23T10:21:03.606 INFO:tasks.workunit.client.0.smithi029.stdout:7/432: truncate d5/f30 1411429 0 2024-04-23T10:21:03.616 INFO:tasks.workunit.client.0.smithi029.stdout:8/417: dread d3/f1e [0,4194304] 0 2024-04-23T10:21:03.616 INFO:tasks.workunit.client.0.smithi029.stdout:5/452: creat d0/d35/d38/d39/f99 x:0 0 0 2024-04-23T10:21:03.618 INFO:tasks.workunit.client.0.smithi029.stdout:8/418: chown d3/d44/f62 3526 1 2024-04-23T10:21:03.620 INFO:tasks.workunit.client.0.smithi029.stdout:5/453: dread - d0/d35/d38/d39/d3f/f7d zero size 2024-04-23T10:21:03.624 INFO:tasks.workunit.client.0.smithi029.stdout:7/433: mkdir d5/d71/d92 0 2024-04-23T10:21:03.626 INFO:tasks.workunit.client.0.smithi029.stdout:2/409: link d1/d4/l6 d1/l87 0 2024-04-23T10:21:03.630 INFO:tasks.workunit.client.0.smithi029.stdout:7/434: creat d5/d29/d4a/f93 x:0 0 0 2024-04-23T10:21:03.643 INFO:tasks.workunit.client.0.smithi029.stdout:5/454: mkdir d0/d9a 0 2024-04-23T10:21:03.644 INFO:tasks.workunit.client.0.smithi029.stdout:7/435: dwrite d5/d8/d51/d55/f66 [0,4194304] 0 2024-04-23T10:21:03.647 INFO:tasks.workunit.client.0.smithi029.stdout:5/455: write d0/d35/d38/d3e/d66/d5a/d78/d3d/f4f [1789741,77508] 0 2024-04-23T10:21:03.656 INFO:tasks.workunit.client.0.smithi029.stdout:7/436: truncate d5/d29/f38 1021804 0 2024-04-23T10:21:03.661 INFO:tasks.workunit.client.0.smithi029.stdout:7/437: dread - d5/d8/d51/d55/d59/f61 zero size 2024-04-23T10:21:03.664 INFO:tasks.workunit.client.0.smithi029.stdout:5/456: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b 0 2024-04-23T10:21:03.668 INFO:tasks.workunit.client.0.smithi029.stdout:0/244: dwrite d0/d1b/f37 [0,4194304] 0 2024-04-23T10:21:03.670 INFO:tasks.workunit.client.0.smithi029.stdout:2/410: creat d1/dd/d22/f88 x:0 0 0 2024-04-23T10:21:03.674 INFO:tasks.workunit.client.0.smithi029.stdout:5/457: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c 0 2024-04-23T10:21:03.684 INFO:tasks.workunit.client.0.smithi029.stdout:0/245: dwrite d0/d1b/f37 [0,4194304] 0 2024-04-23T10:21:03.685 INFO:tasks.workunit.client.0.smithi029.stdout:2/411: dwrite d1/dd/d47/d63/d64/f72 [0,4194304] 0 2024-04-23T10:21:03.692 INFO:tasks.workunit.client.0.smithi029.stdout:0/246: fdatasync d0/f4 0 2024-04-23T10:21:03.693 INFO:tasks.workunit.client.0.smithi029.stdout:0/247: write d0/d1b/f2d [809931,76083] 0 2024-04-23T10:21:03.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/412: creat d1/d3e/f89 x:0 0 0 2024-04-23T10:21:03.704 INFO:tasks.workunit.client.0.smithi029.stdout:5/458: truncate d0/f81 341923 0 2024-04-23T10:21:03.707 INFO:tasks.workunit.client.0.smithi029.stdout:2/413: mknod d1/dd/d60/c8a 0 2024-04-23T10:21:03.709 INFO:tasks.workunit.client.0.smithi029.stdout:0/248: fsync d0/dc/d26/f2e 0 2024-04-23T10:21:03.709 INFO:tasks.workunit.client.0.smithi029.stdout:7/438: link d5/f18 d5/d8/d1a/d4d/f94 0 2024-04-23T10:21:03.710 INFO:tasks.workunit.client.0.smithi029.stdout:7/439: truncate d5/f41 258452 0 2024-04-23T10:21:03.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/249: chown d0/c10 194 1 2024-04-23T10:21:03.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/250: dread - d0/dc/d26/f41 zero size 2024-04-23T10:21:03.715 INFO:tasks.workunit.client.0.smithi029.stdout:0/251: chown d0/dc/c12 58027784 1 2024-04-23T10:21:03.720 INFO:tasks.workunit.client.0.smithi029.stdout:0/252: dread d0/d1b/f2d [0,4194304] 0 2024-04-23T10:21:03.722 INFO:tasks.workunit.client.0.smithi029.stdout:2/414: rename d1/c16 to d1/d4/c8b 0 2024-04-23T10:21:03.726 INFO:tasks.workunit.client.0.smithi029.stdout:0/253: rmdir d0/d1b 39 2024-04-23T10:21:03.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/426: sync 2024-04-23T10:21:03.906 INFO:tasks.workunit.client.0.smithi029.stdout:4/427: rename d0/d3c/d52/d1b/d36/l3a to d0/d3c/d52/d1b/d5b/d65/d6a/l97 0 2024-04-23T10:21:03.907 INFO:tasks.workunit.client.0.smithi029.stdout:4/428: chown d0/d3c/d52 2671759 1 2024-04-23T10:21:03.912 INFO:tasks.workunit.client.0.smithi029.stdout:4/429: fsync d0/d3c/d52/d1b/d36/d45/d68/f73 0 2024-04-23T10:21:03.918 INFO:tasks.workunit.client.0.smithi029.stdout:0/254: dwrite d0/d1b/f3b [0,4194304] 0 2024-04-23T10:21:03.922 INFO:tasks.workunit.client.0.smithi029.stdout:2/415: creat d1/f8c x:0 0 0 2024-04-23T10:21:03.929 INFO:tasks.workunit.client.0.smithi029.stdout:4/430: mkdir d0/d3c/d52/d1b/d36/d45/d68/d98 0 2024-04-23T10:21:03.929 INFO:tasks.workunit.client.0.smithi029.stdout:7/440: write d5/d8/fc [1196514,49624] 0 2024-04-23T10:21:03.932 INFO:tasks.workunit.client.0.smithi029.stdout:7/441: fsync d5/d8/d51/f57 0 2024-04-23T10:21:03.934 INFO:tasks.workunit.client.0.smithi029.stdout:0/255: mkdir d0/dc/d27/d55 0 2024-04-23T10:21:03.936 INFO:tasks.workunit.client.0.smithi029.stdout:0/256: read - d0/f4a zero size 2024-04-23T10:21:03.941 INFO:tasks.workunit.client.0.smithi029.stdout:2/416: rename d1/d4/f1e to d1/d3e/d5a/f8d 0 2024-04-23T10:21:03.946 INFO:tasks.workunit.client.0.smithi029.stdout:4/431: unlink d0/d3c/d52/d1b/d36/l41 0 2024-04-23T10:21:03.952 INFO:tasks.workunit.client.0.smithi029.stdout:7/442: mkdir d5/d8/d1a/d8a/d95 0 2024-04-23T10:21:03.954 INFO:tasks.workunit.client.0.smithi029.stdout:0/257: mknod d0/dc/d27/d3a/c56 0 2024-04-23T10:21:03.955 INFO:tasks.workunit.client.0.smithi029.stdout:0/258: chown d0/f51 103160991 1 2024-04-23T10:21:03.960 INFO:tasks.workunit.client.0.smithi029.stdout:2/417: dread d1/d3e/d5a/f6f [0,4194304] 0 2024-04-23T10:21:03.967 INFO:tasks.workunit.client.0.smithi029.stdout:0/259: rename d0/d1b/f2d to d0/dc/f57 0 2024-04-23T10:21:03.968 INFO:tasks.workunit.client.0.smithi029.stdout:5/459: write d0/d35/d10/d26/f45 [6606915,50268] 0 2024-04-23T10:21:03.975 INFO:tasks.workunit.client.0.smithi029.stdout:0/260: truncate d0/d1b/f37 4873588 0 2024-04-23T10:21:03.981 INFO:tasks.workunit.client.0.smithi029.stdout:7/443: mkdir d5/d8/d1a/d8a/d8b/d8d/d96 0 2024-04-23T10:21:03.982 INFO:tasks.workunit.client.0.smithi029.stdout:4/432: dwrite d0/d12/f5f [0,4194304] 0 2024-04-23T10:21:03.984 INFO:tasks.workunit.client.0.smithi029.stdout:0/261: dread - d0/f2f zero size 2024-04-23T10:21:03.984 INFO:tasks.workunit.client.0.smithi029.stdout:7/444: chown d5/d8/f32 9631730 1 2024-04-23T10:21:03.987 INFO:tasks.workunit.client.0.smithi029.stdout:4/433: read d0/d3c/d52/d1b/d5b/d65/f85 [3989948,35887] 0 2024-04-23T10:21:03.990 INFO:tasks.workunit.client.0.smithi029.stdout:5/460: rename d0/fe to d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/f9d 0 2024-04-23T10:21:03.993 INFO:tasks.workunit.client.0.smithi029.stdout:5/461: dread - d0/d35/d38/d39/f94 zero size 2024-04-23T10:21:03.998 INFO:tasks.workunit.client.0.smithi029.stdout:7/445: creat d5/d8/d1a/d4d/f97 x:0 0 0 2024-04-23T10:21:03.999 INFO:tasks.workunit.client.0.smithi029.stdout:2/418: link d1/dd/d60/c70 d1/d3e/c8e 0 2024-04-23T10:21:04.004 INFO:tasks.workunit.client.0.smithi029.stdout:4/434: creat d0/d3c/d52/d1b/d5b/d65/f99 x:0 0 0 2024-04-23T10:21:04.012 INFO:tasks.workunit.client.0.smithi029.stdout:5/462: creat d0/d2b/f9e x:0 0 0 2024-04-23T10:21:04.019 INFO:tasks.workunit.client.0.smithi029.stdout:7/446: symlink d5/d29/d4a/l98 0 2024-04-23T10:21:04.023 INFO:tasks.workunit.client.0.smithi029.stdout:7/447: chown d5/d8/f25 864369 1 2024-04-23T10:21:04.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/419: dwrite d1/f8c [0,4194304] 0 2024-04-23T10:21:04.027 INFO:tasks.workunit.client.0.smithi029.stdout:4/435: dread d0/d3c/d52/d1b/d36/d45/f58 [0,4194304] 0 2024-04-23T10:21:04.031 INFO:tasks.workunit.client.0.smithi029.stdout:5/463: mknod d0/d2b/c9f 0 2024-04-23T10:21:04.036 INFO:tasks.workunit.client.0.smithi029.stdout:5/464: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85 9223520 1 2024-04-23T10:21:04.043 INFO:tasks.workunit.client.0.smithi029.stdout:5/465: read d0/f40 [2335518,104131] 0 2024-04-23T10:21:04.044 INFO:tasks.workunit.client.0.smithi029.stdout:7/448: creat d5/d29/d4a/f99 x:0 0 0 2024-04-23T10:21:04.048 INFO:tasks.workunit.client.0.smithi029.stdout:6/520: sync 2024-04-23T10:21:04.054 INFO:tasks.workunit.client.0.smithi029.stdout:2/420: unlink d1/dd/l48 0 2024-04-23T10:21:04.056 INFO:tasks.workunit.client.0.smithi029.stdout:7/449: symlink d5/d8/d1a/d4d/l9a 0 2024-04-23T10:21:04.058 INFO:tasks.workunit.client.0.smithi029.stdout:7/450: read - d5/d8/d1a/d4d/f97 zero size 2024-04-23T10:21:04.060 INFO:tasks.workunit.client.0.smithi029.stdout:5/466: dread d0/d35/d38/d3e/f56 [0,4194304] 0 2024-04-23T10:21:04.066 INFO:tasks.workunit.client.0.smithi029.stdout:0/262: dread d0/dc/d27/d3a/f43 [0,4194304] 0 2024-04-23T10:21:04.067 INFO:tasks.workunit.client.0.smithi029.stdout:0/263: stat d0/c1f 0 2024-04-23T10:21:04.070 INFO:tasks.workunit.client.0.smithi029.stdout:7/451: dread d5/d29/f38 [0,4194304] 0 2024-04-23T10:21:04.074 INFO:tasks.workunit.client.0.smithi029.stdout:6/521: write f4 [1484252,8212] 0 2024-04-23T10:21:04.076 INFO:tasks.workunit.client.0.smithi029.stdout:6/522: write d9/df/d16/f2e [3289706,103982] 0 2024-04-23T10:21:04.078 INFO:tasks.workunit.client.0.smithi029.stdout:6/523: chown d9/df/d16/d44 2490908 1 2024-04-23T10:21:04.078 INFO:tasks.workunit.client.0.smithi029.stdout:5/467: link d0/d35/d38/d51/f44 d0/d35/d38/fa0 0 2024-04-23T10:21:04.081 INFO:tasks.workunit.client.0.smithi029.stdout:7/452: unlink d5/d8/d51/d55/l5e 0 2024-04-23T10:21:04.082 INFO:tasks.workunit.client.0.smithi029.stdout:7/453: chown d5/f2c 0 1 2024-04-23T10:21:04.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/264: creat d0/dc/d27/d55/f58 x:0 0 0 2024-04-23T10:21:04.087 INFO:tasks.workunit.client.0.smithi029.stdout:5/468: fsync d0/d35/d38/d3e/f70 0 2024-04-23T10:21:04.090 INFO:tasks.workunit.client.0.smithi029.stdout:6/524: creat d9/df/d16/d1f/d27/d33/da4/fb5 x:0 0 0 2024-04-23T10:21:04.094 INFO:tasks.workunit.client.0.smithi029.stdout:7/454: unlink d5/d8/d1a/d8a/f75 0 2024-04-23T10:21:04.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/421: link d1/d31/d3d/c81 d1/dd/d47/d63/d64/c8f 0 2024-04-23T10:21:04.098 INFO:tasks.workunit.client.0.smithi029.stdout:0/265: dwrite d0/f4a [0,4194304] 0 2024-04-23T10:21:04.098 INFO:tasks.workunit.client.0.smithi029.stdout:5/469: unlink d0/l5 0 2024-04-23T10:21:04.107 INFO:tasks.workunit.client.0.smithi029.stdout:6/525: rename d9/df/d16/d1f/d27/d33/da4/d58/d7e/l87 to d9/df/d16/d44/d4c/lb6 0 2024-04-23T10:21:04.111 INFO:tasks.workunit.client.0.smithi029.stdout:7/455: truncate d5/d8/d1a/d4d/f64 4515007 0 2024-04-23T10:21:04.116 INFO:tasks.workunit.client.0.smithi029.stdout:5/470: mkdir d0/d35/da1 0 2024-04-23T10:21:04.117 INFO:tasks.workunit.client.0.smithi029.stdout:1/351: sync 2024-04-23T10:21:04.117 INFO:tasks.workunit.client.0.smithi029.stdout:8/419: sync 2024-04-23T10:21:04.126 INFO:tasks.workunit.client.0.smithi029.stdout:2/422: creat d1/dd/d22/f90 x:0 0 0 2024-04-23T10:21:04.128 INFO:tasks.workunit.client.0.smithi029.stdout:1/352: fsync d5/d6/de/d22/f45 0 2024-04-23T10:21:04.129 INFO:tasks.workunit.client.0.smithi029.stdout:2/423: readlink d1/d3e/l67 0 2024-04-23T10:21:04.131 INFO:tasks.workunit.client.0.smithi029.stdout:0/266: dwrite d0/dc/d26/f41 [0,4194304] 0 2024-04-23T10:21:04.134 INFO:tasks.workunit.client.0.smithi029.stdout:6/526: dwrite f4 [4194304,4194304] 0 2024-04-23T10:21:04.134 INFO:tasks.workunit.client.0.smithi029.stdout:2/424: chown d1/d31/d3d/c4f 602 1 2024-04-23T10:21:04.136 INFO:tasks.workunit.client.0.smithi029.stdout:0/267: dread d0/d21/f38 [0,4194304] 0 2024-04-23T10:21:04.136 INFO:tasks.workunit.client.0.smithi029.stdout:3/406: dread d3/d45/f7b [0,4194304] 0 2024-04-23T10:21:04.138 INFO:tasks.workunit.client.0.smithi029.stdout:3/407: write d3/d10/f79 [70211,19717] 0 2024-04-23T10:21:04.141 INFO:tasks.workunit.client.0.smithi029.stdout:1/353: mkdir d5/d6/de/d22/d77 0 2024-04-23T10:21:04.143 INFO:tasks.workunit.client.0.smithi029.stdout:6/527: mknod d9/d5b/cb7 0 2024-04-23T10:21:04.144 INFO:tasks.workunit.client.0.smithi029.stdout:0/268: symlink d0/d3e/l59 0 2024-04-23T10:21:04.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/269: mknod d0/d3e/c5a 0 2024-04-23T10:21:04.153 INFO:tasks.workunit.client.0.smithi029.stdout:8/420: getdents d3/d50 0 2024-04-23T10:21:04.155 INFO:tasks.workunit.client.0.smithi029.stdout:6/528: symlink d9/df/d16/d1f/d27/d33/lb8 0 2024-04-23T10:21:04.157 INFO:tasks.workunit.client.0.smithi029.stdout:3/408: dwrite d3/d15/f21 [4194304,4194304] 0 2024-04-23T10:21:04.160 INFO:tasks.workunit.client.0.smithi029.stdout:5/471: dwrite d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/f88 [0,4194304] 0 2024-04-23T10:21:04.160 INFO:tasks.workunit.client.0.smithi029.stdout:3/409: write d3/d10/de/d2e/d36/f82 [761322,101412] 0 2024-04-23T10:21:04.160 INFO:tasks.workunit.client.0.smithi029.stdout:1/354: rename d5/d6/de/d22/c60 to d5/d6/de/d22/d6c/c78 0 2024-04-23T10:21:04.161 INFO:tasks.workunit.client.0.smithi029.stdout:0/270: unlink d0/d21/c22 0 2024-04-23T10:21:04.165 INFO:tasks.workunit.client.0.smithi029.stdout:3/410: dread - d3/d10/de/d2e/d36/d40/d46/f83 zero size 2024-04-23T10:21:04.166 INFO:tasks.workunit.client.0.smithi029.stdout:3/411: chown d3/d10/de/d2e/c85 3154 1 2024-04-23T10:21:04.166 INFO:tasks.workunit.client.0.smithi029.stdout:8/421: rename d3/d2f/d36/f59 to d3/d2f/f7e 0 2024-04-23T10:21:04.167 INFO:tasks.workunit.client.0.smithi029.stdout:3/412: chown d3/d10/d48 28 1 2024-04-23T10:21:04.168 INFO:tasks.workunit.client.0.smithi029.stdout:0/271: fdatasync d0/d21/f53 0 2024-04-23T10:21:04.175 INFO:tasks.workunit.client.0.smithi029.stdout:0/272: creat d0/d3e/d4e/f5b x:0 0 0 2024-04-23T10:21:04.185 INFO:tasks.workunit.client.0.smithi029.stdout:3/413: creat d3/d45/d4f/d6b/f93 x:0 0 0 2024-04-23T10:21:04.187 INFO:tasks.workunit.client.0.smithi029.stdout:0/273: mkdir d0/dc/d26/d44/d5c 0 2024-04-23T10:21:04.189 INFO:tasks.workunit.client.0.smithi029.stdout:1/355: getdents d5/d6/de/d27/d38 0 2024-04-23T10:21:04.191 INFO:tasks.workunit.client.0.smithi029.stdout:0/274: creat d0/d1b/f5d x:0 0 0 2024-04-23T10:21:04.193 INFO:tasks.workunit.client.0.smithi029.stdout:3/414: mknod d3/d10/de/d2e/d36/d40/d46/d72/d5e/c94 0 2024-04-23T10:21:04.194 INFO:tasks.workunit.client.0.smithi029.stdout:1/356: creat d5/d6/de/d27/d38/d47/f79 x:0 0 0 2024-04-23T10:21:04.196 INFO:tasks.workunit.client.0.smithi029.stdout:0/275: write d0/f6 [1876866,97003] 0 2024-04-23T10:21:04.200 INFO:tasks.workunit.client.0.smithi029.stdout:8/422: dread d3/d2f/f39 [0,4194304] 0 2024-04-23T10:21:04.202 INFO:tasks.workunit.client.0.smithi029.stdout:8/423: fdatasync d3/d50/d6a/f70 0 2024-04-23T10:21:04.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/415: rename d3/d15/d4b/f71 to d3/d10/de/d2e/d36/d8a/f95 0 2024-04-23T10:21:04.204 INFO:tasks.workunit.client.0.smithi029.stdout:0/276: rename d0/dc/d27/l40 to d0/d3e/d4e/d50/l5e 0 2024-04-23T10:21:04.209 INFO:tasks.workunit.client.0.smithi029.stdout:3/416: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d31/d96 0 2024-04-23T10:21:04.210 INFO:tasks.workunit.client.0.smithi029.stdout:1/357: dread d5/d6/de/d22/f45 [0,4194304] 0 2024-04-23T10:21:04.211 INFO:tasks.workunit.client.0.smithi029.stdout:6/529: dread d9/df/d16/d34/d36/f6e [0,4194304] 0 2024-04-23T10:21:04.211 INFO:tasks.workunit.client.0.smithi029.stdout:0/277: rename d0/d3e/d4e/f5b to d0/dc/d26/f5f 0 2024-04-23T10:21:04.212 INFO:tasks.workunit.client.0.smithi029.stdout:1/358: chown d5/d6/de/f33 91929020 1 2024-04-23T10:21:04.213 INFO:tasks.workunit.client.0.smithi029.stdout:0/278: read - d0/f51 zero size 2024-04-23T10:21:04.214 INFO:tasks.workunit.client.0.smithi029.stdout:8/424: dwrite d3/d50/f64 [0,4194304] 0 2024-04-23T10:21:04.217 INFO:tasks.workunit.client.0.smithi029.stdout:6/530: mknod d9/df/d16/d44/d75/d90/cb9 0 2024-04-23T10:21:04.218 INFO:tasks.workunit.client.0.smithi029.stdout:0/279: symlink d0/dc/l60 0 2024-04-23T10:21:04.218 INFO:tasks.workunit.client.0.smithi029.stdout:4/436: read d0/f17 [2354216,68457] 0 2024-04-23T10:21:04.219 INFO:tasks.workunit.client.0.smithi029.stdout:8/425: rename d3/d2f/d36/d3e/l57 to d3/d2f/l7f 0 2024-04-23T10:21:04.220 INFO:tasks.workunit.client.0.smithi029.stdout:4/437: chown d0/fe 1 1 2024-04-23T10:21:04.220 INFO:tasks.workunit.client.0.smithi029.stdout:5/472: dread d0/d35/f1c [0,4194304] 0 2024-04-23T10:21:04.221 INFO:tasks.workunit.client.0.smithi029.stdout:0/280: dread - d0/dc/d26/f5f zero size 2024-04-23T10:21:04.223 INFO:tasks.workunit.client.0.smithi029.stdout:8/426: unlink d3/d38/c7c 0 2024-04-23T10:21:04.226 INFO:tasks.workunit.client.0.smithi029.stdout:0/281: rmdir d0/d3e/d4e/d50 39 2024-04-23T10:21:04.228 INFO:tasks.workunit.client.0.smithi029.stdout:5/473: fdatasync d0/d35/d38/d3e/d66/d5a/d78/d3d/f5d 0 2024-04-23T10:21:04.230 INFO:tasks.workunit.client.0.smithi029.stdout:8/427: chown d3/d2f/d36/d68/f6d 27405 1 2024-04-23T10:21:04.233 INFO:tasks.workunit.client.0.smithi029.stdout:8/428: readlink d3/l4b 0 2024-04-23T10:21:04.235 INFO:tasks.workunit.client.0.smithi029.stdout:0/282: dread d0/dc/d26/f28 [0,4194304] 0 2024-04-23T10:21:04.236 INFO:tasks.workunit.client.0.smithi029.stdout:8/429: unlink d3/f14 0 2024-04-23T10:21:04.237 INFO:tasks.workunit.client.0.smithi029.stdout:5/474: rename d0/d35/l1e to d0/la2 0 2024-04-23T10:21:04.238 INFO:tasks.workunit.client.0.smithi029.stdout:1/359: dread d5/d6/de/d22/f23 [0,4194304] 0 2024-04-23T10:21:04.239 INFO:tasks.workunit.client.0.smithi029.stdout:6/531: dwrite d9/df/d16/d44/d75/d90/fa1 [0,4194304] 0 2024-04-23T10:21:04.239 INFO:tasks.workunit.client.0.smithi029.stdout:8/430: mknod d3/d2f/d36/d3e/c80 0 2024-04-23T10:21:04.241 INFO:tasks.workunit.client.0.smithi029.stdout:8/431: fdatasync d3/d38/f5c 0 2024-04-23T10:21:04.241 INFO:tasks.workunit.client.0.smithi029.stdout:1/360: creat d5/d6/de/d22/f7a x:0 0 0 2024-04-23T10:21:04.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/361: chown d5/d6/de/d27/d38/f73 1 1 2024-04-23T10:21:04.243 INFO:tasks.workunit.client.0.smithi029.stdout:5/475: rename d0/l4c to d0/d35/d38/d3e/d66/d5a/la3 0 2024-04-23T10:21:04.243 INFO:tasks.workunit.client.0.smithi029.stdout:6/532: rmdir d9/df/d16/d34 39 2024-04-23T10:21:04.243 INFO:tasks.workunit.client.0.smithi029.stdout:7/456: read d5/f30 [874952,102880] 0 2024-04-23T10:21:04.244 INFO:tasks.workunit.client.0.smithi029.stdout:6/533: fdatasync d9/df/d41/f83 0 2024-04-23T10:21:04.245 INFO:tasks.workunit.client.0.smithi029.stdout:7/457: fdatasync d5/d8/d1a/f76 0 2024-04-23T10:21:04.247 INFO:tasks.workunit.client.0.smithi029.stdout:5/476: symlink d0/d35/d38/d3e/d66/d5a/la4 0 2024-04-23T10:21:04.248 INFO:tasks.workunit.client.0.smithi029.stdout:5/477: stat d0/d35/d38/d3e/f79 0 2024-04-23T10:21:04.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/458: dread - d5/d8/d51/f53 zero size 2024-04-23T10:21:04.250 INFO:tasks.workunit.client.0.smithi029.stdout:7/459: readlink d5/d8/d51/d55/d59/l6d 0 2024-04-23T10:21:04.250 INFO:tasks.workunit.client.0.smithi029.stdout:6/534: unlink d9/df/d16/d1f/d27/d33/da4/ca5 0 2024-04-23T10:21:04.252 INFO:tasks.workunit.client.0.smithi029.stdout:0/283: truncate d0/dc/d27/f30 86147 0 2024-04-23T10:21:04.253 INFO:tasks.workunit.client.0.smithi029.stdout:1/362: dwrite d5/d6/f16 [0,4194304] 0 2024-04-23T10:21:04.253 INFO:tasks.workunit.client.0.smithi029.stdout:7/460: chown d5/d8/d51/l6e 873 1 2024-04-23T10:21:04.255 INFO:tasks.workunit.client.0.smithi029.stdout:5/478: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/fa5 x:0 0 0 2024-04-23T10:21:04.256 INFO:tasks.workunit.client.0.smithi029.stdout:1/363: mkdir d5/d6/de/d15/d7b 0 2024-04-23T10:21:04.258 INFO:tasks.workunit.client.0.smithi029.stdout:7/461: truncate d5/d29/d4a/f8f 535145 0 2024-04-23T10:21:04.262 INFO:tasks.workunit.client.0.smithi029.stdout:0/284: link d0/f1 d0/dc/d26/d44/f61 0 2024-04-23T10:21:04.270 INFO:tasks.workunit.client.0.smithi029.stdout:6/535: rename d9/df/d16/d1f/d27/d33/l17 to d9/df/d16/d1f/d27/d33/da4/d58/d7e/lba 0 2024-04-23T10:21:04.272 INFO:tasks.workunit.client.0.smithi029.stdout:6/536: stat d9/df/d16/d1f/d27/l3c 0 2024-04-23T10:21:04.274 INFO:tasks.workunit.client.0.smithi029.stdout:0/285: rename d0/dc/d27 to d0/d1b/d62 0 2024-04-23T10:21:04.275 INFO:tasks.workunit.client.0.smithi029.stdout:6/537: rmdir d9/df/d16/d44 39 2024-04-23T10:21:04.276 INFO:tasks.workunit.client.0.smithi029.stdout:9/568: dread d0/d1b/d24/f6e [0,4194304] 0 2024-04-23T10:21:04.277 INFO:tasks.workunit.client.0.smithi029.stdout:5/479: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/f58 [0,4194304] 0 2024-04-23T10:21:04.278 INFO:tasks.workunit.client.0.smithi029.stdout:0/286: rename d0/d3e/l59 to d0/dc/d26/d44/d5c/l63 0 2024-04-23T10:21:04.279 INFO:tasks.workunit.client.0.smithi029.stdout:7/462: write d5/d8/d51/f53 [759620,97621] 0 2024-04-23T10:21:04.283 INFO:tasks.workunit.client.0.smithi029.stdout:6/538: mkdir d9/df/d16/d44/d4c/dbb 0 2024-04-23T10:21:04.286 INFO:tasks.workunit.client.0.smithi029.stdout:0/287: rename d0/f51 to d0/d1b/d62/f64 0 2024-04-23T10:21:04.287 INFO:tasks.workunit.client.0.smithi029.stdout:5/480: getdents d0/d35/d38/d39/d3f 0 2024-04-23T10:21:04.289 INFO:tasks.workunit.client.0.smithi029.stdout:0/288: fdatasync d0/dc/d26/f28 0 2024-04-23T10:21:04.289 INFO:tasks.workunit.client.0.smithi029.stdout:1/364: dwrite d5/d6/de/d22/f25 [0,4194304] 0 2024-04-23T10:21:04.290 INFO:tasks.workunit.client.0.smithi029.stdout:6/539: mknod d9/df/d16/cbc 0 2024-04-23T10:21:04.292 INFO:tasks.workunit.client.0.smithi029.stdout:0/289: symlink d0/d1b/d62/d3a/l65 0 2024-04-23T10:21:04.292 INFO:tasks.workunit.client.0.smithi029.stdout:6/540: write d9/df/d16/d1f/d27/d33/da4/d58/fab [257375,109013] 0 2024-04-23T10:21:04.293 INFO:tasks.workunit.client.0.smithi029.stdout:5/481: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/fa6 x:0 0 0 2024-04-23T10:21:04.295 INFO:tasks.workunit.client.0.smithi029.stdout:7/463: link d5/d8/fb d5/d8/d1a/d8a/f9b 0 2024-04-23T10:21:04.295 INFO:tasks.workunit.client.0.smithi029.stdout:9/569: truncate d0/d1b/d39/d50/d5a/f8b 3763651 0 2024-04-23T10:21:04.296 INFO:tasks.workunit.client.0.smithi029.stdout:5/482: mknod d0/d35/d49/ca7 0 2024-04-23T10:21:04.297 INFO:tasks.workunit.client.0.smithi029.stdout:7/464: chown d5/f1f 2 1 2024-04-23T10:21:04.301 INFO:tasks.workunit.client.0.smithi029.stdout:1/365: creat d5/d6/f7c x:0 0 0 2024-04-23T10:21:04.301 INFO:tasks.workunit.client.0.smithi029.stdout:7/465: truncate d5/f30 1516692 0 2024-04-23T10:21:04.303 INFO:tasks.workunit.client.0.smithi029.stdout:1/366: fsync d5/d3e/f4b 0 2024-04-23T10:21:04.307 INFO:tasks.workunit.client.0.smithi029.stdout:6/541: getdents d9/df/d16 0 2024-04-23T10:21:04.308 INFO:tasks.workunit.client.0.smithi029.stdout:1/367: rmdir d5/d6/de/d15 39 2024-04-23T10:21:04.309 INFO:tasks.workunit.client.0.smithi029.stdout:9/570: link d0/d1b/d60/l7b d0/d1b/d24/lc3 0 2024-04-23T10:21:04.310 INFO:tasks.workunit.client.0.smithi029.stdout:1/368: dread d5/d6/de/d22/f51 [0,4194304] 0 2024-04-23T10:21:04.311 INFO:tasks.workunit.client.0.smithi029.stdout:6/542: mkdir d9/df/d16/d1f/d27/dad/dbd 0 2024-04-23T10:21:04.313 INFO:tasks.workunit.client.0.smithi029.stdout:6/543: chown d9/df/d16/d34/f91 778631939 1 2024-04-23T10:21:04.314 INFO:tasks.workunit.client.0.smithi029.stdout:5/483: truncate d0/d6a/f7f 1460829 0 2024-04-23T10:21:04.315 INFO:tasks.workunit.client.0.smithi029.stdout:9/571: rename d0/d1b/c33 to d0/d1b/d39/d50/d67/cc4 0 2024-04-23T10:21:04.316 INFO:tasks.workunit.client.0.smithi029.stdout:6/544: unlink d9/df/f3d 0 2024-04-23T10:21:04.316 INFO:tasks.workunit.client.0.smithi029.stdout:4/438: read d0/d12/f69 [820686,45694] 0 2024-04-23T10:21:04.316 INFO:tasks.workunit.client.0.smithi029.stdout:7/466: write d5/d8/d1a/d4d/f94 [808130,24280] 0 2024-04-23T10:21:04.319 INFO:tasks.workunit.client.0.smithi029.stdout:1/369: rename d5/d6/f6e to d5/d6/d34/d63/f7d 0 2024-04-23T10:21:04.321 INFO:tasks.workunit.client.0.smithi029.stdout:6/545: fdatasync d9/df/d16/d1f/fae 0 2024-04-23T10:21:04.322 INFO:tasks.workunit.client.0.smithi029.stdout:5/484: dread d0/d35/d49/f67 [4194304,4194304] 0 2024-04-23T10:21:04.325 INFO:tasks.workunit.client.0.smithi029.stdout:7/467: rename d5/d71/d85 to d5/d8/d1a/d9c 0 2024-04-23T10:21:04.326 INFO:tasks.workunit.client.0.smithi029.stdout:6/546: read d9/f82 [3575642,91668] 0 2024-04-23T10:21:04.326 INFO:tasks.workunit.client.0.smithi029.stdout:1/370: getdents d5/d3e 0 2024-04-23T10:21:04.328 INFO:tasks.workunit.client.0.smithi029.stdout:5/485: creat d0/d9a/fa8 x:0 0 0 2024-04-23T10:21:04.330 INFO:tasks.workunit.client.0.smithi029.stdout:9/572: dwrite d0/d1b/d39/d50/fb4 [0,4194304] 0 2024-04-23T10:21:04.330 INFO:tasks.workunit.client.0.smithi029.stdout:6/547: readlink d9/df/d16/l1d 0 2024-04-23T10:21:04.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/468: read d5/d8/d1a/f21 [3146651,91837] 0 2024-04-23T10:21:04.332 INFO:tasks.workunit.client.0.smithi029.stdout:4/439: dwrite d0/d12/f2b [0,4194304] 0 2024-04-23T10:21:04.332 INFO:tasks.workunit.client.0.smithi029.stdout:1/371: truncate d5/d6/de/d22/f76 467424 0 2024-04-23T10:21:04.334 INFO:tasks.workunit.client.0.smithi029.stdout:5/486: rename d0/f19 to d0/d35/d38/d51/fa9 0 2024-04-23T10:21:04.334 INFO:tasks.workunit.client.0.smithi029.stdout:4/440: chown d0/d12/f49 52354373 1 2024-04-23T10:21:04.335 INFO:tasks.workunit.client.0.smithi029.stdout:6/548: symlink d9/df/d16/d44/d75/lbe 0 2024-04-23T10:21:04.337 INFO:tasks.workunit.client.0.smithi029.stdout:1/372: chown d5/d6/de/d15/f26 9698 1 2024-04-23T10:21:04.338 INFO:tasks.workunit.client.0.smithi029.stdout:9/573: truncate d0/d1b/f31 2014559 0 2024-04-23T10:21:04.347 INFO:tasks.workunit.client.0.smithi029.stdout:7/469: getdents d5/d8/d51/d55/d59 0 2024-04-23T10:21:04.349 INFO:tasks.workunit.client.0.smithi029.stdout:1/373: mknod d5/d6/de/d22/d77/c7e 0 2024-04-23T10:21:04.351 INFO:tasks.workunit.client.0.smithi029.stdout:9/574: rename d0/d7/d1d/f1f to d0/d7/d1d/d35/da9/fc5 0 2024-04-23T10:21:04.354 INFO:tasks.workunit.client.0.smithi029.stdout:5/487: dwrite d0/d35/d38/d39/d3f/f7d [0,4194304] 0 2024-04-23T10:21:04.355 INFO:tasks.workunit.client.0.smithi029.stdout:4/441: dwrite d0/d3c/d52/d1b/f2e [4194304,4194304] 0 2024-04-23T10:21:04.357 INFO:tasks.workunit.client.0.smithi029.stdout:6/549: write d9/df/d16/d34/d36/d63/f68 [759412,84514] 0 2024-04-23T10:21:04.357 INFO:tasks.workunit.client.0.smithi029.stdout:1/374: dread d5/d6/de/d22/f45 [0,4194304] 0 2024-04-23T10:21:04.358 INFO:tasks.workunit.client.0.smithi029.stdout:5/488: creat d0/d9a/faa x:0 0 0 2024-04-23T10:21:04.359 INFO:tasks.workunit.client.0.smithi029.stdout:9/575: write d0/d7/d1d/d35/d3b/d68/f8f [780235,49496] 0 2024-04-23T10:21:04.363 INFO:tasks.workunit.client.0.smithi029.stdout:5/489: chown d0/d35 28 1 2024-04-23T10:21:04.363 INFO:tasks.workunit.client.0.smithi029.stdout:4/442: truncate d0/d3c/d52/f90 856140 0 2024-04-23T10:21:04.366 INFO:tasks.workunit.client.0.smithi029.stdout:4/443: write d0/d3c/d52/f14 [2505639,119361] 0 2024-04-23T10:21:04.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/375: unlink d5/d6/de/d22/f25 0 2024-04-23T10:21:04.370 INFO:tasks.workunit.client.0.smithi029.stdout:6/550: dread d9/df/d16/d1f/d27/d33/da4/d58/f5a [0,4194304] 0 2024-04-23T10:21:04.371 INFO:tasks.workunit.client.0.smithi029.stdout:5/490: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dab 0 2024-04-23T10:21:04.371 INFO:tasks.workunit.client.0.smithi029.stdout:1/376: rmdir d5/d6 39 2024-04-23T10:21:04.372 INFO:tasks.workunit.client.0.smithi029.stdout:6/551: dread - d9/f64 zero size 2024-04-23T10:21:04.372 INFO:tasks.workunit.client.0.smithi029.stdout:5/491: fsync d0/d35/d38/d3e/f79 0 2024-04-23T10:21:04.375 INFO:tasks.workunit.client.0.smithi029.stdout:1/377: chown d5/d6/de/d27/d38/f73 76 1 2024-04-23T10:21:04.381 INFO:tasks.workunit.client.0.smithi029.stdout:5/492: truncate d0/d35/d38/d3e/d66/d5a/d78/f98 205518 0 2024-04-23T10:21:04.381 INFO:tasks.workunit.client.0.smithi029.stdout:1/378: write d5/d6/de/d27/d38/d47/f79 [657642,76184] 0 2024-04-23T10:21:04.383 INFO:tasks.workunit.client.0.smithi029.stdout:4/444: dread d0/d3c/d52/f42 [0,4194304] 0 2024-04-23T10:21:04.385 INFO:tasks.workunit.client.0.smithi029.stdout:1/379: rmdir d5/d6/de 39 2024-04-23T10:21:04.386 INFO:tasks.workunit.client.0.smithi029.stdout:2/425: sync 2024-04-23T10:21:04.387 INFO:tasks.workunit.client.0.smithi029.stdout:5/493: write d0/d35/d38/d3e/d66/d5a/d78/f98 [876059,74874] 0 2024-04-23T10:21:04.388 INFO:tasks.workunit.client.0.smithi029.stdout:6/552: dwrite d9/df/d16/d1f/d27/d33/da4/d58/f5a [0,4194304] 0 2024-04-23T10:21:04.389 INFO:tasks.workunit.client.0.smithi029.stdout:4/445: mknod d0/d3c/d52/d1b/d5b/d65/c9a 0 2024-04-23T10:21:04.390 INFO:tasks.workunit.client.0.smithi029.stdout:6/553: chown d9/df/d16 2 1 2024-04-23T10:21:04.392 INFO:tasks.workunit.client.0.smithi029.stdout:1/380: chown d5/d6/de/d15/f1a 1811310182 1 2024-04-23T10:21:04.394 INFO:tasks.workunit.client.0.smithi029.stdout:4/446: symlink d0/d5a/d6e/d7a/d89/l9b 0 2024-04-23T10:21:04.395 INFO:tasks.workunit.client.0.smithi029.stdout:2/426: mknod d1/dd/d22/c91 0 2024-04-23T10:21:04.396 INFO:tasks.workunit.client.0.smithi029.stdout:9/576: dread d0/d7/d1d/f20 [4194304,4194304] 0 2024-04-23T10:21:04.397 INFO:tasks.workunit.client.0.smithi029.stdout:1/381: unlink d5/d6/de/l4f 0 2024-04-23T10:21:04.405 INFO:tasks.workunit.client.0.smithi029.stdout:1/382: dwrite d5/d6/f61 [0,4194304] 0 2024-04-23T10:21:04.406 INFO:tasks.workunit.client.0.smithi029.stdout:1/383: stat d5/d6/de/d15/d7b 0 2024-04-23T10:21:04.407 INFO:tasks.workunit.client.0.smithi029.stdout:1/384: chown d5/d6/de/f33 537370853 1 2024-04-23T10:21:04.408 INFO:tasks.workunit.client.0.smithi029.stdout:5/494: rename d0/d35/d38/d3e/d66/d5a/la3 to d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/lac 0 2024-04-23T10:21:04.408 INFO:tasks.workunit.client.0.smithi029.stdout:6/554: fdatasync d9/df/d16/d1f/d27/d33/da4/d58/f5a 0 2024-04-23T10:21:04.411 INFO:tasks.workunit.client.0.smithi029.stdout:9/577: link d0/d1b/d39/d50/d5a/fa6 d0/d7/d6/d66/dba/fc6 0 2024-04-23T10:21:04.414 INFO:tasks.workunit.client.0.smithi029.stdout:1/385: rename d5/d3e/f41 to d5/d6/f7f 0 2024-04-23T10:21:04.415 INFO:tasks.workunit.client.0.smithi029.stdout:4/447: dread d0/d12/f49 [0,4194304] 0 2024-04-23T10:21:04.417 INFO:tasks.workunit.client.0.smithi029.stdout:4/448: chown d0/d3c/d52/d1b/d36/d45 143075 1 2024-04-23T10:21:04.418 INFO:tasks.workunit.client.0.smithi029.stdout:2/427: dread d1/d3e/f38 [0,4194304] 0 2024-04-23T10:21:04.418 INFO:tasks.workunit.client.0.smithi029.stdout:6/555: rename d9/f64 to d9/df/d16/daf/fbf 0 2024-04-23T10:21:04.419 INFO:tasks.workunit.client.0.smithi029.stdout:1/386: rmdir d5/d6/d34/d63 39 2024-04-23T10:21:04.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/495: rename d0/d35/d38 to d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dad 22 2024-04-23T10:21:04.421 INFO:tasks.workunit.client.0.smithi029.stdout:4/449: mknod d0/d3c/d52/d1b/d5b/d65/d6a/c9c 0 2024-04-23T10:21:04.423 INFO:tasks.workunit.client.0.smithi029.stdout:1/387: chown d5/d6/de/d22/d6c/l6d 0 1 2024-04-23T10:21:04.423 INFO:tasks.workunit.client.0.smithi029.stdout:5/496: stat d0/d35/d38/d3e/d66/d5a/la4 0 2024-04-23T10:21:04.424 INFO:tasks.workunit.client.0.smithi029.stdout:9/578: rename d0/d1b/d24/f61 to d0/d1b/d39/d50/d67/fc7 0 2024-04-23T10:21:04.425 INFO:tasks.workunit.client.0.smithi029.stdout:1/388: read d5/d6/ff [2943563,29626] 0 2024-04-23T10:21:04.426 INFO:tasks.workunit.client.0.smithi029.stdout:9/579: chown d0/d1b/d39/f97 393691 1 2024-04-23T10:21:04.427 INFO:tasks.workunit.client.0.smithi029.stdout:1/389: rmdir d5/d6/de/d27/d38 39 2024-04-23T10:21:04.429 INFO:tasks.workunit.client.0.smithi029.stdout:9/580: chown d0/d1b/d39/d50/d67/fc7 1 1 2024-04-23T10:21:04.429 INFO:tasks.workunit.client.0.smithi029.stdout:1/390: chown d5/d3e/f54 1040938 1 2024-04-23T10:21:04.431 INFO:tasks.workunit.client.0.smithi029.stdout:6/556: dwrite d9/df/d16/d44/f62 [0,4194304] 0 2024-04-23T10:21:04.431 INFO:tasks.workunit.client.0.smithi029.stdout:9/581: write d0/f21 [4892796,54721] 0 2024-04-23T10:21:04.434 INFO:tasks.workunit.client.0.smithi029.stdout:1/391: creat d5/d6/de/d22/f80 x:0 0 0 2024-04-23T10:21:04.436 INFO:tasks.workunit.client.0.smithi029.stdout:1/392: chown d5/d6/de/d27/f35 8 1 2024-04-23T10:21:04.443 INFO:tasks.workunit.client.0.smithi029.stdout:2/428: dread d1/d3e/f66 [0,4194304] 0 2024-04-23T10:21:04.451 INFO:tasks.workunit.client.0.smithi029.stdout:1/393: dwrite d5/d6/de/d15/f3b [0,4194304] 0 2024-04-23T10:21:04.452 INFO:tasks.workunit.client.0.smithi029.stdout:9/582: dread d0/d1b/d44/d49/f64 [0,4194304] 0 2024-04-23T10:21:04.453 INFO:tasks.workunit.client.0.smithi029.stdout:2/429: dwrite d1/d3e/d3b/d75/f7a [0,4194304] 0 2024-04-23T10:21:04.455 INFO:tasks.workunit.client.0.smithi029.stdout:1/394: dread d5/f58 [0,4194304] 0 2024-04-23T10:21:04.455 INFO:tasks.workunit.client.0.smithi029.stdout:2/430: mkdir d1/d3e/d3b/d92 0 2024-04-23T10:21:04.456 INFO:tasks.workunit.client.0.smithi029.stdout:1/395: readlink d5/d6/de/d27/l42 0 2024-04-23T10:21:04.457 INFO:tasks.workunit.client.0.smithi029.stdout:9/583: mknod d0/d7/d1d/d35/d3b/db8/cc8 0 2024-04-23T10:21:04.457 INFO:tasks.workunit.client.0.smithi029.stdout:1/396: chown d5/d6/de/l43 248173 1 2024-04-23T10:21:04.458 INFO:tasks.workunit.client.0.smithi029.stdout:1/397: chown d5/c1d 115470832 1 2024-04-23T10:21:04.460 INFO:tasks.workunit.client.0.smithi029.stdout:2/431: link d1/dd/d47/d63/d64/f80 d1/d3e/d5a/f93 0 2024-04-23T10:21:04.469 INFO:tasks.workunit.client.0.smithi029.stdout:1/398: dwrite d5/d6/f40 [0,4194304] 0 2024-04-23T10:21:04.470 INFO:tasks.workunit.client.0.smithi029.stdout:9/584: dwrite d0/d1b/d39/d50/d67/fc7 [0,4194304] 0 2024-04-23T10:21:04.473 INFO:tasks.workunit.client.0.smithi029.stdout:2/432: rename d1/d31/d50/f76 to d1/dd/d47/d63/d64/d78/f94 0 2024-04-23T10:21:04.478 INFO:tasks.workunit.client.0.smithi029.stdout:9/585: link d0/d7/d3f/f96 d0/d7/d3f/dbb/fc9 0 2024-04-23T10:21:04.481 INFO:tasks.workunit.client.0.smithi029.stdout:1/399: dwrite d5/d6/de/d22/f59 [0,4194304] 0 2024-04-23T10:21:04.482 INFO:tasks.workunit.client.0.smithi029.stdout:2/433: link d1/dd/l17 d1/dd/d47/d63/l95 0 2024-04-23T10:21:04.483 INFO:tasks.workunit.client.0.smithi029.stdout:2/434: fdatasync d1/dd/d47/d63/d64/f6b 0 2024-04-23T10:21:04.484 INFO:tasks.workunit.client.0.smithi029.stdout:9/586: creat d0/d1b/d60/dbf/fca x:0 0 0 2024-04-23T10:21:04.486 INFO:tasks.workunit.client.0.smithi029.stdout:2/435: chown d1/d3e/c8e 276385526 1 2024-04-23T10:21:04.493 INFO:tasks.workunit.client.0.smithi029.stdout:2/436: link d1/dd/d47/d63/d64/f6b d1/d3e/d3b/f96 0 2024-04-23T10:21:04.494 INFO:tasks.workunit.client.0.smithi029.stdout:1/400: dwrite d5/f58 [0,4194304] 0 2024-04-23T10:21:04.494 INFO:tasks.workunit.client.0.smithi029.stdout:9/587: dread d0/d1b/d39/d50/f6a [0,4194304] 0 2024-04-23T10:21:04.498 INFO:tasks.workunit.client.0.smithi029.stdout:9/588: creat d0/d7/d1d/d35/da9/fcb x:0 0 0 2024-04-23T10:21:04.499 INFO:tasks.workunit.client.0.smithi029.stdout:9/589: dread - d0/d7/d1d/f74 zero size 2024-04-23T10:21:04.503 INFO:tasks.workunit.client.0.smithi029.stdout:9/590: truncate d0/d7/d1d/d35/d3b/f88 69628 0 2024-04-23T10:21:04.506 INFO:tasks.workunit.client.0.smithi029.stdout:9/591: rename d0/d1b/d24/c29 to d0/d7/d1d/d35/d3b/d68/ccc 0 2024-04-23T10:21:04.510 INFO:tasks.workunit.client.0.smithi029.stdout:9/592: getdents d0/d1b/d60 0 2024-04-23T10:21:04.511 INFO:tasks.workunit.client.0.smithi029.stdout:9/593: symlink d0/d7/d1d/d35/d3b/d68/lcd 0 2024-04-23T10:21:04.512 INFO:tasks.workunit.client.0.smithi029.stdout:9/594: chown d0/d7/d3f/dbb 1218195481 1 2024-04-23T10:21:04.514 INFO:tasks.workunit.client.0.smithi029.stdout:9/595: creat d0/d1b/d39/d50/d5a/fce x:0 0 0 2024-04-23T10:21:04.515 INFO:tasks.workunit.client.0.smithi029.stdout:9/596: stat d0/d7/d6/cb5 0 2024-04-23T10:21:04.516 INFO:tasks.workunit.client.0.smithi029.stdout:9/597: mknod d0/d1b/d44/d49/d65/ccf 0 2024-04-23T10:21:04.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/598: mkdir d0/d7/d1d/d35/da9/dd0 0 2024-04-23T10:21:04.519 INFO:tasks.workunit.client.0.smithi029.stdout:9/599: stat d0/d1b/d24/lc3 0 2024-04-23T10:21:04.519 INFO:tasks.workunit.client.0.smithi029.stdout:9/600: readlink d0/d1b/l4e 0 2024-04-23T10:21:04.522 INFO:tasks.workunit.client.0.smithi029.stdout:9/601: rename d0/d1b/d24/f89 to d0/d1b/d39/d50/d67/db6/fd1 0 2024-04-23T10:21:04.523 INFO:tasks.workunit.client.0.smithi029.stdout:9/602: dread - d0/d7/d3f/f82 zero size 2024-04-23T10:21:04.750 INFO:tasks.workunit.client.0.smithi029.stdout:3/417: sync 2024-04-23T10:21:04.753 INFO:tasks.workunit.client.0.smithi029.stdout:3/418: truncate d3/d10/de/d2e/f42 1099072 0 2024-04-23T10:21:04.790 INFO:tasks.workunit.client.0.smithi029.stdout:3/419: truncate d3/d10/de/f12 3961253 0 2024-04-23T10:21:04.799 INFO:tasks.workunit.client.0.smithi029.stdout:3/420: rename d3/d10/de/d2e/d36/c35 to d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/c97 0 2024-04-23T10:21:04.870 INFO:tasks.workunit.client.0.smithi029.stdout:3/421: creat d3/d10/de/d2e/d36/d40/d46/d65/f98 x:0 0 0 2024-04-23T10:21:04.878 INFO:tasks.workunit.client.0.smithi029.stdout:3/422: creat d3/d10/de/d2e/d36/d40/f99 x:0 0 0 2024-04-23T10:21:04.888 INFO:tasks.workunit.client.0.smithi029.stdout:3/423: rename d3/d10/de/d2e/d36/d40/d46/d72/d75/c8b to d3/c9a 0 2024-04-23T10:21:04.893 INFO:tasks.workunit.client.0.smithi029.stdout:3/424: mknod d3/d10/de/d2e/d36/d40/d46/d72/d31/c9b 0 2024-04-23T10:21:04.895 INFO:tasks.workunit.client.0.smithi029.stdout:3/425: chown d3/d10/de/d2e/d59/l84 1 1 2024-04-23T10:21:04.899 INFO:tasks.workunit.client.0.smithi029.stdout:3/426: creat d3/d15/d4b/f9c x:0 0 0 2024-04-23T10:21:04.901 INFO:tasks.workunit.client.0.smithi029.stdout:3/427: chown d3/d10/de/d2e/d36 103 1 2024-04-23T10:21:04.918 INFO:tasks.workunit.client.0.smithi029.stdout:3/428: dwrite d3/d15/f18 [0,4194304] 0 2024-04-23T10:21:04.940 INFO:tasks.workunit.client.0.smithi029.stdout:3/429: dwrite d3/f8 [4194304,4194304] 0 2024-04-23T10:21:04.949 INFO:tasks.workunit.client.0.smithi029.stdout:3/430: unlink d3/fd 0 2024-04-23T10:21:04.949 INFO:tasks.workunit.client.0.smithi029.stdout:8/432: sync 2024-04-23T10:21:04.954 INFO:tasks.workunit.client.0.smithi029.stdout:8/433: write d3/d2f/d36/d3e/f41 [726826,120580] 0 2024-04-23T10:21:04.962 INFO:tasks.workunit.client.0.smithi029.stdout:8/434: fdatasync d3/f67 0 2024-04-23T10:21:04.965 INFO:tasks.workunit.client.0.smithi029.stdout:8/435: chown d3/d2f/d36/l6b 20 1 2024-04-23T10:21:04.972 INFO:tasks.workunit.client.0.smithi029.stdout:3/431: dread d3/d10/de/d2e/d36/d40/d46/d72/f53 [0,4194304] 0 2024-04-23T10:21:04.989 INFO:tasks.workunit.client.0.smithi029.stdout:3/432: link d3/d10/de/c2d d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/c9d 0 2024-04-23T10:21:05.014 INFO:tasks.workunit.client.0.smithi029.stdout:8/436: dread d3/d2f/d36/d3e/f41 [0,4194304] 0 2024-04-23T10:21:05.016 INFO:tasks.workunit.client.0.smithi029.stdout:3/433: creat d3/d10/de/d2e/d36/d40/d46/d72/d5e/f9e x:0 0 0 2024-04-23T10:21:05.017 INFO:tasks.workunit.client.0.smithi029.stdout:8/437: chown d3/c2a 100 1 2024-04-23T10:21:05.021 INFO:tasks.workunit.client.0.smithi029.stdout:3/434: truncate d3/d10/de/d2e/d36/d40/d46/f83 420230 0 2024-04-23T10:21:05.022 INFO:tasks.workunit.client.0.smithi029.stdout:8/438: creat d3/d44/f81 x:0 0 0 2024-04-23T10:21:05.024 INFO:tasks.workunit.client.0.smithi029.stdout:8/439: readlink d3/l16 0 2024-04-23T10:21:05.027 INFO:tasks.workunit.client.0.smithi029.stdout:3/435: creat d3/d10/de/d2e/d36/d40/d46/f9f x:0 0 0 2024-04-23T10:21:05.029 INFO:tasks.workunit.client.0.smithi029.stdout:3/436: write d3/d45/d4f/f6e [3129417,81978] 0 2024-04-23T10:21:05.032 INFO:tasks.workunit.client.0.smithi029.stdout:8/440: rename d3/f1f to d3/d2f/f82 0 2024-04-23T10:21:05.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/441: chown d3/d71 29 1 2024-04-23T10:21:05.042 INFO:tasks.workunit.client.0.smithi029.stdout:8/442: symlink d3/d38/l83 0 2024-04-23T10:21:05.046 INFO:tasks.workunit.client.0.smithi029.stdout:3/437: dwrite d3/d10/de/d2e/d36/d40/d46/f83 [0,4194304] 0 2024-04-23T10:21:05.050 INFO:tasks.workunit.client.0.smithi029.stdout:8/443: symlink d3/d2f/d36/d68/l84 0 2024-04-23T10:21:05.052 INFO:tasks.workunit.client.0.smithi029.stdout:3/438: symlink d3/d15/la0 0 2024-04-23T10:21:05.053 INFO:tasks.workunit.client.0.smithi029.stdout:3/439: readlink d3/d15/la0 0 2024-04-23T10:21:05.061 INFO:tasks.workunit.client.0.smithi029.stdout:8/444: rename d3/f10 to d3/d50/f85 0 2024-04-23T10:21:05.069 INFO:tasks.workunit.client.0.smithi029.stdout:3/440: dwrite d3/d10/de/d2e/d36/d40/d46/f4d [0,4194304] 0 2024-04-23T10:21:05.090 INFO:tasks.workunit.client.0.smithi029.stdout:8/445: dwrite d3/f11 [0,4194304] 0 2024-04-23T10:21:05.098 INFO:tasks.workunit.client.0.smithi029.stdout:0/290: sync 2024-04-23T10:21:05.107 INFO:tasks.workunit.client.0.smithi029.stdout:0/291: fsync d0/f1 0 2024-04-23T10:21:05.113 INFO:tasks.workunit.client.0.smithi029.stdout:8/446: dread d3/f19 [0,4194304] 0 2024-04-23T10:21:05.116 INFO:tasks.workunit.client.0.smithi029.stdout:0/292: rename d0/d21/l32 to d0/d21/l66 0 2024-04-23T10:21:05.118 INFO:tasks.workunit.client.0.smithi029.stdout:8/447: symlink d3/d7d/l86 0 2024-04-23T10:21:05.288 INFO:tasks.workunit.client.0.smithi029.stdout:4/450: sync 2024-04-23T10:21:05.288 INFO:tasks.workunit.client.0.smithi029.stdout:7/470: sync 2024-04-23T10:21:05.292 INFO:tasks.workunit.client.0.smithi029.stdout:7/471: getdents d5/d9 0 2024-04-23T10:21:05.297 INFO:tasks.workunit.client.0.smithi029.stdout:4/451: getdents d0/d3c/d52 0 2024-04-23T10:21:05.299 INFO:tasks.workunit.client.0.smithi029.stdout:4/452: write d0/f27 [5003978,14529] 0 2024-04-23T10:21:05.302 INFO:tasks.workunit.client.0.smithi029.stdout:7/472: link d5/d8/f23 d5/d8/d1a/d8a/f9d 0 2024-04-23T10:21:05.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/453: symlink d0/d3c/d52/d1b/d5b/d65/d6a/l9d 0 2024-04-23T10:21:05.308 INFO:tasks.workunit.client.0.smithi029.stdout:7/473: mkdir d5/d8/d51/d9e 0 2024-04-23T10:21:05.310 INFO:tasks.workunit.client.0.smithi029.stdout:4/454: write d0/d3c/d52/d20/f81 [613116,38557] 0 2024-04-23T10:21:05.315 INFO:tasks.workunit.client.0.smithi029.stdout:4/455: symlink d0/d5a/d6e/l9e 0 2024-04-23T10:21:05.318 INFO:tasks.workunit.client.0.smithi029.stdout:7/474: dread d5/f24 [0,4194304] 0 2024-04-23T10:21:05.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/475: read - d5/d8/f36 zero size 2024-04-23T10:21:05.328 INFO:tasks.workunit.client.0.smithi029.stdout:4/456: rename d0/d5a/d6e/d7a/d89 to d0/d3c/d52/d1b/d9f 0 2024-04-23T10:21:05.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/476: mknod d5/d8/d51/d9e/c9f 0 2024-04-23T10:21:05.351 INFO:tasks.workunit.client.0.smithi029.stdout:4/457: dwrite d0/d3c/d52/d1b/d36/d45/f78 [0,4194304] 0 2024-04-23T10:21:05.352 INFO:tasks.workunit.client.0.smithi029.stdout:7/477: dwrite d5/d8/d1a/f83 [0,4194304] 0 2024-04-23T10:21:05.364 INFO:tasks.workunit.client.0.smithi029.stdout:4/458: dread d0/d3c/d52/d1b/f6b [0,4194304] 0 2024-04-23T10:21:05.383 INFO:tasks.workunit.client.0.smithi029.stdout:0/293: dwrite d0/d1b/d62/d3a/f43 [0,4194304] 0 2024-04-23T10:21:05.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/448: dwrite d3/d2f/f35 [4194304,4194304] 0 2024-04-23T10:21:05.395 INFO:tasks.workunit.client.0.smithi029.stdout:5/497: sync 2024-04-23T10:21:05.395 INFO:tasks.workunit.client.0.smithi029.stdout:6/557: sync 2024-04-23T10:21:05.400 INFO:tasks.workunit.client.0.smithi029.stdout:0/294: mkdir d0/d1b/d67 0 2024-04-23T10:21:05.401 INFO:tasks.workunit.client.0.smithi029.stdout:7/478: dwrite d5/d8/d51/f57 [0,4194304] 0 2024-04-23T10:21:05.406 INFO:tasks.workunit.client.0.smithi029.stdout:5/498: stat d0/f57 0 2024-04-23T10:21:05.410 INFO:tasks.workunit.client.0.smithi029.stdout:0/295: truncate d0/dc/d26/f33 9353816 0 2024-04-23T10:21:05.416 INFO:tasks.workunit.client.0.smithi029.stdout:6/558: fdatasync d9/df/d16/f7d 0 2024-04-23T10:21:05.424 INFO:tasks.workunit.client.0.smithi029.stdout:0/296: rename d0/d1b/d62/f3c to d0/d1b/d62/d55/f68 0 2024-04-23T10:21:05.425 INFO:tasks.workunit.client.0.smithi029.stdout:4/459: dread d0/d5a/d6e/f88 [0,4194304] 0 2024-04-23T10:21:05.430 INFO:tasks.workunit.client.0.smithi029.stdout:4/460: read d0/d3c/d52/d1b/d5b/d65/d6a/f6c [3426326,29996] 0 2024-04-23T10:21:05.430 INFO:tasks.workunit.client.0.smithi029.stdout:4/461: chown d0/d3c/d52/d20/f81 2 1 2024-04-23T10:21:05.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/499: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/fae x:0 0 0 2024-04-23T10:21:05.434 INFO:tasks.workunit.client.0.smithi029.stdout:6/559: creat d9/df/d16/d44/d75/fc0 x:0 0 0 2024-04-23T10:21:05.435 INFO:tasks.workunit.client.0.smithi029.stdout:6/560: fsync d9/df/d16/d1f/d27/d33/da4/fb5 0 2024-04-23T10:21:05.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/479: creat d5/fa0 x:0 0 0 2024-04-23T10:21:05.441 INFO:tasks.workunit.client.0.smithi029.stdout:4/462: unlink d0/d3c/d52/d1b/d5b/d65/f72 0 2024-04-23T10:21:05.444 INFO:tasks.workunit.client.0.smithi029.stdout:7/480: rmdir d5/d8/d1a/d9c 39 2024-04-23T10:21:05.444 INFO:tasks.workunit.client.0.smithi029.stdout:6/561: dwrite d9/df/d16/d34/d36/fb1 [0,4194304] 0 2024-04-23T10:21:05.448 INFO:tasks.workunit.client.0.smithi029.stdout:0/297: truncate d0/d1b/f37 1134714 0 2024-04-23T10:21:05.455 INFO:tasks.workunit.client.0.smithi029.stdout:4/463: creat d0/d5a/d6e/fa0 x:0 0 0 2024-04-23T10:21:05.456 INFO:tasks.workunit.client.0.smithi029.stdout:4/464: stat d0/d3c/d52/d74/d91 0 2024-04-23T10:21:05.457 INFO:tasks.workunit.client.0.smithi029.stdout:5/500: truncate d0/d35/d49/f54 1827441 0 2024-04-23T10:21:05.459 INFO:tasks.workunit.client.0.smithi029.stdout:7/481: mknod d5/d8/d1a/d8a/ca1 0 2024-04-23T10:21:05.461 INFO:tasks.workunit.client.0.smithi029.stdout:8/449: truncate d3/f11 3147522 0 2024-04-23T10:21:05.461 INFO:tasks.workunit.client.0.smithi029.stdout:9/603: sync 2024-04-23T10:21:05.461 INFO:tasks.workunit.client.0.smithi029.stdout:3/441: sync 2024-04-23T10:21:05.461 INFO:tasks.workunit.client.0.smithi029.stdout:2/437: sync 2024-04-23T10:21:05.461 INFO:tasks.workunit.client.0.smithi029.stdout:1/401: sync 2024-04-23T10:21:05.463 INFO:tasks.workunit.client.0.smithi029.stdout:7/482: dread d5/d29/f38 [0,4194304] 0 2024-04-23T10:21:05.464 INFO:tasks.workunit.client.0.smithi029.stdout:4/465: mkdir d0/d5a/d6e/da1 0 2024-04-23T10:21:05.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/298: fsync d0/d1b/d62/f48 0 2024-04-23T10:21:05.465 INFO:tasks.workunit.client.0.smithi029.stdout:9/604: write d0/d1b/d39/f97 [2126475,15138] 0 2024-04-23T10:21:05.467 INFO:tasks.workunit.client.0.smithi029.stdout:6/562: mknod d9/df/d16/d1f/d27/cc1 0 2024-04-23T10:21:05.471 INFO:tasks.workunit.client.0.smithi029.stdout:6/563: stat d9/df/d16/d34/d84/fb4 0 2024-04-23T10:21:05.476 INFO:tasks.workunit.client.0.smithi029.stdout:2/438: dwrite d1/d3e/f89 [0,4194304] 0 2024-04-23T10:21:05.476 INFO:tasks.workunit.client.0.smithi029.stdout:0/299: mkdir d0/d3e/d69 0 2024-04-23T10:21:05.477 INFO:tasks.workunit.client.0.smithi029.stdout:7/483: rename d5/d8/d51/d55/d59/f79 to d5/d8/d51/d55/d59/fa2 0 2024-04-23T10:21:05.479 INFO:tasks.workunit.client.0.smithi029.stdout:4/466: dwrite d0/d3c/d52/d1b/f1c [0,4194304] 0 2024-04-23T10:21:05.479 INFO:tasks.workunit.client.0.smithi029.stdout:7/484: write d5/d9/f2e [4553719,120500] 0 2024-04-23T10:21:05.481 INFO:tasks.workunit.client.0.smithi029.stdout:7/485: write d5/d71/f82 [1434849,58722] 0 2024-04-23T10:21:05.483 INFO:tasks.workunit.client.0.smithi029.stdout:8/450: rename d3/d50/f85 to d3/d2f/d36/d68/f87 0 2024-04-23T10:21:05.488 INFO:tasks.workunit.client.0.smithi029.stdout:6/564: readlink d9/df/d16/d34/l8b 0 2024-04-23T10:21:05.496 INFO:tasks.workunit.client.0.smithi029.stdout:0/300: mkdir d0/dc/d26/d44/d5c/d6a 0 2024-04-23T10:21:05.505 INFO:tasks.workunit.client.0.smithi029.stdout:3/442: creat d3/d10/fa1 x:0 0 0 2024-04-23T10:21:05.505 INFO:tasks.workunit.client.0.smithi029.stdout:1/402: write d5/d6/de/f62 [491522,24174] 0 2024-04-23T10:21:05.508 INFO:tasks.workunit.client.0.smithi029.stdout:8/451: creat d3/d2f/f88 x:0 0 0 2024-04-23T10:21:05.511 INFO:tasks.workunit.client.0.smithi029.stdout:2/439: fdatasync d1/d4/f44 0 2024-04-23T10:21:05.514 INFO:tasks.workunit.client.0.smithi029.stdout:7/486: unlink d5/fe 0 2024-04-23T10:21:05.518 INFO:tasks.workunit.client.0.smithi029.stdout:3/443: creat d3/d45/fa2 x:0 0 0 2024-04-23T10:21:05.520 INFO:tasks.workunit.client.0.smithi029.stdout:5/501: dwrite d0/d35/d38/f4b [0,4194304] 0 2024-04-23T10:21:05.522 INFO:tasks.workunit.client.0.smithi029.stdout:7/487: rmdir d5/d8/d1a/d4d 39 2024-04-23T10:21:05.523 INFO:tasks.workunit.client.0.smithi029.stdout:2/440: dwrite d1/dd/d47/f5d [0,4194304] 0 2024-04-23T10:21:05.526 INFO:tasks.workunit.client.0.smithi029.stdout:9/605: rename d0/d1b/ca4 to d0/d7/cd2 0 2024-04-23T10:21:05.526 INFO:tasks.workunit.client.0.smithi029.stdout:2/441: write d1/dd/f51 [92347,104180] 0 2024-04-23T10:21:05.527 INFO:tasks.workunit.client.0.smithi029.stdout:8/452: creat d3/d2f/d36/f89 x:0 0 0 2024-04-23T10:21:05.533 INFO:tasks.workunit.client.0.smithi029.stdout:7/488: unlink d5/d8/d51/d55/d59/fa2 0 2024-04-23T10:21:05.547 INFO:tasks.workunit.client.0.smithi029.stdout:8/453: dread d3/d2f/d36/f46 [0,4194304] 0 2024-04-23T10:21:05.548 INFO:tasks.workunit.client.0.smithi029.stdout:8/454: chown d3/d2f/d36/d3e/f41 31191184 1 2024-04-23T10:21:05.552 INFO:tasks.workunit.client.0.smithi029.stdout:7/489: read d5/d8/d1a/d4d/f64 [4454634,128355] 0 2024-04-23T10:21:05.554 INFO:tasks.workunit.client.0.smithi029.stdout:5/502: dread d0/f31 [0,4194304] 0 2024-04-23T10:21:05.554 INFO:tasks.workunit.client.0.smithi029.stdout:8/455: link d3/d50/d6a/f70 d3/d38/f8a 0 2024-04-23T10:21:05.556 INFO:tasks.workunit.client.0.smithi029.stdout:7/490: rename d5/d71/f89 to d5/d8/d1a/d8a/fa3 0 2024-04-23T10:21:05.562 INFO:tasks.workunit.client.0.smithi029.stdout:5/503: dwrite d0/f75 [0,4194304] 0 2024-04-23T10:21:05.583 INFO:tasks.workunit.client.0.smithi029.stdout:8/456: dread d3/d2f/d36/f3a [0,4194304] 0 2024-04-23T10:21:05.583 INFO:tasks.workunit.client.0.smithi029.stdout:8/457: readlink d3/l4b 0 2024-04-23T10:21:05.584 INFO:tasks.workunit.client.0.smithi029.stdout:8/458: dread - d3/d38/f79 zero size 2024-04-23T10:21:05.585 INFO:tasks.workunit.client.0.smithi029.stdout:8/459: dread - d3/d2f/f4c zero size 2024-04-23T10:21:05.587 INFO:tasks.workunit.client.0.smithi029.stdout:7/491: creat d5/d8/d1a/d8e/fa4 x:0 0 0 2024-04-23T10:21:05.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/504: dread d0/d35/d38/d39/d3f/f55 [0,4194304] 0 2024-04-23T10:21:05.592 INFO:tasks.workunit.client.0.smithi029.stdout:8/460: dwrite d3/d2f/f35 [4194304,4194304] 0 2024-04-23T10:21:05.597 INFO:tasks.workunit.client.0.smithi029.stdout:7/492: stat d5/d29/f2a 0 2024-04-23T10:21:05.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/505: mknod d0/d35/d49/caf 0 2024-04-23T10:21:05.599 INFO:tasks.workunit.client.0.smithi029.stdout:8/461: fsync d3/d2f/d36/f3a 0 2024-04-23T10:21:05.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/506: rmdir d0/d9a 39 2024-04-23T10:21:05.603 INFO:tasks.workunit.client.0.smithi029.stdout:8/462: unlink f1 0 2024-04-23T10:21:05.604 INFO:tasks.workunit.client.0.smithi029.stdout:7/493: mkdir d5/d8/d51/d55/da5 0 2024-04-23T10:21:05.607 INFO:tasks.workunit.client.0.smithi029.stdout:5/507: creat d0/d2b/d89/fb0 x:0 0 0 2024-04-23T10:21:05.610 INFO:tasks.workunit.client.0.smithi029.stdout:7/494: symlink d5/d8/d1a/d8e/la6 0 2024-04-23T10:21:05.717 INFO:tasks.workunit.client.0.smithi029.stdout:6/565: truncate d9/df/d16/f2a 3086737 0 2024-04-23T10:21:05.718 INFO:tasks.workunit.client.0.smithi029.stdout:4/467: dwrite d0/f3f [0,4194304] 0 2024-04-23T10:21:05.719 INFO:tasks.workunit.client.0.smithi029.stdout:0/301: write d0/d1b/f37 [1188140,112409] 0 2024-04-23T10:21:05.726 INFO:tasks.workunit.client.0.smithi029.stdout:9/606: getdents d0/d1b 0 2024-04-23T10:21:05.727 INFO:tasks.workunit.client.0.smithi029.stdout:6/566: chown d9/df/d16/d1f/d27/l3c 412 1 2024-04-23T10:21:05.731 INFO:tasks.workunit.client.0.smithi029.stdout:1/403: dwrite d5/d6/ff [0,4194304] 0 2024-04-23T10:21:05.731 INFO:tasks.workunit.client.0.smithi029.stdout:7/495: creat d5/d8/fa7 x:0 0 0 2024-04-23T10:21:05.734 INFO:tasks.workunit.client.0.smithi029.stdout:6/567: stat d9/df/d16/d1f/d27/c3e 0 2024-04-23T10:21:05.746 INFO:tasks.workunit.client.0.smithi029.stdout:3/444: sync 2024-04-23T10:21:05.747 INFO:tasks.workunit.client.0.smithi029.stdout:5/508: truncate d0/d35/d10/d26/f45 4759947 0 2024-04-23T10:21:05.754 INFO:tasks.workunit.client.0.smithi029.stdout:7/496: rmdir d5/d8/d51/d9e 39 2024-04-23T10:21:05.756 INFO:tasks.workunit.client.0.smithi029.stdout:2/442: dwrite d1/dd/d22/f2c [0,4194304] 0 2024-04-23T10:21:05.759 INFO:tasks.workunit.client.0.smithi029.stdout:3/445: write d3/d10/de/d2e/d36/d40/d46/f9f [775776,98500] 0 2024-04-23T10:21:05.761 INFO:tasks.workunit.client.0.smithi029.stdout:2/443: chown d1/d3e/d3b 10283 1 2024-04-23T10:21:05.761 INFO:tasks.workunit.client.0.smithi029.stdout:6/568: creat d9/df/d16/daf/fc2 x:0 0 0 2024-04-23T10:21:05.762 INFO:tasks.workunit.client.0.smithi029.stdout:1/404: mknod d5/d6/de/c81 0 2024-04-23T10:21:05.767 INFO:tasks.workunit.client.0.smithi029.stdout:7/497: write d5/d8/f25 [1378177,120181] 0 2024-04-23T10:21:05.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/463: dwrite d3/f7 [0,4194304] 0 2024-04-23T10:21:05.772 INFO:tasks.workunit.client.0.smithi029.stdout:6/569: chown d9/d5b/f86 1932987 1 2024-04-23T10:21:05.776 INFO:tasks.workunit.client.0.smithi029.stdout:9/607: dwrite d0/d7/d1d/d35/d3b/d68/f8f [0,4194304] 0 2024-04-23T10:21:05.780 INFO:tasks.workunit.client.0.smithi029.stdout:9/608: chown d0/d7/d1d/d35/d3b 114219801 1 2024-04-23T10:21:05.783 INFO:tasks.workunit.client.0.smithi029.stdout:5/509: truncate d0/d6a/f7f 2000575 0 2024-04-23T10:21:05.783 INFO:tasks.workunit.client.0.smithi029.stdout:8/464: chown d3/c34 4002619 1 2024-04-23T10:21:05.786 INFO:tasks.workunit.client.0.smithi029.stdout:4/468: truncate d0/d3c/d52/d1b/f6b 510683 0 2024-04-23T10:21:05.789 INFO:tasks.workunit.client.0.smithi029.stdout:3/446: mknod d3/d10/d48/ca3 0 2024-04-23T10:21:05.790 INFO:tasks.workunit.client.0.smithi029.stdout:6/570: creat d9/df/d16/d1f/d2c/fc3 x:0 0 0 2024-04-23T10:21:05.792 INFO:tasks.workunit.client.0.smithi029.stdout:2/444: mknod d1/d31/c97 0 2024-04-23T10:21:05.794 INFO:tasks.workunit.client.0.smithi029.stdout:9/609: creat d0/d1b/d39/d50/fd3 x:0 0 0 2024-04-23T10:21:05.795 INFO:tasks.workunit.client.0.smithi029.stdout:0/302: dwrite d0/d21/f39 [0,4194304] 0 2024-04-23T10:21:05.795 INFO:tasks.workunit.client.0.smithi029.stdout:7/498: unlink d5/d29/f6c 0 2024-04-23T10:21:05.800 INFO:tasks.workunit.client.0.smithi029.stdout:4/469: creat d0/d3c/fa2 x:0 0 0 2024-04-23T10:21:05.803 INFO:tasks.workunit.client.0.smithi029.stdout:9/610: chown d0/d1b/d39/d50 40889026 1 2024-04-23T10:21:05.803 INFO:tasks.workunit.client.0.smithi029.stdout:8/465: creat d3/d2f/d36/d68/f8b x:0 0 0 2024-04-23T10:21:05.807 INFO:tasks.workunit.client.0.smithi029.stdout:3/447: creat d3/d15/d4b/d52/fa4 x:0 0 0 2024-04-23T10:21:05.808 INFO:tasks.workunit.client.0.smithi029.stdout:1/405: dwrite d5/d6/d34/d63/f75 [0,4194304] 0 2024-04-23T10:21:05.809 INFO:tasks.workunit.client.0.smithi029.stdout:6/571: rename d9/d5b/f86 to d9/df/d41/d49/d69/fc4 0 2024-04-23T10:21:05.811 INFO:tasks.workunit.client.0.smithi029.stdout:6/572: dread - d9/df/d41/f83 zero size 2024-04-23T10:21:05.814 INFO:tasks.workunit.client.0.smithi029.stdout:9/611: write d0/d7/d6/d66/dba/fc2 [3535797,70651] 0 2024-04-23T10:21:05.814 INFO:tasks.workunit.client.0.smithi029.stdout:1/406: truncate d5/d6/de/d22/f80 431399 0 2024-04-23T10:21:05.819 INFO:tasks.workunit.client.0.smithi029.stdout:0/303: creat d0/dc/d26/d44/d4c/f6b x:0 0 0 2024-04-23T10:21:05.821 INFO:tasks.workunit.client.0.smithi029.stdout:7/499: rename d5/d9/c4e to d5/d58/ca8 0 2024-04-23T10:21:05.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/573: symlink d9/df/d16/lc5 0 2024-04-23T10:21:05.825 INFO:tasks.workunit.client.0.smithi029.stdout:5/510: truncate d0/d35/d10/f71 4377696 0 2024-04-23T10:21:05.827 INFO:tasks.workunit.client.0.smithi029.stdout:9/612: mkdir d0/d1b/d39/d50/dd4 0 2024-04-23T10:21:05.827 INFO:tasks.workunit.client.0.smithi029.stdout:2/445: truncate d1/f8c 4032866 0 2024-04-23T10:21:05.829 INFO:tasks.workunit.client.0.smithi029.stdout:4/470: mkdir d0/d3c/d52/d1b/d9f/d92/da3 0 2024-04-23T10:21:05.834 INFO:tasks.workunit.client.0.smithi029.stdout:4/471: read d0/d12/f69 [2963318,100428] 0 2024-04-23T10:21:05.835 INFO:tasks.workunit.client.0.smithi029.stdout:1/407: creat d5/d6/de/d15/d7b/f82 x:0 0 0 2024-04-23T10:21:05.836 INFO:tasks.workunit.client.0.smithi029.stdout:0/304: dwrite d0/d1b/f3b [0,4194304] 0 2024-04-23T10:21:05.840 INFO:tasks.workunit.client.0.smithi029.stdout:7/500: dwrite d5/d8/f6f [0,4194304] 0 2024-04-23T10:21:05.841 INFO:tasks.workunit.client.0.smithi029.stdout:0/305: chown d0/d1b/d62/f30 40972 1 2024-04-23T10:21:05.842 INFO:tasks.workunit.client.0.smithi029.stdout:7/501: chown d5/d8/d51/d55 0 1 2024-04-23T10:21:05.845 INFO:tasks.workunit.client.0.smithi029.stdout:3/448: truncate d3/d10/de/d2e/d36/d40/d46/f83 2458912 0 2024-04-23T10:21:05.846 INFO:tasks.workunit.client.0.smithi029.stdout:6/574: dwrite d9/f82 [0,4194304] 0 2024-04-23T10:21:05.847 INFO:tasks.workunit.client.0.smithi029.stdout:9/613: mkdir d0/d7/d1d/d35/dd5 0 2024-04-23T10:21:05.851 INFO:tasks.workunit.client.0.smithi029.stdout:1/408: rename d5/d6/de/d22/f76 to d5/d6/de/d22/f83 0 2024-04-23T10:21:05.851 INFO:tasks.workunit.client.0.smithi029.stdout:8/466: getdents d3/d2f 0 2024-04-23T10:21:05.852 INFO:tasks.workunit.client.0.smithi029.stdout:0/306: rmdir d0/dc/d26/d44/d4c 39 2024-04-23T10:21:05.854 INFO:tasks.workunit.client.0.smithi029.stdout:8/467: fsync d3/f33 0 2024-04-23T10:21:05.854 INFO:tasks.workunit.client.0.smithi029.stdout:6/575: rmdir d9/df 39 2024-04-23T10:21:05.855 INFO:tasks.workunit.client.0.smithi029.stdout:9/614: creat d0/d1b/d44/fd6 x:0 0 0 2024-04-23T10:21:05.857 INFO:tasks.workunit.client.0.smithi029.stdout:7/502: symlink d5/d8/d51/d55/da5/la9 0 2024-04-23T10:21:05.860 INFO:tasks.workunit.client.0.smithi029.stdout:4/472: dwrite d0/d3c/d52/d1b/d5b/d65/f99 [0,4194304] 0 2024-04-23T10:21:05.860 INFO:tasks.workunit.client.0.smithi029.stdout:7/503: dread - d5/d8/d1a/d8e/fa4 zero size 2024-04-23T10:21:05.861 INFO:tasks.workunit.client.0.smithi029.stdout:7/504: fdatasync d5/d71/f82 0 2024-04-23T10:21:05.863 INFO:tasks.workunit.client.0.smithi029.stdout:8/468: rmdir d3/d44 39 2024-04-23T10:21:05.864 INFO:tasks.workunit.client.0.smithi029.stdout:2/446: rename d1/dd/d47/f6a to d1/d4/f98 0 2024-04-23T10:21:05.866 INFO:tasks.workunit.client.0.smithi029.stdout:3/449: truncate d3/d10/de/d2e/d36/d40/d46/d72/d31/f26 4707982 0 2024-04-23T10:21:05.867 INFO:tasks.workunit.client.0.smithi029.stdout:9/615: symlink d0/d7/d1d/d35/d3b/db8/ld7 0 2024-04-23T10:21:05.868 INFO:tasks.workunit.client.0.smithi029.stdout:0/307: unlink d0/d21/l66 0 2024-04-23T10:21:05.868 INFO:tasks.workunit.client.0.smithi029.stdout:3/450: dread - d3/d10/de/d2e/d36/d40/d46/d72/d5e/f9e zero size 2024-04-23T10:21:05.869 INFO:tasks.workunit.client.0.smithi029.stdout:9/616: write d0/d7/d3f/dbb/fc1 [882053,22064] 0 2024-04-23T10:21:05.870 INFO:tasks.workunit.client.0.smithi029.stdout:4/473: creat d0/d3c/d52/d74/fa4 x:0 0 0 2024-04-23T10:21:05.870 INFO:tasks.workunit.client.0.smithi029.stdout:0/308: readlink d0/d1b/d62/d3a/l65 0 2024-04-23T10:21:05.870 INFO:tasks.workunit.client.0.smithi029.stdout:4/474: chown d0/d5a 414236 1 2024-04-23T10:21:05.873 INFO:tasks.workunit.client.0.smithi029.stdout:6/576: dread - d9/df/d41/d49/f81 zero size 2024-04-23T10:21:05.875 INFO:tasks.workunit.client.0.smithi029.stdout:5/511: rename d0/d35/d38/d3e/d66/d5a/d78/d3d/f5d to d0/d35/d38/d39/d3f/fb1 0 2024-04-23T10:21:05.876 INFO:tasks.workunit.client.0.smithi029.stdout:8/469: mkdir d3/d2f/d36/d68/d8c 0 2024-04-23T10:21:05.878 INFO:tasks.workunit.client.0.smithi029.stdout:0/309: chown d0/dc/l3d 149679 1 2024-04-23T10:21:05.879 INFO:tasks.workunit.client.0.smithi029.stdout:9/617: creat d0/d7/d1d/d35/d3b/d68/fd8 x:0 0 0 2024-04-23T10:21:05.881 INFO:tasks.workunit.client.0.smithi029.stdout:7/505: creat d5/d8/d1a/d9c/faa x:0 0 0 2024-04-23T10:21:05.881 INFO:tasks.workunit.client.0.smithi029.stdout:2/447: mknod d1/c99 0 2024-04-23T10:21:05.882 INFO:tasks.workunit.client.0.smithi029.stdout:9/618: fdatasync d0/d1b/d39/d50/d5a/f7d 0 2024-04-23T10:21:05.883 INFO:tasks.workunit.client.0.smithi029.stdout:7/506: chown d5/d29/c86 222032595 1 2024-04-23T10:21:05.883 INFO:tasks.workunit.client.0.smithi029.stdout:5/512: rename d0/d2b to d0/d35/d10/d26/db2 0 2024-04-23T10:21:05.884 INFO:tasks.workunit.client.0.smithi029.stdout:4/475: creat d0/d3c/d52/d74/d91/fa5 x:0 0 0 2024-04-23T10:21:05.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/409: dwrite d5/d6/de/d22/f23 [0,4194304] 0 2024-04-23T10:21:05.887 INFO:tasks.workunit.client.0.smithi029.stdout:5/513: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85 501462 1 2024-04-23T10:21:05.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/577: creat d9/df/d16/d44/fc6 x:0 0 0 2024-04-23T10:21:05.888 INFO:tasks.workunit.client.0.smithi029.stdout:0/310: mkdir d0/d1b/d67/d6c 0 2024-04-23T10:21:05.889 INFO:tasks.workunit.client.0.smithi029.stdout:0/311: dread - d0/f2f zero size 2024-04-23T10:21:05.890 INFO:tasks.workunit.client.0.smithi029.stdout:9/619: rename d0/d1b/d44 to d0/d7/d1d/d35/dd9 0 2024-04-23T10:21:05.891 INFO:tasks.workunit.client.0.smithi029.stdout:7/507: creat d5/d8/d1a/d9c/fab x:0 0 0 2024-04-23T10:21:05.892 INFO:tasks.workunit.client.0.smithi029.stdout:4/476: mknod d0/d3c/d52/d1b/d5b/d65/d6a/ca6 0 2024-04-23T10:21:05.892 INFO:tasks.workunit.client.0.smithi029.stdout:5/514: truncate d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/fa6 447445 0 2024-04-23T10:21:05.893 INFO:tasks.workunit.client.0.smithi029.stdout:5/515: chown d0/d35/d38/d39/d3f/f7d 2212 1 2024-04-23T10:21:05.898 INFO:tasks.workunit.client.0.smithi029.stdout:6/578: rename d9/df/d25/fb2 to d9/df/d41/d49/fc7 0 2024-04-23T10:21:05.899 INFO:tasks.workunit.client.0.smithi029.stdout:2/448: link d1/dd/l3c d1/d3e/d3b/l9a 0 2024-04-23T10:21:05.902 INFO:tasks.workunit.client.0.smithi029.stdout:5/516: chown d0/la2 56705 1 2024-04-23T10:21:05.905 INFO:tasks.workunit.client.0.smithi029.stdout:8/470: dread d3/d2f/d36/f40 [0,4194304] 0 2024-04-23T10:21:05.906 INFO:tasks.workunit.client.0.smithi029.stdout:4/477: symlink d0/d5a/d6e/da1/la7 0 2024-04-23T10:21:05.907 INFO:tasks.workunit.client.0.smithi029.stdout:6/579: write d9/df/d16/d1f/d27/fa6 [61281,47078] 0 2024-04-23T10:21:05.909 INFO:tasks.workunit.client.0.smithi029.stdout:5/517: mkdir d0/d35/d38/db3 0 2024-04-23T10:21:05.909 INFO:tasks.workunit.client.0.smithi029.stdout:8/471: truncate d3/d2f/d36/d68/f8b 688213 0 2024-04-23T10:21:05.912 INFO:tasks.workunit.client.0.smithi029.stdout:7/508: rename d5/d29/d4a/c50 to d5/d8/d80/cac 0 2024-04-23T10:21:05.913 INFO:tasks.workunit.client.0.smithi029.stdout:6/580: truncate d9/df/d16/d44/d75/d90/fa3 148653 0 2024-04-23T10:21:05.915 INFO:tasks.workunit.client.0.smithi029.stdout:7/509: fdatasync d5/d8/d1a/f83 0 2024-04-23T10:21:05.918 INFO:tasks.workunit.client.0.smithi029.stdout:5/518: creat d0/d35/d10/d26/db2/fb4 x:0 0 0 2024-04-23T10:21:05.918 INFO:tasks.workunit.client.0.smithi029.stdout:4/478: dwrite d0/f27 [4194304,4194304] 0 2024-04-23T10:21:05.927 INFO:tasks.workunit.client.0.smithi029.stdout:2/449: dread d1/dd/d47/d63/d64/f6b [0,4194304] 0 2024-04-23T10:21:05.928 INFO:tasks.workunit.client.0.smithi029.stdout:0/312: dwrite d0/f2f [0,4194304] 0 2024-04-23T10:21:05.932 INFO:tasks.workunit.client.0.smithi029.stdout:8/472: dwrite d3/d2f/d36/d3e/f41 [4194304,4194304] 0 2024-04-23T10:21:05.934 INFO:tasks.workunit.client.0.smithi029.stdout:5/519: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/db5 0 2024-04-23T10:21:05.935 INFO:tasks.workunit.client.0.smithi029.stdout:9/620: rename d0/d1b/d39/d50/c76 to d0/d7/d1d/cda 0 2024-04-23T10:21:05.937 INFO:tasks.workunit.client.0.smithi029.stdout:2/450: mkdir d1/d31/d50/d9b 0 2024-04-23T10:21:05.940 INFO:tasks.workunit.client.0.smithi029.stdout:5/520: creat d0/d35/d38/d51/fb6 x:0 0 0 2024-04-23T10:21:05.943 INFO:tasks.workunit.client.0.smithi029.stdout:9/621: unlink d0/d7/d1d/l30 0 2024-04-23T10:21:05.944 INFO:tasks.workunit.client.0.smithi029.stdout:7/510: dread d5/d8/d1a/d4d/f94 [0,4194304] 0 2024-04-23T10:21:05.948 INFO:tasks.workunit.client.0.smithi029.stdout:0/313: mkdir d0/dc/d26/d44/d4c/d6d 0 2024-04-23T10:21:05.948 INFO:tasks.workunit.client.0.smithi029.stdout:4/479: dwrite d0/d3c/d52/d1b/d5b/d65/f6d [0,4194304] 0 2024-04-23T10:21:05.948 INFO:tasks.workunit.client.0.smithi029.stdout:7/511: fdatasync d5/d9/f26 0 2024-04-23T10:21:05.949 INFO:tasks.workunit.client.0.smithi029.stdout:8/473: creat d3/d2f/d36/d68/d8c/f8d x:0 0 0 2024-04-23T10:21:05.951 INFO:tasks.workunit.client.0.smithi029.stdout:2/451: write d1/d3e/d5a/f6f [1623608,67624] 0 2024-04-23T10:21:05.952 INFO:tasks.workunit.client.0.smithi029.stdout:9/622: rmdir d0/d7/d1d/d35/d3b/d68 39 2024-04-23T10:21:05.954 INFO:tasks.workunit.client.0.smithi029.stdout:9/623: write d0/d7/d1d/fbe [287184,77660] 0 2024-04-23T10:21:05.957 INFO:tasks.workunit.client.0.smithi029.stdout:9/624: fsync d0/d7/d3f/dbb/fc1 0 2024-04-23T10:21:05.957 INFO:tasks.workunit.client.0.smithi029.stdout:0/314: creat d0/d1b/d62/d3a/f6e x:0 0 0 2024-04-23T10:21:05.962 INFO:tasks.workunit.client.0.smithi029.stdout:6/581: rename d9/df/d16/d44/l9d to d9/df/d16/d34/lc8 0 2024-04-23T10:21:05.963 INFO:tasks.workunit.client.0.smithi029.stdout:8/474: mknod d3/d2f/c8e 0 2024-04-23T10:21:05.964 INFO:tasks.workunit.client.0.smithi029.stdout:5/521: dwrite d0/f40 [0,4194304] 0 2024-04-23T10:21:05.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/625: mknod d0/d7/d1d/d35/cdb 0 2024-04-23T10:21:05.967 INFO:tasks.workunit.client.0.smithi029.stdout:9/626: chown d0/d7/d6/d66/dba/fc2 89764761 1 2024-04-23T10:21:05.969 INFO:tasks.workunit.client.0.smithi029.stdout:2/452: rename d1/l3f to d1/dd/d47/d63/d64/l9c 0 2024-04-23T10:21:05.971 INFO:tasks.workunit.client.0.smithi029.stdout:8/475: dread d3/d2f/d36/f3b [0,4194304] 0 2024-04-23T10:21:05.972 INFO:tasks.workunit.client.0.smithi029.stdout:5/522: readlink d0/d35/d38/d51/l5e 0 2024-04-23T10:21:05.977 INFO:tasks.workunit.client.0.smithi029.stdout:0/315: mknod d0/dc/d26/d44/c6f 0 2024-04-23T10:21:05.977 INFO:tasks.workunit.client.0.smithi029.stdout:0/316: chown d0/c1f 133867291 1 2024-04-23T10:21:05.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/582: mknod d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/cc9 0 2024-04-23T10:21:05.979 INFO:tasks.workunit.client.0.smithi029.stdout:9/627: dread d0/d7/d6/fe [0,4194304] 0 2024-04-23T10:21:05.979 INFO:tasks.workunit.client.0.smithi029.stdout:6/583: readlink d9/df/d16/d44/d4c/l79 0 2024-04-23T10:21:05.979 INFO:tasks.workunit.client.0.smithi029.stdout:4/480: link d0/d5a/c7d d0/d3c/d52/d1b/d9f/ca8 0 2024-04-23T10:21:05.980 INFO:tasks.workunit.client.0.smithi029.stdout:7/512: write d5/d8/fb [1891777,118678] 0 2024-04-23T10:21:05.981 INFO:tasks.workunit.client.0.smithi029.stdout:8/476: mknod d3/d50/d6a/c8f 0 2024-04-23T10:21:05.983 INFO:tasks.workunit.client.0.smithi029.stdout:8/477: write d3/f7 [4145934,87504] 0 2024-04-23T10:21:05.984 INFO:tasks.workunit.client.0.smithi029.stdout:7/513: write d5/d8/d1a/d9c/faa [459396,5145] 0 2024-04-23T10:21:05.984 INFO:tasks.workunit.client.0.smithi029.stdout:4/481: mkdir d0/d12/da9 0 2024-04-23T10:21:05.985 INFO:tasks.workunit.client.0.smithi029.stdout:4/482: stat d0/d3c/c53 0 2024-04-23T10:21:05.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/453: dread d1/d31/d3d/f41 [4194304,4194304] 0 2024-04-23T10:21:05.988 INFO:tasks.workunit.client.0.smithi029.stdout:5/523: link d0/d35/d38/d51/fb6 d0/d35/d38/d39/fb7 0 2024-04-23T10:21:05.992 INFO:tasks.workunit.client.0.smithi029.stdout:8/478: creat d3/d38/f90 x:0 0 0 2024-04-23T10:21:05.993 INFO:tasks.workunit.client.0.smithi029.stdout:8/479: readlink d3/d2f/d36/d68/l6e 0 2024-04-23T10:21:05.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/514: unlink d5/d8/d1a/f91 0 2024-04-23T10:21:05.994 INFO:tasks.workunit.client.0.smithi029.stdout:9/628: write d0/d7/d3f/f53 [696306,10286] 0 2024-04-23T10:21:05.996 INFO:tasks.workunit.client.0.smithi029.stdout:0/317: creat d0/dc/d26/d44/f70 x:0 0 0 2024-04-23T10:21:05.998 INFO:tasks.workunit.client.0.smithi029.stdout:5/524: mknod d0/d35/d10/d26/db2/cb8 0 2024-04-23T10:21:05.998 INFO:tasks.workunit.client.0.smithi029.stdout:2/454: rmdir d1/dd/d47/d63/d64/d78 39 2024-04-23T10:21:05.999 INFO:tasks.workunit.client.0.smithi029.stdout:2/455: read d1/dd/d22/f2c [1996339,86979] 0 2024-04-23T10:21:05.999 INFO:tasks.workunit.client.0.smithi029.stdout:0/318: read d0/d1b/d62/f29 [342195,53637] 0 2024-04-23T10:21:06.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/480: rename d3/f33 to d3/d38/f91 0 2024-04-23T10:21:06.002 INFO:tasks.workunit.client.0.smithi029.stdout:9/629: write d0/d7/f18 [5401554,35102] 0 2024-04-23T10:21:06.003 INFO:tasks.workunit.client.0.smithi029.stdout:6/584: getdents d9/df/d16/d1f/d27/d33/da4/d66/d95 0 2024-04-23T10:21:06.005 INFO:tasks.workunit.client.0.smithi029.stdout:4/483: dread d0/d3c/d52/f1d [0,4194304] 0 2024-04-23T10:21:06.006 INFO:tasks.workunit.client.0.smithi029.stdout:7/515: symlink d5/d8/d1a/lad 0 2024-04-23T10:21:06.011 INFO:tasks.workunit.client.0.smithi029.stdout:0/319: mkdir d0/d3e/d4e/d50/d71 0 2024-04-23T10:21:06.012 INFO:tasks.workunit.client.0.smithi029.stdout:9/630: mknod d0/d7/d6/d66/dba/cdc 0 2024-04-23T10:21:06.014 INFO:tasks.workunit.client.0.smithi029.stdout:9/631: truncate d0/d7/d1d/fbe 1191907 0 2024-04-23T10:21:06.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/516: fdatasync d5/f18 0 2024-04-23T10:21:06.018 INFO:tasks.workunit.client.0.smithi029.stdout:8/481: dread d3/d50/f77 [0,4194304] 0 2024-04-23T10:21:06.019 INFO:tasks.workunit.client.0.smithi029.stdout:5/525: dread d0/d35/f1c [0,4194304] 0 2024-04-23T10:21:06.020 INFO:tasks.workunit.client.0.smithi029.stdout:6/585: creat d9/df/d16/d1f/d27/dad/dbd/fca x:0 0 0 2024-04-23T10:21:06.025 INFO:tasks.workunit.client.0.smithi029.stdout:7/517: mknod d5/d8/d51/d9e/cae 0 2024-04-23T10:21:06.028 INFO:tasks.workunit.client.0.smithi029.stdout:9/632: rename d0/l3 to d0/d1b/d39/d4f/ldd 0 2024-04-23T10:21:06.029 INFO:tasks.workunit.client.0.smithi029.stdout:7/518: chown d5/d9/ld 63772 1 2024-04-23T10:21:06.031 INFO:tasks.workunit.client.0.smithi029.stdout:5/526: unlink d0/d9a/fa8 0 2024-04-23T10:21:06.034 INFO:tasks.workunit.client.0.smithi029.stdout:4/484: dwrite d0/d3c/d52/d1b/d36/d45/d4f/f7f [0,4194304] 0 2024-04-23T10:21:06.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/456: dwrite d1/d3e/d3b/f52 [0,4194304] 0 2024-04-23T10:21:06.036 INFO:tasks.workunit.client.0.smithi029.stdout:6/586: rename d9/df/d16/d1f/d27/d33/fa2 to d9/df/d41/d49/d69/fcb 0 2024-04-23T10:21:06.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/482: link d3/f19 d3/d2f/d36/f92 0 2024-04-23T10:21:06.039 INFO:tasks.workunit.client.0.smithi029.stdout:0/320: dread d0/dc/f11 [0,4194304] 0 2024-04-23T10:21:06.039 INFO:tasks.workunit.client.0.smithi029.stdout:8/483: readlink d3/d2f/d36/l3c 0 2024-04-23T10:21:06.041 INFO:tasks.workunit.client.0.smithi029.stdout:6/587: chown d9/df/d16/d1f/d27/d33/da4/d58 499 1 2024-04-23T10:21:06.042 INFO:tasks.workunit.client.0.smithi029.stdout:0/321: stat d0/d3e/d69 0 2024-04-23T10:21:06.051 INFO:tasks.workunit.client.0.smithi029.stdout:5/527: creat d0/d35/d83/fb9 x:0 0 0 2024-04-23T10:21:06.051 INFO:tasks.workunit.client.0.smithi029.stdout:7/519: dwrite d5/f18 [0,4194304] 0 2024-04-23T10:21:06.051 INFO:tasks.workunit.client.0.smithi029.stdout:4/485: rename d0/d3c/d52/l55 to d0/d3c/d52/d74/laa 0 2024-04-23T10:21:06.052 INFO:tasks.workunit.client.0.smithi029.stdout:7/520: stat d5/d8/d1a/f7a 0 2024-04-23T10:21:06.053 INFO:tasks.workunit.client.0.smithi029.stdout:9/633: unlink d0/d7/d6/fc 0 2024-04-23T10:21:06.055 INFO:tasks.workunit.client.0.smithi029.stdout:2/457: symlink d1/dd/l9d 0 2024-04-23T10:21:06.060 INFO:tasks.workunit.client.0.smithi029.stdout:5/528: read - d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/fae zero size 2024-04-23T10:21:06.061 INFO:tasks.workunit.client.0.smithi029.stdout:7/521: stat d5/d8/d1a/d8a/d8b/d8d 0 2024-04-23T10:21:06.063 INFO:tasks.workunit.client.0.smithi029.stdout:8/484: creat d3/d2f/d36/d68/d8c/f93 x:0 0 0 2024-04-23T10:21:06.063 INFO:tasks.workunit.client.0.smithi029.stdout:4/486: creat d0/d5a/d6e/da1/fab x:0 0 0 2024-04-23T10:21:06.064 INFO:tasks.workunit.client.0.smithi029.stdout:9/634: rename d0/d7/d6/d66 to d0/d7/d1d/d35/dde 0 2024-04-23T10:21:06.066 INFO:tasks.workunit.client.0.smithi029.stdout:7/522: mkdir d5/d8/d51/d55/d59/daf 0 2024-04-23T10:21:06.068 INFO:tasks.workunit.client.0.smithi029.stdout:7/523: write d5/f2c [4877586,80816] 0 2024-04-23T10:21:06.072 INFO:tasks.workunit.client.0.smithi029.stdout:7/524: fsync d5/d8/d51/f53 0 2024-04-23T10:21:06.073 INFO:tasks.workunit.client.0.smithi029.stdout:8/485: mkdir d3/d2f/d36/d94 0 2024-04-23T10:21:06.074 INFO:tasks.workunit.client.0.smithi029.stdout:7/525: fsync d5/d8/fa7 0 2024-04-23T10:21:06.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/458: dread d1/dd/d47/d63/d64/d78/f94 [0,4194304] 0 2024-04-23T10:21:06.077 INFO:tasks.workunit.client.0.smithi029.stdout:2/459: rmdir d1/d31 39 2024-04-23T10:21:06.083 INFO:tasks.workunit.client.0.smithi029.stdout:8/486: rename d3/d2f to d3/d50/d6a/d95 0 2024-04-23T10:21:06.083 INFO:tasks.workunit.client.0.smithi029.stdout:4/487: dread d0/d3c/d52/d1b/f6b [0,4194304] 0 2024-04-23T10:21:06.084 INFO:tasks.workunit.client.0.smithi029.stdout:6/588: dwrite d9/df/d16/f24 [0,4194304] 0 2024-04-23T10:21:06.086 INFO:tasks.workunit.client.0.smithi029.stdout:0/322: dread d0/d1b/d62/f29 [0,4194304] 0 2024-04-23T10:21:06.087 INFO:tasks.workunit.client.0.smithi029.stdout:9/635: dread d0/f1e [0,4194304] 0 2024-04-23T10:21:06.089 INFO:tasks.workunit.client.0.smithi029.stdout:6/589: rmdir d9/df/d16/d1f 39 2024-04-23T10:21:06.090 INFO:tasks.workunit.client.0.smithi029.stdout:4/488: dread - d0/d3c/d52/d74/f77 zero size 2024-04-23T10:21:06.091 INFO:tasks.workunit.client.0.smithi029.stdout:7/526: dwrite d5/d8/d1a/d8a/f7d [0,4194304] 0 2024-04-23T10:21:06.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/460: rmdir d1/d3e/d3b/d92 0 2024-04-23T10:21:06.094 INFO:tasks.workunit.client.0.smithi029.stdout:7/527: dread - d5/d8/d1a/d8e/fa4 zero size 2024-04-23T10:21:06.097 INFO:tasks.workunit.client.0.smithi029.stdout:6/590: stat d9/df/d16/d1f/d27/d33/c31 0 2024-04-23T10:21:06.098 INFO:tasks.workunit.client.0.smithi029.stdout:9/636: read d0/d1b/d39/d50/d5a/fa6 [608909,75347] 0 2024-04-23T10:21:06.098 INFO:tasks.workunit.client.0.smithi029.stdout:8/487: dread d3/f23 [0,4194304] 0 2024-04-23T10:21:06.099 INFO:tasks.workunit.client.0.smithi029.stdout:2/461: rmdir d1/dd/d60 39 2024-04-23T10:21:06.106 INFO:tasks.workunit.client.0.smithi029.stdout:6/591: fdatasync d9/df/d41/d49/d69/f6f 0 2024-04-23T10:21:06.106 INFO:tasks.workunit.client.0.smithi029.stdout:0/323: link d0/d21/f53 d0/d3e/f72 0 2024-04-23T10:21:06.107 INFO:tasks.workunit.client.0.smithi029.stdout:9/637: rmdir d0/d7/d1d/d35/dd9/d49/d65 39 2024-04-23T10:21:06.109 INFO:tasks.workunit.client.0.smithi029.stdout:4/489: dwrite d0/d3c/d52/d1b/d36/d45/f58 [0,4194304] 0 2024-04-23T10:21:06.109 INFO:tasks.workunit.client.0.smithi029.stdout:8/488: mkdir d3/d71/d96 0 2024-04-23T10:21:06.112 INFO:tasks.workunit.client.0.smithi029.stdout:4/490: fdatasync d0/d12/f2b 0 2024-04-23T10:21:06.114 INFO:tasks.workunit.client.0.smithi029.stdout:8/489: readlink d3/d50/d6a/d95/d36/d68/l6e 0 2024-04-23T10:21:06.114 INFO:tasks.workunit.client.0.smithi029.stdout:7/528: creat d5/d8/fb0 x:0 0 0 2024-04-23T10:21:06.115 INFO:tasks.workunit.client.0.smithi029.stdout:2/462: dwrite d1/dd/d47/d63/d64/f72 [0,4194304] 0 2024-04-23T10:21:06.115 INFO:tasks.workunit.client.0.smithi029.stdout:6/592: mkdir d9/df/d41/d49/dcc 0 2024-04-23T10:21:06.115 INFO:tasks.workunit.client.0.smithi029.stdout:0/324: chown d0/d3e/f72 1289339 1 2024-04-23T10:21:06.116 INFO:tasks.workunit.client.0.smithi029.stdout:4/491: write d0/d3c/d52/d74/fa4 [739317,78610] 0 2024-04-23T10:21:06.118 INFO:tasks.workunit.client.0.smithi029.stdout:6/593: fdatasync d9/df/d16/d34/d84/fb4 0 2024-04-23T10:21:06.129 INFO:tasks.workunit.client.0.smithi029.stdout:8/490: mkdir d3/d50/d6a/d95/d36/d97 0 2024-04-23T10:21:06.139 INFO:tasks.workunit.client.0.smithi029.stdout:0/325: dwrite d0/dc/d26/d44/f61 [0,4194304] 0 2024-04-23T10:21:06.139 INFO:tasks.workunit.client.0.smithi029.stdout:7/529: truncate d5/d8/d51/f8c 2177450 0 2024-04-23T10:21:06.142 INFO:tasks.workunit.client.0.smithi029.stdout:2/463: mkdir d1/d31/d50/d9b/d9e 0 2024-04-23T10:21:06.143 INFO:tasks.workunit.client.0.smithi029.stdout:9/638: dread d0/d1b/d39/d50/fb4 [0,4194304] 0 2024-04-23T10:21:06.146 INFO:tasks.workunit.client.0.smithi029.stdout:6/594: creat d9/df/d16/d34/d36/fcd x:0 0 0 2024-04-23T10:21:06.148 INFO:tasks.workunit.client.0.smithi029.stdout:4/492: dread d0/d12/f5f [0,4194304] 0 2024-04-23T10:21:06.150 INFO:tasks.workunit.client.0.smithi029.stdout:9/639: chown d0/d7/d1d/d35/d3b/d68 917896413 1 2024-04-23T10:21:06.150 INFO:tasks.workunit.client.0.smithi029.stdout:4/493: chown d0/d3c/d52/d1b/c23 0 1 2024-04-23T10:21:06.153 INFO:tasks.workunit.client.0.smithi029.stdout:7/530: symlink d5/d71/d92/lb1 0 2024-04-23T10:21:06.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/595: dread d9/df/d16/f24 [0,4194304] 0 2024-04-23T10:21:06.153 INFO:tasks.workunit.client.0.smithi029.stdout:2/464: mknod d1/d3e/d5a/d6d/c9f 0 2024-04-23T10:21:06.159 INFO:tasks.workunit.client.0.smithi029.stdout:4/494: mknod d0/d5a/d6e/da1/cac 0 2024-04-23T10:21:06.160 INFO:tasks.workunit.client.0.smithi029.stdout:6/596: chown d9/df/d16/d1f/d27/l3c 2019 1 2024-04-23T10:21:06.162 INFO:tasks.workunit.client.0.smithi029.stdout:6/597: fdatasync d9/f18 0 2024-04-23T10:21:06.163 INFO:tasks.workunit.client.0.smithi029.stdout:6/598: chown d9/c89 0 1 2024-04-23T10:21:06.164 INFO:tasks.workunit.client.0.smithi029.stdout:4/495: truncate d0/d3c/fa2 153385 0 2024-04-23T10:21:06.166 INFO:tasks.workunit.client.0.smithi029.stdout:4/496: write d0/f3f [1900686,27477] 0 2024-04-23T10:21:06.167 INFO:tasks.workunit.client.0.smithi029.stdout:9/640: dwrite d0/d7/d1d/d35/dde/dba/fc2 [0,4194304] 0 2024-04-23T10:21:06.168 INFO:tasks.workunit.client.0.smithi029.stdout:2/465: dread d1/d3e/d3b/f96 [0,4194304] 0 2024-04-23T10:21:06.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/326: dread d0/dc/d26/f33 [0,4194304] 0 2024-04-23T10:21:06.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/599: rmdir d9/df/d16/d1f 39 2024-04-23T10:21:06.180 INFO:tasks.workunit.client.0.smithi029.stdout:0/327: dwrite d0/d1b/d62/d3a/f43 [4194304,4194304] 0 2024-04-23T10:21:06.184 INFO:tasks.workunit.client.0.smithi029.stdout:6/600: creat d9/df/d16/d34/d36/d63/fce x:0 0 0 2024-04-23T10:21:06.185 INFO:tasks.workunit.client.0.smithi029.stdout:7/531: dread d5/d8/d51/d55/f66 [0,4194304] 0 2024-04-23T10:21:06.186 INFO:tasks.workunit.client.0.smithi029.stdout:2/466: mknod d1/dd/d60/ca0 0 2024-04-23T10:21:06.188 INFO:tasks.workunit.client.0.smithi029.stdout:0/328: mkdir d0/d3e/d4e/d50/d73 0 2024-04-23T10:21:06.194 INFO:tasks.workunit.client.0.smithi029.stdout:9/641: link d0/d7/d1d/d35/dde/f94 d0/d1b/d39/fdf 0 2024-04-23T10:21:06.196 INFO:tasks.workunit.client.0.smithi029.stdout:6/601: mknod d9/df/d16/d1f/d27/d33/da4/d66/d95/ccf 0 2024-04-23T10:21:06.199 INFO:tasks.workunit.client.0.smithi029.stdout:0/329: creat d0/d3e/d4e/d50/d73/f74 x:0 0 0 2024-04-23T10:21:06.207 INFO:tasks.workunit.client.0.smithi029.stdout:2/467: link d1/f2e d1/d3e/d5a/d6d/fa1 0 2024-04-23T10:21:06.213 INFO:tasks.workunit.client.0.smithi029.stdout:0/330: mknod d0/dc/d26/d44/c75 0 2024-04-23T10:21:06.213 INFO:tasks.workunit.client.0.smithi029.stdout:9/642: dwrite d0/d7/d1d/d35/dd9/d49/d65/f8a [0,4194304] 0 2024-04-23T10:21:06.215 INFO:tasks.workunit.client.0.smithi029.stdout:2/468: dwrite d1/dd/d22/f90 [0,4194304] 0 2024-04-23T10:21:06.219 INFO:tasks.workunit.client.0.smithi029.stdout:0/331: creat d0/d21/f76 x:0 0 0 2024-04-23T10:21:06.221 INFO:tasks.workunit.client.0.smithi029.stdout:6/602: getdents d9/df/d16/d1f 0 2024-04-23T10:21:06.224 INFO:tasks.workunit.client.0.smithi029.stdout:2/469: mknod d1/d3e/d3b/ca2 0 2024-04-23T10:21:06.228 INFO:tasks.workunit.client.0.smithi029.stdout:9/643: symlink d0/d7/le0 0 2024-04-23T10:21:06.230 INFO:tasks.workunit.client.0.smithi029.stdout:0/332: readlink d0/dc/d26/d44/d5c/l63 0 2024-04-23T10:21:06.232 INFO:tasks.workunit.client.0.smithi029.stdout:6/603: mkdir d9/df/d16/d1f/d27/dad/dd0 0 2024-04-23T10:21:06.234 INFO:tasks.workunit.client.0.smithi029.stdout:6/604: dread d9/df/d16/d44/d75/d90/fa3 [0,4194304] 0 2024-04-23T10:21:06.237 INFO:tasks.workunit.client.0.smithi029.stdout:0/333: creat d0/d21/f77 x:0 0 0 2024-04-23T10:21:06.246 INFO:tasks.workunit.client.0.smithi029.stdout:0/334: dwrite d0/d21/f53 [0,4194304] 0 2024-04-23T10:21:06.252 INFO:tasks.workunit.client.0.smithi029.stdout:0/335: dread d0/f1 [0,4194304] 0 2024-04-23T10:21:06.253 INFO:tasks.workunit.client.0.smithi029.stdout:2/470: dread d1/f8c [0,4194304] 0 2024-04-23T10:21:06.254 INFO:tasks.workunit.client.0.smithi029.stdout:9/644: mknod d0/d1b/d60/ce1 0 2024-04-23T10:21:06.259 INFO:tasks.workunit.client.0.smithi029.stdout:9/645: chown d0/d7/la1 91 1 2024-04-23T10:21:06.261 INFO:tasks.workunit.client.0.smithi029.stdout:6/605: dread f4 [4194304,4194304] 0 2024-04-23T10:21:06.263 INFO:tasks.workunit.client.0.smithi029.stdout:6/606: readlink d9/df/d16/d1f/d27/l9e 0 2024-04-23T10:21:06.266 INFO:tasks.workunit.client.0.smithi029.stdout:2/471: creat d1/d31/d50/d9b/d9e/fa3 x:0 0 0 2024-04-23T10:21:06.336 INFO:tasks.workunit.client.0.smithi029.stdout:9/646: chown d0/d7/l5 15616 1 2024-04-23T10:21:06.342 INFO:tasks.workunit.client.0.smithi029.stdout:6/607: rename d9/df/d16/d44/c7a to d9/df/d16/d1f/d27/d33/da4/cd1 0 2024-04-23T10:21:06.347 INFO:tasks.workunit.client.0.smithi029.stdout:9/647: rmdir d0/d1b/d39/d50/d67 39 2024-04-23T10:21:06.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/608: symlink d9/df/d16/d34/d36/d63/ld2 0 2024-04-23T10:21:06.356 INFO:tasks.workunit.client.0.smithi029.stdout:6/609: truncate d9/df/d16/d44/fc6 707139 0 2024-04-23T10:21:06.359 INFO:tasks.workunit.client.0.smithi029.stdout:6/610: chown d9/df/d16/d1f/d27/d33/da4/d66/d95/da7 7465 1 2024-04-23T10:21:06.363 INFO:tasks.workunit.client.0.smithi029.stdout:0/336: getdents d0/d3e 0 2024-04-23T10:21:06.373 INFO:tasks.workunit.client.0.smithi029.stdout:0/337: creat d0/dc/d26/d44/d5c/f78 x:0 0 0 2024-04-23T10:21:06.385 INFO:tasks.workunit.client.0.smithi029.stdout:9/648: truncate d0/d1b/d39/d50/f80 3750719 0 2024-04-23T10:21:06.394 INFO:tasks.workunit.client.0.smithi029.stdout:6/611: dread d9/df/d16/d1f/d27/f70 [0,4194304] 0 2024-04-23T10:21:06.413 INFO:tasks.workunit.client.0.smithi029.stdout:0/338: dwrite d0/d1b/d62/f29 [0,4194304] 0 2024-04-23T10:21:06.415 INFO:tasks.workunit.client.0.smithi029.stdout:0/339: chown d0/dc/d26/f28 390411132 1 2024-04-23T10:21:06.426 INFO:tasks.workunit.client.0.smithi029.stdout:0/340: dread d0/dc/d26/d44/f45 [0,4194304] 0 2024-04-23T10:21:06.427 INFO:tasks.workunit.client.0.smithi029.stdout:0/341: readlink d0/dc/l60 0 2024-04-23T10:21:06.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/649: creat d0/d7/d1d/d35/d3b/db8/fe2 x:0 0 0 2024-04-23T10:21:06.442 INFO:tasks.workunit.client.0.smithi029.stdout:0/342: creat d0/d1b/f79 x:0 0 0 2024-04-23T10:21:06.449 INFO:tasks.workunit.client.0.smithi029.stdout:9/650: mkdir d0/d7/d1d/d35/d3b/db8/de3 0 2024-04-23T10:21:06.457 INFO:tasks.workunit.client.0.smithi029.stdout:9/651: mkdir d0/d7/d1d/d35/dd9/d49/d65/de4 0 2024-04-23T10:21:06.459 INFO:tasks.workunit.client.0.smithi029.stdout:9/652: chown d0/d7/d3f/lad 876249 1 2024-04-23T10:21:06.462 INFO:tasks.workunit.client.0.smithi029.stdout:9/653: write d0/d7/d1d/d35/f62 [1461775,127989] 0 2024-04-23T10:21:06.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/343: mknod d0/dc/d26/d44/d5c/d6a/c7a 0 2024-04-23T10:21:06.470 INFO:tasks.workunit.client.0.smithi029.stdout:6/612: getdents d9/df/d16 0 2024-04-23T10:21:06.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/654: creat d0/d7/d3f/dbb/fe5 x:0 0 0 2024-04-23T10:21:06.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/344: creat d0/d1b/d62/f7b x:0 0 0 2024-04-23T10:21:06.487 INFO:tasks.workunit.client.0.smithi029.stdout:0/345: dread - d0/d1b/d62/d55/f68 zero size 2024-04-23T10:21:06.508 INFO:tasks.workunit.client.0.smithi029.stdout:0/346: mkdir d0/d3e/d4e/d7c 0 2024-04-23T10:21:06.511 INFO:tasks.workunit.client.0.smithi029.stdout:9/655: link d0/d7/f12 d0/d7/d1d/d35/d3b/d68/fe6 0 2024-04-23T10:21:06.513 INFO:tasks.workunit.client.0.smithi029.stdout:6/613: truncate d9/df/f22 3746765 0 2024-04-23T10:21:06.514 INFO:tasks.workunit.client.0.smithi029.stdout:9/656: write d0/d7/f18 [3343977,68905] 0 2024-04-23T10:21:06.521 INFO:tasks.workunit.client.0.smithi029.stdout:0/347: unlink d0/dc/c19 0 2024-04-23T10:21:06.523 INFO:tasks.workunit.client.0.smithi029.stdout:6/614: symlink d9/df/d16/d44/d4c/ld3 0 2024-04-23T10:21:06.528 INFO:tasks.workunit.client.0.smithi029.stdout:0/348: write d0/dc/f36 [948325,130029] 0 2024-04-23T10:21:06.528 INFO:tasks.workunit.client.0.smithi029.stdout:6/615: stat d9/df/d16/daf/fbf 0 2024-04-23T10:21:06.531 INFO:tasks.workunit.client.0.smithi029.stdout:6/616: chown d9/df/d16/d34/d36/f6e 14641 1 2024-04-23T10:21:06.534 INFO:tasks.workunit.client.0.smithi029.stdout:9/657: creat d0/d7/d1d/d35/d3b/fe7 x:0 0 0 2024-04-23T10:21:06.538 INFO:tasks.workunit.client.0.smithi029.stdout:9/658: truncate d0/d1b/d39/d50/f16 1090860 0 2024-04-23T10:21:06.539 INFO:tasks.workunit.client.0.smithi029.stdout:0/349: symlink d0/d1b/d62/d3a/l7d 0 2024-04-23T10:21:06.543 INFO:tasks.workunit.client.0.smithi029.stdout:6/617: truncate d9/df/d16/f1a 3389722 0 2024-04-23T10:21:06.545 INFO:tasks.workunit.client.0.smithi029.stdout:0/350: mkdir d0/d3e/d4e/d50/d73/d7e 0 2024-04-23T10:21:06.558 INFO:tasks.workunit.client.0.smithi029.stdout:9/659: creat d0/d7/d1d/d35/da9/fe8 x:0 0 0 2024-04-23T10:21:06.561 INFO:tasks.workunit.client.0.smithi029.stdout:0/351: dwrite d0/d3e/d4e/d50/d73/f74 [0,4194304] 0 2024-04-23T10:21:06.562 INFO:tasks.workunit.client.0.smithi029.stdout:0/352: truncate d0/d1b/f5d 197123 0 2024-04-23T10:21:06.576 INFO:tasks.workunit.client.0.smithi029.stdout:6/618: dread d9/df/d16/d1f/f38 [0,4194304] 0 2024-04-23T10:21:06.591 INFO:tasks.workunit.client.0.smithi029.stdout:6/619: unlink d9/df/d16/d1f/c4b 0 2024-04-23T10:21:06.592 INFO:tasks.workunit.client.0.smithi029.stdout:6/620: fsync d9/df/d16/d44/d75/d90/fa1 0 2024-04-23T10:21:06.606 INFO:tasks.workunit.client.0.smithi029.stdout:6/621: truncate d9/df/d16/d34/f65 2338863 0 2024-04-23T10:21:06.613 INFO:tasks.workunit.client.0.smithi029.stdout:9/660: dwrite d0/f5b [0,4194304] 0 2024-04-23T10:21:06.614 INFO:tasks.workunit.client.0.smithi029.stdout:0/353: dwrite d0/dc/f15 [0,4194304] 0 2024-04-23T10:21:06.615 INFO:tasks.workunit.client.0.smithi029.stdout:9/661: fsync d0/d7/d3f/dbb/fe5 0 2024-04-23T10:21:06.616 INFO:tasks.workunit.client.0.smithi029.stdout:0/354: fdatasync d0/d1b/f3b 0 2024-04-23T10:21:06.621 INFO:tasks.workunit.client.0.smithi029.stdout:6/622: creat d9/df/d16/d1f/d27/d33/da4/d58/d7e/fd4 x:0 0 0 2024-04-23T10:21:06.622 INFO:tasks.workunit.client.0.smithi029.stdout:6/623: fsync d9/d5b/f71 0 2024-04-23T10:21:06.625 INFO:tasks.workunit.client.0.smithi029.stdout:0/355: fsync d0/dc/d26/f5f 0 2024-04-23T10:21:06.630 INFO:tasks.workunit.client.0.smithi029.stdout:6/624: rename d9/df/d16/d1f/d27/d33/da4/fb5 to d9/df/d16/d44/d75/fd5 0 2024-04-23T10:21:06.631 INFO:tasks.workunit.client.0.smithi029.stdout:6/625: chown d9/df/d16/d44/d75/d90 12370 1 2024-04-23T10:21:06.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/626: stat d9/df/d41/d49/fb3 0 2024-04-23T10:21:06.633 INFO:tasks.workunit.client.0.smithi029.stdout:0/356: rmdir d0/d3e/d4e/d50/d73 39 2024-04-23T10:21:06.635 INFO:tasks.workunit.client.0.smithi029.stdout:0/357: readlink d0/d1b/d62/d3a/l7d 0 2024-04-23T10:21:06.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/358: fdatasync d0/dc/d26/f5f 0 2024-04-23T10:21:06.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/359: rename d0/d1b/d62 to d0/d21/d7f 0 2024-04-23T10:21:06.647 INFO:tasks.workunit.client.0.smithi029.stdout:9/662: dread d0/d7/f18 [0,4194304] 0 2024-04-23T10:21:06.657 INFO:tasks.workunit.client.0.smithi029.stdout:9/663: dwrite d0/d7/d1d/f74 [0,4194304] 0 2024-04-23T10:21:06.660 INFO:tasks.workunit.client.0.smithi029.stdout:3/451: sync 2024-04-23T10:21:06.660 INFO:tasks.workunit.client.0.smithi029.stdout:0/360: stat d0/dc/d26/c46 0 2024-04-23T10:21:06.665 INFO:tasks.workunit.client.0.smithi029.stdout:6/627: getdents d9/df/d16/d34/d36/d63 0 2024-04-23T10:21:06.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/628: stat d9/df/d16/daf/fbf 0 2024-04-23T10:21:06.667 INFO:tasks.workunit.client.0.smithi029.stdout:6/629: write d9/f29 [3601056,79940] 0 2024-04-23T10:21:06.671 INFO:tasks.workunit.client.0.smithi029.stdout:0/361: symlink d0/d1b/d67/d6c/l80 0 2024-04-23T10:21:06.683 INFO:tasks.workunit.client.0.smithi029.stdout:5/529: sync 2024-04-23T10:21:06.683 INFO:tasks.workunit.client.0.smithi029.stdout:7/532: sync 2024-04-23T10:21:06.683 INFO:tasks.workunit.client.0.smithi029.stdout:2/472: sync 2024-04-23T10:21:06.683 INFO:tasks.workunit.client.0.smithi029.stdout:1/410: sync 2024-04-23T10:21:06.683 INFO:tasks.workunit.client.0.smithi029.stdout:8/491: sync 2024-04-23T10:21:06.683 INFO:tasks.workunit.client.0.smithi029.stdout:4/497: sync 2024-04-23T10:21:06.684 INFO:tasks.workunit.client.0.smithi029.stdout:9/664: dread d0/d7/d3f/dbb/fc9 [0,4194304] 0 2024-04-23T10:21:06.688 INFO:tasks.workunit.client.0.smithi029.stdout:8/492: write d3/d50/d6a/d95/f88 [707131,72] 0 2024-04-23T10:21:06.690 INFO:tasks.workunit.client.0.smithi029.stdout:3/452: creat d3/d10/de/d2e/d36/fa5 x:0 0 0 2024-04-23T10:21:06.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/411: rmdir d5/d6/d34 39 2024-04-23T10:21:06.695 INFO:tasks.workunit.client.0.smithi029.stdout:8/493: chown d3/d50/d6a/d95/d36/l5b 24 1 2024-04-23T10:21:06.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/630: dread d9/df/d41/f6c [0,4194304] 0 2024-04-23T10:21:06.697 INFO:tasks.workunit.client.0.smithi029.stdout:9/665: readlink d0/d1b/laf 0 2024-04-23T10:21:06.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/473: fsync d1/dd/d47/f53 0 2024-04-23T10:21:06.699 INFO:tasks.workunit.client.0.smithi029.stdout:1/412: readlink d5/d6/de/d27/d38/l4a 0 2024-04-23T10:21:06.700 INFO:tasks.workunit.client.0.smithi029.stdout:3/453: read - d3/d10/de/d2e/d36/d40/d46/d72/d28/f64 zero size 2024-04-23T10:21:06.700 INFO:tasks.workunit.client.0.smithi029.stdout:4/498: dread d0/d3c/d52/d1b/d36/d45/d4f/f7f [0,4194304] 0 2024-04-23T10:21:06.703 INFO:tasks.workunit.client.0.smithi029.stdout:0/362: dread d0/dc/d26/f28 [0,4194304] 0 2024-04-23T10:21:06.703 INFO:tasks.workunit.client.0.smithi029.stdout:7/533: rmdir d5/d8/d1a/d8a/d95 0 2024-04-23T10:21:06.704 INFO:tasks.workunit.client.0.smithi029.stdout:1/413: chown d5/d6/de/d22/c71 33004 1 2024-04-23T10:21:06.704 INFO:tasks.workunit.client.0.smithi029.stdout:6/631: read d9/df/f73 [3709007,105068] 0 2024-04-23T10:21:06.708 INFO:tasks.workunit.client.0.smithi029.stdout:4/499: mknod d0/d3c/d52/d1b/d66/cad 0 2024-04-23T10:21:06.711 INFO:tasks.workunit.client.0.smithi029.stdout:0/363: write d0/d21/d7f/d3a/f6e [31682,130279] 0 2024-04-23T10:21:06.716 INFO:tasks.workunit.client.0.smithi029.stdout:6/632: fsync d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/fac 0 2024-04-23T10:21:06.716 INFO:tasks.workunit.client.0.smithi029.stdout:8/494: dwrite d3/f26 [4194304,4194304] 0 2024-04-23T10:21:06.717 INFO:tasks.workunit.client.0.smithi029.stdout:5/530: dwrite d0/d35/d38/d51/f4a [0,4194304] 0 2024-04-23T10:21:06.721 INFO:tasks.workunit.client.0.smithi029.stdout:5/531: stat d0/d35/d38/db3 0 2024-04-23T10:21:06.722 INFO:tasks.workunit.client.0.smithi029.stdout:0/364: mknod d0/d3e/c81 0 2024-04-23T10:21:06.727 INFO:tasks.workunit.client.0.smithi029.stdout:9/666: dread d0/d7/d1d/d35/d3b/d68/f91 [0,4194304] 0 2024-04-23T10:21:06.727 INFO:tasks.workunit.client.0.smithi029.stdout:5/532: fsync d0/f12 0 2024-04-23T10:21:06.731 INFO:tasks.workunit.client.0.smithi029.stdout:8/495: rmdir d3/d50/d6a/d95/d36/d68/d8c 39 2024-04-23T10:21:06.731 INFO:tasks.workunit.client.0.smithi029.stdout:1/414: getdents d5/d6/de/d27/d38 0 2024-04-23T10:21:06.732 INFO:tasks.workunit.client.0.smithi029.stdout:2/474: dwrite d1/d3e/d5a/f6e [0,4194304] 0 2024-04-23T10:21:06.735 INFO:tasks.workunit.client.0.smithi029.stdout:0/365: write d0/d21/d7f/f29 [1156181,41789] 0 2024-04-23T10:21:06.735 INFO:tasks.workunit.client.0.smithi029.stdout:6/633: creat d9/df/d41/d49/d69/fd6 x:0 0 0 2024-04-23T10:21:06.737 INFO:tasks.workunit.client.0.smithi029.stdout:7/534: dwrite d5/d29/f5b [0,4194304] 0 2024-04-23T10:21:06.738 INFO:tasks.workunit.client.0.smithi029.stdout:5/533: chown d0/d35/d10 22 1 2024-04-23T10:21:06.743 INFO:tasks.workunit.client.0.smithi029.stdout:2/475: write d1/d3e/f79 [476048,86381] 0 2024-04-23T10:21:06.743 INFO:tasks.workunit.client.0.smithi029.stdout:9/667: chown d0/d1b/d39/d4f/la8 0 1 2024-04-23T10:21:06.743 INFO:tasks.workunit.client.0.smithi029.stdout:3/454: link d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/c97 d3/d10/d48/ca6 0 2024-04-23T10:21:06.746 INFO:tasks.workunit.client.0.smithi029.stdout:7/535: unlink d5/f47 0 2024-04-23T10:21:06.746 INFO:tasks.workunit.client.0.smithi029.stdout:4/500: dwrite d0/d3c/d52/f26 [0,4194304] 0 2024-04-23T10:21:06.748 INFO:tasks.workunit.client.0.smithi029.stdout:5/534: stat d0/d35/d38/d3e/d66/d5a/d78/d3d 0 2024-04-23T10:21:06.748 INFO:tasks.workunit.client.0.smithi029.stdout:7/536: fsync d5/d8/f43 0 2024-04-23T10:21:06.749 INFO:tasks.workunit.client.0.smithi029.stdout:2/476: truncate d1/d3e/d5a/f6f 2435075 0 2024-04-23T10:21:06.749 INFO:tasks.workunit.client.0.smithi029.stdout:1/415: truncate d5/d6/de/d27/d38/f65 480150 0 2024-04-23T10:21:06.751 INFO:tasks.workunit.client.0.smithi029.stdout:6/634: write d9/df/d16/f7d [1035404,23737] 0 2024-04-23T10:21:06.751 INFO:tasks.workunit.client.0.smithi029.stdout:7/537: stat d5/d9/f2b 0 2024-04-23T10:21:06.751 INFO:tasks.workunit.client.0.smithi029.stdout:2/477: stat d1/d31/d50/d9b/d9e/fa3 0 2024-04-23T10:21:06.753 INFO:tasks.workunit.client.0.smithi029.stdout:8/496: mknod d3/d50/d6a/d95/d36/d97/c98 0 2024-04-23T10:21:06.755 INFO:tasks.workunit.client.0.smithi029.stdout:0/366: creat d0/dc/d26/d44/d4c/d6d/f82 x:0 0 0 2024-04-23T10:21:06.755 INFO:tasks.workunit.client.0.smithi029.stdout:4/501: rmdir d0/d3c 39 2024-04-23T10:21:06.758 INFO:tasks.workunit.client.0.smithi029.stdout:5/535: fdatasync d0/d35/d38/d51/fa9 0 2024-04-23T10:21:06.759 INFO:tasks.workunit.client.0.smithi029.stdout:1/416: mkdir d5/d6/de/d22/d84 0 2024-04-23T10:21:06.760 INFO:tasks.workunit.client.0.smithi029.stdout:7/538: mkdir d5/d8/d51/d9e/db2 0 2024-04-23T10:21:06.760 INFO:tasks.workunit.client.0.smithi029.stdout:5/536: fdatasync d0/d35/d38/d39/f86 0 2024-04-23T10:21:06.762 INFO:tasks.workunit.client.0.smithi029.stdout:8/497: creat d3/d50/d6a/f99 x:0 0 0 2024-04-23T10:21:06.763 INFO:tasks.workunit.client.0.smithi029.stdout:7/539: stat d5/d8/d1a/d8a/d8b 0 2024-04-23T10:21:06.764 INFO:tasks.workunit.client.0.smithi029.stdout:2/478: rename d1/d3e/d5a/f8d to d1/d3e/d3b/d75/fa4 0 2024-04-23T10:21:06.766 INFO:tasks.workunit.client.0.smithi029.stdout:3/455: getdents d3/d10/de 0 2024-04-23T10:21:06.767 INFO:tasks.workunit.client.0.smithi029.stdout:8/498: symlink d3/d50/d6a/d95/d36/d97/l9a 0 2024-04-23T10:21:06.768 INFO:tasks.workunit.client.0.smithi029.stdout:1/417: symlink d5/d6/de/d15/l85 0 2024-04-23T10:21:06.770 INFO:tasks.workunit.client.0.smithi029.stdout:2/479: read d1/d3e/d5a/f6e [2657771,39843] 0 2024-04-23T10:21:06.774 INFO:tasks.workunit.client.0.smithi029.stdout:3/456: chown d3/d15/la0 15126456 1 2024-04-23T10:21:06.775 INFO:tasks.workunit.client.0.smithi029.stdout:0/367: write d0/dc/f23 [4988858,5891] 0 2024-04-23T10:21:06.779 INFO:tasks.workunit.client.0.smithi029.stdout:5/537: truncate d0/d35/d38/d51/f4a 1874542 0 2024-04-23T10:21:06.780 INFO:tasks.workunit.client.0.smithi029.stdout:2/480: fdatasync d1/dd/d47/d63/d64/f6b 0 2024-04-23T10:21:06.781 INFO:tasks.workunit.client.0.smithi029.stdout:0/368: chown d0/d1b/f5d 1341269653 1 2024-04-23T10:21:06.783 INFO:tasks.workunit.client.0.smithi029.stdout:1/418: write d5/d6/de/d27/d38/f67 [161355,38764] 0 2024-04-23T10:21:06.785 INFO:tasks.workunit.client.0.smithi029.stdout:9/668: dwrite d0/f1e [0,4194304] 0 2024-04-23T10:21:06.788 INFO:tasks.workunit.client.0.smithi029.stdout:6/635: dwrite d9/df/d16/d34/d36/f6e [0,4194304] 0 2024-04-23T10:21:06.791 INFO:tasks.workunit.client.0.smithi029.stdout:3/457: fdatasync d3/d10/de/d2e/d36/d40/d46/f9f 0 2024-04-23T10:21:06.792 INFO:tasks.workunit.client.0.smithi029.stdout:2/481: mknod d1/d31/d50/ca5 0 2024-04-23T10:21:06.793 INFO:tasks.workunit.client.0.smithi029.stdout:7/540: dwrite d5/d8/d1a/f76 [0,4194304] 0 2024-04-23T10:21:06.795 INFO:tasks.workunit.client.0.smithi029.stdout:7/541: dread - d5/d29/d4a/f93 zero size 2024-04-23T10:21:06.797 INFO:tasks.workunit.client.0.smithi029.stdout:8/499: dwrite d3/f66 [0,4194304] 0 2024-04-23T10:21:06.799 INFO:tasks.workunit.client.0.smithi029.stdout:0/369: write d0/d21/f53 [1583265,20070] 0 2024-04-23T10:21:06.800 INFO:tasks.workunit.client.0.smithi029.stdout:2/482: write d1/dd/d22/f88 [1019736,62383] 0 2024-04-23T10:21:06.821 INFO:tasks.workunit.client.0.smithi029.stdout:3/458: write d3/d45/f7b [1644236,89947] 0 2024-04-23T10:21:06.822 INFO:tasks.workunit.client.0.smithi029.stdout:6/636: dwrite d9/df/d16/d1f/d27/d33/da4/d58/f5a [4194304,4194304] 0 2024-04-23T10:21:06.823 INFO:tasks.workunit.client.0.smithi029.stdout:8/500: dwrite d3/d50/f64 [4194304,4194304] 0 2024-04-23T10:21:06.825 INFO:tasks.workunit.client.0.smithi029.stdout:9/669: creat d0/d1b/fe9 x:0 0 0 2024-04-23T10:21:06.826 INFO:tasks.workunit.client.0.smithi029.stdout:3/459: write d3/f69 [4726816,21323] 0 2024-04-23T10:21:06.830 INFO:tasks.workunit.client.0.smithi029.stdout:0/370: dwrite d0/d1b/f3b [0,4194304] 0 2024-04-23T10:21:06.831 INFO:tasks.workunit.client.0.smithi029.stdout:5/538: getdents d0/d35/d10/d26 0 2024-04-23T10:21:06.833 INFO:tasks.workunit.client.0.smithi029.stdout:1/419: getdents d5/d6/d34 0 2024-04-23T10:21:06.833 INFO:tasks.workunit.client.0.smithi029.stdout:6/637: mknod d9/df/d16/d1f/d27/d33/cd7 0 2024-04-23T10:21:06.836 INFO:tasks.workunit.client.0.smithi029.stdout:7/542: getdents d5/d8/d1a/d4d 0 2024-04-23T10:21:06.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/483: truncate d1/f2e 705117 0 2024-04-23T10:21:06.838 INFO:tasks.workunit.client.0.smithi029.stdout:8/501: fdatasync d3/d50/d6a/d95/d36/d68/f87 0 2024-04-23T10:21:06.838 INFO:tasks.workunit.client.0.smithi029.stdout:7/543: chown d5/d9 24205736 1 2024-04-23T10:21:06.839 INFO:tasks.workunit.client.0.smithi029.stdout:5/539: creat d0/d35/d38/d3e/d66/d5a/d78/d3d/fba x:0 0 0 2024-04-23T10:21:06.840 INFO:tasks.workunit.client.0.smithi029.stdout:1/420: symlink d5/d6/de/d15/d7b/l86 0 2024-04-23T10:21:06.841 INFO:tasks.workunit.client.0.smithi029.stdout:6/638: mkdir d9/df/d16/d1f/d27/d33/da4/dd8 0 2024-04-23T10:21:06.842 INFO:tasks.workunit.client.0.smithi029.stdout:7/544: creat d5/d9/fb3 x:0 0 0 2024-04-23T10:21:06.843 INFO:tasks.workunit.client.0.smithi029.stdout:8/502: stat d3/l24 0 2024-04-23T10:21:06.844 INFO:tasks.workunit.client.0.smithi029.stdout:2/484: mkdir d1/dd/d47/d63/d64/d78/da6 0 2024-04-23T10:21:06.845 INFO:tasks.workunit.client.0.smithi029.stdout:9/670: getdents d0/d7/d1d/d35/d3b/d68 0 2024-04-23T10:21:06.847 INFO:tasks.workunit.client.0.smithi029.stdout:0/371: getdents d0/d1b/d67 0 2024-04-23T10:21:06.851 INFO:tasks.workunit.client.0.smithi029.stdout:2/485: creat d1/dd/d47/d63/fa7 x:0 0 0 2024-04-23T10:21:06.852 INFO:tasks.workunit.client.0.smithi029.stdout:5/540: rename d0/d35/d38/d51/f46 to d0/d9a/fbb 0 2024-04-23T10:21:06.853 INFO:tasks.workunit.client.0.smithi029.stdout:7/545: symlink d5/d8/d1a/lb4 0 2024-04-23T10:21:06.853 INFO:tasks.workunit.client.0.smithi029.stdout:6/639: truncate d9/df/d16/d1f/d27/d33/da4/d66/d95/faa 633275 0 2024-04-23T10:21:06.854 INFO:tasks.workunit.client.0.smithi029.stdout:8/503: symlink d3/d50/d6a/d95/d36/d68/l9b 0 2024-04-23T10:21:06.858 INFO:tasks.workunit.client.0.smithi029.stdout:3/460: dread d3/d45/f7b [0,4194304] 0 2024-04-23T10:21:06.859 INFO:tasks.workunit.client.0.smithi029.stdout:0/372: mknod d0/d3e/d4e/d50/c83 0 2024-04-23T10:21:06.861 INFO:tasks.workunit.client.0.smithi029.stdout:1/421: dwrite d5/d6/de/d27/d38/f65 [0,4194304] 0 2024-04-23T10:21:06.862 INFO:tasks.workunit.client.0.smithi029.stdout:2/486: rename d1/d4/l12 to d1/dd/d47/d63/la8 0 2024-04-23T10:21:06.863 INFO:tasks.workunit.client.0.smithi029.stdout:6/640: mkdir d9/df/d16/d44/d4c/dd9 0 2024-04-23T10:21:06.863 INFO:tasks.workunit.client.0.smithi029.stdout:7/546: creat d5/d8/d51/d55/d59/fb5 x:0 0 0 2024-04-23T10:21:06.865 INFO:tasks.workunit.client.0.smithi029.stdout:3/461: chown d3/d10/de/d2e/d36/d40/d46/d72/d75 7693054 1 2024-04-23T10:21:06.865 INFO:tasks.workunit.client.0.smithi029.stdout:7/547: stat d5/d8 0 2024-04-23T10:21:06.866 INFO:tasks.workunit.client.0.smithi029.stdout:8/504: creat d3/f9c x:0 0 0 2024-04-23T10:21:06.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/671: dwrite d0/d7/d3f/f40 [0,4194304] 0 2024-04-23T10:21:06.867 INFO:tasks.workunit.client.0.smithi029.stdout:1/422: write d5/d6/f40 [2020571,41737] 0 2024-04-23T10:21:06.868 INFO:tasks.workunit.client.0.smithi029.stdout:6/641: chown d9/df/d16/d44/fc6 57 1 2024-04-23T10:21:06.870 INFO:tasks.workunit.client.0.smithi029.stdout:7/548: fsync d5/d29/d4a/f93 0 2024-04-23T10:21:06.873 INFO:tasks.workunit.client.0.smithi029.stdout:8/505: symlink d3/d7d/l9d 0 2024-04-23T10:21:06.878 INFO:tasks.workunit.client.0.smithi029.stdout:3/462: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7 0 2024-04-23T10:21:06.878 INFO:tasks.workunit.client.0.smithi029.stdout:5/541: dwrite d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/f88 [4194304,4194304] 0 2024-04-23T10:21:06.879 INFO:tasks.workunit.client.0.smithi029.stdout:6/642: fsync d9/df/d16/d44/d75/d90/fa3 0 2024-04-23T10:21:06.880 INFO:tasks.workunit.client.0.smithi029.stdout:7/549: dread - d5/d29/d4a/f56 zero size 2024-04-23T10:21:06.881 INFO:tasks.workunit.client.0.smithi029.stdout:0/373: dread d0/dc/d26/d44/f45 [0,4194304] 0 2024-04-23T10:21:06.882 INFO:tasks.workunit.client.0.smithi029.stdout:9/672: write d0/d1b/d39/d50/d67/db6/fd1 [1690152,10549] 0 2024-04-23T10:21:06.885 INFO:tasks.workunit.client.0.smithi029.stdout:5/542: chown d0/d35/d10/d26/l6e 1160896 1 2024-04-23T10:21:06.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/643: fdatasync d9/df/f73 0 2024-04-23T10:21:06.888 INFO:tasks.workunit.client.0.smithi029.stdout:8/506: link d3/d38/f49 d3/d50/d6a/d95/d36/d68/f9e 0 2024-04-23T10:21:06.893 INFO:tasks.workunit.client.0.smithi029.stdout:6/644: fsync d9/df/d16/d1f/d27/f57 0 2024-04-23T10:21:06.894 INFO:tasks.workunit.client.0.smithi029.stdout:1/423: truncate d5/d6/de/d27/d38/d47/f57 3716084 0 2024-04-23T10:21:06.894 INFO:tasks.workunit.client.0.smithi029.stdout:5/543: fdatasync d0/d35/d38/d39/d3f/f7d 0 2024-04-23T10:21:06.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/673: mknod d0/d1b/d39/cea 0 2024-04-23T10:21:06.897 INFO:tasks.workunit.client.0.smithi029.stdout:1/424: readlink d5/d3e/l50 0 2024-04-23T10:21:06.898 INFO:tasks.workunit.client.0.smithi029.stdout:6/645: chown d9/df/d16/l1d 263 1 2024-04-23T10:21:06.900 INFO:tasks.workunit.client.0.smithi029.stdout:7/550: getdents d5/d29 0 2024-04-23T10:21:06.903 INFO:tasks.workunit.client.0.smithi029.stdout:8/507: creat d3/d71/d96/f9f x:0 0 0 2024-04-23T10:21:06.904 INFO:tasks.workunit.client.0.smithi029.stdout:9/674: mknod d0/d1b/d39/d4f/ceb 0 2024-04-23T10:21:06.905 INFO:tasks.workunit.client.0.smithi029.stdout:0/374: dwrite d0/d21/d7f/f30 [0,4194304] 0 2024-04-23T10:21:06.906 INFO:tasks.workunit.client.0.smithi029.stdout:5/544: stat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/fa6 0 2024-04-23T10:21:06.907 INFO:tasks.workunit.client.0.smithi029.stdout:3/463: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d5e/f9e [0,4194304] 0 2024-04-23T10:21:06.907 INFO:tasks.workunit.client.0.smithi029.stdout:1/425: mknod d5/d6/d34/c87 0 2024-04-23T10:21:06.908 INFO:tasks.workunit.client.0.smithi029.stdout:7/551: chown d5/d8/d51/d9e/cae 8 1 2024-04-23T10:21:06.910 INFO:tasks.workunit.client.0.smithi029.stdout:6/646: unlink d9/df/d16/d44/f62 0 2024-04-23T10:21:06.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/552: readlink d5/d8/l15 0 2024-04-23T10:21:06.911 INFO:tasks.workunit.client.0.smithi029.stdout:5/545: mkdir d0/d35/d10/d26/db2/dbc 0 2024-04-23T10:21:06.913 INFO:tasks.workunit.client.0.smithi029.stdout:1/426: creat d5/d6/de/d22/d77/f88 x:0 0 0 2024-04-23T10:21:06.915 INFO:tasks.workunit.client.0.smithi029.stdout:0/375: truncate d0/f4 502091 0 2024-04-23T10:21:06.916 INFO:tasks.workunit.client.0.smithi029.stdout:8/508: write d3/d50/d6a/d95/d36/d68/f6d [488386,7634] 0 2024-04-23T10:21:06.917 INFO:tasks.workunit.client.0.smithi029.stdout:3/464: unlink d3/d10/de/d2e/d36/d40/d46/d72/c2c 0 2024-04-23T10:21:06.919 INFO:tasks.workunit.client.0.smithi029.stdout:7/553: rename d5/d29/d4a/f7e to d5/d71/d92/fb6 0 2024-04-23T10:21:06.923 INFO:tasks.workunit.client.0.smithi029.stdout:1/427: creat d5/d6/de/d22/d77/f89 x:0 0 0 2024-04-23T10:21:06.923 INFO:tasks.workunit.client.0.smithi029.stdout:0/376: fsync d0/f1 0 2024-04-23T10:21:06.928 INFO:tasks.workunit.client.0.smithi029.stdout:3/465: mknod d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/ca8 0 2024-04-23T10:21:06.930 INFO:tasks.workunit.client.0.smithi029.stdout:3/466: chown d3/f69 0 1 2024-04-23T10:21:06.932 INFO:tasks.workunit.client.0.smithi029.stdout:8/509: dwrite d3/f66 [0,4194304] 0 2024-04-23T10:21:06.935 INFO:tasks.workunit.client.0.smithi029.stdout:7/554: dwrite d5/d8/d1a/d9c/fab [0,4194304] 0 2024-04-23T10:21:06.936 INFO:tasks.workunit.client.0.smithi029.stdout:9/675: truncate d0/d1b/d39/f97 1156078 0 2024-04-23T10:21:06.938 INFO:tasks.workunit.client.0.smithi029.stdout:6/647: truncate d9/df/d16/d34/d36/fb1 3156624 0 2024-04-23T10:21:06.940 INFO:tasks.workunit.client.0.smithi029.stdout:3/467: mknod d3/d10/de/d2e/d36/d40/d46/d72/d28/ca9 0 2024-04-23T10:21:06.941 INFO:tasks.workunit.client.0.smithi029.stdout:8/510: mknod d3/ca0 0 2024-04-23T10:21:06.949 INFO:tasks.workunit.client.0.smithi029.stdout:8/511: read d3/d50/d6a/d95/d36/f3b [9794,7431] 0 2024-04-23T10:21:06.950 INFO:tasks.workunit.client.0.smithi029.stdout:1/428: dread d5/d6/d34/d63/f7d [0,4194304] 0 2024-04-23T10:21:06.952 INFO:tasks.workunit.client.0.smithi029.stdout:0/377: dread d0/f4a [0,4194304] 0 2024-04-23T10:21:06.954 INFO:tasks.workunit.client.0.smithi029.stdout:5/546: dwrite d0/d35/d38/d39/d3f/f7b [0,4194304] 0 2024-04-23T10:21:06.959 INFO:tasks.workunit.client.0.smithi029.stdout:0/378: fdatasync d0/d3e/f72 0 2024-04-23T10:21:06.961 INFO:tasks.workunit.client.0.smithi029.stdout:9/676: mkdir d0/d7/d1d/d35/dd5/dec 0 2024-04-23T10:21:06.961 INFO:tasks.workunit.client.0.smithi029.stdout:5/547: write d0/d35/d38/d39/f94 [527466,82419] 0 2024-04-23T10:21:06.963 INFO:tasks.workunit.client.0.smithi029.stdout:7/555: truncate d5/d8/d51/d55/f66 2429915 0 2024-04-23T10:21:06.963 INFO:tasks.workunit.client.0.smithi029.stdout:1/429: truncate d5/d6/de/d22/f5b 4470706 0 2024-04-23T10:21:06.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/677: stat d0/f5b 0 2024-04-23T10:21:06.970 INFO:tasks.workunit.client.0.smithi029.stdout:3/468: dread d3/d10/de/d2e/d36/d40/d46/f9f [0,4194304] 0 2024-04-23T10:21:06.973 INFO:tasks.workunit.client.0.smithi029.stdout:0/379: symlink d0/l84 0 2024-04-23T10:21:06.980 INFO:tasks.workunit.client.0.smithi029.stdout:6/648: dwrite d9/df/d16/d1f/d27/d33/f4e [0,4194304] 0 2024-04-23T10:21:06.981 INFO:tasks.workunit.client.0.smithi029.stdout:3/469: mkdir d3/d10/de/d2e/daa 0 2024-04-23T10:21:06.983 INFO:tasks.workunit.client.0.smithi029.stdout:8/512: dwrite d3/d50/d6a/d95/f54 [0,4194304] 0 2024-04-23T10:21:06.984 INFO:tasks.workunit.client.0.smithi029.stdout:3/470: dread - d3/d10/fa1 zero size 2024-04-23T10:21:06.986 INFO:tasks.workunit.client.0.smithi029.stdout:7/556: getdents d5/d8/d1a/d8a 0 2024-04-23T10:21:06.988 INFO:tasks.workunit.client.0.smithi029.stdout:9/678: rename d0/d1b/d39/c78 to d0/d7/d1d/d35/d3b/d68/dbd/ced 0 2024-04-23T10:21:06.989 INFO:tasks.workunit.client.0.smithi029.stdout:0/380: write d0/d21/d7f/d55/f68 [943476,115321] 0 2024-04-23T10:21:06.990 INFO:tasks.workunit.client.0.smithi029.stdout:1/430: truncate d5/d6/de/d22/f5b 90332 0 2024-04-23T10:21:06.993 INFO:tasks.workunit.client.0.smithi029.stdout:8/513: symlink d3/d44/la1 0 2024-04-23T10:21:06.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/557: fsync d5/d71/d92/fb6 0 2024-04-23T10:21:06.997 INFO:tasks.workunit.client.0.smithi029.stdout:3/471: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7/dab 0 2024-04-23T10:21:06.998 INFO:tasks.workunit.client.0.smithi029.stdout:1/431: unlink d5/d6/de/d22/f80 0 2024-04-23T10:21:06.999 INFO:tasks.workunit.client.0.smithi029.stdout:0/381: unlink d0/d3e/d4e/d50/l5e 0 2024-04-23T10:21:07.000 INFO:tasks.workunit.client.0.smithi029.stdout:9/679: creat d0/fee x:0 0 0 2024-04-23T10:21:07.003 INFO:tasks.workunit.client.0.smithi029.stdout:6/649: rename d9/d5b/cb7 to d9/df/cda 0 2024-04-23T10:21:07.006 INFO:tasks.workunit.client.0.smithi029.stdout:0/382: getdents d0/d3e/d4e/d50/d71 0 2024-04-23T10:21:07.010 INFO:tasks.workunit.client.0.smithi029.stdout:8/514: write d3/f29 [873907,65726] 0 2024-04-23T10:21:07.011 INFO:tasks.workunit.client.0.smithi029.stdout:6/650: symlink d9/df/d41/d49/dcc/ldb 0 2024-04-23T10:21:07.014 INFO:tasks.workunit.client.0.smithi029.stdout:9/680: rename d0/d7/cd2 to d0/d7/d1d/d35/dde/dba/cef 0 2024-04-23T10:21:07.018 INFO:tasks.workunit.client.0.smithi029.stdout:6/651: mkdir d9/df/d16/d44/d4c/dbb/ddc 0 2024-04-23T10:21:07.020 INFO:tasks.workunit.client.0.smithi029.stdout:0/383: rename d0/dc/l14 to d0/d21/d7f/d3a/l85 0 2024-04-23T10:21:07.021 INFO:tasks.workunit.client.0.smithi029.stdout:9/681: fdatasync d0/d7/f17 0 2024-04-23T10:21:07.025 INFO:tasks.workunit.client.0.smithi029.stdout:3/472: dwrite d3/d10/de/d2e/d36/d40/f7e [0,4194304] 0 2024-04-23T10:21:07.025 INFO:tasks.workunit.client.0.smithi029.stdout:0/384: chown d0/dc/d26/d44/c75 15401949 1 2024-04-23T10:21:07.029 INFO:tasks.workunit.client.0.smithi029.stdout:1/432: dwrite d5/d6/de/d27/f35 [0,4194304] 0 2024-04-23T10:21:07.032 INFO:tasks.workunit.client.0.smithi029.stdout:6/652: truncate d9/df/d16/d1f/d27/d33/da4/d66/d95/f98 1167663 0 2024-04-23T10:21:07.033 INFO:tasks.workunit.client.0.smithi029.stdout:8/515: dwrite d3/f22 [0,4194304] 0 2024-04-23T10:21:07.034 INFO:tasks.workunit.client.0.smithi029.stdout:9/682: creat d0/d1b/d39/d4f/ff0 x:0 0 0 2024-04-23T10:21:07.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/516: readlink d3/l4b 0 2024-04-23T10:21:07.037 INFO:tasks.workunit.client.0.smithi029.stdout:0/385: creat d0/d21/d7f/d3a/f86 x:0 0 0 2024-04-23T10:21:07.040 INFO:tasks.workunit.client.0.smithi029.stdout:3/473: mknod d3/d10/de/d2e/d36/d40/d43/cac 0 2024-04-23T10:21:07.043 INFO:tasks.workunit.client.0.smithi029.stdout:9/683: fdatasync d0/d7/f18 0 2024-04-23T10:21:07.045 INFO:tasks.workunit.client.0.smithi029.stdout:0/386: creat d0/d21/d7f/d3a/f87 x:0 0 0 2024-04-23T10:21:07.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/474: fsync d3/d10/de/d2e/d36/d40/d46/f7f 0 2024-04-23T10:21:07.050 INFO:tasks.workunit.client.0.smithi029.stdout:6/653: dwrite d9/df/d16/d34/d36/d63/fce [0,4194304] 0 2024-04-23T10:21:07.053 INFO:tasks.workunit.client.0.smithi029.stdout:0/387: creat d0/d3e/f88 x:0 0 0 2024-04-23T10:21:07.053 INFO:tasks.workunit.client.0.smithi029.stdout:6/654: chown d9/df/d16/l52 5 1 2024-04-23T10:21:07.056 INFO:tasks.workunit.client.0.smithi029.stdout:3/475: read d3/d15/f18 [3736342,107656] 0 2024-04-23T10:21:07.056 INFO:tasks.workunit.client.0.smithi029.stdout:0/388: write d0/dc/d26/d44/d5c/f78 [294607,116977] 0 2024-04-23T10:21:07.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/517: dwrite d3/d44/f62 [0,4194304] 0 2024-04-23T10:21:07.060 INFO:tasks.workunit.client.0.smithi029.stdout:0/389: write d0/d21/f77 [227208,38043] 0 2024-04-23T10:21:07.061 INFO:tasks.workunit.client.0.smithi029.stdout:6/655: read d9/df/d16/d1f/d27/d33/f32 [648349,113610] 0 2024-04-23T10:21:07.062 INFO:tasks.workunit.client.0.smithi029.stdout:0/390: read d0/d1b/f37 [866319,37820] 0 2024-04-23T10:21:07.065 INFO:tasks.workunit.client.0.smithi029.stdout:3/476: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad 0 2024-04-23T10:21:07.068 INFO:tasks.workunit.client.0.smithi029.stdout:8/518: creat d3/d71/fa2 x:0 0 0 2024-04-23T10:21:07.073 INFO:tasks.workunit.client.0.smithi029.stdout:0/391: unlink d0/d21/d7f/d3a/f6e 0 2024-04-23T10:21:07.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/684: dwrite d0/d1b/d24/f6e [0,4194304] 0 2024-04-23T10:21:07.077 INFO:tasks.workunit.client.0.smithi029.stdout:8/519: creat d3/d50/d6a/fa3 x:0 0 0 2024-04-23T10:21:07.078 INFO:tasks.workunit.client.0.smithi029.stdout:8/520: chown l2 3786405 1 2024-04-23T10:21:07.080 INFO:tasks.workunit.client.0.smithi029.stdout:0/392: chown d0/l9 279519170 1 2024-04-23T10:21:07.085 INFO:tasks.workunit.client.0.smithi029.stdout:9/685: mkdir d0/d7/d1d/d35/dd9/d49/df1 0 2024-04-23T10:21:07.085 INFO:tasks.workunit.client.0.smithi029.stdout:8/521: rmdir d3/d50/d6a/d95/d36/d3e 39 2024-04-23T10:21:07.086 INFO:tasks.workunit.client.0.smithi029.stdout:6/656: dwrite f4 [4194304,4194304] 0 2024-04-23T10:21:07.087 INFO:tasks.workunit.client.0.smithi029.stdout:1/433: dread d5/d6/de/d15/f3b [0,4194304] 0 2024-04-23T10:21:07.091 INFO:tasks.workunit.client.0.smithi029.stdout:9/686: mkdir d0/d7/d1d/d35/dd5/df2 0 2024-04-23T10:21:07.091 INFO:tasks.workunit.client.0.smithi029.stdout:3/477: dwrite d3/d45/d4f/d6b/f74 [0,4194304] 0 2024-04-23T10:21:07.094 INFO:tasks.workunit.client.0.smithi029.stdout:0/393: dread d0/d21/f77 [0,4194304] 0 2024-04-23T10:21:07.101 INFO:tasks.workunit.client.0.smithi029.stdout:6/657: readlink d9/df/d41/d49/d69/l99 0 2024-04-23T10:21:07.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/394: dwrite d0/d21/d7f/f48 [0,4194304] 0 2024-04-23T10:21:07.102 INFO:tasks.workunit.client.0.smithi029.stdout:9/687: readlink d0/d1b/d39/d4f/ldd 0 2024-04-23T10:21:07.104 INFO:tasks.workunit.client.0.smithi029.stdout:0/395: write d0/dc/d26/d44/f45 [2414003,125197] 0 2024-04-23T10:21:07.105 INFO:tasks.workunit.client.0.smithi029.stdout:8/522: rmdir d3/d50/d6a/d95/d36/d68/d8c 39 2024-04-23T10:21:07.108 INFO:tasks.workunit.client.0.smithi029.stdout:3/478: rename d3/d10/de/d2e/d36/d40/d46/d72/d31/c17 to d3/d10/de/d2e/d36/d40/d46/d72/d75/cae 0 2024-04-23T10:21:07.110 INFO:tasks.workunit.client.0.smithi029.stdout:0/396: fsync d0/dc/d26/f33 0 2024-04-23T10:21:07.111 INFO:tasks.workunit.client.0.smithi029.stdout:0/397: truncate d0/f4f 925376 0 2024-04-23T10:21:07.111 INFO:tasks.workunit.client.0.smithi029.stdout:6/658: creat d9/df/d16/d44/d4c/dd9/fdd x:0 0 0 2024-04-23T10:21:07.113 INFO:tasks.workunit.client.0.smithi029.stdout:8/523: mkdir d3/d50/d6a/d95/d36/d97/da4 0 2024-04-23T10:21:07.117 INFO:tasks.workunit.client.0.smithi029.stdout:9/688: link d0/d7/d3f/f48 d0/d7/d1d/d35/d3b/db8/ff3 0 2024-04-23T10:21:07.117 INFO:tasks.workunit.client.0.smithi029.stdout:6/659: read d9/df/d16/d1f/d27/d33/da4/d58/fab [195832,49341] 0 2024-04-23T10:21:07.118 INFO:tasks.workunit.client.0.smithi029.stdout:3/479: dwrite d3/d10/de/d2e/d36/d40/d46/f9f [0,4194304] 0 2024-04-23T10:21:07.122 INFO:tasks.workunit.client.0.smithi029.stdout:0/398: truncate d0/dc/d26/f28 2341993 0 2024-04-23T10:21:07.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/689: unlink d0/d1b/d39/d50/d67/db6/lbc 0 2024-04-23T10:21:07.125 INFO:tasks.workunit.client.0.smithi029.stdout:8/524: creat d3/fa5 x:0 0 0 2024-04-23T10:21:07.127 INFO:tasks.workunit.client.0.smithi029.stdout:0/399: rmdir d0/d1b/d67 39 2024-04-23T10:21:07.129 INFO:tasks.workunit.client.0.smithi029.stdout:6/660: dwrite d9/df/d41/d49/fb3 [0,4194304] 0 2024-04-23T10:21:07.136 INFO:tasks.workunit.client.0.smithi029.stdout:6/661: stat d9/c35 0 2024-04-23T10:21:07.137 INFO:tasks.workunit.client.0.smithi029.stdout:9/690: dwrite d0/d7/d1d/d35/dd9/d49/d65/f8a [4194304,4194304] 0 2024-04-23T10:21:07.142 INFO:tasks.workunit.client.0.smithi029.stdout:3/480: dread d3/f5 [0,4194304] 0 2024-04-23T10:21:07.147 INFO:tasks.workunit.client.0.smithi029.stdout:9/691: read d0/d7/d3f/f8c [182869,41080] 0 2024-04-23T10:21:07.149 INFO:tasks.workunit.client.0.smithi029.stdout:8/525: creat d3/d50/d6a/d95/d36/fa6 x:0 0 0 2024-04-23T10:21:07.150 INFO:tasks.workunit.client.0.smithi029.stdout:9/692: write d0/d7/d1d/d35/f62 [243533,40696] 0 2024-04-23T10:21:07.153 INFO:tasks.workunit.client.0.smithi029.stdout:3/481: dread d3/d10/de/d2e/f42 [0,4194304] 0 2024-04-23T10:21:07.154 INFO:tasks.workunit.client.0.smithi029.stdout:0/400: getdents d0/d3e/d4e 0 2024-04-23T10:21:07.156 INFO:tasks.workunit.client.0.smithi029.stdout:9/693: creat d0/d1b/d39/d50/d5a/ff4 x:0 0 0 2024-04-23T10:21:07.157 INFO:tasks.workunit.client.0.smithi029.stdout:0/401: creat d0/d21/f89 x:0 0 0 2024-04-23T10:21:07.158 INFO:tasks.workunit.client.0.smithi029.stdout:0/402: dread - d0/d21/d7f/d55/f58 zero size 2024-04-23T10:21:07.159 INFO:tasks.workunit.client.0.smithi029.stdout:3/482: creat d3/d10/de/d2e/d36/d40/d46/faf x:0 0 0 2024-04-23T10:21:07.160 INFO:tasks.workunit.client.0.smithi029.stdout:0/403: write d0/d21/d7f/d3a/f4b [645713,35515] 0 2024-04-23T10:21:07.161 INFO:tasks.workunit.client.0.smithi029.stdout:9/694: mknod d0/d7/d1d/d35/dd9/cf5 0 2024-04-23T10:21:07.163 INFO:tasks.workunit.client.0.smithi029.stdout:3/483: rename d3/d45/fa2 to d3/d15/fb0 0 2024-04-23T10:21:07.166 INFO:tasks.workunit.client.0.smithi029.stdout:0/404: creat d0/d21/d7f/d55/f8a x:0 0 0 2024-04-23T10:21:07.167 INFO:tasks.workunit.client.0.smithi029.stdout:5/548: dread d0/f40 [0,4194304] 0 2024-04-23T10:21:07.167 INFO:tasks.workunit.client.0.smithi029.stdout:3/484: rmdir d3/d10/de/d2e/d36/d40/d46/d72/d31 39 2024-04-23T10:21:07.169 INFO:tasks.workunit.client.0.smithi029.stdout:8/526: write d3/d50/d6a/d95/d36/d68/f87 [304848,26937] 0 2024-04-23T10:21:07.171 INFO:tasks.workunit.client.0.smithi029.stdout:0/405: unlink d0/dc/d26/f5f 0 2024-04-23T10:21:07.172 INFO:tasks.workunit.client.0.smithi029.stdout:0/406: readlink d0/l84 0 2024-04-23T10:21:07.172 INFO:tasks.workunit.client.0.smithi029.stdout:9/695: creat d0/d1b/ff6 x:0 0 0 2024-04-23T10:21:07.173 INFO:tasks.workunit.client.0.smithi029.stdout:8/527: creat d3/d44/fa7 x:0 0 0 2024-04-23T10:21:07.176 INFO:tasks.workunit.client.0.smithi029.stdout:9/696: symlink d0/d7/d3f/lf7 0 2024-04-23T10:21:07.178 INFO:tasks.workunit.client.0.smithi029.stdout:3/485: dwrite d3/d45/d4f/d6b/f93 [0,4194304] 0 2024-04-23T10:21:07.179 INFO:tasks.workunit.client.0.smithi029.stdout:3/486: readlink d3/l1f 0 2024-04-23T10:21:07.181 INFO:tasks.workunit.client.0.smithi029.stdout:9/697: fdatasync d0/d1b/d60/dbf/fca 0 2024-04-23T10:21:07.182 INFO:tasks.workunit.client.0.smithi029.stdout:3/487: fsync d3/d10/f58 0 2024-04-23T10:21:07.188 INFO:tasks.workunit.client.0.smithi029.stdout:5/549: dwrite d0/f57 [0,4194304] 0 2024-04-23T10:21:07.189 INFO:tasks.workunit.client.0.smithi029.stdout:3/488: rmdir d3/d10/de/d2e 39 2024-04-23T10:21:07.192 INFO:tasks.workunit.client.0.smithi029.stdout:0/407: dwrite d0/dc/d26/f2e [0,4194304] 0 2024-04-23T10:21:07.194 INFO:tasks.workunit.client.0.smithi029.stdout:0/408: stat d0/c1f 0 2024-04-23T10:21:07.194 INFO:tasks.workunit.client.0.smithi029.stdout:8/528: truncate d3/d50/d6a/d95/d36/d3e/f4f 3273078 0 2024-04-23T10:21:07.197 INFO:tasks.workunit.client.0.smithi029.stdout:8/529: symlink d3/d44/la8 0 2024-04-23T10:21:07.201 INFO:tasks.workunit.client.0.smithi029.stdout:5/550: dwrite d0/d35/d38/d3e/f70 [4194304,4194304] 0 2024-04-23T10:21:07.204 INFO:tasks.workunit.client.0.smithi029.stdout:8/530: rename d3/c2a to d3/d50/d6a/d95/d36/d97/ca9 0 2024-04-23T10:21:07.205 INFO:tasks.workunit.client.0.smithi029.stdout:8/531: fsync d3/f9c 0 2024-04-23T10:21:07.206 INFO:tasks.workunit.client.0.smithi029.stdout:0/409: dwrite d0/d1b/f79 [0,4194304] 0 2024-04-23T10:21:07.215 INFO:tasks.workunit.client.0.smithi029.stdout:0/410: mkdir d0/dc/d26/d44/d5c/d6a/d8b 0 2024-04-23T10:21:07.218 INFO:tasks.workunit.client.0.smithi029.stdout:5/551: dwrite d0/f40 [4194304,4194304] 0 2024-04-23T10:21:07.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/532: write d3/d50/d6a/f70 [574098,51769] 0 2024-04-23T10:21:07.223 INFO:tasks.workunit.client.0.smithi029.stdout:8/533: truncate d3/d50/d6a/d95/d36/f46 2066666 0 2024-04-23T10:21:07.224 INFO:tasks.workunit.client.0.smithi029.stdout:5/552: chown d0/d35/d38/d3e/d66 5943 1 2024-04-23T10:21:07.224 INFO:tasks.workunit.client.0.smithi029.stdout:8/534: chown d3/d50/d6a/d95/d36 46 1 2024-04-23T10:21:07.225 INFO:tasks.workunit.client.0.smithi029.stdout:0/411: creat d0/d1b/d67/f8c x:0 0 0 2024-04-23T10:21:07.230 INFO:tasks.workunit.client.0.smithi029.stdout:8/535: truncate d3/f67 1876030 0 2024-04-23T10:21:07.230 INFO:tasks.workunit.client.0.smithi029.stdout:5/553: creat d0/d35/d10/d26/db2/dbc/fbd x:0 0 0 2024-04-23T10:21:07.234 INFO:tasks.workunit.client.0.smithi029.stdout:5/554: read d0/d35/d38/d51/f4a [102145,56825] 0 2024-04-23T10:21:07.236 INFO:tasks.workunit.client.0.smithi029.stdout:5/555: write d0/d35/d38/d39/d3f/f7d [4492171,120862] 0 2024-04-23T10:21:07.236 INFO:tasks.workunit.client.0.smithi029.stdout:0/412: dwrite d0/d1b/f3b [4194304,4194304] 0 2024-04-23T10:21:07.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/556: stat d0/d35/d38/d39/fb7 0 2024-04-23T10:21:07.239 INFO:tasks.workunit.client.0.smithi029.stdout:0/413: creat d0/d3e/f8d x:0 0 0 2024-04-23T10:21:07.239 INFO:tasks.workunit.client.0.smithi029.stdout:5/557: chown d0/d35/d38/d51/l5e 100 1 2024-04-23T10:21:07.240 INFO:tasks.workunit.client.0.smithi029.stdout:0/414: stat d0/l24 0 2024-04-23T10:21:07.242 INFO:tasks.workunit.client.0.smithi029.stdout:5/558: fdatasync d0/d35/d38/d51/fa9 0 2024-04-23T10:21:07.245 INFO:tasks.workunit.client.0.smithi029.stdout:5/559: write d0/f2f [4124724,32600] 0 2024-04-23T10:21:07.246 INFO:tasks.workunit.client.0.smithi029.stdout:0/415: chown d0/d21/d7f/f30 1 1 2024-04-23T10:21:07.247 INFO:tasks.workunit.client.0.smithi029.stdout:5/560: stat d0/d35/d38/d3e/d66/d5a/d78/c3c 0 2024-04-23T10:21:07.248 INFO:tasks.workunit.client.0.smithi029.stdout:5/561: stat d0/d35/d38/d39 0 2024-04-23T10:21:07.253 INFO:tasks.workunit.client.0.smithi029.stdout:5/562: unlink d0/l8 0 2024-04-23T10:21:07.254 INFO:tasks.workunit.client.0.smithi029.stdout:5/563: dread - d0/d35/d10/d26/db2/dbc/fbd zero size 2024-04-23T10:21:07.256 INFO:tasks.workunit.client.0.smithi029.stdout:5/564: write d0/d35/d38/d39/d3f/f7d [169413,88595] 0 2024-04-23T10:21:07.262 INFO:tasks.workunit.client.0.smithi029.stdout:5/565: rmdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dab 0 2024-04-23T10:21:07.264 INFO:tasks.workunit.client.0.smithi029.stdout:0/416: dread d0/dc/f16 [0,4194304] 0 2024-04-23T10:21:07.265 INFO:tasks.workunit.client.0.smithi029.stdout:5/566: unlink d0/d35/d38/d3e/d66/d5a/d78/l3a 0 2024-04-23T10:21:07.266 INFO:tasks.workunit.client.0.smithi029.stdout:8/536: dread d3/f26 [0,4194304] 0 2024-04-23T10:21:07.267 INFO:tasks.workunit.client.0.smithi029.stdout:5/567: readlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/l97 0 2024-04-23T10:21:07.267 INFO:tasks.workunit.client.0.smithi029.stdout:0/417: link d0/d21/f39 d0/d3e/d4e/d50/d71/f8e 0 2024-04-23T10:21:07.269 INFO:tasks.workunit.client.0.smithi029.stdout:5/568: truncate d0/d35/d10/d26/db2/d89/fb0 119543 0 2024-04-23T10:21:07.269 INFO:tasks.workunit.client.0.smithi029.stdout:0/418: creat d0/d21/d7f/f8f x:0 0 0 2024-04-23T10:21:07.271 INFO:tasks.workunit.client.0.smithi029.stdout:5/569: fsync d0/d35/d10/d26/db2/dbc/fbd 0 2024-04-23T10:21:07.271 INFO:tasks.workunit.client.0.smithi029.stdout:0/419: fdatasync d0/d21/d7f/d55/f8a 0 2024-04-23T10:21:07.273 INFO:tasks.workunit.client.0.smithi029.stdout:5/570: write d0/d35/d38/d39/f94 [288559,104913] 0 2024-04-23T10:21:07.273 INFO:tasks.workunit.client.0.smithi029.stdout:0/420: chown d0/d1b/d67/d6c/l80 339285264 1 2024-04-23T10:21:07.274 INFO:tasks.workunit.client.0.smithi029.stdout:0/421: dread - d0/d21/d7f/f7b zero size 2024-04-23T10:21:07.275 INFO:tasks.workunit.client.0.smithi029.stdout:8/537: dwrite d3/f26 [0,4194304] 0 2024-04-23T10:21:07.275 INFO:tasks.workunit.client.0.smithi029.stdout:0/422: readlink d0/l9 0 2024-04-23T10:21:07.276 INFO:tasks.workunit.client.0.smithi029.stdout:8/538: chown d3/cf 18 1 2024-04-23T10:21:07.277 INFO:tasks.workunit.client.0.smithi029.stdout:0/423: write d0/d3e/f72 [1842240,128965] 0 2024-04-23T10:21:07.278 INFO:tasks.workunit.client.0.smithi029.stdout:5/571: creat d0/d35/d38/d3e/d66/d5a/d78/d3d/fbe x:0 0 0 2024-04-23T10:21:07.279 INFO:tasks.workunit.client.0.smithi029.stdout:5/572: stat d0/d35/d10/d26/db2/c52 0 2024-04-23T10:21:07.281 INFO:tasks.workunit.client.0.smithi029.stdout:8/539: mknod d3/d50/d6a/d95/d36/caa 0 2024-04-23T10:21:07.282 INFO:tasks.workunit.client.0.smithi029.stdout:8/540: read d3/d50/d6a/d95/d36/d68/f8b [484229,61597] 0 2024-04-23T10:21:07.283 INFO:tasks.workunit.client.0.smithi029.stdout:8/541: readlink d3/d44/l63 0 2024-04-23T10:21:07.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/573: unlink d0/d9a/fbb 0 2024-04-23T10:21:07.285 INFO:tasks.workunit.client.0.smithi029.stdout:5/574: write d0/d35/d10/d26/db2/d89/fb0 [387602,41967] 0 2024-04-23T10:21:07.291 INFO:tasks.workunit.client.0.smithi029.stdout:0/424: getdents d0/d3e/d4e/d50/d73 0 2024-04-23T10:21:07.291 INFO:tasks.workunit.client.0.smithi029.stdout:5/575: symlink d0/d35/d10/lbf 0 2024-04-23T10:21:07.298 INFO:tasks.workunit.client.0.smithi029.stdout:5/576: dread d0/d35/d38/d39/f94 [0,4194304] 0 2024-04-23T10:21:07.299 INFO:tasks.workunit.client.0.smithi029.stdout:5/577: dread - d0/d9a/faa zero size 2024-04-23T10:21:07.299 INFO:tasks.workunit.client.0.smithi029.stdout:8/542: dread d3/d50/d6a/d95/d36/d3e/f4f [0,4194304] 0 2024-04-23T10:21:07.301 INFO:tasks.workunit.client.0.smithi029.stdout:0/425: rmdir d0/d3e/d69 0 2024-04-23T10:21:07.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/578: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/f88 [0,4194304] 0 2024-04-23T10:21:07.317 INFO:tasks.workunit.client.0.smithi029.stdout:5/579: fsync d0/d35/d38/d3e/d66/d5a/f92 0 2024-04-23T10:21:07.318 INFO:tasks.workunit.client.0.smithi029.stdout:0/426: mkdir d0/dc/d90 0 2024-04-23T10:21:07.319 INFO:tasks.workunit.client.0.smithi029.stdout:5/580: rmdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72 39 2024-04-23T10:21:07.321 INFO:tasks.workunit.client.0.smithi029.stdout:0/427: creat d0/d21/d7f/d55/f91 x:0 0 0 2024-04-23T10:21:07.321 INFO:tasks.workunit.client.0.smithi029.stdout:0/428: chown d0/d21/c49 309978 1 2024-04-23T10:21:07.323 INFO:tasks.workunit.client.0.smithi029.stdout:5/581: unlink d0/d35/d38/d51/f44 0 2024-04-23T10:21:07.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/429: mkdir d0/dc/d26/d44/d5c/d92 0 2024-04-23T10:21:07.326 INFO:tasks.workunit.client.0.smithi029.stdout:0/430: fdatasync d0/d1b/d67/f8c 0 2024-04-23T10:21:07.330 INFO:tasks.workunit.client.0.smithi029.stdout:5/582: dwrite d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/f9d [4194304,4194304] 0 2024-04-23T10:21:07.331 INFO:tasks.workunit.client.0.smithi029.stdout:0/431: rmdir d0/d1b/d67/d6c 39 2024-04-23T10:21:07.332 INFO:tasks.workunit.client.0.smithi029.stdout:0/432: chown d0/dc/d26/d44/f45 11679 1 2024-04-23T10:21:07.352 INFO:tasks.workunit.client.0.smithi029.stdout:5/583: dread d0/d35/d10/f42 [0,4194304] 0 2024-04-23T10:21:07.355 INFO:tasks.workunit.client.0.smithi029.stdout:5/584: creat d0/d35/d38/d39/d3f/fc0 x:0 0 0 2024-04-23T10:21:07.356 INFO:tasks.workunit.client.0.smithi029.stdout:0/433: symlink d0/d3e/d4e/d50/d73/d7e/l93 0 2024-04-23T10:21:07.358 INFO:tasks.workunit.client.0.smithi029.stdout:5/585: mknod d0/d35/d10/d26/db2/cc1 0 2024-04-23T10:21:07.360 INFO:tasks.workunit.client.0.smithi029.stdout:5/586: write d0/d35/d38/d39/d3f/f55 [3458485,5488] 0 2024-04-23T10:21:07.362 INFO:tasks.workunit.client.0.smithi029.stdout:5/587: rmdir d0/d35/d10/d26/db2/dbc 39 2024-04-23T10:21:07.366 INFO:tasks.workunit.client.0.smithi029.stdout:5/588: creat d0/d35/d38/d3e/fc2 x:0 0 0 2024-04-23T10:21:07.368 INFO:tasks.workunit.client.0.smithi029.stdout:0/434: link d0/d21/c52 d0/c94 0 2024-04-23T10:21:07.369 INFO:tasks.workunit.client.0.smithi029.stdout:0/435: dread - d0/d21/d7f/d55/f58 zero size 2024-04-23T10:21:07.371 INFO:tasks.workunit.client.0.smithi029.stdout:5/589: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/f9d [0,4194304] 0 2024-04-23T10:21:07.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/436: creat d0/d3e/d4e/d7c/f95 x:0 0 0 2024-04-23T10:21:07.398 INFO:tasks.workunit.client.0.smithi029.stdout:5/590: truncate d0/d35/d38/d39/d3f/f87 2891472 0 2024-04-23T10:21:07.405 INFO:tasks.workunit.client.0.smithi029.stdout:5/591: dwrite d0/d35/d83/fb9 [0,4194304] 0 2024-04-23T10:21:07.502 INFO:tasks.workunit.client.0.smithi029.stdout:4/502: sync 2024-04-23T10:21:07.644 INFO:tasks.workunit.client.0.smithi029.stdout:0/437: getdents d0/dc 0 2024-04-23T10:21:07.665 INFO:tasks.workunit.client.0.smithi029.stdout:9/698: dread d0/f11 [0,4194304] 0 2024-04-23T10:21:07.689 INFO:tasks.workunit.client.0.smithi029.stdout:0/438: creat d0/dc/f96 x:0 0 0 2024-04-23T10:21:07.690 INFO:tasks.workunit.client.0.smithi029.stdout:4/503: symlink d0/d3c/d52/d1b/d66/lae 0 2024-04-23T10:21:07.694 INFO:tasks.workunit.client.0.smithi029.stdout:5/592: creat d0/d35/d38/d3e/fc3 x:0 0 0 2024-04-23T10:21:07.695 INFO:tasks.workunit.client.0.smithi029.stdout:5/593: dread - d0/d35/d38/d3e/fc2 zero size 2024-04-23T10:21:07.702 INFO:tasks.workunit.client.0.smithi029.stdout:4/504: mknod d0/d5a/caf 0 2024-04-23T10:21:07.704 INFO:tasks.workunit.client.0.smithi029.stdout:4/505: write d0/d3c/d52/d1b/d5b/f93 [280801,32325] 0 2024-04-23T10:21:07.705 INFO:tasks.workunit.client.0.smithi029.stdout:9/699: link d0/d7/d3f/lf7 d0/d7/d3f/dbb/lf8 0 2024-04-23T10:21:07.710 INFO:tasks.workunit.client.0.smithi029.stdout:5/594: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/cc4 0 2024-04-23T10:21:07.717 INFO:tasks.workunit.client.0.smithi029.stdout:9/700: creat d0/d7/d1d/d35/dd5/ff9 x:0 0 0 2024-04-23T10:21:07.718 INFO:tasks.workunit.client.0.smithi029.stdout:4/506: mknod d0/d3c/d52/d1b/d36/d45/d4f/d7b/cb0 0 2024-04-23T10:21:07.723 INFO:tasks.workunit.client.0.smithi029.stdout:5/595: write d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/fa6 [1459177,122594] 0 2024-04-23T10:21:07.735 INFO:tasks.workunit.client.0.smithi029.stdout:4/507: dwrite d0/d3c/d52/d1b/d36/d45/f58 [0,4194304] 0 2024-04-23T10:21:07.739 INFO:tasks.workunit.client.0.smithi029.stdout:0/439: stat d0/dc/f11 0 2024-04-23T10:21:07.745 INFO:tasks.workunit.client.0.smithi029.stdout:9/701: truncate d0/d1b/d39/d50/d67/db6/fd1 1734957 0 2024-04-23T10:21:07.745 INFO:tasks.workunit.client.0.smithi029.stdout:4/508: mkdir d0/d5a/d6e/da1/db1 0 2024-04-23T10:21:07.750 INFO:tasks.workunit.client.0.smithi029.stdout:0/440: rename d0/d21/d7f/f64 to d0/d21/d7f/d55/f97 0 2024-04-23T10:21:07.752 INFO:tasks.workunit.client.0.smithi029.stdout:4/509: creat d0/d5a/fb2 x:0 0 0 2024-04-23T10:21:07.754 INFO:tasks.workunit.client.0.smithi029.stdout:9/702: symlink d0/d1b/d39/d50/d5a/lfa 0 2024-04-23T10:21:07.756 INFO:tasks.workunit.client.0.smithi029.stdout:4/510: truncate d0/f17 4423595 0 2024-04-23T10:21:07.761 INFO:tasks.workunit.client.0.smithi029.stdout:4/511: fdatasync d0/d3c/d52/d1b/f6b 0 2024-04-23T10:21:07.763 INFO:tasks.workunit.client.0.smithi029.stdout:9/703: mknod d0/d1b/d39/d50/d5a/cfb 0 2024-04-23T10:21:07.766 INFO:tasks.workunit.client.0.smithi029.stdout:5/596: dread d0/d35/d38/fa0 [0,4194304] 0 2024-04-23T10:21:07.769 INFO:tasks.workunit.client.0.smithi029.stdout:4/512: symlink d0/d3c/d52/d1b/d9f/d92/lb3 0 2024-04-23T10:21:07.776 INFO:tasks.workunit.client.0.smithi029.stdout:9/704: creat d0/d7/d1d/d35/d3b/d68/dbd/ffc x:0 0 0 2024-04-23T10:21:07.779 INFO:tasks.workunit.client.0.smithi029.stdout:4/513: unlink d0/l4b 0 2024-04-23T10:21:07.779 INFO:tasks.workunit.client.0.smithi029.stdout:4/514: chown d0/f3f 1 1 2024-04-23T10:21:07.781 INFO:tasks.workunit.client.0.smithi029.stdout:4/515: dread - d0/d3c/d52/d74/d91/fa5 zero size 2024-04-23T10:21:07.785 INFO:tasks.workunit.client.0.smithi029.stdout:0/441: getdents d0/dc/d26 0 2024-04-23T10:21:07.797 INFO:tasks.workunit.client.0.smithi029.stdout:0/442: truncate d0/d21/f38 2912580 0 2024-04-23T10:21:07.799 INFO:tasks.workunit.client.0.smithi029.stdout:5/597: dread d0/f12 [0,4194304] 0 2024-04-23T10:21:07.801 INFO:tasks.workunit.client.0.smithi029.stdout:4/516: getdents d0 0 2024-04-23T10:21:07.807 INFO:tasks.workunit.client.0.smithi029.stdout:5/598: unlink d0/d35/d38/d39/d3f/f7b 0 2024-04-23T10:21:07.809 INFO:tasks.workunit.client.0.smithi029.stdout:4/517: write d0/d3c/d52/f1d [4439338,80651] 0 2024-04-23T10:21:07.809 INFO:tasks.workunit.client.0.smithi029.stdout:0/443: getdents d0/dc/d26/d44/d5c 0 2024-04-23T10:21:07.812 INFO:tasks.workunit.client.0.smithi029.stdout:5/599: fsync d0/d35/d38/d3e/d66/d5a/d78/d6d/f58 0 2024-04-23T10:21:07.821 INFO:tasks.workunit.client.0.smithi029.stdout:0/444: dwrite d0/d3e/f72 [4194304,4194304] 0 2024-04-23T10:21:07.825 INFO:tasks.workunit.client.0.smithi029.stdout:4/518: creat d0/d3c/d52/d74/d8a/fb4 x:0 0 0 2024-04-23T10:21:07.836 INFO:tasks.workunit.client.0.smithi029.stdout:4/519: write d0/d3c/d52/d1b/f35 [3040252,19863] 0 2024-04-23T10:21:07.837 INFO:tasks.workunit.client.0.smithi029.stdout:5/600: dwrite d0/d35/d38/d3e/f4e [0,4194304] 0 2024-04-23T10:21:07.840 INFO:tasks.workunit.client.0.smithi029.stdout:4/520: write d0/d5a/d6e/fa0 [687490,34307] 0 2024-04-23T10:21:07.842 INFO:tasks.workunit.client.0.smithi029.stdout:0/445: dread d0/d21/d7f/d3a/f4b [0,4194304] 0 2024-04-23T10:21:07.845 INFO:tasks.workunit.client.0.smithi029.stdout:5/601: unlink d0/d35/c69 0 2024-04-23T10:21:07.848 INFO:tasks.workunit.client.0.smithi029.stdout:4/521: mknod d0/d3c/d52/d20/cb5 0 2024-04-23T10:21:07.850 INFO:tasks.workunit.client.0.smithi029.stdout:5/602: creat d0/d35/d38/d39/d3f/fc5 x:0 0 0 2024-04-23T10:21:07.850 INFO:tasks.workunit.client.0.smithi029.stdout:4/522: chown d0/d3c/d52/d1b/d9f/l9b 452239828 1 2024-04-23T10:21:07.852 INFO:tasks.workunit.client.0.smithi029.stdout:5/603: write d0/d35/d38/d3e/d66/d5a/d78/d3d/fbe [901234,14321] 0 2024-04-23T10:21:07.855 INFO:tasks.workunit.client.0.smithi029.stdout:5/604: write d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/fa6 [2572727,53863] 0 2024-04-23T10:21:07.855 INFO:tasks.workunit.client.0.smithi029.stdout:4/523: symlink d0/d3c/d52/d74/d8a/lb6 0 2024-04-23T10:21:07.858 INFO:tasks.workunit.client.0.smithi029.stdout:0/446: creat d0/d1b/d67/f98 x:0 0 0 2024-04-23T10:21:07.860 INFO:tasks.workunit.client.0.smithi029.stdout:5/605: rmdir d0/d35/d38/d3e/d66/d5a 39 2024-04-23T10:21:07.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/524: dwrite d0/f27 [4194304,4194304] 0 2024-04-23T10:21:07.866 INFO:tasks.workunit.client.0.smithi029.stdout:5/606: write d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/fa6 [1292508,100155] 0 2024-04-23T10:21:07.868 INFO:tasks.workunit.client.0.smithi029.stdout:2/487: sync 2024-04-23T10:21:07.880 INFO:tasks.workunit.client.0.smithi029.stdout:0/447: dwrite d0/dc/d26/d44/d4c/d6d/f82 [0,4194304] 0 2024-04-23T10:21:07.886 INFO:tasks.workunit.client.0.smithi029.stdout:4/525: getdents d0/d3c/d52/d1b/d5b/d65/d6a 0 2024-04-23T10:21:07.888 INFO:tasks.workunit.client.0.smithi029.stdout:4/526: fdatasync d0/d3c/d52/f26 0 2024-04-23T10:21:07.889 INFO:tasks.workunit.client.0.smithi029.stdout:5/607: write d0/d35/d38/d3e/d66/f82 [84411,57610] 0 2024-04-23T10:21:07.896 INFO:tasks.workunit.client.0.smithi029.stdout:2/488: dwrite d1/d3e/f71 [0,4194304] 0 2024-04-23T10:21:07.896 INFO:tasks.workunit.client.0.smithi029.stdout:5/608: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6 0 2024-04-23T10:21:07.900 INFO:tasks.workunit.client.0.smithi029.stdout:4/527: dwrite d0/d12/f2b [0,4194304] 0 2024-04-23T10:21:07.902 INFO:tasks.workunit.client.0.smithi029.stdout:4/528: chown d0/d3c/d52/d1b/d66/lae 214 1 2024-04-23T10:21:07.911 INFO:tasks.workunit.client.0.smithi029.stdout:5/609: dwrite d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/fae [0,4194304] 0 2024-04-23T10:21:07.920 INFO:tasks.workunit.client.0.smithi029.stdout:5/610: creat d0/d35/d38/d3e/d66/d8c/fc7 x:0 0 0 2024-04-23T10:21:07.921 INFO:tasks.workunit.client.0.smithi029.stdout:4/529: link d0/d3c/d52/d1b/d36/d45/d4f/d7b/cb0 d0/d3c/d52/d74/d91/cb7 0 2024-04-23T10:21:07.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/611: mkdir d0/d9a/dc8 0 2024-04-23T10:21:07.923 INFO:tasks.workunit.client.0.smithi029.stdout:4/530: mknod d0/d3c/d52/d20/cb8 0 2024-04-23T10:21:07.924 INFO:tasks.workunit.client.0.smithi029.stdout:5/612: write d0/d35/d38/f4b [2366387,16712] 0 2024-04-23T10:21:07.929 INFO:tasks.workunit.client.0.smithi029.stdout:4/531: mknod d0/d3c/d52/d1b/d36/d45/cb9 0 2024-04-23T10:21:07.933 INFO:tasks.workunit.client.0.smithi029.stdout:5/613: getdents d0/d35/d38/d3e/d66/d5a/d78 0 2024-04-23T10:21:07.938 INFO:tasks.workunit.client.0.smithi029.stdout:5/614: truncate d0/d35/d10/f71 699191 0 2024-04-23T10:21:07.939 INFO:tasks.workunit.client.0.smithi029.stdout:4/532: truncate d0/f3f 2696166 0 2024-04-23T10:21:07.946 INFO:tasks.workunit.client.0.smithi029.stdout:4/533: truncate d0/d3c/d52/d1b/d36/d45/f78 3657186 0 2024-04-23T10:21:07.947 INFO:tasks.workunit.client.0.smithi029.stdout:4/534: chown d0/d3c/d52/d1b/d36/d45/l4a 24 1 2024-04-23T10:21:08.100 INFO:tasks.workunit.client.0.smithi029.stdout:7/558: sync 2024-04-23T10:21:08.104 INFO:tasks.workunit.client.0.smithi029.stdout:7/559: mkdir d5/d71/d92/db7 0 2024-04-23T10:21:08.106 INFO:tasks.workunit.client.0.smithi029.stdout:7/560: chown d5/d8/d1a/d8e/la6 398143 1 2024-04-23T10:21:08.108 INFO:tasks.workunit.client.0.smithi029.stdout:7/561: write d5/d8/fb0 [1025882,42167] 0 2024-04-23T10:21:08.161 INFO:tasks.workunit.client.0.smithi029.stdout:7/562: rename d5/d8/d1a/d4d/l9a to d5/d8/d80/lb8 0 2024-04-23T10:21:08.170 INFO:tasks.workunit.client.0.smithi029.stdout:7/563: mknod d5/d8/d51/d55/d59/daf/cb9 0 2024-04-23T10:21:08.171 INFO:tasks.workunit.client.0.smithi029.stdout:7/564: readlink d5/d8/l42 0 2024-04-23T10:21:08.184 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-23T10:21:08.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:21:08.241 INFO:tasks.workunit.client.0.smithi029.stdout:7/565: dwrite d5/d8/f23 [0,4194304] 0 2024-04-23T10:21:08.244 INFO:tasks.workunit.client.0.smithi029.stdout:7/566: write d5/d8/d1a/d9c/fab [2548780,19027] 0 2024-04-23T10:21:08.248 INFO:tasks.workunit.client.0.smithi029.stdout:1/434: sync 2024-04-23T10:21:08.256 INFO:tasks.workunit.client.0.smithi029.stdout:1/435: mkdir d5/d6/d34/d8a 0 2024-04-23T10:21:08.257 INFO:tasks.workunit.client.0.smithi029.stdout:1/436: chown d5/d6/de/d27/d38/l4c 184627357 1 2024-04-23T10:21:08.266 INFO:tasks.workunit.client.0.smithi029.stdout:1/437: dread d5/d6/de/f33 [0,4194304] 0 2024-04-23T10:21:08.268 INFO:tasks.workunit.client.0.smithi029.stdout:1/438: truncate d5/d3e/f54 897119 0 2024-04-23T10:21:08.270 INFO:tasks.workunit.client.0.smithi029.stdout:7/567: rename d5/f4f to d5/d8/d51/d9e/db2/fba 0 2024-04-23T10:21:08.276 INFO:tasks.workunit.client.0.smithi029.stdout:7/568: write d5/d8/d1a/f21 [3982184,51607] 0 2024-04-23T10:21:08.278 INFO:tasks.workunit.client.0.smithi029.stdout:1/439: truncate d5/d6/f40 2741561 0 2024-04-23T10:21:08.289 INFO:tasks.workunit.client.0.smithi029.stdout:7/569: dwrite d5/d8/f43 [0,4194304] 0 2024-04-23T10:21:08.292 INFO:tasks.workunit.client.0.smithi029.stdout:7/570: mknod d5/d8/d51/cbb 0 2024-04-23T10:21:08.296 INFO:tasks.workunit.client.0.smithi029.stdout:1/440: dread d5/d6/de/d15/f26 [0,4194304] 0 2024-04-23T10:21:08.298 INFO:tasks.workunit.client.0.smithi029.stdout:1/441: chown d5/d6/de/d27/f46 5345864 1 2024-04-23T10:21:08.301 INFO:tasks.workunit.client.0.smithi029.stdout:1/442: mknod d5/d6/de/d15/c8b 0 2024-04-23T10:21:08.304 INFO:tasks.workunit.client.0.smithi029.stdout:1/443: mkdir d5/d8c 0 2024-04-23T10:21:08.305 INFO:tasks.workunit.client.0.smithi029.stdout:1/444: chown d5/d6/de/d15/c8b 95000 1 2024-04-23T10:21:08.316 INFO:tasks.workunit.client.0.smithi029.stdout:7/571: dread d5/d8/d1a/f21 [0,4194304] 0 2024-04-23T10:21:08.319 INFO:tasks.workunit.client.0.smithi029.stdout:8/543: sync 2024-04-23T10:21:08.319 INFO:tasks.workunit.client.0.smithi029.stdout:2/489: sync 2024-04-23T10:21:08.319 INFO:tasks.workunit.client.0.smithi029.stdout:3/489: sync 2024-04-23T10:21:08.319 INFO:tasks.workunit.client.0.smithi029.stdout:5/615: sync 2024-04-23T10:21:08.319 INFO:tasks.workunit.client.0.smithi029.stdout:9/705: sync 2024-04-23T10:21:08.319 INFO:tasks.workunit.client.0.smithi029.stdout:6/662: sync 2024-04-23T10:21:08.319 INFO:tasks.workunit.client.0.smithi029.stdout:4/535: sync 2024-04-23T10:21:08.320 INFO:tasks.workunit.client.0.smithi029.stdout:5/616: stat d0/f2f 0 2024-04-23T10:21:08.321 INFO:tasks.workunit.client.0.smithi029.stdout:9/706: rmdir d0/d1b 39 2024-04-23T10:21:08.323 INFO:tasks.workunit.client.0.smithi029.stdout:2/490: creat d1/d3e/fa9 x:0 0 0 2024-04-23T10:21:08.324 INFO:tasks.workunit.client.0.smithi029.stdout:6/663: symlink d9/d5b/lde 0 2024-04-23T10:21:08.324 INFO:tasks.workunit.client.0.smithi029.stdout:4/536: unlink d0/d3c/c53 0 2024-04-23T10:21:08.327 INFO:tasks.workunit.client.0.smithi029.stdout:5/617: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b 127 1 2024-04-23T10:21:08.327 INFO:tasks.workunit.client.0.smithi029.stdout:6/664: chown d9/df/f22 967679 1 2024-04-23T10:21:08.328 INFO:tasks.workunit.client.0.smithi029.stdout:9/707: creat d0/d7/d1d/d35/dd9/ffd x:0 0 0 2024-04-23T10:21:08.328 INFO:tasks.workunit.client.0.smithi029.stdout:7/572: dread d5/d9/f3a [0,4194304] 0 2024-04-23T10:21:08.328 INFO:tasks.workunit.client.0.smithi029.stdout:8/544: dread d3/d50/d6a/d95/d36/d68/f8b [0,4194304] 0 2024-04-23T10:21:08.331 INFO:tasks.workunit.client.0.smithi029.stdout:2/491: rename d1/d3e/f38 to d1/d31/d50/faa 0 2024-04-23T10:21:08.331 INFO:tasks.workunit.client.0.smithi029.stdout:4/537: write d0/d3c/d52/d1b/d5b/d65/f99 [542458,38578] 0 2024-04-23T10:21:08.331 INFO:tasks.workunit.client.0.smithi029.stdout:5/618: fdatasync d0/d35/d38/d3e/d66/f6c 0 2024-04-23T10:21:08.333 INFO:tasks.workunit.client.0.smithi029.stdout:3/490: creat d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/fb1 x:0 0 0 2024-04-23T10:21:08.334 INFO:tasks.workunit.client.0.smithi029.stdout:4/538: dread - d0/d3c/d52/d1b/d5b/d65/d6a/f95 zero size 2024-04-23T10:21:08.334 INFO:tasks.workunit.client.0.smithi029.stdout:1/445: dread d5/f37 [0,4194304] 0 2024-04-23T10:21:08.337 INFO:tasks.workunit.client.0.smithi029.stdout:9/708: unlink d0/d7/d1d/d35/fab 0 2024-04-23T10:21:08.339 INFO:tasks.workunit.client.0.smithi029.stdout:1/446: read d5/d6/de/d22/f59 [4091669,68372] 0 2024-04-23T10:21:08.339 INFO:tasks.workunit.client.0.smithi029.stdout:4/539: read d0/d3c/d52/d1b/d5b/f93 [101081,69830] 0 2024-04-23T10:21:08.341 INFO:tasks.workunit.client.0.smithi029.stdout:1/447: fdatasync d5/d6/d34/d63/f75 0 2024-04-23T10:21:08.341 INFO:tasks.workunit.client.0.smithi029.stdout:2/492: mknod d1/dd/d60/cab 0 2024-04-23T10:21:08.344 INFO:tasks.workunit.client.0.smithi029.stdout:5/619: dwrite d0/d35/d49/f84 [0,4194304] 0 2024-04-23T10:21:08.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0728f640 1 Processor -- start 2024-04-23T10:21:08.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0728f640 1 -- start start 2024-04-23T10:21:08.350 INFO:tasks.workunit.client.0.smithi029.stdout:9/709: read - d0/d7/d1d/f9b zero size 2024-04-23T10:21:08.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0728f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c000c83c0 0x7f3c000c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0728f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000cd6b0 0x7f3c00158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0728f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c000c6e80 con 0x7f3c000c87a0 2024-04-23T10:21:08.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0728f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f3c000c7460 con 0x7f3c000c83c0 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0728f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3c000cdc10 con 0x7f3c000cd6b0 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0502b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c000c83c0 0x7f3c000c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0502b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c000c83c0 0x7f3c000c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56154/0 (socket says 172.21.15.29:56154) 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0502b640 1 -- 172.21.15.29:0/1201752204 learned_addr learned my addr 172.21.15.29:0/1201752204 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0582c640 1 --2- 172.21.15.29:0/1201752204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000cd6b0 0x7f3c00158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0502b640 1 -- 172.21.15.29:0/1201752204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000cd6b0 msgr2=0x7f3c00158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0502b640 1 --2- 172.21.15.29:0/1201752204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000cd6b0 0x7f3c00158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0502b640 1 -- 172.21.15.29:0/1201752204 >> v1:172.21.15.72:6789/0 conn(0x7f3c000c87a0 legacy=0x7f3c00152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.350+0000 7f3c0502b640 1 -- 172.21.15.29:0/1201752204 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c000cdef0 con 0x7f3c000c83c0 2024-04-23T10:21:08.352 INFO:tasks.workunit.client.0.smithi029.stdout:8/545: mknod d3/d50/d6a/d95/d36/d68/d8c/cab 0 2024-04-23T10:21:08.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0502b640 1 --2- 172.21.15.29:0/1201752204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c83c0 0x7f3c000c78f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3c00074740 tx=0x7f3bf001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20122c1f91d583cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3bfffff640 1 -- 172.21.15.29:0/1201752204 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00a5720 con 0x7f3c000c83c0 2024-04-23T10:21:08.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3bfffff640 1 -- 172.21.15.29:0/1201752204 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf00a58c0 con 0x7f3c000c83c0 2024-04-23T10:21:08.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3bfffff640 1 -- 172.21.15.29:0/1201752204 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00a5c90 con 0x7f3c000c83c0 2024-04-23T10:21:08.354 INFO:tasks.workunit.client.0.smithi029.stdout:4/540: mkdir d0/d3c/d52/d74/d8a/dba 0 2024-04-23T10:21:08.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 -- 172.21.15.29:0/1201752204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c83c0 msgr2=0x7f3c000c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 --2- 172.21.15.29:0/1201752204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c83c0 0x7f3c000c78f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3c00074740 tx=0x7f3bf001c9b0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 -- 172.21.15.29:0/1201752204 shutdown_connections 2024-04-23T10:21:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 --2- 172.21.15.29:0/1201752204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000cd6b0 0x7f3c00158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 --2- 172.21.15.29:0/1201752204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c83c0 0x7f3c000c78f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 -- 172.21.15.29:0/1201752204 >> 172.21.15.29:0/1201752204 conn(0x7f3c00068180 msgr2=0x7f3c0006b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 -- 172.21.15.29:0/1201752204 shutdown_connections 2024-04-23T10:21:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 -- 172.21.15.29:0/1201752204 wait complete. 2024-04-23T10:21:08.355 INFO:tasks.workunit.client.0.smithi029.stdout:4/541: dread - d0/d3c/d52/d74/d91/fa5 zero size 2024-04-23T10:21:08.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 Processor -- start 2024-04-23T10:21:08.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.354+0000 7f3c0728f640 1 -- start start 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000c83c0 0x7f3c001f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c87a0 0x7f3c00158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000cd6b0 0x7f3c00151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00165820 con 0x7f3c000c87a0 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3c001533a0 con 0x7f3c000cd6b0 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3c001659a0 con 0x7f3c000c83c0 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c87a0 0x7f3c00158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c87a0 0x7f3c00158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56158/0 (socket says 172.21.15.29:56158) 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 -- 172.21.15.29:0/3797565784 learned_addr learned my addr 172.21.15.29:0/3797565784 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0502b640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000c83c0 0x7f3c001f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 -- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000c83c0 msgr2=0x7f3c001f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000c83c0 0x7f3c001f47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 -- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000cd6b0 msgr2=0x7f3c00151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000cd6b0 0x7f3c00151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 -- 172.21.15.29:0/3797565784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c00153820 con 0x7f3c000c87a0 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0482a640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c87a0 0x7f3c00158a90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c4b0 tx=0x7f3bf400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3797565784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4016020 con 0x7f3c000c87a0 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3797565784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf4012830 con 0x7f3c000c87a0 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c00153ac0 con 0x7f3c000c87a0 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3797565784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4012c20 con 0x7f3c000c87a0 2024-04-23T10:21:08.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c00150e60 con 0x7f3c000c87a0 2024-04-23T10:21:08.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3797565784 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3bf4019020 con 0x7f3c000c87a0 2024-04-23T10:21:08.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c000693c0 con 0x7f3c000c87a0 2024-04-23T10:21:08.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3bfdffb640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3bec068380 0x7f3bec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.358+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3797565784 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3bf4086f60 con 0x7f3c000c87a0 2024-04-23T10:21:08.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.362+0000 7f3c0502b640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3bec068380 0x7f3bec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.362+0000 7f3c0502b640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3bec068380 0x7f3bec06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00ae000 tx=0x7f3bf00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.363 INFO:tasks.workunit.client.0.smithi029.stdout:5/620: mknod d0/d35/d38/d3e/d66/d5a/d78/cc9 0 2024-04-23T10:21:08.364 INFO:tasks.workunit.client.0.smithi029.stdout:5/621: chown d0/d35/d10/d26/db2/c52 1668 1 2024-04-23T10:21:08.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/710: stat d0/d1b/laf 0 2024-04-23T10:21:08.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.366+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3797565784 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3bf4020020 con 0x7f3c000c87a0 2024-04-23T10:21:08.367 INFO:tasks.workunit.client.0.smithi029.stdout:3/491: creat d3/d10/de/d2e/d36/fb2 x:0 0 0 2024-04-23T10:21:08.369 INFO:tasks.workunit.client.0.smithi029.stdout:8/546: unlink d3/l20 0 2024-04-23T10:21:08.371 INFO:tasks.workunit.client.0.smithi029.stdout:8/547: readlink d3/d50/d6a/d95/d36/d97/l9a 0 2024-04-23T10:21:08.371 INFO:tasks.workunit.client.0.smithi029.stdout:6/665: dwrite d9/df/d16/d44/d75/d90/fa3 [0,4194304] 0 2024-04-23T10:21:08.376 INFO:tasks.workunit.client.0.smithi029.stdout:9/711: dread d0/d1b/d39/d50/f16 [0,4194304] 0 2024-04-23T10:21:08.376 INFO:tasks.workunit.client.0.smithi029.stdout:4/542: creat d0/d3c/d52/fbb x:0 0 0 2024-04-23T10:21:08.377 INFO:tasks.workunit.client.0.smithi029.stdout:8/548: mkdir d3/d50/dac 0 2024-04-23T10:21:08.379 INFO:tasks.workunit.client.0.smithi029.stdout:6/666: write d9/df/d16/d1f/d27/d33/f72 [775890,37019] 0 2024-04-23T10:21:08.379 INFO:tasks.workunit.client.0.smithi029.stdout:2/493: truncate d1/dd/d47/d63/d64/d78/f94 146009 0 2024-04-23T10:21:08.379 INFO:tasks.workunit.client.0.smithi029.stdout:4/543: fdatasync d0/d3c/d52/fbb 0 2024-04-23T10:21:08.380 INFO:tasks.workunit.client.0.smithi029.stdout:9/712: fsync d0/d7/d1d/d35/d3b/d68/fd8 0 2024-04-23T10:21:08.381 INFO:tasks.workunit.client.0.smithi029.stdout:8/549: chown d3/d50/d6a/d95/d36/d97/da4 1366 1 2024-04-23T10:21:08.383 INFO:tasks.workunit.client.0.smithi029.stdout:7/573: dwrite d5/d8/d1a/d4d/f64 [0,4194304] 0 2024-04-23T10:21:08.383 INFO:tasks.workunit.client.0.smithi029.stdout:6/667: write d9/f18 [5581258,25702] 0 2024-04-23T10:21:08.386 INFO:tasks.workunit.client.0.smithi029.stdout:4/544: dread - d0/d3c/d52/d74/d8a/fb4 zero size 2024-04-23T10:21:08.387 INFO:tasks.workunit.client.0.smithi029.stdout:7/574: truncate d5/d8/d1a/f21 5199925 0 2024-04-23T10:21:08.388 INFO:tasks.workunit.client.0.smithi029.stdout:3/492: getdents d3/d45 0 2024-04-23T10:21:08.390 INFO:tasks.workunit.client.0.smithi029.stdout:7/575: fdatasync d5/d8/d1a/d9c/fab 0 2024-04-23T10:21:08.392 INFO:tasks.workunit.client.0.smithi029.stdout:8/550: mkdir d3/d50/dad 0 2024-04-23T10:21:08.395 INFO:tasks.workunit.client.0.smithi029.stdout:5/622: rename d0/d35/d38/d51 to d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/dca 0 2024-04-23T10:21:08.397 INFO:tasks.workunit.client.0.smithi029.stdout:3/493: rmdir d3/d10/de/d2e/d36/d40/d46/d72/d75 39 2024-04-23T10:21:08.397 INFO:tasks.workunit.client.0.smithi029.stdout:0/448: dread d0/dc/d26/f28 [0,4194304] 0 2024-04-23T10:21:08.399 INFO:tasks.workunit.client.0.smithi029.stdout:5/623: read d0/d35/f1c [3466411,102265] 0 2024-04-23T10:21:08.399 INFO:tasks.workunit.client.0.smithi029.stdout:8/551: creat d3/d50/d6a/d95/fae x:0 0 0 2024-04-23T10:21:08.402 INFO:tasks.workunit.client.0.smithi029.stdout:2/494: dwrite d1/dd/d47/d63/d64/f72 [4194304,4194304] 0 2024-04-23T10:21:08.407 INFO:tasks.workunit.client.0.smithi029.stdout:3/494: dread - d3/d10/fa1 zero size 2024-04-23T10:21:08.408 INFO:tasks.workunit.client.0.smithi029.stdout:7/576: dread d5/d71/f82 [0,4194304] 0 2024-04-23T10:21:08.409 INFO:tasks.workunit.client.0.smithi029.stdout:0/449: read d0/dc/d26/d44/f61 [4697240,23038] 0 2024-04-23T10:21:08.413 INFO:tasks.workunit.client.0.smithi029.stdout:9/713: write d0/d1b/d39/d50/d5a/f8b [1332272,37923] 0 2024-04-23T10:21:08.414 INFO:tasks.workunit.client.0.smithi029.stdout:4/545: rename d0/d12/f2b to d0/d3c/d52/d74/d91/fbc 0 2024-04-23T10:21:08.416 INFO:tasks.workunit.client.0.smithi029.stdout:4/546: write d0/d3c/d52/fbb [105556,73301] 0 2024-04-23T10:21:08.417 INFO:tasks.workunit.client.0.smithi029.stdout:5/624: rename d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/db5 to d0/d35/d38/d39/dcb 0 2024-04-23T10:21:08.418 INFO:tasks.workunit.client.0.smithi029.stdout:2/495: mknod d1/d31/cac 0 2024-04-23T10:21:08.420 INFO:tasks.workunit.client.0.smithi029.stdout:0/450: creat d0/d3e/d4e/d50/d71/f99 x:0 0 0 2024-04-23T10:21:08.422 INFO:tasks.workunit.client.0.smithi029.stdout:6/668: dread d9/f18 [0,4194304] 0 2024-04-23T10:21:08.430 INFO:tasks.workunit.client.0.smithi029.stdout:3/495: rename d3/d10/de/d2e/d36/d40/d46/d72/f49 to d3/d45/d4f/fb3 0 2024-04-23T10:21:08.430 INFO:tasks.workunit.client.0.smithi029.stdout:7/577: link d5/d8/d1a/d8e/fa4 d5/fbc 0 2024-04-23T10:21:08.432 INFO:tasks.workunit.client.0.smithi029.stdout:8/552: getdents d3/d50/d6a/d95/d36/d3e 0 2024-04-23T10:21:08.433 INFO:tasks.workunit.client.0.smithi029.stdout:7/578: stat d5/d8/d1a/d9c/faa 0 2024-04-23T10:21:08.434 INFO:tasks.workunit.client.0.smithi029.stdout:9/714: dwrite d0/d1b/d39/d50/f6a [0,4194304] 0 2024-04-23T10:21:08.438 INFO:tasks.workunit.client.0.smithi029.stdout:0/451: write d0/d21/d7f/d3a/f4b [2851177,124587] 0 2024-04-23T10:21:08.439 INFO:tasks.workunit.client.0.smithi029.stdout:2/496: write d1/dd/d22/f54 [1653840,76924] 0 2024-04-23T10:21:08.440 INFO:tasks.workunit.client.0.smithi029.stdout:5/625: truncate d0/d35/d38/d3e/d66/f82 44201 0 2024-04-23T10:21:08.440 INFO:tasks.workunit.client.0.smithi029.stdout:3/496: chown d3/d10/de/d2e/d36/d40/d46/d72/d31/d96 4344106 1 2024-04-23T10:21:08.442 INFO:tasks.workunit.client.0.smithi029.stdout:8/553: creat d3/d50/d6a/faf x:0 0 0 2024-04-23T10:21:08.445 INFO:tasks.workunit.client.0.smithi029.stdout:7/579: unlink d5/d8/d51/d55/d59/daf/cb9 0 2024-04-23T10:21:08.448 INFO:tasks.workunit.client.0.smithi029.stdout:0/452: creat d0/d3e/d4e/d7c/f9a x:0 0 0 2024-04-23T10:21:08.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/669: dwrite d9/f29 [0,4194304] 0 2024-04-23T10:21:08.448 INFO:tasks.workunit.client.0.smithi029.stdout:2/497: readlink d1/dd/l3c 0 2024-04-23T10:21:08.449 INFO:tasks.workunit.client.0.smithi029.stdout:4/547: dwrite d0/fd [0,4194304] 0 2024-04-23T10:21:08.449 INFO:tasks.workunit.client.0.smithi029.stdout:8/554: stat d3/fd 0 2024-04-23T10:21:08.453 INFO:tasks.workunit.client.0.smithi029.stdout:0/453: creat d0/d3e/d4e/d7c/f9b x:0 0 0 2024-04-23T10:21:08.459 INFO:tasks.workunit.client.0.smithi029.stdout:2/498: rename d1/d3e/c34 to d1/d3e/cad 0 2024-04-23T10:21:08.461 INFO:tasks.workunit.client.0.smithi029.stdout:5/626: rename d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d93 to d0/d35/d38/d3e/d66/d5a/dcc 0 2024-04-23T10:21:08.461 INFO:tasks.workunit.client.0.smithi029.stdout:4/548: symlink d0/d3c/d52/d74/d91/lbd 0 2024-04-23T10:21:08.462 INFO:tasks.workunit.client.0.smithi029.stdout:6/670: truncate d9/df/d16/d34/f93 848253 0 2024-04-23T10:21:08.463 INFO:tasks.workunit.client.0.smithi029.stdout:8/555: dread d3/d38/f3d [0,4194304] 0 2024-04-23T10:21:08.464 INFO:tasks.workunit.client.0.smithi029.stdout:3/497: link d3/d10/de/d2e/d36/d40/d46/d72/d5e/f9e d3/d45/d4f/fb4 0 2024-04-23T10:21:08.465 INFO:tasks.workunit.client.0.smithi029.stdout:2/499: creat d1/d3e/d3b/fae x:0 0 0 2024-04-23T10:21:08.466 INFO:tasks.workunit.client.0.smithi029.stdout:7/580: getdents d5/d71 0 2024-04-23T10:21:08.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/498: creat d3/d10/d48/fb5 x:0 0 0 2024-04-23T10:21:08.471 INFO:tasks.workunit.client.0.smithi029.stdout:5/627: symlink d0/d35/d38/d3e/d66/d5a/d78/lcd 0 2024-04-23T10:21:08.472 INFO:tasks.workunit.client.0.smithi029.stdout:6/671: read d9/df/d16/d34/d84/f8a [594173,6977] 0 2024-04-23T10:21:08.472 INFO:tasks.workunit.client.0.smithi029.stdout:2/500: creat d1/d3e/d5a/d6d/faf x:0 0 0 2024-04-23T10:21:08.476 INFO:tasks.workunit.client.0.smithi029.stdout:5/628: dread - d0/d35/d38/d39/d3f/fc0 zero size 2024-04-23T10:21:08.477 INFO:tasks.workunit.client.0.smithi029.stdout:0/454: getdents d0/d3e/d4e/d50/d73 0 2024-04-23T10:21:08.478 INFO:tasks.workunit.client.0.smithi029.stdout:8/556: creat d3/d38/fb0 x:0 0 0 2024-04-23T10:21:08.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/672: chown d9/df/d16/d34/d36/d63/ld2 444882 1 2024-04-23T10:21:08.483 INFO:tasks.workunit.client.0.smithi029.stdout:2/501: symlink d1/dd/d47/d63/lb0 0 2024-04-23T10:21:08.484 INFO:tasks.workunit.client.0.smithi029.stdout:7/581: mknod d5/d71/d92/db7/cbd 0 2024-04-23T10:21:08.484 INFO:tasks.workunit.client.0.smithi029.stdout:3/499: dwrite d3/d45/d4f/d6b/f93 [0,4194304] 0 2024-04-23T10:21:08.485 INFO:tasks.workunit.client.0.smithi029.stdout:8/557: mkdir d3/d44/db1 0 2024-04-23T10:21:08.485 INFO:tasks.workunit.client.0.smithi029.stdout:6/673: rmdir d9/df/d16/daf 39 2024-04-23T10:21:08.487 INFO:tasks.workunit.client.0.smithi029.stdout:0/455: rename d0/d21/d7f/d55/f97 to d0/dc/d26/d44/d4c/f9c 0 2024-04-23T10:21:08.493 INFO:tasks.workunit.client.0.smithi029.stdout:0/456: write d0/d1b/f79 [4344789,84857] 0 2024-04-23T10:21:08.493 INFO:tasks.workunit.client.0.smithi029.stdout:4/549: dwrite d0/d3c/d52/d1b/d36/d45/d68/f84 [0,4194304] 0 2024-04-23T10:21:08.498 INFO:tasks.workunit.client.0.smithi029.stdout:2/502: write d1/d3e/d3b/f7f [372863,73341] 0 2024-04-23T10:21:08.498 INFO:tasks.workunit.client.0.smithi029.stdout:7/582: dread d5/d29/f38 [0,4194304] 0 2024-04-23T10:21:08.502 INFO:tasks.workunit.client.0.smithi029.stdout:6/674: mknod d9/df/d16/d44/d4c/dd9/cdf 0 2024-04-23T10:21:08.503 INFO:tasks.workunit.client.0.smithi029.stdout:7/583: write d5/d8/d1a/f83 [5018516,114836] 0 2024-04-23T10:21:08.503 INFO:tasks.workunit.client.0.smithi029.stdout:4/550: symlink d0/d3c/d52/d1b/d5b/lbe 0 2024-04-23T10:21:08.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/503: fsync d1/d3e/f77 0 2024-04-23T10:21:08.510 INFO:tasks.workunit.client.0.smithi029.stdout:0/457: read d0/dc/d26/d44/d5c/f78 [351113,65145] 0 2024-04-23T10:21:08.510 INFO:tasks.workunit.client.0.smithi029.stdout:8/558: dwrite d3/d38/f79 [0,4194304] 0 2024-04-23T10:21:08.512 INFO:tasks.workunit.client.0.smithi029.stdout:7/584: creat d5/d8/d1a/d8a/d8b/d8d/fbe x:0 0 0 2024-04-23T10:21:08.513 INFO:tasks.workunit.client.0.smithi029.stdout:5/629: dread d0/d35/d38/d3e/d66/d5a/d78/d3d/fbe [0,4194304] 0 2024-04-23T10:21:08.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/585: stat d5/d8/d51/d55/l74 0 2024-04-23T10:21:08.517 INFO:tasks.workunit.client.0.smithi029.stdout:8/559: unlink d3/d50/d6a/d95/d36/f3a 0 2024-04-23T10:21:08.518 INFO:tasks.workunit.client.0.smithi029.stdout:7/586: chown d5/d9/f26 3045 1 2024-04-23T10:21:08.520 INFO:tasks.workunit.client.0.smithi029.stdout:0/458: unlink d0/dc/l35 0 2024-04-23T10:21:08.520 INFO:tasks.workunit.client.0.smithi029.stdout:3/500: dwrite d3/d10/de/d2e/d36/f38 [0,4194304] 0 2024-04-23T10:21:08.521 INFO:tasks.workunit.client.0.smithi029.stdout:0/459: readlink d0/l24 0 2024-04-23T10:21:08.523 INFO:tasks.workunit.client.0.smithi029.stdout:0/460: chown d0/d3e/d4e/d7c/f9b 150992425 1 2024-04-23T10:21:08.523 INFO:tasks.workunit.client.0.smithi029.stdout:8/560: symlink d3/d7d/lb2 0 2024-04-23T10:21:08.523 INFO:tasks.workunit.client.0.smithi029.stdout:4/551: truncate d0/d3c/d52/f42 1449781 0 2024-04-23T10:21:08.525 INFO:tasks.workunit.client.0.smithi029.stdout:2/504: dwrite d1/d3e/d3b/f96 [0,4194304] 0 2024-04-23T10:21:08.529 INFO:tasks.workunit.client.0.smithi029.stdout:3/501: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d31/db6 0 2024-04-23T10:21:08.531 INFO:tasks.workunit.client.0.smithi029.stdout:2/505: symlink d1/dd/d60/lb1 0 2024-04-23T10:21:08.535 INFO:tasks.workunit.client.0.smithi029.stdout:8/561: dread d3/f23 [0,4194304] 0 2024-04-23T10:21:08.538 INFO:tasks.workunit.client.0.smithi029.stdout:2/506: stat d1/l87 0 2024-04-23T10:21:08.540 INFO:tasks.workunit.client.0.smithi029.stdout:3/502: mknod d3/d10/de/d2e/d36/d40/d46/cb7 0 2024-04-23T10:21:08.541 INFO:tasks.workunit.client.0.smithi029.stdout:3/503: chown d3/d10/de/d2e/d36/d40 1276240 1 2024-04-23T10:21:08.544 INFO:tasks.workunit.client.0.smithi029.stdout:3/504: read d3/d10/de/d2e/d36/f39 [1027321,62275] 0 2024-04-23T10:21:08.544 INFO:tasks.workunit.client.0.smithi029.stdout:2/507: chown d1/d3e/cad 28933 1 2024-04-23T10:21:08.545 INFO:tasks.workunit.client.0.smithi029.stdout:7/587: write d5/f1f [3174016,52571] 0 2024-04-23T10:21:08.547 INFO:tasks.workunit.client.0.smithi029.stdout:8/562: symlink d3/d50/d6a/d95/d36/lb3 0 2024-04-23T10:21:08.551 INFO:tasks.workunit.client.0.smithi029.stdout:5/630: dwrite d0/d35/d38/d39/d3f/f87 [0,4194304] 0 2024-04-23T10:21:08.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/508: mknod d1/d3e/d3b/cb2 0 2024-04-23T10:21:08.559 INFO:tasks.workunit.client.0.smithi029.stdout:7/588: mknod d5/d8/d51/d55/cbf 0 2024-04-23T10:21:08.560 INFO:tasks.workunit.client.0.smithi029.stdout:3/505: write d3/d10/de/d2e/d36/f39 [15992,115244] 0 2024-04-23T10:21:08.561 INFO:tasks.workunit.client.0.smithi029.stdout:5/631: write d0/d35/d38/d39/d3f/f55 [1894801,82963] 0 2024-04-23T10:21:08.562 INFO:tasks.workunit.client.0.smithi029.stdout:6/675: dread d9/df/d16/f1a [0,4194304] 0 2024-04-23T10:21:08.563 INFO:tasks.workunit.client.0.smithi029.stdout:8/563: rename d3/d50/d6a/d95/d36/f92 to d3/d71/fb4 0 2024-04-23T10:21:08.564 INFO:tasks.workunit.client.0.smithi029.stdout:4/552: dwrite d0/d3c/d52/d1b/f6b [0,4194304] 0 2024-04-23T10:21:08.567 INFO:tasks.workunit.client.0.smithi029.stdout:5/632: write d0/d35/d38/d3e/f56 [7208385,30201] 0 2024-04-23T10:21:08.567 INFO:tasks.workunit.client.0.smithi029.stdout:3/506: write d3/d10/de/d2e/d36/fb2 [742508,16114] 0 2024-04-23T10:21:08.568 INFO:tasks.workunit.client.0.smithi029.stdout:8/564: dread - d3/d50/d6a/d95/f7e zero size 2024-04-23T10:21:08.568 INFO:tasks.workunit.client.0.smithi029.stdout:7/589: truncate d5/d8/d51/d55/d59/f61 961505 0 2024-04-23T10:21:08.570 INFO:tasks.workunit.client.0.smithi029.stdout:8/565: write d3/d38/f90 [831689,44219] 0 2024-04-23T10:21:08.570 INFO:tasks.workunit.client.0.smithi029.stdout:5/633: chown d0/d35/d38/d39/d3f/fc0 13013 1 2024-04-23T10:21:08.573 INFO:tasks.workunit.client.0.smithi029.stdout:5/634: chown d0/d35/d38/d39/d3f/fc0 1288510 1 2024-04-23T10:21:08.574 INFO:tasks.workunit.client.0.smithi029.stdout:2/509: creat d1/fb3 x:0 0 0 2024-04-23T10:21:08.577 INFO:tasks.workunit.client.0.smithi029.stdout:3/507: symlink d3/d10/de/d2e/d36/d40/d46/lb8 0 2024-04-23T10:21:08.579 INFO:tasks.workunit.client.0.smithi029.stdout:7/590: creat d5/d8/d1a/d9c/fc0 x:0 0 0 2024-04-23T10:21:08.583 INFO:tasks.workunit.client.0.smithi029.stdout:8/566: creat d3/d50/d6a/d95/d36/d97/da4/fb5 x:0 0 0 2024-04-23T10:21:08.585 INFO:tasks.workunit.client.0.smithi029.stdout:7/591: mkdir d5/d29/d4a/dc1 0 2024-04-23T10:21:08.587 INFO:tasks.workunit.client.0.smithi029.stdout:6/676: getdents d9/df/d25 0 2024-04-23T10:21:08.588 INFO:tasks.workunit.client.0.smithi029.stdout:4/553: dwrite d0/d3c/d52/d1b/d5b/f93 [0,4194304] 0 2024-04-23T10:21:08.593 INFO:tasks.workunit.client.0.smithi029.stdout:5/635: dwrite d0/d35/d38/d39/f8a [0,4194304] 0 2024-04-23T10:21:08.599 INFO:tasks.workunit.client.0.smithi029.stdout:2/510: creat d1/dd/d47/d63/d64/fb4 x:0 0 0 2024-04-23T10:21:08.599 INFO:tasks.workunit.client.0.smithi029.stdout:8/567: fdatasync d3/d50/d6a/d95/d36/f3b 0 2024-04-23T10:21:08.600 INFO:tasks.workunit.client.0.smithi029.stdout:3/508: truncate d3/d10/de/d2e/d36/f33 1545096 0 2024-04-23T10:21:08.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/677: rename d9/df/d16/d44/c5c to d9/df/d16/d44/d4c/ce0 0 2024-04-23T10:21:08.602 INFO:tasks.workunit.client.0.smithi029.stdout:3/509: chown d3/d10/de/f14 4975890 1 2024-04-23T10:21:08.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/592: symlink d5/d8/d1a/lc2 0 2024-04-23T10:21:08.603 INFO:tasks.workunit.client.0.smithi029.stdout:4/554: creat d0/d5a/d96/fbf x:0 0 0 2024-04-23T10:21:08.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/568: symlink d3/d71/lb6 0 2024-04-23T10:21:08.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/678: rmdir d9 39 2024-04-23T10:21:08.606 INFO:tasks.workunit.client.0.smithi029.stdout:4/555: write d0/f27 [4063332,126603] 0 2024-04-23T10:21:08.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/569: chown d3/d50/d6a/fa3 3840 1 2024-04-23T10:21:08.608 INFO:tasks.workunit.client.0.smithi029.stdout:2/511: rename d1/d3e/d3b/fae to d1/d31/d50/d9b/fb5 0 2024-04-23T10:21:08.609 INFO:tasks.workunit.client.0.smithi029.stdout:7/593: mkdir d5/d71/d92/db7/dc3 0 2024-04-23T10:21:08.611 INFO:tasks.workunit.client.0.smithi029.stdout:4/556: symlink d0/d5a/d96/lc0 0 2024-04-23T10:21:08.613 INFO:tasks.workunit.client.0.smithi029.stdout:8/570: rename d3/d50/d6a/d95/d36/d68/d8c/f93 to d3/d50/d6a/d95/d36/d94/fb7 0 2024-04-23T10:21:08.614 INFO:tasks.workunit.client.0.smithi029.stdout:4/557: write d0/d3c/d52/f42 [2259049,130051] 0 2024-04-23T10:21:08.614 INFO:tasks.workunit.client.0.smithi029.stdout:5/636: link d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/dca/fa9 d0/d6a/fce 0 2024-04-23T10:21:08.615 INFO:tasks.workunit.client.0.smithi029.stdout:2/512: mknod d1/d3e/d3b/cb6 0 2024-04-23T10:21:08.616 INFO:tasks.workunit.client.0.smithi029.stdout:2/513: chown d1/d31/d50/f82 52661 1 2024-04-23T10:21:08.616 INFO:tasks.workunit.client.0.smithi029.stdout:3/510: creat d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/fb9 x:0 0 0 2024-04-23T10:21:08.620 INFO:tasks.workunit.client.0.smithi029.stdout:7/594: truncate d5/d8/d51/f8c 1784425 0 2024-04-23T10:21:08.624 INFO:tasks.workunit.client.0.smithi029.stdout:3/511: mkdir d3/d10/de/d2e/d36/d40/d46/d65/dba 0 2024-04-23T10:21:08.625 INFO:tasks.workunit.client.0.smithi029.stdout:7/595: readlink d5/d8/d80/lb8 0 2024-04-23T10:21:08.626 INFO:tasks.workunit.client.0.smithi029.stdout:4/558: dwrite d0/d3c/d52/d74/d8a/fb4 [0,4194304] 0 2024-04-23T10:21:08.628 INFO:tasks.workunit.client.0.smithi029.stdout:3/512: mknod d3/d10/d48/cbb 0 2024-04-23T10:21:08.629 INFO:tasks.workunit.client.0.smithi029.stdout:3/513: fsync d3/d10/de/d2e/d36/d40/f7e 0 2024-04-23T10:21:08.630 INFO:tasks.workunit.client.0.smithi029.stdout:4/559: symlink d0/d5a/d6e/da1/lc1 0 2024-04-23T10:21:08.631 INFO:tasks.workunit.client.0.smithi029.stdout:7/596: creat d5/d29/d4a/dc1/fc4 x:0 0 0 2024-04-23T10:21:08.634 INFO:tasks.workunit.client.0.smithi029.stdout:4/560: rmdir d0/d5a/d6e/da1 39 2024-04-23T10:21:08.638 INFO:tasks.workunit.client.0.smithi029.stdout:7/597: creat d5/d9/fc5 x:0 0 0 2024-04-23T10:21:08.640 INFO:tasks.workunit.client.0.smithi029.stdout:6/679: truncate d9/f18 4072107 0 2024-04-23T10:21:08.643 INFO:tasks.workunit.client.0.smithi029.stdout:8/571: dwrite d3/d38/f4d [0,4194304] 0 2024-04-23T10:21:08.645 INFO:tasks.workunit.client.0.smithi029.stdout:2/514: dread d1/d3e/d5a/f93 [0,4194304] 0 2024-04-23T10:21:08.645 INFO:tasks.workunit.client.0.smithi029.stdout:7/598: chown d5/d8/c14 7735227 1 2024-04-23T10:21:08.647 INFO:tasks.workunit.client.0.smithi029.stdout:7/599: chown d5/d71/d92/db7/cbd 33 1 2024-04-23T10:21:08.653 INFO:tasks.workunit.client.0.smithi029.stdout:4/561: rename d0/d5a/d6e to d0/d3c/d52/d74/d8a/dba/dc2 0 2024-04-23T10:21:08.654 INFO:tasks.workunit.client.0.smithi029.stdout:4/562: fsync d0/d3c/d52/d1b/d5b/d65/f6d 0 2024-04-23T10:21:08.656 INFO:tasks.workunit.client.0.smithi029.stdout:2/515: truncate d1/dd/f49 3928985 0 2024-04-23T10:21:08.656 INFO:tasks.workunit.client.0.smithi029.stdout:8/572: truncate d3/d50/d6a/d95/d36/d3e/f60 237698 0 2024-04-23T10:21:08.657 INFO:tasks.workunit.client.0.smithi029.stdout:2/516: dread - d1/dd/d47/d63/fa7 zero size 2024-04-23T10:21:08.658 INFO:tasks.workunit.client.0.smithi029.stdout:2/517: readlink d1/d31/d50/l61 0 2024-04-23T10:21:08.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/573: fdatasync d3/d50/d6a/d95/d36/d68/f87 0 2024-04-23T10:21:08.659 INFO:tasks.workunit.client.0.smithi029.stdout:4/563: fdatasync d0/d3c/d52/f1d 0 2024-04-23T10:21:08.660 INFO:tasks.workunit.client.0.smithi029.stdout:6/680: symlink d9/df/d16/d1f/d27/d33/da4/d58/le1 0 2024-04-23T10:21:08.660 INFO:tasks.workunit.client.0.smithi029.stdout:2/518: readlink d1/d31/d3d/l57 0 2024-04-23T10:21:08.660 INFO:tasks.workunit.client.0.smithi029.stdout:8/574: chown d3/d38/f4d 10631 1 2024-04-23T10:21:08.663 INFO:tasks.workunit.client.0.smithi029.stdout:7/600: dread d5/d8/d1a/f7a [0,4194304] 0 2024-04-23T10:21:08.668 INFO:tasks.workunit.client.0.smithi029.stdout:8/575: fsync d3/d50/d6a/d95/d36/d68/f8b 0 2024-04-23T10:21:08.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/681: write d9/df/d41/d49/fc7 [49439,8423] 0 2024-04-23T10:21:08.670 INFO:tasks.workunit.client.0.smithi029.stdout:2/519: truncate d1/dd/d47/d63/fa7 933464 0 2024-04-23T10:21:08.682 INFO:tasks.workunit.client.0.smithi029.stdout:8/576: dwrite d3/f22 [4194304,4194304] 0 2024-04-23T10:21:08.683 INFO:tasks.workunit.client.0.smithi029.stdout:2/520: dwrite d1/d3e/fa9 [0,4194304] 0 2024-04-23T10:21:08.685 INFO:tasks.workunit.client.0.smithi029.stdout:6/682: creat d9/df/d16/d1f/d27/d33/da4/d66/d95/fe2 x:0 0 0 2024-04-23T10:21:08.691 INFO:tasks.workunit.client.0.smithi029.stdout:2/521: mkdir d1/d4/db7 0 2024-04-23T10:21:08.694 INFO:tasks.workunit.client.0.smithi029.stdout:8/577: creat d3/d50/d6a/d95/d36/d68/d8c/fb8 x:0 0 0 2024-04-23T10:21:08.694 INFO:tasks.workunit.client.0.smithi029.stdout:2/522: write d1/d3e/d3b/f7f [25922,20778] 0 2024-04-23T10:21:08.697 INFO:tasks.workunit.client.0.smithi029.stdout:4/564: link d0/d3c/d52/d74/d8a/dba/dc2/da1/lc1 d0/d3c/d52/d74/d8a/dba/dc2/da1/db1/lc3 0 2024-04-23T10:21:08.700 INFO:tasks.workunit.client.0.smithi029.stdout:8/578: mknod d3/d50/dad/cb9 0 2024-04-23T10:21:08.700 INFO:tasks.workunit.client.0.smithi029.stdout:2/523: mkdir d1/d4/db7/db8 0 2024-04-23T10:21:08.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c000709a0 con 0x7f3c000c87a0 2024-04-23T10:21:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:21:08.714 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:21:08.714 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:21:08.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3bfdffb640 1 -- 172.21.15.29:0/3797565784 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f3bf40182c0 con 0x7f3c000c87a0 2024-04-23T10:21:08.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3bec068380 msgr2=0x7f3bec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3bec068380 0x7f3bec06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00ae000 tx=0x7f3bf00a7070 comp rx=0 tx=0).stop 2024-04-23T10:21:08.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c87a0 msgr2=0x7f3c00158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c87a0 0x7f3c00158a90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c4b0 tx=0x7f3bf400c970 comp rx=0 tx=0).stop 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 shutdown_connections 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3bec068380 0x7f3bec06a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c000cd6b0 0x7f3c00151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c000c87a0 0x7f3c00158a90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 --2- 172.21.15.29:0/3797565784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c000c83c0 0x7f3c001f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 >> 172.21.15.29:0/3797565784 conn(0x7f3c00068180 msgr2=0x7f3c000c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 shutdown_connections 2024-04-23T10:21:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.714+0000 7f3c0728f640 1 -- 172.21.15.29:0/3797565784 wait complete. 2024-04-23T10:21:08.759 INFO:tasks.workunit.client.0.smithi029.stdout:2/524: mknod d1/d3e/d3b/d75/cb9 0 2024-04-23T10:21:08.762 INFO:tasks.workunit.client.0.smithi029.stdout:7/601: dwrite d5/d8/d51/f7f [0,4194304] 0 2024-04-23T10:21:08.768 INFO:tasks.workunit.client.0.smithi029.stdout:7/602: truncate d5/f41 873979 0 2024-04-23T10:21:08.771 INFO:tasks.workunit.client.0.smithi029.stdout:6/683: dread d9/df/f73 [0,4194304] 0 2024-04-23T10:21:08.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/579: dwrite d3/f9c [0,4194304] 0 2024-04-23T10:21:08.779 INFO:tasks.workunit.client.0.smithi029.stdout:6/684: rmdir d9/d5b 39 2024-04-23T10:21:08.783 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-23T10:21:08.784 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-23T10:21:08.784 INFO:tasks.workunit.client.0.smithi029.stdout:8/580: rename d3/d50/d6a/f99 to d3/d50/d6a/d95/fba 0 2024-04-23T10:21:08.784 INFO:tasks.workunit.client.0.smithi029.stdout:2/525: dwrite d1/d3e/d5a/d6d/faf [0,4194304] 0 2024-04-23T10:21:08.785 INFO:tasks.workunit.client.0.smithi029.stdout:4/565: dread d0/d3c/d52/d1b/d36/d45/d4f/f7f [0,4194304] 0 2024-04-23T10:21:08.787 INFO:tasks.workunit.client.0.smithi029.stdout:7/603: dwrite d5/d8/fa7 [0,4194304] 0 2024-04-23T10:21:08.788 INFO:tasks.workunit.client.0.smithi029.stdout:6/685: truncate d9/df/d16/d1f/d27/fa6 1127167 0 2024-04-23T10:21:08.797 INFO:tasks.workunit.client.0.smithi029.stdout:4/566: creat d0/d3c/d52/d74/d8a/dba/fc4 x:0 0 0 2024-04-23T10:21:08.799 INFO:tasks.workunit.client.0.smithi029.stdout:4/567: readlink d0/d3c/d52/d1b/d36/d45/l76 0 2024-04-23T10:21:08.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/604: creat d5/d71/d92/db7/dc3/fc6 x:0 0 0 2024-04-23T10:21:08.808 INFO:tasks.workunit.client.0.smithi029.stdout:6/686: dwrite d9/df/d16/f7d [0,4194304] 0 2024-04-23T10:21:08.808 INFO:tasks.workunit.client.0.smithi029.stdout:7/605: chown d5/d8/d51/d55/d59/c5f 64991 1 2024-04-23T10:21:08.810 INFO:tasks.workunit.client.0.smithi029.stdout:8/581: truncate d3/f22 5449537 0 2024-04-23T10:21:08.812 INFO:tasks.workunit.client.0.smithi029.stdout:7/606: rmdir d5/d71 39 2024-04-23T10:21:08.817 INFO:tasks.workunit.client.0.smithi029.stdout:4/568: creat d0/d3c/d52/d20/fc5 x:0 0 0 2024-04-23T10:21:08.819 INFO:tasks.workunit.client.0.smithi029.stdout:2/526: dwrite d1/dd/d47/d63/d64/d78/f94 [0,4194304] 0 2024-04-23T10:21:08.822 INFO:tasks.workunit.client.0.smithi029.stdout:7/607: unlink d5/d8/d1a/l27 0 2024-04-23T10:21:08.825 INFO:tasks.workunit.client.0.smithi029.stdout:8/582: dwrite d3/d50/d6a/d95/d36/f46 [0,4194304] 0 2024-04-23T10:21:08.831 INFO:tasks.workunit.client.0.smithi029.stdout:2/527: chown d1/dd/d47/d63/l95 22883059 1 2024-04-23T10:21:08.833 INFO:tasks.workunit.client.0.smithi029.stdout:4/569: read d0/d3c/d52/d1b/d5b/d65/d6a/f6f [647959,130886] 0 2024-04-23T10:21:08.839 INFO:tasks.workunit.client.0.smithi029.stdout:7/608: rename d5/d29/l54 to d5/d8/d1a/d8a/d8b/d8d/d96/lc7 0 2024-04-23T10:21:08.841 INFO:tasks.workunit.client.0.smithi029.stdout:6/687: getdents d9/df/d16/d34/d84 0 2024-04-23T10:21:08.843 INFO:tasks.workunit.client.0.smithi029.stdout:4/570: creat d0/d3c/d52/d74/d8a/dba/dc2/d7a/fc6 x:0 0 0 2024-04-23T10:21:08.845 INFO:tasks.workunit.client.0.smithi029.stdout:8/583: write d3/fd [1624148,62600] 0 2024-04-23T10:21:08.847 INFO:tasks.workunit.client.0.smithi029.stdout:7/609: fdatasync d5/d8/d1a/d8a/fa3 0 2024-04-23T10:21:08.847 INFO:tasks.workunit.client.0.smithi029.stdout:8/584: chown d3/d71/lb6 3895 1 2024-04-23T10:21:08.848 INFO:tasks.workunit.client.0.smithi029.stdout:8/585: readlink d3/d50/d6a/d95/d36/d97/l9a 0 2024-04-23T10:21:08.850 INFO:tasks.workunit.client.0.smithi029.stdout:6/688: rename d9/df/d16/d1f/d2c/c6d to d9/df/d16/d44/d4c/dbb/ddc/ce3 0 2024-04-23T10:21:08.852 INFO:tasks.workunit.client.0.smithi029.stdout:4/571: creat d0/d3c/d52/d74/d8a/dba/dc2/da1/fc7 x:0 0 0 2024-04-23T10:21:08.853 INFO:tasks.workunit.client.0.smithi029.stdout:7/610: mkdir d5/dc8 0 2024-04-23T10:21:08.854 INFO:tasks.workunit.client.0.smithi029.stdout:6/689: fsync d9/f92 0 2024-04-23T10:21:08.855 INFO:tasks.workunit.client.0.smithi029.stdout:4/572: creat d0/d3c/fc8 x:0 0 0 2024-04-23T10:21:08.856 INFO:tasks.workunit.client.0.smithi029.stdout:8/586: truncate d3/f11 1047168 0 2024-04-23T10:21:08.857 INFO:tasks.workunit.client.0.smithi029.stdout:7/611: chown d5/c6 392359242 1 2024-04-23T10:21:08.858 INFO:tasks.workunit.client.0.smithi029.stdout:2/528: dread d1/d3e/f4c [0,4194304] 0 2024-04-23T10:21:08.858 INFO:tasks.workunit.client.0.smithi029.stdout:7/612: chown d5/d8/d1a/lad 6538 1 2024-04-23T10:21:08.859 INFO:tasks.workunit.client.0.smithi029.stdout:6/690: readlink d9/df/d16/d44/d4c/lb6 0 2024-04-23T10:21:08.859 INFO:tasks.workunit.client.0.smithi029.stdout:7/613: write d5/d8/d51/f7f [857332,97961] 0 2024-04-23T10:21:08.859 INFO:tasks.workunit.client.0.smithi029.stdout:2/529: fdatasync d1/dd/d47/d63/d64/d78/f94 0 2024-04-23T10:21:08.860 INFO:tasks.workunit.client.0.smithi029.stdout:8/587: readlink d3/l1d 0 2024-04-23T10:21:08.861 INFO:tasks.workunit.client.0.smithi029.stdout:4/573: write d0/d3c/d52/d20/f57 [3601132,35218] 0 2024-04-23T10:21:08.863 INFO:tasks.workunit.client.0.smithi029.stdout:7/614: mkdir d5/d29/dc9 0 2024-04-23T10:21:08.865 INFO:tasks.workunit.client.0.smithi029.stdout:2/530: fdatasync d1/d3e/d3b/f7d 0 2024-04-23T10:21:08.867 INFO:tasks.workunit.client.0.smithi029.stdout:4/574: creat d0/d3c/fc9 x:0 0 0 2024-04-23T10:21:08.869 INFO:tasks.workunit.client.0.smithi029.stdout:4/575: write d0/d3c/d52/d74/d8a/dba/dc2/d7a/fc6 [938138,98591] 0 2024-04-23T10:21:08.872 INFO:tasks.workunit.client.0.smithi029.stdout:8/588: rename d3/l4b to d3/d50/d6a/d95/d36/d97/lbb 0 2024-04-23T10:21:08.876 INFO:tasks.workunit.client.0.smithi029.stdout:2/531: dread d1/d3e/d5a/d6d/fa1 [0,4194304] 0 2024-04-23T10:21:08.876 INFO:tasks.workunit.client.0.smithi029.stdout:6/691: link d9/df/d16/f7d d9/df/d16/d1f/d27/d33/da4/d58/d7e/fe4 0 2024-04-23T10:21:08.877 INFO:tasks.workunit.client.0.smithi029.stdout:4/576: mknod d0/d3c/d52/d1b/d36/d45/d4f/d7b/cca 0 2024-04-23T10:21:08.877 INFO:tasks.workunit.client.0.smithi029.stdout:7/615: getdents d5/dc8 0 2024-04-23T10:21:08.878 INFO:tasks.workunit.client.0.smithi029.stdout:8/589: symlink d3/d50/d6a/d95/d36/d97/da4/lbc 0 2024-04-23T10:21:08.879 INFO:tasks.workunit.client.0.smithi029.stdout:2/532: unlink d1/l87 0 2024-04-23T10:21:08.880 INFO:tasks.workunit.client.0.smithi029.stdout:4/577: mkdir d0/d12/dcb 0 2024-04-23T10:21:08.882 INFO:tasks.workunit.client.0.smithi029.stdout:6/692: read d9/df/d16/f46 [757948,22428] 0 2024-04-23T10:21:08.882 INFO:tasks.workunit.client.0.smithi029.stdout:4/578: readlink d0/d3c/d52/d1b/d5b/lbe 0 2024-04-23T10:21:08.882 INFO:tasks.workunit.client.0.smithi029.stdout:7/616: chown d5/d58/ca8 3010845 1 2024-04-23T10:21:08.882 INFO:tasks.workunit.client.0.smithi029.stdout:4/579: chown d0/d3c/fc9 96 1 2024-04-23T10:21:08.884 INFO:tasks.workunit.client.0.smithi029.stdout:2/533: mknod d1/d3e/d3b/cba 0 2024-04-23T10:21:08.886 INFO:tasks.workunit.client.0.smithi029.stdout:2/534: chown d1/d3e/d3b/f7d 3122640 1 2024-04-23T10:21:08.886 INFO:tasks.workunit.client.0.smithi029.stdout:4/580: mknod d0/d3c/d52/d1b/d9f/d92/ccc 0 2024-04-23T10:21:08.890 INFO:tasks.workunit.client.0.smithi029.stdout:7/617: dwrite d5/fa0 [0,4194304] 0 2024-04-23T10:21:08.890 INFO:tasks.workunit.client.0.smithi029.stdout:8/590: write d3/d50/d6a/d95/d36/d3e/f3f [932019,47281] 0 2024-04-23T10:21:08.891 INFO:tasks.workunit.client.0.smithi029.stdout:8/591: write d3/d50/d6a/faf [74159,19384] 0 2024-04-23T10:21:08.892 INFO:tasks.workunit.client.0.smithi029.stdout:6/693: write d9/df/d16/d44/d4c/fa9 [825050,7220] 0 2024-04-23T10:21:08.902 INFO:tasks.workunit.client.0.smithi029.stdout:6/694: dwrite d9/df/d16/d1f/d27/fa6 [0,4194304] 0 2024-04-23T10:21:08.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc671049640 1 Processor -- start 2024-04-23T10:21:08.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc671049640 1 -- start start 2024-04-23T10:21:08.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc671049640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc66c155300 0x7fc66c15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc671049640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0c5940 0x7fc66c15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc671049640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc66c0cb8f0 0x7fc66c0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc671049640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc66c15f620 con 0x7fc66c0cb8f0 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc671049640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc66c15ed80 con 0x7fc66c155300 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc671049640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c15f060 con 0x7fc66c0c5940 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc66c0cb8f0 0x7fc66c0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc66c0cb8f0 0x7fc66c0cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56162/0 (socket says 172.21.15.29:56162) 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 -- 172.21.15.29:0/1365136375 learned_addr learned my addr 172.21.15.29:0/1365136375 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66a59c640 1 --2- 172.21.15.29:0/1365136375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0c5940 0x7fc66c15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/1365136375 >> v2:172.21.15.72:3300/0 conn(0x7fc66c155300 0x7fc66c15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 -- 172.21.15.29:0/1365136375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0c5940 msgr2=0x7fc66c15ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 --2- 172.21.15.29:0/1365136375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0c5940 0x7fc66c15ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 -- 172.21.15.29:0/1365136375 >> v2:172.21.15.72:3300/0 conn(0x7fc66c155300 msgr2=0x7fc66c15e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 --2- 172.21.15.29:0/1365136375 >> v2:172.21.15.72:3300/0 conn(0x7fc66c155300 0x7fc66c15e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 -- 172.21.15.29:0/1365136375 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c15f340 con 0x7fc66c0cb8f0 2024-04-23T10:21:08.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/1365136375 >> v2:172.21.15.72:3300/0 conn(0x7fc66c155300 0x7fc66c15e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:21:08.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc66b59e640 1 --2- 172.21.15.29:0/1365136375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0cb8f0 0x7fc66c0cbd20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0d1740 tx=0x7fc66401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2187fd5e4a7586 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc669d9b640 1 -- 172.21.15.29:0/1365136375 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6640b4070 con 0x7fc66c0cb8f0 2024-04-23T10:21:08.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc669d9b640 1 -- 172.21.15.29:0/1365136375 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6640af400 con 0x7fc66c0cb8f0 2024-04-23T10:21:08.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.946+0000 7fc669d9b640 1 -- 172.21.15.29:0/1365136375 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6640af7d0 con 0x7fc66c0cb8f0 2024-04-23T10:21:08.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- 172.21.15.29:0/1365136375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0cb8f0 msgr2=0x7fc66c0cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 --2- 172.21.15.29:0/1365136375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0cb8f0 0x7fc66c0cbd20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0d1740 tx=0x7fc66401f1e0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- 172.21.15.29:0/1365136375 shutdown_connections 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 --2- 172.21.15.29:0/1365136375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0cb8f0 0x7fc66c0cbd20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 --2- 172.21.15.29:0/1365136375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0c5940 0x7fc66c15ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 --2- 172.21.15.29:0/1365136375 >> v2:172.21.15.72:3300/0 conn(0x7fc66c155300 0x7fc66c15e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- 172.21.15.29:0/1365136375 >> 172.21.15.29:0/1365136375 conn(0x7fc66c06d590 msgr2=0x7fc66c074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- 172.21.15.29:0/1365136375 shutdown_connections 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- 172.21.15.29:0/1365136375 wait complete. 2024-04-23T10:21:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 Processor -- start 2024-04-23T10:21:08.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- start start 2024-04-23T10:21:08.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0c5940 0x7fc66c1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0cb8f0 0x7fc66c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c155300 0x7fc66c159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c15bfc0 con 0x7fc66c0c5940 2024-04-23T10:21:08.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c15b560 con 0x7fc66c155300 2024-04-23T10:21:08.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c1556e0 con 0x7fc66c0cb8f0 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0c5940 0x7fc66c1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0c5940 0x7fc66c1591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56176/0 (socket says 172.21.15.29:56176) 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 -- 172.21.15.29:0/2015204609 learned_addr learned my addr 172.21.15.29:0/2015204609 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66a59c640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0cb8f0 0x7fc66c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66b59e640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c155300 0x7fc66c159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 -- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0cb8f0 msgr2=0x7fc66c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0cb8f0 0x7fc66c0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 -- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c155300 msgr2=0x7fc66c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c155300 0x7fc66c159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 -- 172.21.15.29:0/2015204609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c0d0850 con 0x7fc66c0c5940 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0c5940 0x7fc66c1591f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00d800 tx=0x7fc65c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc6537fe640 1 -- 172.21.15.29:0/2015204609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00b660 con 0x7fc66c0c5940 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc6537fe640 1 -- 172.21.15.29:0/2015204609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c019070 con 0x7fc66c0c5940 2024-04-23T10:21:08.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc6537fe640 1 -- 172.21.15.29:0/2015204609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00ba00 con 0x7fc66c0c5940 2024-04-23T10:21:08.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- 172.21.15.29:0/2015204609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c1f4a90 con 0x7fc66c0c5940 2024-04-23T10:21:08.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.950+0000 7fc671049640 1 -- 172.21.15.29:0/2015204609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c1f0d30 con 0x7fc66c0c5940 2024-04-23T10:21:08.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6537fe640 1 -- 172.21.15.29:0/2015204609 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc65c00bba0 con 0x7fc66c0c5940 2024-04-23T10:21:08.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6537fe640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc6580683b0 0x7fc65806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6537fe640 1 -- 172.21.15.29:0/2015204609 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc65c0870c0 con 0x7fc66c0c5940 2024-04-23T10:21:08.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66a59c640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc6580683b0 0x7fc65806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66a59c640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc6580683b0 0x7fc65806a870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc66c15eaf0 tx=0x7fc660009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 Processor -- start 2024-04-23T10:21:08.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 -- start start 2024-04-23T10:21:08.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576da9600 0x564576da99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 0x564576daeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576daf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564576c552a0 con 0x564576da9600 2024-04-23T10:21:08.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564576bbb5f0 con 0x564576daefe0 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x564576b56820 con 0x564576dae6c0 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576da9600 0x564576da99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576da9600 0x564576da99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56182/0 (socket says 172.21.15.29:56182) 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 -- 172.21.15.29:0/674857108 learned_addr learned my addr 172.21.15.29:0/674857108 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66a59c640 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 0x564576daeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66b59e640 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576daf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 -- 172.21.15.29:0/674857108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 msgr2=0x564576daeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 0x564576daeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 -- 172.21.15.29:0/674857108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 msgr2=0x564576daf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576daf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 -- 172.21.15.29:0/674857108 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564576c01c00 con 0x564576da9600 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576da9600 0x564576da99e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc65c05f170 tx=0x7fc65c056590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26484d1f105dd287 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc650ff9640 1 -- 172.21.15.29:0/674857108 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c05f6a0 con 0x564576da9600 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc650ff9640 1 -- 172.21.15.29:0/674857108 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c054c10 con 0x564576da9600 2024-04-23T10:21:08.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc650ff9640 1 -- 172.21.15.29:0/674857108 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0531e0 con 0x564576da9600 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 -- 172.21.15.29:0/674857108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576da9600 msgr2=0x564576da99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576da9600 0x564576da99e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc65c05f170 tx=0x7fc65c056590 comp rx=0 tx=0).stop 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 -- 172.21.15.29:0/674857108 shutdown_connections 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576daf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 0x564576daeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 --2- 172.21.15.29:0/674857108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576da9600 0x564576da99e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 -- 172.21.15.29:0/674857108 >> 172.21.15.29:0/674857108 conn(0x564576daa470 msgr2=0x564576dac890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.954+0000 7fc6741cb000 1 -- 172.21.15.29:0/674857108 shutdown_connections 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 -- 172.21.15.29:0/674857108 wait complete. 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 -- start start 2024-04-23T10:21:08.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 Processor -- start 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 0x564576da89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 0x564576da8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576daefe0 0x564576db4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564576b66c60 con 0x564576daefe0 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564576c3dbf0 con 0x564576da9600 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x564576c78560 con 0x564576dae6c0 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 10 client.0 _ll_register_callbacks cb 0x564576b92570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576daefe0 0x564576db4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576daefe0 0x564576db4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56198/0 (socket says 172.21.15.29:56198) 2024-04-23T10:21:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 -- 172.21.15.29:0/2130983258 learned_addr learned my addr 172.21.15.29:0/2130983258 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66a59c640 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 0x564576da8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 0x564576da89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 -- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 msgr2=0x564576da8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 0x564576da8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 -- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 msgr2=0x564576da89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 0x564576da89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 -- 172.21.15.29:0/2130983258 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564576bf6630 con 0x564576daefe0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66b59e640 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576daefe0 0x564576db4620 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc6640b2040 tx=0x7fc66401da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6418ee79b1ef39 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc649ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc649ffb640 1 -- 172.21.15.29:0/2130983258 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6640b4040 con 0x564576daefe0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc649ffb640 1 -- 172.21.15.29:0/2130983258 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc6640af700 con 0x564576daefe0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 -- 172.21.15.29:0/2130983258 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc65c054c10 con 0x564576daefe0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc649ffb640 1 -- 172.21.15.29:0/2130983258 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc6640cc050 con 0x564576daefe0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 10 client.5364 fetch_fsmap learned FSMap version 18 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 -- 172.21.15.29:0/2130983258 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564576b5b490 con 0x564576daefe0 2024-04-23T10:21:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc649ffb640 1 -- 172.21.15.29:0/2130983258 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c054c10 con 0x564576daefe0 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc649ffb640 1 -- 172.21.15.29:0/2130983258 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc6640cf020 con 0x564576daefe0 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 10 client.5364 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 10 client.5364 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 20 client.5364 populate_metadata read hostname 'smithi029' 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564576db5390 0x564576db5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 4 client.5364 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc6741cb000 1 -- 172.21.15.29:0/2130983258 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564576b557f0 con 0x564576db5390 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564576db5390 0x564576db5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564576db5390 0x564576db5770 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de0fb9e1bcadd599 server_cookie=d5820be043aebbe4 in_seq=0 out_seq=0 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.958+0000 7fc649ffb640 10 client.5364 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc649ffb640 1 -- 172.21.15.29:0/2130983258 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564576b557f0 con 0x564576db5390 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc649ffb640 10 client.5364 handle_command_reply: tid=0 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 client.5364 shutdown 2024-04-23T10:21:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 -- 172.21.15.29:0/2130983258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576daefe0 msgr2=0x564576db4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576daefe0 0x564576db4620 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc6640b2040 tx=0x7fc66401da20 comp rx=0 tx=0).stop 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 -- 172.21.15.29:0/2130983258 shutdown_connections 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564576db5390 0x564576db5770 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576daefe0 0x564576db4620 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576dae6c0 0x564576da8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc649ffb640 0 client.5364 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 --2- 172.21.15.29:0/2130983258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 0x564576da89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 -- 172.21.15.29:0/2130983258 >> 172.21.15.29:0/2130983258 conn(0x564576daa470 msgr2=0x564576dad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 -- 172.21.15.29:0/2130983258 shutdown_connections 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 1 -- 172.21.15.29:0/2130983258 wait complete. 2024-04-23T10:21:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.962+0000 7fc6741cb000 20 client.5364 trim_cache size 0 max 16384 2024-04-23T10:21:08.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 Processor -- start 2024-04-23T10:21:08.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- start start 2024-04-23T10:21:08.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 0x564576db6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576db6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576daefe0 0x564576dc9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1fe800 con 0x564576dae6c0 2024-04-23T10:21:08.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1feed0 con 0x564576da9600 2024-04-23T10:21:08.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c1fcf80 con 0x564576daefe0 2024-04-23T10:21:08.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576db6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576db6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56200/0 (socket says 172.21.15.29:56200) 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 -- 172.21.15.29:0/4169668232 learned_addr learned my addr 172.21.15.29:0/4169668232 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66b59e640 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576daefe0 0x564576dc9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 0x564576db6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 -- 172.21.15.29:0/4169668232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576daefe0 msgr2=0x564576dc9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576daefe0 0x564576dc9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 -- 172.21.15.29:0/4169668232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 msgr2=0x564576db6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 0x564576db6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 -- 172.21.15.29:0/4169668232 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564576b56a70 con 0x564576dae6c0 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc66a59c640 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576db6ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc660011b00 tx=0x7fc660014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fd79d8a89fb8a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc64bfff640 1 -- 172.21.15.29:0/4169668232 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660003b30 con 0x564576dae6c0 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc64bfff640 1 -- 172.21.15.29:0/4169668232 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc660028070 con 0x564576dae6c0 2024-04-23T10:21:08.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc64bfff640 1 -- 172.21.15.29:0/4169668232 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66002d470 con 0x564576dae6c0 2024-04-23T10:21:08.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- 172.21.15.29:0/4169668232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 msgr2=0x564576db6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576db6ed0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc660011b00 tx=0x7fc660014000 comp rx=0 tx=0).stop 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- 172.21.15.29:0/4169668232 shutdown_connections 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576daefe0 0x564576dc9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576db6ed0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 --2- 172.21.15.29:0/4169668232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576da9600 0x564576db6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- 172.21.15.29:0/4169668232 >> 172.21.15.29:0/4169668232 conn(0x564576daa470 msgr2=0x564576dbff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- 172.21.15.29:0/4169668232 shutdown_connections 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- 172.21.15.29:0/4169668232 wait complete. 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 -- start start 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.978+0000 7fc6741cb000 1 Processor -- start 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576da9600 0x564576e22e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576e23370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576d6ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564576bba900 con 0x564576dae6c0 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x564576b85e60 con 0x564576daefe0 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x564576bbfc20 con 0x564576da9600 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 10 client.0 _ll_register_callbacks cb 0x7fc660009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576e23370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576e23370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56212/0 (socket says 172.21.15.29:56212) 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 -- 172.21.15.29:0/3491348830 learned_addr learned my addr 172.21.15.29:0/3491348830 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576da9600 0x564576e22e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66b59e640 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576d6ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 -- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576da9600 msgr2=0x564576e22e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576da9600 0x564576e22e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 -- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 msgr2=0x564576d6ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576d6ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 -- 172.21.15.29:0/3491348830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564576c3e080 con 0x564576dae6c0 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66b59e640 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576d6ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:21:08.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66a59c640 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576e23370 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc660009240 tx=0x7fc660004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3546cc8d212401b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc649ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc649ffb640 1 -- 172.21.15.29:0/3491348830 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660005c70 con 0x564576dae6c0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 -- 172.21.15.29:0/3491348830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc660028070 con 0x564576dae6c0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc649ffb640 1 -- 172.21.15.29:0/3491348830 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc660006030 con 0x564576dae6c0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc649ffb640 1 -- 172.21.15.29:0/3491348830 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc660040050 con 0x564576dae6c0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 10 client.5370 fetch_fsmap learned FSMap version 18 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 -- 172.21.15.29:0/3491348830 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564576b613e0 con 0x564576dae6c0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc649ffb640 1 -- 172.21.15.29:0/3491348830 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc660028070 con 0x564576dae6c0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc649ffb640 1 -- 172.21.15.29:0/3491348830 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc660043020 con 0x564576dae6c0 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 10 client.5370 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 10 client.5370 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 20 client.5370 populate_metadata read hostname 'smithi029' 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564576d6fbd0 0x564576d6ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 4 client.5370 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-23T10:21:08.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc6741cb000 1 -- 172.21.15.29:0/3491348830 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x564576b64940 con 0x564576d6fbd0 2024-04-23T10:21:08.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564576d6fbd0 0x564576d6ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:08.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc649ffb640 10 client.5370 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:21:08.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:08.982+0000 7fc66ad9d640 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564576d6fbd0 0x564576d6ffe0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a14766162b9e72 server_cookie=8d9cb0b01db77fad in_seq=0 out_seq=0 2024-04-23T10:21:08.987 INFO:tasks.workunit.client.0.smithi029.stdout:6/695: creat d9/df/d16/d1f/d27/d33/da4/d66/fe5 x:0 0 0 2024-04-23T10:21:08.988 INFO:tasks.workunit.client.0.smithi029.stdout:7/618: mkdir d5/d71/dca 0 2024-04-23T10:21:08.988 INFO:tasks.workunit.client.0.smithi029.stdout:7/619: dread - d5/d29/d4a/f56 zero size 2024-04-23T10:21:08.990 INFO:tasks.workunit.client.0.smithi029.stdout:6/696: symlink d9/df/d16/d44/d4c/dbb/le6 0 2024-04-23T10:21:08.991 INFO:tasks.workunit.client.0.smithi029.stdout:6/697: chown d9/df/d16/f1a 0 1 2024-04-23T10:21:08.992 INFO:tasks.workunit.client.0.smithi029.stdout:7/620: symlink d5/d8/d51/d55/d59/lcb 0 2024-04-23T10:21:08.992 INFO:tasks.workunit.client.0.smithi029.stdout:6/698: fsync d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/fac 0 2024-04-23T10:21:08.994 INFO:tasks.workunit.client.0.smithi029.stdout:7/621: mkdir d5/d71/d92/db7/dc3/dcc 0 2024-04-23T10:21:08.996 INFO:tasks.workunit.client.0.smithi029.stdout:6/699: rename d9/df/d41/d49/d69/f6f to d9/df/d41/fe7 0 2024-04-23T10:21:08.996 INFO:tasks.workunit.client.0.smithi029.stdout:7/622: dread d5/d29/d4a/f8f [0,4194304] 0 2024-04-23T10:21:09.000 INFO:tasks.workunit.client.0.smithi029.stdout:6/700: rmdir d9/df/d16/d1f/d27/dad/dbd 39 2024-04-23T10:21:09.044 INFO:tasks.workunit.client.0.smithi029.stdout:7/623: write d5/d8/d1a/d4d/f52 [3549792,117784] 0 2024-04-23T10:21:09.101 INFO:tasks.workunit.client.0.smithi029.stdout:1/448: sync 2024-04-23T10:21:09.571 INFO:tasks.workunit.client.0.smithi029.stdout:9/715: sync 2024-04-23T10:21:09.689 INFO:tasks.workunit.client.0.smithi029.stdout:2/535: sync 2024-04-23T10:21:09.689 INFO:tasks.workunit.client.0.smithi029.stdout:4/581: sync 2024-04-23T10:21:09.690 INFO:tasks.workunit.client.0.smithi029.stdout:5/637: sync 2024-04-23T10:21:09.690 INFO:tasks.workunit.client.0.smithi029.stdout:8/592: sync 2024-04-23T10:21:09.690 INFO:tasks.workunit.client.0.smithi029.stdout:0/461: sync 2024-04-23T10:21:09.690 INFO:tasks.workunit.client.0.smithi029.stdout:3/514: sync 2024-04-23T10:21:09.842 INFO:tasks.workunit.client.0.smithi029.stdout:2/536: sync 2024-04-23T10:21:10.358 INFO:tasks.workunit.client.0.smithi029.stdout:7/624: dread d5/f30 [0,4194304] 0 2024-04-23T10:21:11.351 INFO:tasks.workunit.client.0.smithi029.stdout:2/537: dread d1/dd/f51 [0,4194304] 0 2024-04-23T10:21:12.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/716: chown d0/d1b/d60/ce1 14 1 2024-04-23T10:21:12.858 INFO:tasks.workunit.client.0.smithi029.stdout:1/449: getdents d5/d6 0 2024-04-23T10:21:12.892 INFO:tasks.workunit.client.0.smithi029.stdout:5/638: dread d0/d35/d38/d3e/f70 [0,4194304] 0 2024-04-23T10:21:13.243 INFO:tasks.workunit.client.0.smithi029.stdout:8/593: dread - d3/d50/d6a/d95/d36/fa6 zero size 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc649ffb640 1 -- 172.21.15.29:0/3491348830 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564576b64940 con 0x564576d6fbd0 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc649ffb640 10 client.5370 handle_command_reply: tid=0 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 client.5370 shutdown 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 -- 172.21.15.29:0/3491348830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 msgr2=0x564576e23370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576e23370 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc660009240 tx=0x7fc660004740 comp rx=0 tx=0).stop 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 -- 172.21.15.29:0/3491348830 shutdown_connections 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x564576d6fbd0 0x564576d6ffe0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564576daefe0 0x564576d6ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564576dae6c0 0x564576e23370 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 --2- 172.21.15.29:0/3491348830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564576da9600 0x564576e22e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 -- 172.21.15.29:0/3491348830 >> 172.21.15.29:0/3491348830 conn(0x564576daa470 msgr2=0x564576dca230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc649ffb640 0 client.5370 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 -- 172.21.15.29:0/3491348830 shutdown_connections 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 1 -- 172.21.15.29:0/3491348830 wait complete. 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc6741cb000 20 client.5370 trim_cache size 0 max 16384 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 18, 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stdout: "84b25be9": { 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 18, 2024-04-23T10:21:13.685 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 79.5, 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:13.686 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:13.687 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:13.687 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:13.687 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:21:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 -- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc6580683b0 msgr2=0x7fc65806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc6580683b0 0x7fc65806a870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc66c15eaf0 tx=0x7fc660009190 comp rx=0 tx=0).stop 2024-04-23T10:21:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 -- 172.21.15.29:0/2015204609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0c5940 msgr2=0x7fc66c1591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0c5940 0x7fc66c1591f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00d800 tx=0x7fc65c00dcc0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 -- 172.21.15.29:0/2015204609 shutdown_connections 2024-04-23T10:21:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc6580683b0 0x7fc65806a870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc66c155300 0x7fc66c159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc66c0cb8f0 0x7fc66c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 --2- 172.21.15.29:0/2015204609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0c5940 0x7fc66c1591f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.682+0000 7fc671049640 1 -- 172.21.15.29:0/2015204609 >> 172.21.15.29:0/2015204609 conn(0x7fc66c06d590 msgr2=0x7fc66c0cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.686+0000 7fc671049640 1 -- 172.21.15.29:0/2015204609 shutdown_connections 2024-04-23T10:21:13.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:13.686+0000 7fc671049640 1 -- 172.21.15.29:0/2015204609 wait complete. 2024-04-23T10:21:13.707 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '84b25be9', quiesce took 5.5 seconds. Will release after: 19.5 2024-04-23T10:21:18.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:21:18.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:21:33.208 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:21:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c4604640 1 Processor -- start 2024-04-23T10:21:33.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c4604640 1 -- start start 2024-04-23T10:21:33.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c4604640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc153190 0x7f23bc159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c4604640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23bc0cd360 0x7f23bc06f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c4604640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc0c3fe0 con 0x7f23bc06f150 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c4604640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f23bc159380 con 0x7f23bc0cd360 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c4604640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc0c42c0 con 0x7f23bc153190 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c2ba1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23bc0cd360 0x7f23bc06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c1b9f640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f23bc06f150 0x7f23bc0ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:39180/0 (socket says 172.21.15.29:39180) 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c23a0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc153190 0x7f23bc159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c1b9f640 1 -- 172.21.15.29:0/966924931 learned_addr learned my addr 172.21.15.29:0/966924931 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:21:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c23a0640 1 -- 172.21.15.29:0/966924931 >> v2:172.21.15.72:3300/0 conn(0x7f23bc0cd360 msgr2=0x7f23bc06f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c23a0640 1 --2- 172.21.15.29:0/966924931 >> v2:172.21.15.72:3300/0 conn(0x7f23bc0cd360 0x7f23bc06f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c23a0640 1 -- 172.21.15.29:0/966924931 >> v1:172.21.15.72:6789/0 conn(0x7f23bc06f150 legacy=0x7f23bc0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.342+0000 7f23c23a0640 1 -- 172.21.15.29:0/966924931 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc0c45a0 con 0x7f23bc153190 2024-04-23T10:21:33.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c23a0640 1 --2- 172.21.15.29:0/966924931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc153190 0x7f23bc159810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009d90 tx=0x7f23b801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79aa0806ad43ac11 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c139e640 1 -- 172.21.15.29:0/966924931 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b80b4070 con 0x7f23bc153190 2024-04-23T10:21:33.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c139e640 1 -- 172.21.15.29:0/966924931 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b80af600 con 0x7f23bc153190 2024-04-23T10:21:33.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c139e640 1 -- 172.21.15.29:0/966924931 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b80af9d0 con 0x7f23bc153190 2024-04-23T10:21:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c4604640 1 -- 172.21.15.29:0/966924931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc153190 msgr2=0x7f23bc159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c4604640 1 --2- 172.21.15.29:0/966924931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc153190 0x7f23bc159810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009d90 tx=0x7f23b801f150 comp rx=0 tx=0).stop 2024-04-23T10:21:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c4604640 1 -- 172.21.15.29:0/966924931 shutdown_connections 2024-04-23T10:21:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c4604640 1 --2- 172.21.15.29:0/966924931 >> v2:172.21.15.72:3300/0 conn(0x7f23bc0cd360 0x7f23bc06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c4604640 1 --2- 172.21.15.29:0/966924931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc153190 0x7f23bc159810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c4604640 1 -- 172.21.15.29:0/966924931 >> 172.21.15.29:0/966924931 conn(0x7f23bc06cfb0 msgr2=0x7f23bc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c4604640 1 -- 172.21.15.29:0/966924931 shutdown_connections 2024-04-23T10:21:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.346+0000 7f23c4604640 1 -- 172.21.15.29:0/966924931 wait complete. 2024-04-23T10:21:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 Processor -- start 2024-04-23T10:21:33.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 -- start start 2024-04-23T10:21:33.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc06f150 0x7f23bc1e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23bc0cd360 0x7f23bc074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc153190 0x7f23bc1ef100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc0c4880 con 0x7f23bc153190 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc153570 con 0x7f23bc0cd360 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc0c9070 con 0x7f23bc06f150 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc153190 0x7f23bc1ef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc153190 0x7f23bc1ef100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51904/0 (socket says 172.21.15.29:51904) 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 -- 172.21.15.29:0/1583614609 learned_addr learned my addr 172.21.15.29:0/1583614609 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c1b9f640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23bc0cd360 0x7f23bc074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c23a0640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc06f150 0x7f23bc1e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 -- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc06f150 msgr2=0x7f23bc1e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc06f150 0x7f23bc1e4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 -- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23bc0cd360 msgr2=0x7f23bc074fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23bc0cd360 0x7f23bc074fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 -- 172.21.15.29:0/1583614609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc075a60 con 0x7f23bc153190 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c23a0640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc06f150 0x7f23bc1e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c2ba1640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc153190 0x7f23bc1ef100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f23b400e8b0 tx=0x7f23b400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23b2ffd640 1 -- 172.21.15.29:0/1583614609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4017070 con 0x7f23bc153190 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23b2ffd640 1 -- 172.21.15.29:0/1583614609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b400c940 con 0x7f23bc153190 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc1e3030 con 0x7f23bc153190 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23b2ffd640 1 -- 172.21.15.29:0/1583614609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b400cd10 con 0x7f23bc153190 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc1563f0 con 0x7f23bc153190 2024-04-23T10:21:33.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.350+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc068d70 con 0x7f23bc153190 2024-04-23T10:21:33.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.354+0000 7f23b2ffd640 1 -- 172.21.15.29:0/1583614609 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f23b401a070 con 0x7f23bc153190 2024-04-23T10:21:33.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.354+0000 7f23b2ffd640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f23a0068380 0x7f23a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.354+0000 7f23b2ffd640 1 -- 172.21.15.29:0/1583614609 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f23b4086d20 con 0x7f23bc153190 2024-04-23T10:21:33.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.354+0000 7f23c23a0640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f23a0068380 0x7f23a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.354+0000 7f23c23a0640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f23a0068380 0x7f23a006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f23b80b1000 tx=0x7f23b80aa000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.358+0000 7f23b2ffd640 1 -- 172.21.15.29:0/1583614609 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f23bc075a60 con 0x7f23bc153190 2024-04-23T10:21:33.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.558+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23bc073b70 con 0x7f23bc153190 2024-04-23T10:21:33.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.558+0000 7f23b2ffd640 1 -- 172.21.15.29:0/1583614609 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f23b4056870 con 0x7f23bc153190 2024-04-23T10:21:33.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:21:33.559 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:21:33.560 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:21:33.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f23a0068380 msgr2=0x7f23a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f23a0068380 0x7f23a006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f23b80b1000 tx=0x7f23b80aa000 comp rx=0 tx=0).stop 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc153190 msgr2=0x7f23bc1ef100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc153190 0x7f23bc1ef100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f23b400e8b0 tx=0x7f23b400ed70 comp rx=0 tx=0).stop 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 shutdown_connections 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f23a0068380 0x7f23a006a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc153190 0x7f23bc1ef100 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23bc0cd360 0x7f23bc074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 --2- 172.21.15.29:0/1583614609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23bc06f150 0x7f23bc1e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 >> 172.21.15.29:0/1583614609 conn(0x7f23bc06cfb0 msgr2=0x7f23bc156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 shutdown_connections 2024-04-23T10:21:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.562+0000 7f23c4604640 1 -- 172.21.15.29:0/1583614609 wait complete. 2024-04-23T10:21:33.579 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id 84b25be9 --release --await' 2024-04-23T10:21:33.579 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id 84b25be9 --release --await 2024-04-23T10:21:33.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc135fc640 1 Processor -- start 2024-04-23T10:21:33.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc135fc640 1 -- start start 2024-04-23T10:21:33.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc135fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc0c06f790 0x7efc0c0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc135fc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc0c072590 con 0x7efc0c06f3b0 2024-04-23T10:21:33.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc135fc640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc0c158830 con 0x7efc0c071160 2024-04-23T10:21:33.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc135fc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7efc0c072fe0 con 0x7efc0c06f790 2024-04-23T10:21:33.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc11398640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efc0c06f3b0 0x7efc0c157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:42538/0 (socket says 172.21.15.29:42538) 2024-04-23T10:21:33.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc11398640 1 -- 172.21.15.29:0/1188374244 learned_addr learned my addr 172.21.15.29:0/1188374244 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:21:33.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc10b97640 1 --2- 172.21.15.29:0/1188374244 >> v2:172.21.15.29:3300/0 conn(0x7efc0c06f790 0x7efc0c0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc03fff640 1 -- 172.21.15.29:0/1188374244 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731897508 0 0) 0x7efc0c072590 con 0x7efc0c06f3b0 2024-04-23T10:21:33.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc03fff640 1 -- 172.21.15.29:0/1188374244 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbf8003530 con 0x7efc0c06f3b0 2024-04-23T10:21:33.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc10b97640 1 -- 172.21.15.29:0/1188374244 >> v1:172.21.15.72:6789/0 conn(0x7efc0c071160 legacy=0x7efc0c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc10b97640 1 -- 172.21.15.29:0/1188374244 >> v1:172.21.15.29:6789/0 conn(0x7efc0c06f3b0 legacy=0x7efc0c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.710+0000 7efc10b97640 1 -- 172.21.15.29:0/1188374244 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c158b10 con 0x7efc0c06f790 2024-04-23T10:21:33.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc10b97640 1 --2- 172.21.15.29:0/1188374244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c06f790 0x7efc0c0c4d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097c0 tx=0x7efbfc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e279dbf5d5258c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc03fff640 1 -- 172.21.15.29:0/1188374244 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0b1070 con 0x7efc0c06f790 2024-04-23T10:21:33.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc03fff640 1 -- 172.21.15.29:0/1188374244 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc0ac410 con 0x7efc0c06f790 2024-04-23T10:21:33.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc03fff640 1 -- 172.21.15.29:0/1188374244 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0ac7e0 con 0x7efc0c06f790 2024-04-23T10:21:33.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- 172.21.15.29:0/1188374244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c06f790 msgr2=0x7efc0c0c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 --2- 172.21.15.29:0/1188374244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c06f790 0x7efc0c0c4d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097c0 tx=0x7efbfc01c4a0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- 172.21.15.29:0/1188374244 shutdown_connections 2024-04-23T10:21:33.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 --2- 172.21.15.29:0/1188374244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c06f790 0x7efc0c0c4d70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- 172.21.15.29:0/1188374244 >> 172.21.15.29:0/1188374244 conn(0x7efc0c06cfb0 msgr2=0x7efc0c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:33.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- 172.21.15.29:0/1188374244 shutdown_connections 2024-04-23T10:21:33.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- 172.21.15.29:0/1188374244 wait complete. 2024-04-23T10:21:33.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 Processor -- start 2024-04-23T10:21:33.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- start start 2024-04-23T10:21:33.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c06f3b0 0x7efc0c143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc0c06f790 0x7efc0c140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c071160 0x7efc0c1412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c0cc6c0 con 0x7efc0c071160 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c158500 con 0x7efc0c06f3b0 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc135fc640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efc0c0cc840 con 0x7efc0c06f790 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11b99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c071160 0x7efc0c1412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11b99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c071160 0x7efc0c1412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51932/0 (socket says 172.21.15.29:51932) 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11b99640 1 -- 172.21.15.29:0/4278361022 learned_addr learned my addr 172.21.15.29:0/4278361022 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11398640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c06f3b0 0x7efc0c143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc10b97640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc0c06f790 0x7efc0c140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11b99640 1 -- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc0c06f790 msgr2=0x7efc0c140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11b99640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc0c06f790 0x7efc0c140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11b99640 1 -- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c06f3b0 msgr2=0x7efc0c143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11b99640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c06f3b0 0x7efc0c143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc11b99640 1 -- 172.21.15.29:0/4278361022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c0caca0 con 0x7efc0c071160 2024-04-23T10:21:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.714+0000 7efc10b97640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc0c06f790 0x7efc0c140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:21:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc11b99640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c071160 0x7efc0c1412a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c730 tx=0x7efc0400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc01ffb640 1 -- 172.21.15.29:0/4278361022 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04016020 con 0x7efc0c071160 2024-04-23T10:21:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc01ffb640 1 -- 172.21.15.29:0/4278361022 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc04006d60 con 0x7efc0c071160 2024-04-23T10:21:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc135fc640 1 -- 172.21.15.29:0/4278361022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c0caf40 con 0x7efc0c071160 2024-04-23T10:21:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc01ffb640 1 -- 172.21.15.29:0/4278361022 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04003bc0 con 0x7efc0c071160 2024-04-23T10:21:33.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc135fc640 1 -- 172.21.15.29:0/4278361022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c0c7f40 con 0x7efc0c071160 2024-04-23T10:21:33.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc01ffb640 1 -- 172.21.15.29:0/4278361022 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc040050d0 con 0x7efc0c071160 2024-04-23T10:21:33.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc01ffb640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efbf0068380 0x7efbf006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc01ffb640 1 -- 172.21.15.29:0/4278361022 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efc04086a10 con 0x7efc0c071160 2024-04-23T10:21:33.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc11398640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efbf0068380 0x7efbf006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc1677e000 1 Processor -- start 2024-04-23T10:21:33.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc1677e000 1 -- start start 2024-04-23T10:21:33.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc11398640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efbf0068380 0x7efbf006a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc08005890 tx=0x7efc08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc1677e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b906028a0 0x556b905cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc1677e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b905cbf00 0x556b905cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc1677e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b90607500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc1677e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556b90413660 con 0x556b905cbf00 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc1677e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556b903b85d0 con 0x556b90607120 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.718+0000 7efc1677e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556b9040f620 con 0x556b906028a0 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b905cbf00 0x556b905cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b905cbf00 0x556b905cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51942/0 (socket says 172.21.15.29:51942) 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 -- 172.21.15.29:0/3502952770 learned_addr learned my addr 172.21.15.29:0/3502952770 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc11398640 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b906028a0 0x556b905cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc11b99640 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b90607500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 -- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b906028a0 msgr2=0x556b905cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b906028a0 0x556b905cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 -- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 msgr2=0x556b90607500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b90607500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 -- 172.21.15.29:0/3502952770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b903ecbd0 con 0x556b905cbf00 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc11398640 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b906028a0 0x556b905cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc11b99640 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b90607500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b905cbf00 0x556b905cc2e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0190b0 tx=0x7efbfc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ed68d4a748166d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efbf6ffd640 1 -- 172.21.15.29:0/3502952770 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0b1040 con 0x556b905cbf00 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efbf6ffd640 1 -- 172.21.15.29:0/3502952770 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc0ac610 con 0x556b905cbf00 2024-04-23T10:21:33.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efbf6ffd640 1 -- 172.21.15.29:0/3502952770 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0ac9c0 con 0x556b905cbf00 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- 172.21.15.29:0/3502952770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b905cbf00 msgr2=0x556b905cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b905cbf00 0x556b905cc2e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0190b0 tx=0x7efbfc004740 comp rx=0 tx=0).stop 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- 172.21.15.29:0/3502952770 shutdown_connections 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b90607500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b905cbf00 0x556b905cc2e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 --2- 172.21.15.29:0/3502952770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b906028a0 0x556b905cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- 172.21.15.29:0/3502952770 >> 172.21.15.29:0/3502952770 conn(0x556b904adb00 msgr2=0x556b90604ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- 172.21.15.29:0/3502952770 shutdown_connections 2024-04-23T10:21:33.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- 172.21.15.29:0/3502952770 wait complete. 2024-04-23T10:21:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- start start 2024-04-23T10:21:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 Processor -- start 2024-04-23T10:21:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90601650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b90601b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b905c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556b904d0d40 con 0x556b906028a0 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556b903cdeb0 con 0x556b90607120 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556b9040e2a0 con 0x556b905cbf00 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 10 client.0 _ll_register_callbacks cb 0x556b905b1a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b90601b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b90601b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51948/0 (socket says 172.21.15.29:51948) 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 -- 172.21.15.29:0/353540909 learned_addr learned my addr 172.21.15.29:0/353540909 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc11398640 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90601650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc11b99640 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b905c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 -- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 msgr2=0x556b90601650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90601650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 -- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 msgr2=0x556b905c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b905c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 -- 172.21.15.29:0/353540909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b90459b30 con 0x556b906028a0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc10b97640 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b90601b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0190b0 tx=0x7efbfc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33747d9b7bf5652 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efbebfff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efbebfff640 1 -- 172.21.15.29:0/353540909 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0b9070 con 0x556b906028a0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efbebfff640 1 -- 172.21.15.29:0/353540909 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efbfc003620 con 0x556b906028a0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.722+0000 7efc1677e000 1 -- 172.21.15.29:0/353540909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b903ad060 con 0x556b906028a0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efbebfff640 1 -- 172.21.15.29:0/353540909 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7efbfc0c5050 con 0x556b906028a0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 10 client.5388 fetch_fsmap learned FSMap version 18 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 -- 172.21.15.29:0/353540909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556b903b2b70 con 0x556b906028a0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efbebfff640 1 -- 172.21.15.29:0/353540909 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556b903ad060 con 0x556b906028a0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efbebfff640 1 -- 172.21.15.29:0/353540909 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7efbfc0c8020 con 0x556b906028a0 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 10 client.5388 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 10 client.5388 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:21:33.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 20 client.5388 populate_metadata read hostname 'smithi029' 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556b905c76a0 0x556b905c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 4 client.5388 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 -- 172.21.15.29:0/353540909 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b903ebe30 con 0x556b905c76a0 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc11398640 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556b905c76a0 0x556b905c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc11398640 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556b905c76a0 0x556b905c7ab0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca6e87b71382e4e server_cookie=5bdb9beb6e45f965 in_seq=0 out_seq=0 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efbebfff640 10 client.5388 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efbebfff640 1 -- 172.21.15.29:0/353540909 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556b903ebe30 con 0x556b905c76a0 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efbebfff640 10 client.5388 handle_command_reply: tid=0 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 client.5388 shutdown 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 -- 172.21.15.29:0/353540909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 msgr2=0x556b90601b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b90601b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0190b0 tx=0x7efbfc01ace0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 -- 172.21.15.29:0/353540909 shutdown_connections 2024-04-23T10:21:33.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556b905c76a0 0x556b905c7ab0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b90607120 0x556b905c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efbebfff640 0 client.5388 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:21:33.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b90601b90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 --2- 172.21.15.29:0/353540909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90601650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 -- 172.21.15.29:0/353540909 >> 172.21.15.29:0/353540909 conn(0x556b904adb00 msgr2=0x556b906069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:33.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 -- 172.21.15.29:0/353540909 shutdown_connections 2024-04-23T10:21:33.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 1 -- 172.21.15.29:0/353540909 wait complete. 2024-04-23T10:21:33.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.726+0000 7efc1677e000 20 client.5388 trim_cache size 0 max 16384 2024-04-23T10:21:33.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 Processor -- start 2024-04-23T10:21:33.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- start start 2024-04-23T10:21:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b905cbf00 0x556b905ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b905ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b90607120 0x556b9061db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c201d60 con 0x556b906028a0 2024-04-23T10:21:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c202430 con 0x556b905cbf00 2024-04-23T10:21:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efc0c2004d0 con 0x556b90607120 2024-04-23T10:21:33.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b905ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b905ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51964/0 (socket says 172.21.15.29:51964) 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 -- 172.21.15.29:0/1403642611 learned_addr learned my addr 172.21.15.29:0/1403642611 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 -- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b90607120 msgr2=0x556b9061db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc11b99640 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b90607120 0x556b9061db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc11398640 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b905cbf00 0x556b905ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b90607120 0x556b9061db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 -- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b905cbf00 msgr2=0x556b905ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b905cbf00 0x556b905ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 -- 172.21.15.29:0/1403642611 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b904955e0 con 0x556b906028a0 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc11398640 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b905cbf00 0x556b905ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc10b97640 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b905ca890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efbfc000c10 tx=0x7efbfc0ae040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a690d9b44548c213 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efbf67fc640 1 -- 172.21.15.29:0/1403642611 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0b1040 con 0x556b906028a0 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efbf67fc640 1 -- 172.21.15.29:0/1403642611 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc000e50 con 0x556b906028a0 2024-04-23T10:21:33.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efbf67fc640 1 -- 172.21.15.29:0/1403642611 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc003af0 con 0x556b906028a0 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- 172.21.15.29:0/1403642611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 msgr2=0x556b905ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b905ca890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efbfc000c10 tx=0x7efbfc0ae040 comp rx=0 tx=0).stop 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- 172.21.15.29:0/1403642611 shutdown_connections 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b90607120 0x556b9061db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b906028a0 0x556b905ca890 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 --2- 172.21.15.29:0/1403642611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b905cbf00 0x556b905ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- 172.21.15.29:0/1403642611 >> 172.21.15.29:0/1403642611 conn(0x556b904adb00 msgr2=0x556b905c68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- 172.21.15.29:0/1403642611 shutdown_connections 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- 172.21.15.29:0/1403642611 wait complete. 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 -- start start 2024-04-23T10:21:33.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.746+0000 7efc1677e000 1 Processor -- start 2024-04-23T10:21:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90674d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b906028a0 0x556b90675250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b90607120 0x556b906207a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556b90412970 con 0x556b90607120 2024-04-23T10:21:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556b903c88f0 con 0x556b906028a0 2024-04-23T10:21:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556b90417c90 con 0x556b905cbf00 2024-04-23T10:21:33.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 10 client.0 _ll_register_callbacks cb 0x7efbf8003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b90607120 0x556b906207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b90607120 0x556b906207a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51978/0 (socket says 172.21.15.29:51978) 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 -- 172.21.15.29:0/3860532982 learned_addr learned my addr 172.21.15.29:0/3860532982 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11398640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90674d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc10b97640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b906028a0 0x556b90675250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 -- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 msgr2=0x556b90674d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90674d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 -- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b906028a0 msgr2=0x556b90675250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b906028a0 0x556b90675250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 -- 172.21.15.29:0/3860532982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b903a5ae0 con 0x556b90607120 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11398640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90674d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:21:33.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc10b97640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b906028a0 0x556b90675250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11b99640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b90607120 0x556b906207a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efc04052920 tx=0x7efc04000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe93c8beb6a9688 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efbebfff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efbebfff640 1 -- 172.21.15.29:0/3860532982 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0405f0a0 con 0x556b90607120 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efbebfff640 1 -- 172.21.15.29:0/3860532982 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efc04052b30 con 0x556b90607120 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 -- 172.21.15.29:0/3860532982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbfc000e50 con 0x556b90607120 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efbebfff640 1 -- 172.21.15.29:0/3860532982 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7efc040750c0 con 0x556b90607120 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 10 client.5394 fetch_fsmap learned FSMap version 18 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 -- 172.21.15.29:0/3860532982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556b903a8d80 con 0x556b90607120 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efbebfff640 1 -- 172.21.15.29:0/3860532982 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc000e50 con 0x556b90607120 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efbebfff640 1 -- 172.21.15.29:0/3860532982 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7efc04055910 con 0x556b90607120 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 10 client.5394 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 10 client.5394 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 20 client.5394 populate_metadata read hostname 'smithi029' 2024-04-23T10:21:33.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556b90621510 0x556b90621920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 4 client.5394 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "84b25be9", "release": true, "await": true}] 2024-04-23T10:21:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc1677e000 1 -- 172.21.15.29:0/3860532982 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "84b25be9", "release": true, "await": true}) -- 0x556b903b10d0 con 0x556b90621510 2024-04-23T10:21:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11398640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556b90621510 0x556b90621920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efbebfff640 10 client.5394 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:21:33.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:33.750+0000 7efc11398640 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556b90621510 0x556b90621920 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d77b3812d7535c03 server_cookie=4161cdb27288d51d in_seq=0 out_seq=0 2024-04-23T10:21:34.341 INFO:tasks.workunit.client.0.smithi029.stdout:3/515: creat d3/d10/de/d2e/fbc x:0 0 0 2024-04-23T10:21:34.341 INFO:tasks.workunit.client.0.smithi029.stdout:8/594: write d3/d50/d6a/d95/d36/d68/f9e [822255,130144] 0 2024-04-23T10:21:34.344 INFO:tasks.workunit.client.0.smithi029.stdout:7/625: creat d5/d8/d1a/d4d/fcd x:0 0 0 2024-04-23T10:21:34.350 INFO:tasks.workunit.client.0.smithi029.stdout:6/701: truncate d9/d5b/f71 3865 0 2024-04-23T10:21:34.352 INFO:tasks.workunit.client.0.smithi029.stdout:0/462: mknod d0/d21/d7f/d3a/c9d 0 2024-04-23T10:21:34.364 INFO:tasks.workunit.client.0.smithi029.stdout:4/582: creat d0/d3c/d52/d74/d91/fcd x:0 0 0 2024-04-23T10:21:34.374 INFO:tasks.workunit.client.0.smithi029.stdout:2/538: mknod d1/d31/d50/d9b/d9e/cbb 0 2024-04-23T10:21:34.380 INFO:tasks.workunit.client.0.smithi029.stdout:1/450: dwrite d5/d6/de/d22/f83 [0,4194304] 0 2024-04-23T10:21:34.383 INFO:tasks.workunit.client.0.smithi029.stdout:9/717: dwrite d0/d7/d1d/fbe [0,4194304] 0 2024-04-23T10:21:34.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.390+0000 7efbebfff640 1 -- 172.21.15.29:0/3860532982 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556b903b10d0 con 0x556b90621510 2024-04-23T10:21:34.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.390+0000 7efbebfff640 10 client.5394 handle_command_reply: tid=0 2024-04-23T10:21:34.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.390+0000 7efc1677e000 1 client.5394 shutdown 2024-04-23T10:21:34.397 INFO:tasks.workunit.client.0.smithi029.stdout:7/626: dread d5/f63 [0,4194304] 0 2024-04-23T10:21:34.398 INFO:tasks.workunit.client.0.smithi029.stdout:5/639: dwrite d0/d35/d38/d3e/fc2 [0,4194304] 0 2024-04-23T10:21:34.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.398+0000 7efc1677e000 1 -- 172.21.15.29:0/3860532982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b90607120 msgr2=0x556b906207a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:34.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.398+0000 7efc1677e000 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b90607120 0x556b906207a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efc04052920 tx=0x7efc04000f50 comp rx=0 tx=0).stop 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.398+0000 7efc1677e000 1 -- 172.21.15.29:0/3860532982 shutdown_connections 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.398+0000 7efc1677e000 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556b90621510 0x556b90621920 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.398+0000 7efc1677e000 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556b90607120 0x556b906207a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.398+0000 7efbebfff640 0 client.5394 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.398+0000 7efc1677e000 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556b906028a0 0x556b90675250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc1677e000 1 --2- 172.21.15.29:0/3860532982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556b905cbf00 0x556b90674d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc1677e000 1 -- 172.21.15.29:0/3860532982 >> 172.21.15.29:0/3860532982 conn(0x556b904adb00 msgr2=0x556b90602080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc1677e000 1 -- 172.21.15.29:0/3860532982 shutdown_connections 2024-04-23T10:21:34.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc1677e000 1 -- 172.21.15.29:0/3860532982 wait complete. 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc1677e000 20 client.5394 trim_cache size 0 max 16384 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 20, 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stdout: "84b25be9": { 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 20, 2024-04-23T10:21:34.402 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 79.5, 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:34.403 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:34.404 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:34.404 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:21:34.404 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:21:34.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 -- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efbf0068380 msgr2=0x7efbf006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:34.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efbf0068380 0x7efbf006a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc08005890 tx=0x7efc08009040 comp rx=0 tx=0).stop 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 -- 172.21.15.29:0/4278361022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c071160 msgr2=0x7efc0c1412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c071160 0x7efc0c1412a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c730 tx=0x7efc0400cb30 comp rx=0 tx=0).stop 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 -- 172.21.15.29:0/4278361022 shutdown_connections 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7efbf0068380 0x7efbf006a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc0c071160 0x7efc0c1412a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc0c06f790 0x7efc0c140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 --2- 172.21.15.29:0/4278361022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c06f3b0 0x7efc0c143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 -- 172.21.15.29:0/4278361022 >> 172.21.15.29:0/4278361022 conn(0x7efc0c06cfb0 msgr2=0x7efc0c0ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 -- 172.21.15.29:0/4278361022 shutdown_connections 2024-04-23T10:21:34.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:21:34.402+0000 7efc135fc640 1 -- 172.21.15.29:0/4278361022 wait complete. 2024-04-23T10:21:34.411 INFO:tasks.workunit.client.0.smithi029.stdout:1/451: chown d5/d6/de/d22/d84 4065 1 2024-04-23T10:21:34.413 INFO:tasks.workunit.client.0.smithi029.stdout:8/595: fdatasync d3/f19 0 2024-04-23T10:21:34.424 INFO:tasks.workunit.client.0.smithi029.stdout:2/539: dread - d1/d31/d3d/f74 zero size 2024-04-23T10:21:34.426 INFO:tasks.workunit.client.0.smithi029.stdout:7/627: rmdir d5/d58 39 2024-04-23T10:21:34.428 INFO:tasks.workunit.client.0.smithi029.stdout:5/640: mkdir d0/d35/d38/db3/dcf 0 2024-04-23T10:21:34.431 INFO:tasks.workunit.client.0.smithi029.stdout:8/596: unlink d3/f66 0 2024-04-23T10:21:34.434 INFO:tasks.workunit.client.0.smithi029.stdout:4/583: write d0/fd [3707981,209] 0 2024-04-23T10:21:34.436 INFO:tasks.workunit.client.0.smithi029.stdout:0/463: write d0/dc/f16 [4859529,56346] 0 2024-04-23T10:21:34.438 INFO:tasks.workunit.client.0.smithi029.stdout:9/718: creat d0/d7/d3f/dbb/ffe x:0 0 0 2024-04-23T10:21:34.439 INFO:tasks.workunit.client.0.smithi029.stdout:3/516: write d3/d45/d4f/fb4 [4657098,83373] 0 2024-04-23T10:21:34.441 INFO:tasks.workunit.client.0.smithi029.stdout:6/702: dread d9/df/d16/f7d [0,4194304] 0 2024-04-23T10:21:34.444 INFO:tasks.workunit.client.0.smithi029.stdout:1/452: write d5/d6/de/d15/f1a [1150744,87249] 0 2024-04-23T10:21:34.447 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '84b25be9', seconds elapsed: 26.3 2024-04-23T10:21:34.449 INFO:tasks.workunit.client.0.smithi029.stdout:3/517: write d3/d10/de/d2e/fbc [461734,4196] 0 2024-04-23T10:21:34.451 INFO:tasks.workunit.client.0.smithi029.stdout:9/719: read - d0/d7/d3f/dbb/ffe zero size 2024-04-23T10:21:34.456 INFO:tasks.workunit.client.0.smithi029.stdout:0/464: chown d0/dc/d26/d44/d4c 43037864 1 2024-04-23T10:21:34.459 INFO:tasks.workunit.client.0.smithi029.stdout:1/453: mknod d5/d6/de/d15/d7b/c8d 0 2024-04-23T10:21:34.461 INFO:tasks.workunit.client.0.smithi029.stdout:5/641: mknod d0/d35/d38/d3e/d66/d5a/d78/d3d/cd0 0 2024-04-23T10:21:34.462 INFO:tasks.workunit.client.0.smithi029.stdout:2/540: dread d1/dd/d47/d63/d64/f80 [0,4194304] 0 2024-04-23T10:21:34.463 INFO:tasks.workunit.client.0.smithi029.stdout:8/597: getdents d3/d50/d6a/d95/d36/d97/da4 0 2024-04-23T10:21:34.466 INFO:tasks.workunit.client.0.smithi029.stdout:9/720: symlink d0/d7/d1d/d35/dd9/lff 0 2024-04-23T10:21:34.466 INFO:tasks.workunit.client.0.smithi029.stdout:7/628: dwrite d5/d8/fa7 [0,4194304] 0 2024-04-23T10:21:34.466 INFO:tasks.workunit.client.0.smithi029.stdout:1/454: rename d5/c24 to d5/d6/c8e 0 2024-04-23T10:21:34.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/518: readlink d3/d10/de/d2e/d36/d40/d46/d72/l3c 0 2024-04-23T10:21:34.470 INFO:tasks.workunit.client.0.smithi029.stdout:6/703: dread d9/df/f13 [0,4194304] 0 2024-04-23T10:21:34.470 INFO:tasks.workunit.client.0.smithi029.stdout:9/721: dread - d0/d1b/ff6 zero size 2024-04-23T10:21:34.473 INFO:tasks.workunit.client.0.smithi029.stdout:8/598: unlink d3/d50/d6a/d95/d36/l3c 0 2024-04-23T10:21:34.475 INFO:tasks.workunit.client.0.smithi029.stdout:7/629: chown d5/d71/f82 6717938 1 2024-04-23T10:21:34.480 INFO:tasks.workunit.client.0.smithi029.stdout:0/465: unlink d0/d3e/d4e/d50/d73/f74 0 2024-04-23T10:21:34.481 INFO:tasks.workunit.client.0.smithi029.stdout:4/584: rename d0/d12/l44 to d0/d3c/d52/d1b/d36/d45/d4f/lce 0 2024-04-23T10:21:34.483 INFO:tasks.workunit.client.0.smithi029.stdout:3/519: creat d3/d45/fbd x:0 0 0 2024-04-23T10:21:34.484 INFO:tasks.workunit.client.0.smithi029.stdout:0/466: unlink d0/d21/c4d 0 2024-04-23T10:21:34.487 INFO:tasks.workunit.client.0.smithi029.stdout:9/722: write d0/d7/d3f/f82 [186335,17579] 0 2024-04-23T10:21:34.492 INFO:tasks.workunit.client.0.smithi029.stdout:4/585: stat d0/d3c/d52/d1b/d9f/ca8 0 2024-04-23T10:21:34.492 INFO:tasks.workunit.client.0.smithi029.stdout:7/630: creat d5/d9/fce x:0 0 0 2024-04-23T10:21:34.498 INFO:tasks.workunit.client.0.smithi029.stdout:2/541: rename d1/dd/d47/d63/la8 to d1/d3e/d5a/d6d/lbc 0 2024-04-23T10:21:34.498 INFO:tasks.workunit.client.0.smithi029.stdout:0/467: dread - d0/d21/d7f/d3a/f87 zero size 2024-04-23T10:21:34.501 INFO:tasks.workunit.client.0.smithi029.stdout:4/586: creat d0/d12/da9/fcf x:0 0 0 2024-04-23T10:21:34.502 INFO:tasks.workunit.client.0.smithi029.stdout:3/520: creat d3/d10/d48/fbe x:0 0 0 2024-04-23T10:21:34.502 INFO:tasks.workunit.client.0.smithi029.stdout:2/542: chown d1/d4 12 1 2024-04-23T10:21:34.505 INFO:tasks.workunit.client.0.smithi029.stdout:8/599: dread d3/f26 [4194304,4194304] 0 2024-04-23T10:21:34.505 INFO:tasks.workunit.client.0.smithi029.stdout:1/455: mknod d5/d6/de/d27/d38/d47/c8f 0 2024-04-23T10:21:34.506 INFO:tasks.workunit.client.0.smithi029.stdout:4/587: chown d0/l8c 3677338 1 2024-04-23T10:21:34.514 INFO:tasks.workunit.client.0.smithi029.stdout:0/468: write d0/d21/f76 [45184,42214] 0 2024-04-23T10:21:34.514 INFO:tasks.workunit.client.0.smithi029.stdout:9/723: dwrite d0/d1b/d39/f97 [0,4194304] 0 2024-04-23T10:21:34.515 INFO:tasks.workunit.client.0.smithi029.stdout:1/456: mknod d5/c90 0 2024-04-23T10:21:34.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/588: readlink d0/d3c/d52/d1b/d36/d45/d68/l82 0 2024-04-23T10:21:34.518 INFO:tasks.workunit.client.0.smithi029.stdout:7/631: fsync d5/d71/d92/db7/dc3/fc6 0 2024-04-23T10:21:34.520 INFO:tasks.workunit.client.0.smithi029.stdout:6/704: creat d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/fe8 x:0 0 0 2024-04-23T10:21:34.522 INFO:tasks.workunit.client.0.smithi029.stdout:8/600: fsync d3/d71/fa2 0 2024-04-23T10:21:34.532 INFO:tasks.workunit.client.0.smithi029.stdout:4/589: mkdir d0/d3c/d52/d1b/d36/d45/dd0 0 2024-04-23T10:21:34.533 INFO:tasks.workunit.client.0.smithi029.stdout:6/705: chown d9/df/d16/d44/d75 3 1 2024-04-23T10:21:34.533 INFO:tasks.workunit.client.0.smithi029.stdout:2/543: getdents d1/d31/d50/d9b/d9e 0 2024-04-23T10:21:34.534 INFO:tasks.workunit.client.0.smithi029.stdout:8/601: readlink d3/d50/d6a/d95/d36/d97/lbb 0 2024-04-23T10:21:34.536 INFO:tasks.workunit.client.0.smithi029.stdout:7/632: creat d5/d8/d1a/fcf x:0 0 0 2024-04-23T10:21:34.543 INFO:tasks.workunit.client.0.smithi029.stdout:8/602: mknod d3/d50/dac/cbd 0 2024-04-23T10:21:34.545 INFO:tasks.workunit.client.0.smithi029.stdout:4/590: write d0/d3c/d52/fbb [1196136,68399] 0 2024-04-23T10:21:34.545 INFO:tasks.workunit.client.0.smithi029.stdout:0/469: rename d0/d3e/d4e/d50/d71/f99 to d0/dc/d26/d44/f9e 0 2024-04-23T10:21:34.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/633: unlink d5/l34 0 2024-04-23T10:21:34.546 INFO:tasks.workunit.client.0.smithi029.stdout:3/521: dread d3/d10/de/d2e/d36/d40/d46/d72/d31/f55 [0,4194304] 0 2024-04-23T10:21:34.548 INFO:tasks.workunit.client.0.smithi029.stdout:2/544: symlink d1/dd/d47/d63/d64/d78/da6/lbd 0 2024-04-23T10:21:34.549 INFO:tasks.workunit.client.0.smithi029.stdout:6/706: readlink d9/df/d16/d1f/d27/d33/da4/d58/d7e/lba 0 2024-04-23T10:21:34.550 INFO:tasks.workunit.client.0.smithi029.stdout:1/457: dwrite d5/d6/de/d22/f23 [4194304,4194304] 0 2024-04-23T10:21:34.551 INFO:tasks.workunit.client.0.smithi029.stdout:0/470: stat d0/dc/c18 0 2024-04-23T10:21:34.556 INFO:tasks.workunit.client.0.smithi029.stdout:1/458: chown d5/d6/de/d15/c8b 639 1 2024-04-23T10:21:34.559 INFO:tasks.workunit.client.0.smithi029.stdout:9/724: rename d0/d7/d1d/d35/d3b/db8/fe2 to d0/d7/d1d/d35/dd9/d49/d65/de4/f100 0 2024-04-23T10:21:34.562 INFO:tasks.workunit.client.0.smithi029.stdout:8/603: truncate d3/d50/d6a/d95/d36/f46 822399 0 2024-04-23T10:21:34.566 INFO:tasks.workunit.client.0.smithi029.stdout:4/591: symlink d0/d3c/d52/d74/d8a/ld1 0 2024-04-23T10:21:34.570 INFO:tasks.workunit.client.0.smithi029.stdout:2/545: read d1/dd/f1d [91705,117129] 0 2024-04-23T10:21:34.573 INFO:tasks.workunit.client.0.smithi029.stdout:6/707: creat d9/df/d25/fe9 x:0 0 0 2024-04-23T10:21:34.573 INFO:tasks.workunit.client.0.smithi029.stdout:3/522: write d3/d10/de/d2e/d36/fb2 [21756,12127] 0 2024-04-23T10:21:34.576 INFO:tasks.workunit.client.0.smithi029.stdout:8/604: write d3/d50/d6a/d95/f39 [1448336,84995] 0 2024-04-23T10:21:34.580 INFO:tasks.workunit.client.0.smithi029.stdout:4/592: creat d0/d3c/d52/d74/fd2 x:0 0 0 2024-04-23T10:21:34.582 INFO:tasks.workunit.client.0.smithi029.stdout:2/546: unlink d1/dd/d47/d63/d64/d78/f94 0 2024-04-23T10:21:34.588 INFO:tasks.workunit.client.0.smithi029.stdout:9/725: getdents d0/d1b/d24 0 2024-04-23T10:21:34.588 INFO:tasks.workunit.client.0.smithi029.stdout:4/593: unlink d0/d3c/d52/fbb 0 2024-04-23T10:21:34.589 INFO:tasks.workunit.client.0.smithi029.stdout:8/605: stat d3/d38/fb0 0 2024-04-23T10:21:34.590 INFO:tasks.workunit.client.0.smithi029.stdout:3/523: write d3/d10/de/f12 [435343,88797] 0 2024-04-23T10:21:34.591 INFO:tasks.workunit.client.0.smithi029.stdout:1/459: dread d5/d6/de/d27/d38/f65 [0,4194304] 0 2024-04-23T10:21:34.592 INFO:tasks.workunit.client.0.smithi029.stdout:0/471: dwrite d0/dc/d26/d44/d4c/d6d/f82 [0,4194304] 0 2024-04-23T10:21:34.592 INFO:tasks.workunit.client.0.smithi029.stdout:6/708: rename d9/d5b to d9/df/d16/d1f/d27/dad/dd0/dea 0 2024-04-23T10:21:34.594 INFO:tasks.workunit.client.0.smithi029.stdout:7/634: dread d5/d8/d1a/d4d/f94 [0,4194304] 0 2024-04-23T10:21:34.603 INFO:tasks.workunit.client.0.smithi029.stdout:1/460: mknod d5/d6/c91 0 2024-04-23T10:21:34.606 INFO:tasks.workunit.client.0.smithi029.stdout:9/726: dread d0/d7/d1d/d35/dde/f70 [0,4194304] 0 2024-04-23T10:21:34.611 INFO:tasks.workunit.client.0.smithi029.stdout:6/709: creat d9/df/feb x:0 0 0 2024-04-23T10:21:34.611 INFO:tasks.workunit.client.0.smithi029.stdout:2/547: dwrite d1/dd/d47/d63/d64/f72 [4194304,4194304] 0 2024-04-23T10:21:34.613 INFO:tasks.workunit.client.0.smithi029.stdout:7/635: chown d5/d8/d51/l60 646960 1 2024-04-23T10:21:34.614 INFO:tasks.workunit.client.0.smithi029.stdout:9/727: unlink d0/d7/d3f/c5d 0 2024-04-23T10:21:34.616 INFO:tasks.workunit.client.0.smithi029.stdout:0/472: rename d0/d21/d7f/d3a/l85 to d0/dc/d26/l9f 0 2024-04-23T10:21:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:4/594: getdents d0/d3c/d52/d74/d91 0 2024-04-23T10:21:34.626 INFO:tasks.workunit.client.0.smithi029.stdout:0/473: chown d0/d21/d7f/f29 491283274 1 2024-04-23T10:21:34.628 INFO:tasks.workunit.client.0.smithi029.stdout:7/636: truncate d5/d8/f36 289798 0 2024-04-23T10:21:34.629 INFO:tasks.workunit.client.0.smithi029.stdout:8/606: dread d3/fd [0,4194304] 0 2024-04-23T10:21:34.630 INFO:tasks.workunit.client.0.smithi029.stdout:9/728: truncate d0/d1b/d39/fdf 1472662 0 2024-04-23T10:21:34.631 INFO:tasks.workunit.client.0.smithi029.stdout:0/474: dread - d0/d3e/f8d zero size 2024-04-23T10:21:34.631 INFO:tasks.workunit.client.0.smithi029.stdout:1/461: link d5/d6/de/d22/d6c/l6d d5/d6/l92 0 2024-04-23T10:21:34.634 INFO:tasks.workunit.client.0.smithi029.stdout:3/524: dread d3/f8 [4194304,4194304] 0 2024-04-23T10:21:34.636 INFO:tasks.workunit.client.0.smithi029.stdout:2/548: write d1/d3e/d3b/d75/f7a [1067177,109721] 0 2024-04-23T10:21:34.643 INFO:tasks.workunit.client.0.smithi029.stdout:4/595: rename d0/d5a/caf to d0/d3c/cd3 0 2024-04-23T10:21:34.645 INFO:tasks.workunit.client.0.smithi029.stdout:1/462: fsync d5/d6/de/d22/f51 0 2024-04-23T10:21:34.646 INFO:tasks.workunit.client.0.smithi029.stdout:2/549: chown d1/f2e 1 1 2024-04-23T10:21:34.646 INFO:tasks.workunit.client.0.smithi029.stdout:8/607: creat d3/d44/db1/fbe x:0 0 0 2024-04-23T10:21:34.648 INFO:tasks.workunit.client.0.smithi029.stdout:9/729: unlink d0/d7/d1d/d35/dde/dba/cef 0 2024-04-23T10:21:34.649 INFO:tasks.workunit.client.0.smithi029.stdout:0/475: dread d0/dc/f36 [0,4194304] 0 2024-04-23T10:21:34.649 INFO:tasks.workunit.client.0.smithi029.stdout:7/637: dwrite d5/d8/d51/f8c [0,4194304] 0 2024-04-23T10:21:34.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/710: link d9/df/d16/d44/d4c/dd9/cdf d9/df/d41/d49/cec 0 2024-04-23T10:21:34.655 INFO:tasks.workunit.client.0.smithi029.stdout:1/463: creat d5/d8c/f93 x:0 0 0 2024-04-23T10:21:34.659 INFO:tasks.workunit.client.0.smithi029.stdout:2/550: write d1/d31/d3d/f74 [561838,94394] 0 2024-04-23T10:21:34.664 INFO:tasks.workunit.client.0.smithi029.stdout:7/638: read - d5/d8/d51/d55/f87 zero size 2024-04-23T10:21:34.666 INFO:tasks.workunit.client.0.smithi029.stdout:8/608: dread d3/d50/f77 [0,4194304] 0 2024-04-23T10:21:34.667 INFO:tasks.workunit.client.0.smithi029.stdout:2/551: chown d1/l2d 305644 1 2024-04-23T10:21:34.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/711: chown d9/df/d16/d1f/d2c/l50 74701441 1 2024-04-23T10:21:34.669 INFO:tasks.workunit.client.0.smithi029.stdout:0/476: mkdir d0/dc/d26/d44/d5c/d92/da0 0 2024-04-23T10:21:34.670 INFO:tasks.workunit.client.0.smithi029.stdout:9/730: write d0/d1b/d60/dbf/fca [216691,92994] 0 2024-04-23T10:21:34.672 INFO:tasks.workunit.client.0.smithi029.stdout:3/525: rename d3/d10/de/d2e/d36/d40/d43/cac to d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/cbf 0 2024-04-23T10:21:34.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/464: symlink d5/d6/de/d22/d77/l94 0 2024-04-23T10:21:34.674 INFO:tasks.workunit.client.0.smithi029.stdout:2/552: readlink d1/d4/l6 0 2024-04-23T10:21:34.676 INFO:tasks.workunit.client.0.smithi029.stdout:7/639: symlink d5/d8/d1a/d8e/ld0 0 2024-04-23T10:21:34.676 INFO:tasks.workunit.client.0.smithi029.stdout:6/712: symlink d9/df/d16/d1f/d27/d33/da4/d58/led 0 2024-04-23T10:21:34.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/553: chown d1/d31/c46 0 1 2024-04-23T10:21:34.679 INFO:tasks.workunit.client.0.smithi029.stdout:9/731: unlink d0/f5b 0 2024-04-23T10:21:34.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/713: dread - d9/df/d16/d1f/d27/d33/da4/d58/d7e/fd4 zero size 2024-04-23T10:21:34.690 INFO:tasks.workunit.client.0.smithi029.stdout:0/477: creat d0/d1b/fa1 x:0 0 0 2024-04-23T10:21:34.690 INFO:tasks.workunit.client.0.smithi029.stdout:4/596: link d0/d3c/d52/d20/cb8 d0/d3c/d52/d1b/d36/d45/d4f/cd4 0 2024-04-23T10:21:34.691 INFO:tasks.workunit.client.0.smithi029.stdout:2/554: unlink d1/d4/c8b 0 2024-04-23T10:21:34.694 INFO:tasks.workunit.client.0.smithi029.stdout:1/465: truncate d5/d6/d34/d63/f75 2354889 0 2024-04-23T10:21:34.695 INFO:tasks.workunit.client.0.smithi029.stdout:9/732: dread - d0/d7/d1d/d35/d3b/d68/fd8 zero size 2024-04-23T10:21:34.696 INFO:tasks.workunit.client.0.smithi029.stdout:8/609: dwrite d3/d50/d6a/d95/d36/d94/fb7 [0,4194304] 0 2024-04-23T10:21:34.696 INFO:tasks.workunit.client.0.smithi029.stdout:2/555: dread - d1/d31/d50/f82 zero size 2024-04-23T10:21:34.699 INFO:tasks.workunit.client.0.smithi029.stdout:3/526: creat d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7/dab/fc0 x:0 0 0 2024-04-23T10:21:34.709 INFO:tasks.workunit.client.0.smithi029.stdout:7/640: rename d5/d8/f36 to d5/d29/d4a/fd1 0 2024-04-23T10:21:34.711 INFO:tasks.workunit.client.0.smithi029.stdout:8/610: mkdir d3/d50/d6a/d95/d36/dbf 0 2024-04-23T10:21:34.714 INFO:tasks.workunit.client.0.smithi029.stdout:2/556: chown d1/dd/d22/f90 4 1 2024-04-23T10:21:34.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/597: readlink d0/d3c/d52/d1b/d36/d45/d4f/d7b/l8e 0 2024-04-23T10:21:34.716 INFO:tasks.workunit.client.0.smithi029.stdout:0/478: dwrite d0/f4a [0,4194304] 0 2024-04-23T10:21:34.721 INFO:tasks.workunit.client.0.smithi029.stdout:9/733: getdents d0/d7/d3f/dbb 0 2024-04-23T10:21:34.721 INFO:tasks.workunit.client.0.smithi029.stdout:9/734: chown d0 133165975 1 2024-04-23T10:21:34.722 INFO:tasks.workunit.client.0.smithi029.stdout:6/714: dwrite d9/df/d16/d34/f65 [0,4194304] 0 2024-04-23T10:21:34.729 INFO:tasks.workunit.client.0.smithi029.stdout:8/611: dread d3/f29 [0,4194304] 0 2024-04-23T10:21:34.731 INFO:tasks.workunit.client.0.smithi029.stdout:3/527: dread d3/d10/de/f12 [0,4194304] 0 2024-04-23T10:21:34.734 INFO:tasks.workunit.client.0.smithi029.stdout:1/466: dread d5/d6/de/d22/f45 [0,4194304] 0 2024-04-23T10:21:34.738 INFO:tasks.workunit.client.0.smithi029.stdout:7/641: getdents d5/d29/dc9 0 2024-04-23T10:21:34.742 INFO:tasks.workunit.client.0.smithi029.stdout:0/479: rmdir d0/dc/d26/d44/d5c/d6a/d8b 0 2024-04-23T10:21:34.743 INFO:tasks.workunit.client.0.smithi029.stdout:9/735: creat d0/d7/d1d/d35/dd5/df2/f101 x:0 0 0 2024-04-23T10:21:34.744 INFO:tasks.workunit.client.0.smithi029.stdout:3/528: stat d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/c9d 0 2024-04-23T10:21:34.747 INFO:tasks.workunit.client.0.smithi029.stdout:8/612: symlink d3/d7d/lc0 0 2024-04-23T10:21:34.749 INFO:tasks.workunit.client.0.smithi029.stdout:1/467: symlink d5/d6/de/d27/d38/d47/l95 0 2024-04-23T10:21:34.752 INFO:tasks.workunit.client.0.smithi029.stdout:6/715: creat d9/df/d16/d44/d75/d90/fee x:0 0 0 2024-04-23T10:21:34.752 INFO:tasks.workunit.client.0.smithi029.stdout:4/598: fsync d0/d3c/d52/d74/d8a/dba/dc2/d7a/fc6 0 2024-04-23T10:21:34.754 INFO:tasks.workunit.client.0.smithi029.stdout:7/642: unlink d5/d29/d4a/f99 0 2024-04-23T10:21:34.756 INFO:tasks.workunit.client.0.smithi029.stdout:2/557: link d1/d3e/fa9 d1/d3e/d5a/d6d/fbe 0 2024-04-23T10:21:34.758 INFO:tasks.workunit.client.0.smithi029.stdout:6/716: chown d9/df/d16/d34/l8f 27 1 2024-04-23T10:21:34.758 INFO:tasks.workunit.client.0.smithi029.stdout:2/558: dread d1/f2e [0,4194304] 0 2024-04-23T10:21:34.761 INFO:tasks.workunit.client.0.smithi029.stdout:3/529: symlink d3/d10/de/d2e/d36/d40/d46/d72/d75/lc1 0 2024-04-23T10:21:34.761 INFO:tasks.workunit.client.0.smithi029.stdout:2/559: dread - d1/d3e/d5a/f84 zero size 2024-04-23T10:21:34.762 INFO:tasks.workunit.client.0.smithi029.stdout:8/613: fdatasync d3/d50/d6a/d95/d36/d3e/f41 0 2024-04-23T10:21:34.763 INFO:tasks.workunit.client.0.smithi029.stdout:9/736: rmdir d0/d1b/d39/d50/d67 39 2024-04-23T10:21:34.767 INFO:tasks.workunit.client.0.smithi029.stdout:4/599: write d0/d3c/fc9 [145717,35852] 0 2024-04-23T10:21:34.769 INFO:tasks.workunit.client.0.smithi029.stdout:1/468: rename d5/d6/l92 to d5/l96 0 2024-04-23T10:21:34.770 INFO:tasks.workunit.client.0.smithi029.stdout:6/717: write d9/df/d16/d1f/d2c/f4a [266188,122431] 0 2024-04-23T10:21:34.770 INFO:tasks.workunit.client.0.smithi029.stdout:3/530: mknod d3/d10/cc2 0 2024-04-23T10:21:34.773 INFO:tasks.workunit.client.0.smithi029.stdout:8/614: mknod d3/d50/d6a/cc1 0 2024-04-23T10:21:34.776 INFO:tasks.workunit.client.0.smithi029.stdout:7/643: dwrite d5/d8/d51/f5c [0,4194304] 0 2024-04-23T10:21:34.780 INFO:tasks.workunit.client.0.smithi029.stdout:1/469: dread - d5/d8c/f93 zero size 2024-04-23T10:21:34.783 INFO:tasks.workunit.client.0.smithi029.stdout:2/560: dwrite d1/dd/d47/f53 [0,4194304] 0 2024-04-23T10:21:34.783 INFO:tasks.workunit.client.0.smithi029.stdout:4/600: fsync d0/d3c/d52/d1b/d36/d45/d68/f84 0 2024-04-23T10:21:34.796 INFO:tasks.workunit.client.0.smithi029.stdout:2/561: chown d1/d3e/d5a/d6d/lbc 403 1 2024-04-23T10:21:34.800 INFO:tasks.workunit.client.0.smithi029.stdout:9/737: dread d0/d1b/d39/d4f/f9c [0,4194304] 0 2024-04-23T10:21:34.800 INFO:tasks.workunit.client.0.smithi029.stdout:4/601: symlink d0/d3c/d52/d1b/d36/d45/d4f/d7b/ld5 0 2024-04-23T10:21:34.802 INFO:tasks.workunit.client.0.smithi029.stdout:3/531: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3 0 2024-04-23T10:21:34.803 INFO:tasks.workunit.client.0.smithi029.stdout:2/562: chown d1/d31/d50/d9b/fb5 1685593482 1 2024-04-23T10:21:34.803 INFO:tasks.workunit.client.0.smithi029.stdout:6/718: link d9/df/d16/f2e d9/df/d16/d1f/d27/fef 0 2024-04-23T10:21:34.805 INFO:tasks.workunit.client.0.smithi029.stdout:1/470: rename d5/d6/d34/d63/l68 to d5/d6/de/l97 0 2024-04-23T10:21:34.806 INFO:tasks.workunit.client.0.smithi029.stdout:9/738: dread - d0/d7/d1d/d35/dd9/fd6 zero size 2024-04-23T10:21:34.811 INFO:tasks.workunit.client.0.smithi029.stdout:4/602: mkdir d0/d3c/d52/dd6 0 2024-04-23T10:21:34.812 INFO:tasks.workunit.client.0.smithi029.stdout:7/644: dread d5/d8/d1a/d4d/f64 [0,4194304] 0 2024-04-23T10:21:34.812 INFO:tasks.workunit.client.0.smithi029.stdout:8/615: link d3/d50/d6a/d95/f4c d3/d50/d6a/d95/d36/d3e/fc2 0 2024-04-23T10:21:34.813 INFO:tasks.workunit.client.0.smithi029.stdout:2/563: unlink d1/d3e/d3b/f96 0 2024-04-23T10:21:34.817 INFO:tasks.workunit.client.0.smithi029.stdout:3/532: creat d3/d10/de/d2e/d36/d40/d46/d72/fc4 x:0 0 0 2024-04-23T10:21:34.822 INFO:tasks.workunit.client.0.smithi029.stdout:7/645: fsync d5/fa0 0 2024-04-23T10:21:34.830 INFO:tasks.workunit.client.0.smithi029.stdout:3/533: read - d3/d10/de/d2e/d36/d40/d46/d72/d28/f8e zero size 2024-04-23T10:21:34.836 INFO:tasks.workunit.client.0.smithi029.stdout:8/616: dwrite d3/fd [0,4194304] 0 2024-04-23T10:21:34.840 INFO:tasks.workunit.client.0.smithi029.stdout:7/646: mknod d5/d8/d1a/cd2 0 2024-04-23T10:21:34.841 INFO:tasks.workunit.client.0.smithi029.stdout:6/719: rename d9/df/d16/d1f/d2c/l9c to d9/df/d41/d49/d69/lf0 0 2024-04-23T10:21:34.841 INFO:tasks.workunit.client.0.smithi029.stdout:2/564: dwrite d1/d3e/d5a/d6d/fbe [0,4194304] 0 2024-04-23T10:21:34.843 INFO:tasks.workunit.client.0.smithi029.stdout:1/471: link d5/d6/de/d15/f3b d5/d6/de/d22/d77/f98 0 2024-04-23T10:21:34.843 INFO:tasks.workunit.client.0.smithi029.stdout:4/603: creat d0/d3c/d52/d1b/d5b/d65/d6a/d7c/fd7 x:0 0 0 2024-04-23T10:21:34.852 INFO:tasks.workunit.client.0.smithi029.stdout:1/472: chown d5/d6/de/d22/f45 9068 1 2024-04-23T10:21:34.853 INFO:tasks.workunit.client.0.smithi029.stdout:8/617: mkdir d3/d38/dc3 0 2024-04-23T10:21:34.855 INFO:tasks.workunit.client.0.smithi029.stdout:9/739: link d0/d7/d6/cb3 d0/d1b/d39/d50/d5a/c102 0 2024-04-23T10:21:34.855 INFO:tasks.workunit.client.0.smithi029.stdout:6/720: fdatasync d9/df/d41/d49/fc7 0 2024-04-23T10:21:34.856 INFO:tasks.workunit.client.0.smithi029.stdout:1/473: chown d5/d6/f74 34740 1 2024-04-23T10:21:34.857 INFO:tasks.workunit.client.0.smithi029.stdout:7/647: mkdir d5/d8/d1a/d9c/dd3 0 2024-04-23T10:21:34.859 INFO:tasks.workunit.client.0.smithi029.stdout:8/618: chown d3/d50/c78 134 1 2024-04-23T10:21:34.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/740: chown d0/d1b/f31 22 1 2024-04-23T10:21:34.866 INFO:tasks.workunit.client.0.smithi029.stdout:4/604: write d0/d12/f49 [913036,125168] 0 2024-04-23T10:21:34.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/619: fdatasync d3/d44/db1/fbe 0 2024-04-23T10:21:34.869 INFO:tasks.workunit.client.0.smithi029.stdout:6/721: dread d9/df/d16/d1f/d27/d33/f32 [0,4194304] 0 2024-04-23T10:21:34.869 INFO:tasks.workunit.client.0.smithi029.stdout:3/534: rename d3/d15/c3e to d3/d10/de/d2e/d36/d40/d46/d72/d5e/cc5 0 2024-04-23T10:21:34.870 INFO:tasks.workunit.client.0.smithi029.stdout:2/565: dwrite d1/dd/d47/d63/d64/f6b [0,4194304] 0 2024-04-23T10:21:34.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/474: fdatasync d5/d6/f7c 0 2024-04-23T10:21:34.884 INFO:tasks.workunit.client.0.smithi029.stdout:7/648: dwrite d5/f2c [4194304,4194304] 0 2024-04-23T10:21:34.884 INFO:tasks.workunit.client.0.smithi029.stdout:8/620: truncate d3/d50/d6a/d95/fae 36201 0 2024-04-23T10:21:34.885 INFO:tasks.workunit.client.0.smithi029.stdout:3/535: unlink d3/d10/de/d2e/d36/d40/d46/faf 0 2024-04-23T10:21:34.890 INFO:tasks.workunit.client.0.smithi029.stdout:9/741: write d0/d7/d1d/d35/da9/fb7 [303244,25949] 0 2024-04-23T10:21:34.890 INFO:tasks.workunit.client.0.smithi029.stdout:7/649: symlink d5/d71/dca/ld4 0 2024-04-23T10:21:34.891 INFO:tasks.workunit.client.0.smithi029.stdout:1/475: truncate d5/d6/de/d15/d7b/f82 452068 0 2024-04-23T10:21:34.892 INFO:tasks.workunit.client.0.smithi029.stdout:3/536: creat d3/d15/fc6 x:0 0 0 2024-04-23T10:21:34.898 INFO:tasks.workunit.client.0.smithi029.stdout:6/722: dwrite d9/df/d16/d1f/d27/f70 [0,4194304] 0 2024-04-23T10:21:34.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/742: creat d0/d7/d1d/d35/da9/f103 x:0 0 0 2024-04-23T10:21:34.900 INFO:tasks.workunit.client.0.smithi029.stdout:1/476: creat d5/d6/de/d27/f99 x:0 0 0 2024-04-23T10:21:34.901 INFO:tasks.workunit.client.0.smithi029.stdout:7/650: creat d5/d8/d51/d55/d59/daf/fd5 x:0 0 0 2024-04-23T10:21:34.901 INFO:tasks.workunit.client.0.smithi029.stdout:4/605: dread d0/d3c/d52/f75 [0,4194304] 0 2024-04-23T10:21:34.904 INFO:tasks.workunit.client.0.smithi029.stdout:3/537: rename d3/d10/de/d2e/d36/d40/d46/d72/d31/f26 to d3/d45/fc7 0 2024-04-23T10:21:34.905 INFO:tasks.workunit.client.0.smithi029.stdout:9/743: symlink d0/d1b/d39/d50/l104 0 2024-04-23T10:21:34.906 INFO:tasks.workunit.client.0.smithi029.stdout:1/477: readlink d5/d6/de/d15/l69 0 2024-04-23T10:21:34.907 INFO:tasks.workunit.client.0.smithi029.stdout:4/606: rmdir d0/d12/dcb 0 2024-04-23T10:21:34.909 INFO:tasks.workunit.client.0.smithi029.stdout:8/621: dread d3/d50/d6a/d95/d36/d3e/f3f [0,4194304] 0 2024-04-23T10:21:34.910 INFO:tasks.workunit.client.0.smithi029.stdout:9/744: fdatasync d0/d7/f8 0 2024-04-23T10:21:34.912 INFO:tasks.workunit.client.0.smithi029.stdout:1/478: symlink d5/d6/de/d22/d6c/l9a 0 2024-04-23T10:21:34.917 INFO:tasks.workunit.client.0.smithi029.stdout:9/745: mknod d0/d1b/d39/c105 0 2024-04-23T10:21:34.919 INFO:tasks.workunit.client.0.smithi029.stdout:6/723: write d9/f18 [1355758,8806] 0 2024-04-23T10:21:34.919 INFO:tasks.workunit.client.0.smithi029.stdout:7/651: link d5/d8/d51/d55/d59/l6d d5/d58/ld6 0 2024-04-23T10:21:34.923 INFO:tasks.workunit.client.0.smithi029.stdout:4/607: rename d0/d3c/d52/d74/d8a/dba/dc2 to d0/d3c/d52/d1b/d9f/d92/dd8 0 2024-04-23T10:21:34.923 INFO:tasks.workunit.client.0.smithi029.stdout:3/538: write d3/d10/f79 [332236,75723] 0 2024-04-23T10:21:34.925 INFO:tasks.workunit.client.0.smithi029.stdout:7/652: chown d5/d8/d51/d55/d59/f61 36918 1 2024-04-23T10:21:34.927 INFO:tasks.workunit.client.0.smithi029.stdout:1/479: write d5/d6/f16 [1904144,47792] 0 2024-04-23T10:21:34.930 INFO:tasks.workunit.client.0.smithi029.stdout:1/480: stat d5/d6/de/l43 0 2024-04-23T10:21:34.931 INFO:tasks.workunit.client.0.smithi029.stdout:3/539: truncate d3/d10/de/d2e/d36/f33 1566972 0 2024-04-23T10:21:34.933 INFO:tasks.workunit.client.0.smithi029.stdout:7/653: creat d5/d71/d92/db7/dc3/dcc/fd7 x:0 0 0 2024-04-23T10:21:34.933 INFO:tasks.workunit.client.0.smithi029.stdout:6/724: write d9/df/d16/d34/d36/fb1 [2683672,75798] 0 2024-04-23T10:21:34.933 INFO:tasks.workunit.client.0.smithi029.stdout:9/746: link d0/d1b/d39/l5e d0/d7/d1d/d35/da9/dd0/l106 0 2024-04-23T10:21:34.934 INFO:tasks.workunit.client.0.smithi029.stdout:3/540: chown d3/d10/de/d2e/d36/d8a 2 1 2024-04-23T10:21:34.936 INFO:tasks.workunit.client.0.smithi029.stdout:4/608: creat d0/d3c/d52/d1b/d66/fd9 x:0 0 0 2024-04-23T10:21:34.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/481: fsync d5/d6/ff 0 2024-04-23T10:21:34.939 INFO:tasks.workunit.client.0.smithi029.stdout:7/654: dread d5/f24 [0,4194304] 0 2024-04-23T10:21:34.940 INFO:tasks.workunit.client.0.smithi029.stdout:4/609: dread - d0/d3c/d52/d1b/d36/d45/d68/f8f zero size 2024-04-23T10:21:34.941 INFO:tasks.workunit.client.0.smithi029.stdout:3/541: fsync d3/d10/f2b 0 2024-04-23T10:21:34.943 INFO:tasks.workunit.client.0.smithi029.stdout:6/725: write d9/df/d16/f24 [3413924,39471] 0 2024-04-23T10:21:34.948 INFO:tasks.workunit.client.0.smithi029.stdout:4/610: unlink d0/d3c/d52/d20/cb5 0 2024-04-23T10:21:34.955 INFO:tasks.workunit.client.0.smithi029.stdout:1/482: dwrite d5/d6/f21 [0,4194304] 0 2024-04-23T10:21:34.955 INFO:tasks.workunit.client.0.smithi029.stdout:6/726: write d9/df/d16/d44/d4c/dd9/fdd [337999,54891] 0 2024-04-23T10:21:34.955 INFO:tasks.workunit.client.0.smithi029.stdout:7/655: link d5/f1f d5/dc8/fd8 0 2024-04-23T10:21:34.957 INFO:tasks.workunit.client.0.smithi029.stdout:9/747: link d0/d1b/d39/fdf d0/d1b/d39/d50/d67/db6/f107 0 2024-04-23T10:21:34.958 INFO:tasks.workunit.client.0.smithi029.stdout:4/611: stat d0/d3c/d52/d1b/d9f/d92/dd8/da1/cac 0 2024-04-23T10:21:34.961 INFO:tasks.workunit.client.0.smithi029.stdout:6/727: unlink d9/df/d16/c67 0 2024-04-23T10:21:34.961 INFO:tasks.workunit.client.0.smithi029.stdout:7/656: chown d5/d8/d51/d55/d59/daf/fd5 72 1 2024-04-23T10:21:34.961 INFO:tasks.workunit.client.0.smithi029.stdout:3/542: dwrite f0 [0,4194304] 0 2024-04-23T10:21:34.966 INFO:tasks.workunit.client.0.smithi029.stdout:1/483: creat d5/d6/de/d15/d7b/f9b x:0 0 0 2024-04-23T10:21:34.967 INFO:tasks.workunit.client.0.smithi029.stdout:9/748: mkdir d0/d7/d1d/d35/dd5/dec/d108 0 2024-04-23T10:21:34.970 INFO:tasks.workunit.client.0.smithi029.stdout:3/543: mknod d3/d45/d4f/cc8 0 2024-04-23T10:21:34.970 INFO:tasks.workunit.client.0.smithi029.stdout:9/749: stat d0/d7/d1d/d35/d3b/d68/f8f 0 2024-04-23T10:21:34.971 INFO:tasks.workunit.client.0.smithi029.stdout:4/612: getdents d0/d3c/d52/d1b/d9f/d92 0 2024-04-23T10:21:34.973 INFO:tasks.workunit.client.0.smithi029.stdout:1/484: creat d5/d3e/f9c x:0 0 0 2024-04-23T10:21:34.975 INFO:tasks.workunit.client.0.smithi029.stdout:7/657: rename d5/d8/d1a/lc2 to d5/d29/d4a/dc1/ld9 0 2024-04-23T10:21:34.976 INFO:tasks.workunit.client.0.smithi029.stdout:4/613: fsync d0/d3c/d52/d1b/d5b/d65/d6a/d7c/fd7 0 2024-04-23T10:21:34.979 INFO:tasks.workunit.client.0.smithi029.stdout:4/614: stat d0/d3c/d52/d1b/d5b/lbe 0 2024-04-23T10:21:34.981 INFO:tasks.workunit.client.0.smithi029.stdout:1/485: mknod d5/d6/de/d22/d77/c9d 0 2024-04-23T10:21:34.982 INFO:tasks.workunit.client.0.smithi029.stdout:4/615: chown d0/d3c/d52/d1b/d36/l37 4621 1 2024-04-23T10:21:34.983 INFO:tasks.workunit.client.0.smithi029.stdout:4/616: stat d0/d3c/d52/d1b/d5b/d65/d6a 0 2024-04-23T10:21:34.983 INFO:tasks.workunit.client.0.smithi029.stdout:9/750: write d0/d7/f1a [2465543,113676] 0 2024-04-23T10:21:34.991 INFO:tasks.workunit.client.0.smithi029.stdout:4/617: write d0/d3c/d52/d1b/f39 [2409514,34945] 0 2024-04-23T10:21:34.991 INFO:tasks.workunit.client.0.smithi029.stdout:9/751: write d0/d1b/d39/d50/d5a/f7d [538859,48341] 0 2024-04-23T10:21:34.992 INFO:tasks.workunit.client.0.smithi029.stdout:1/486: unlink d5/d6/de/d22/d77/l94 0 2024-04-23T10:21:34.994 INFO:tasks.workunit.client.0.smithi029.stdout:4/618: chown d0/d3c/fa2 57990 1 2024-04-23T10:21:34.998 INFO:tasks.workunit.client.0.smithi029.stdout:4/619: dread - d0/d3c/d52/d74/f77 zero size 2024-04-23T10:21:34.999 INFO:tasks.workunit.client.0.smithi029.stdout:7/658: dwrite d5/d8/d51/d55/d59/f73 [0,4194304] 0 2024-04-23T10:21:34.999 INFO:tasks.workunit.client.0.smithi029.stdout:6/728: dread d9/f10 [0,4194304] 0 2024-04-23T10:21:35.001 INFO:tasks.workunit.client.0.smithi029.stdout:1/487: write d5/d6/de/f33 [1019158,33981] 0 2024-04-23T10:21:35.004 INFO:tasks.workunit.client.0.smithi029.stdout:4/620: mkdir d0/d3c/d52/d1b/d5b/d65/d6a/dda 0 2024-04-23T10:21:35.007 INFO:tasks.workunit.client.0.smithi029.stdout:1/488: mknod d5/d6/c9e 0 2024-04-23T10:21:35.009 INFO:tasks.workunit.client.0.smithi029.stdout:9/752: dwrite d0/d7/d1d/d35/dd5/ff9 [0,4194304] 0 2024-04-23T10:21:35.010 INFO:tasks.workunit.client.0.smithi029.stdout:6/729: mknod d9/df/d16/d1f/d27/d33/da4/d66/cf1 0 2024-04-23T10:21:35.013 INFO:tasks.workunit.client.0.smithi029.stdout:7/659: rename d5/d58 to d5/d71/d92/dda 0 2024-04-23T10:21:35.014 INFO:tasks.workunit.client.0.smithi029.stdout:4/621: creat d0/d3c/d52/d1b/d9f/fdb x:0 0 0 2024-04-23T10:21:35.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/489: getdents d5/d6/de/d22/d77 0 2024-04-23T10:21:35.021 INFO:tasks.workunit.client.0.smithi029.stdout:4/622: getdents d0/d3c 0 2024-04-23T10:21:35.022 INFO:tasks.workunit.client.0.smithi029.stdout:1/490: mkdir d5/d6/de/d27/d38/d9f 0 2024-04-23T10:21:35.022 INFO:tasks.workunit.client.0.smithi029.stdout:4/623: chown d0/d3c/cd3 6054625 1 2024-04-23T10:21:35.025 INFO:tasks.workunit.client.0.smithi029.stdout:6/730: link d9/df/d16/d1f/d27/dad/dbd/fca d9/df/d16/d1f/d27/ff2 0 2024-04-23T10:21:35.028 INFO:tasks.workunit.client.0.smithi029.stdout:7/660: write d5/d29/d4a/f93 [130619,78384] 0 2024-04-23T10:21:35.034 INFO:tasks.workunit.client.0.smithi029.stdout:9/753: dwrite d0/d1b/d39/d50/fd3 [0,4194304] 0 2024-04-23T10:21:35.037 INFO:tasks.workunit.client.0.smithi029.stdout:4/624: dwrite d0/d3c/d52/d1b/d36/d45/f78 [0,4194304] 0 2024-04-23T10:21:35.039 INFO:tasks.workunit.client.0.smithi029.stdout:7/661: write d5/d8/d1a/f7a [1207539,44638] 0 2024-04-23T10:21:35.051 INFO:tasks.workunit.client.0.smithi029.stdout:9/754: dwrite d0/d7/f18 [0,4194304] 0 2024-04-23T10:21:35.051 INFO:tasks.workunit.client.0.smithi029.stdout:4/625: dwrite d0/d3c/d52/d74/d91/fbc [0,4194304] 0 2024-04-23T10:21:35.056 INFO:tasks.workunit.client.0.smithi029.stdout:9/755: rmdir d0/d7/d6 39 2024-04-23T10:21:35.059 INFO:tasks.workunit.client.0.smithi029.stdout:9/756: symlink d0/d7/d1d/d35/d3b/l109 0 2024-04-23T10:21:35.060 INFO:tasks.workunit.client.0.smithi029.stdout:4/626: creat d0/d3c/d52/d1b/d36/d45/dd0/fdc x:0 0 0 2024-04-23T10:21:35.060 INFO:tasks.workunit.client.0.smithi029.stdout:7/662: getdents d5/d8/d51/d9e/db2 0 2024-04-23T10:21:35.065 INFO:tasks.workunit.client.0.smithi029.stdout:7/663: mkdir d5/d8/d1a/d4d/ddb 0 2024-04-23T10:21:35.067 INFO:tasks.workunit.client.0.smithi029.stdout:4/627: creat d0/d3c/d52/d1b/d5b/d65/d6a/d7c/fdd x:0 0 0 2024-04-23T10:21:35.068 INFO:tasks.workunit.client.0.smithi029.stdout:9/757: truncate d0/d1b/d39/d4f/f9c 274842 0 2024-04-23T10:21:35.069 INFO:tasks.workunit.client.0.smithi029.stdout:4/628: dread d0/d3c/fa2 [0,4194304] 0 2024-04-23T10:21:35.069 INFO:tasks.workunit.client.0.smithi029.stdout:7/664: fsync d5/dc8/fd8 0 2024-04-23T10:21:35.070 INFO:tasks.workunit.client.0.smithi029.stdout:9/758: dread - d0/d7/d1d/d35/da9/fe8 zero size 2024-04-23T10:21:35.074 INFO:tasks.workunit.client.0.smithi029.stdout:9/759: dread d0/d7/d1d/d35/d3b/f88 [0,4194304] 0 2024-04-23T10:21:35.075 INFO:tasks.workunit.client.0.smithi029.stdout:4/629: truncate d0/d3c/d52/d1b/d5b/d65/f6d 1425803 0 2024-04-23T10:21:35.080 INFO:tasks.workunit.client.0.smithi029.stdout:7/665: rename d5/d71/d92/dda/l77 to d5/d8/d1a/d4d/ldc 0 2024-04-23T10:21:35.080 INFO:tasks.workunit.client.0.smithi029.stdout:4/630: fsync d0/d3c/d52/d1b/f35 0 2024-04-23T10:21:35.081 INFO:tasks.workunit.client.0.smithi029.stdout:7/666: chown d5/d8/d51/d55/f87 541 1 2024-04-23T10:21:35.084 INFO:tasks.workunit.client.0.smithi029.stdout:9/760: write d0/d7/f12 [2710302,127240] 0 2024-04-23T10:21:35.086 INFO:tasks.workunit.client.0.smithi029.stdout:4/631: truncate d0/d3c/d52/d1b/d36/d45/d68/f73 1020167 0 2024-04-23T10:21:35.088 INFO:tasks.workunit.client.0.smithi029.stdout:7/667: link d5/d29/f2a d5/d29/fdd 0 2024-04-23T10:21:35.090 INFO:tasks.workunit.client.0.smithi029.stdout:9/761: rmdir d0/d7/d1d/d35/dd9/d49/df1 0 2024-04-23T10:21:35.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/762: link d0/d7/d1d/d35/dde/f94 d0/d7/d1d/d35/dd5/df2/f10a 0 2024-04-23T10:21:35.099 INFO:tasks.workunit.client.0.smithi029.stdout:9/763: mkdir d0/d7/d1d/d35/d3b/d10b 0 2024-04-23T10:21:35.103 INFO:tasks.workunit.client.0.smithi029.stdout:4/632: dwrite d0/d3c/d52/d1b/d36/d45/f58 [0,4194304] 0 2024-04-23T10:21:35.104 INFO:tasks.workunit.client.0.smithi029.stdout:7/668: dwrite d5/d8/f32 [0,4194304] 0 2024-04-23T10:21:35.113 INFO:tasks.workunit.client.0.smithi029.stdout:7/669: mkdir d5/d8/d1a/d8a/dde 0 2024-04-23T10:21:35.114 INFO:tasks.workunit.client.0.smithi029.stdout:4/633: write d0/d3c/d52/d1b/f1c [4281659,11547] 0 2024-04-23T10:21:35.115 INFO:tasks.workunit.client.0.smithi029.stdout:9/764: dwrite d0/d7/d1d/d35/d3b/d68/fd8 [0,4194304] 0 2024-04-23T10:21:35.117 INFO:tasks.workunit.client.0.smithi029.stdout:7/670: unlink d5/d8/d1a/f7a 0 2024-04-23T10:21:35.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/765: creat d0/d7/d1d/d35/d3b/d68/f10c x:0 0 0 2024-04-23T10:21:35.125 INFO:tasks.workunit.client.0.smithi029.stdout:7/671: creat d5/d8/d51/fdf x:0 0 0 2024-04-23T10:21:35.131 INFO:tasks.workunit.client.0.smithi029.stdout:9/766: write d0/d7/d1d/d35/d3b/f88 [149286,69622] 0 2024-04-23T10:21:35.137 INFO:tasks.workunit.client.0.smithi029.stdout:7/672: dwrite d5/d9/fb3 [0,4194304] 0 2024-04-23T10:21:35.140 INFO:tasks.workunit.client.0.smithi029.stdout:7/673: fsync d5/dc8/fd8 0 2024-04-23T10:21:35.142 INFO:tasks.workunit.client.0.smithi029.stdout:7/674: dread - d5/d8/d1a/f78 zero size 2024-04-23T10:21:35.143 INFO:tasks.workunit.client.0.smithi029.stdout:7/675: fsync d5/d8/d51/f8c 0 2024-04-23T10:21:35.146 INFO:tasks.workunit.client.0.smithi029.stdout:7/676: read d5/d29/d4a/fd1 [142348,58927] 0 2024-04-23T10:21:35.150 INFO:tasks.workunit.client.0.smithi029.stdout:9/767: dread d0/d7/d3f/f96 [0,4194304] 0 2024-04-23T10:21:35.151 INFO:tasks.workunit.client.0.smithi029.stdout:4/634: dread d0/d3c/d52/d1b/d5b/d65/d6a/f6c [0,4194304] 0 2024-04-23T10:21:35.151 INFO:tasks.workunit.client.0.smithi029.stdout:7/677: rmdir d5/d8/d1a/d8a/dde 0 2024-04-23T10:21:35.154 INFO:tasks.workunit.client.0.smithi029.stdout:4/635: truncate d0/d3c/d52/d1b/f2e 13220769 0 2024-04-23T10:21:35.155 INFO:tasks.workunit.client.0.smithi029.stdout:7/678: creat d5/d8/d1a/d8e/fe0 x:0 0 0 2024-04-23T10:21:35.158 INFO:tasks.workunit.client.0.smithi029.stdout:9/768: link d0/d1b/d39/d50/d67/fc7 d0/d7/d1d/d35/dd9/d49/d65/de4/f10d 0 2024-04-23T10:21:35.161 INFO:tasks.workunit.client.0.smithi029.stdout:9/769: chown d0/d7/d1d/d35/d3b/d68/dbd 47146 1 2024-04-23T10:21:35.161 INFO:tasks.workunit.client.0.smithi029.stdout:4/636: write d0/f17 [2888562,118936] 0 2024-04-23T10:21:35.167 INFO:tasks.workunit.client.0.smithi029.stdout:9/770: symlink d0/d7/d1d/d35/d3b/d10b/l10e 0 2024-04-23T10:21:35.170 INFO:tasks.workunit.client.0.smithi029.stdout:6/731: read d9/df/d41/f6c [1629938,113525] 0 2024-04-23T10:21:35.172 INFO:tasks.workunit.client.0.smithi029.stdout:7/679: read d5/d8/d51/f7f [4123047,123877] 0 2024-04-23T10:21:35.177 INFO:tasks.workunit.client.0.smithi029.stdout:9/771: mkdir d0/d1b/d39/d50/d67/db6/d10f 0 2024-04-23T10:21:35.179 INFO:tasks.workunit.client.0.smithi029.stdout:7/680: chown d5/d8/d1a/c4b 0 1 2024-04-23T10:21:35.180 INFO:tasks.workunit.client.0.smithi029.stdout:4/637: rmdir d0/d3c/d52/d1b/d9f/d92/dd8/da1/db1 39 2024-04-23T10:21:35.183 INFO:tasks.workunit.client.0.smithi029.stdout:9/772: creat d0/d1b/d60/dbf/f110 x:0 0 0 2024-04-23T10:21:35.188 INFO:tasks.workunit.client.0.smithi029.stdout:9/773: dread - d0/d1b/d39/d50/d5a/fce zero size 2024-04-23T10:21:35.190 INFO:tasks.workunit.client.0.smithi029.stdout:7/681: symlink d5/d8/d1a/d8a/d8b/d8d/d96/le1 0 2024-04-23T10:21:35.192 INFO:tasks.workunit.client.0.smithi029.stdout:4/638: dread d0/d3c/d52/d20/f81 [0,4194304] 0 2024-04-23T10:21:35.192 INFO:tasks.workunit.client.0.smithi029.stdout:9/774: fsync d0/d1b/d39/d50/f6a 0 2024-04-23T10:21:35.193 INFO:tasks.workunit.client.0.smithi029.stdout:6/732: dwrite d9/df/d16/d1f/fae [0,4194304] 0 2024-04-23T10:21:35.197 INFO:tasks.workunit.client.0.smithi029.stdout:4/639: truncate d0/d3c/d52/d1b/d9f/d92/dd8/d7a/fc6 1967722 0 2024-04-23T10:21:35.198 INFO:tasks.workunit.client.0.smithi029.stdout:7/682: rename d5/d8/l44 to d5/d8/d1a/d9c/le2 0 2024-04-23T10:21:35.200 INFO:tasks.workunit.client.0.smithi029.stdout:7/683: chown d5/d71/f72 10 1 2024-04-23T10:21:35.201 INFO:tasks.workunit.client.0.smithi029.stdout:4/640: symlink d0/d5a/lde 0 2024-04-23T10:21:35.204 INFO:tasks.workunit.client.0.smithi029.stdout:4/641: write d0/d3c/d52/d1b/d36/d45/f58 [587984,65769] 0 2024-04-23T10:21:35.204 INFO:tasks.workunit.client.0.smithi029.stdout:9/775: rename d0/d1b/d39/d4f/l63 to d0/d7/d1d/d35/d3b/d68/l111 0 2024-04-23T10:21:35.207 INFO:tasks.workunit.client.0.smithi029.stdout:4/642: truncate d0/d3c/fc8 944090 0 2024-04-23T10:21:35.210 INFO:tasks.workunit.client.0.smithi029.stdout:9/776: rename d0/d1b/d39/d50/d5a to d0/d1b/d39/d112 0 2024-04-23T10:21:35.211 INFO:tasks.workunit.client.0.smithi029.stdout:4/643: symlink d0/d3c/ldf 0 2024-04-23T10:21:35.211 INFO:tasks.workunit.client.0.smithi029.stdout:9/777: read d0/d7/f18 [915473,121181] 0 2024-04-23T10:21:35.212 INFO:tasks.workunit.client.0.smithi029.stdout:9/778: read - d0/d1b/ff6 zero size 2024-04-23T10:21:35.212 INFO:tasks.workunit.client.0.smithi029.stdout:6/733: dread d9/f18 [0,4194304] 0 2024-04-23T10:21:35.213 INFO:tasks.workunit.client.0.smithi029.stdout:7/684: write d5/d8/d1a/d9c/f88 [657169,83607] 0 2024-04-23T10:21:35.218 INFO:tasks.workunit.client.0.smithi029.stdout:9/779: creat d0/d7/d1d/d35/d3b/db8/f113 x:0 0 0 2024-04-23T10:21:35.219 INFO:tasks.workunit.client.0.smithi029.stdout:4/644: fdatasync d0/d3c/d52/d1b/d36/d45/d4f/f7f 0 2024-04-23T10:21:35.220 INFO:tasks.workunit.client.0.smithi029.stdout:7/685: write d5/d8/d1a/d8a/f9d [583555,57318] 0 2024-04-23T10:21:35.222 INFO:tasks.workunit.client.0.smithi029.stdout:6/734: link d9/df/d25/l4f d9/df/d16/d1f/d27/d33/da4/lf3 0 2024-04-23T10:21:35.224 INFO:tasks.workunit.client.0.smithi029.stdout:9/780: truncate d0/d7/d1d/f74 572572 0 2024-04-23T10:21:35.226 INFO:tasks.workunit.client.0.smithi029.stdout:4/645: write d0/d3c/d52/d1b/d5b/d65/d6a/f95 [276217,82034] 0 2024-04-23T10:21:35.233 INFO:tasks.workunit.client.0.smithi029.stdout:4/646: symlink d0/d3c/d52/d74/d8a/le0 0 2024-04-23T10:21:35.236 INFO:tasks.workunit.client.0.smithi029.stdout:6/735: dwrite d9/df/d16/d1f/d2c/fc3 [0,4194304] 0 2024-04-23T10:21:35.240 INFO:tasks.workunit.client.0.smithi029.stdout:7/686: dread d5/d8/d1a/d9c/fab [0,4194304] 0 2024-04-23T10:21:35.243 INFO:tasks.workunit.client.0.smithi029.stdout:6/736: symlink d9/df/d16/d1f/d27/d33/da4/d58/d7e/lf4 0 2024-04-23T10:21:35.244 INFO:tasks.workunit.client.0.smithi029.stdout:9/781: dwrite d0/d1b/d39/d50/fb4 [0,4194304] 0 2024-04-23T10:21:35.247 INFO:tasks.workunit.client.0.smithi029.stdout:4/647: symlink d0/d5a/d96/le1 0 2024-04-23T10:21:35.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/687: mkdir d5/d9/de3 0 2024-04-23T10:21:35.250 INFO:tasks.workunit.client.0.smithi029.stdout:7/688: dread - d5/d8/d51/d55/d59/daf/fd5 zero size 2024-04-23T10:21:35.255 INFO:tasks.workunit.client.0.smithi029.stdout:4/648: dread d0/d3c/d52/d1b/d5b/d65/d6a/f6c [0,4194304] 0 2024-04-23T10:21:35.255 INFO:tasks.workunit.client.0.smithi029.stdout:6/737: chown d9/df/d16/d1f/d27/d33/da4/d58/l59 0 1 2024-04-23T10:21:35.257 INFO:tasks.workunit.client.0.smithi029.stdout:7/689: rmdir d5/d8/d51/d9e 39 2024-04-23T10:21:35.259 INFO:tasks.workunit.client.0.smithi029.stdout:4/649: dread - d0/d3c/d52/d1b/d9f/d92/dd8/da1/fc7 zero size 2024-04-23T10:21:35.260 INFO:tasks.workunit.client.0.smithi029.stdout:4/650: write d0/d3c/d52/d1b/f1c [4595085,22057] 0 2024-04-23T10:21:35.263 INFO:tasks.workunit.client.0.smithi029.stdout:7/690: mknod d5/d8/d1a/d4d/ce4 0 2024-04-23T10:21:35.264 INFO:tasks.workunit.client.0.smithi029.stdout:9/782: rename d0/d7/d6/f47 to d0/d1b/d39/d50/dd4/f114 0 2024-04-23T10:21:35.265 INFO:tasks.workunit.client.0.smithi029.stdout:9/783: read d0/d1b/d60/dbf/fca [289277,102820] 0 2024-04-23T10:21:35.265 INFO:tasks.workunit.client.0.smithi029.stdout:7/691: creat d5/d8/d1a/d9c/dd3/fe5 x:0 0 0 2024-04-23T10:21:35.266 INFO:tasks.workunit.client.0.smithi029.stdout:6/738: mknod d9/df/d16/d1f/d27/dad/dd0/dea/cf5 0 2024-04-23T10:21:35.267 INFO:tasks.workunit.client.0.smithi029.stdout:7/692: rmdir d5 39 2024-04-23T10:21:35.269 INFO:tasks.workunit.client.0.smithi029.stdout:4/651: rename d0/d3c/d52/d1b/d9f/fdb to d0/fe2 0 2024-04-23T10:21:35.270 INFO:tasks.workunit.client.0.smithi029.stdout:7/693: write d5/d29/d4a/f93 [366480,55690] 0 2024-04-23T10:21:35.271 INFO:tasks.workunit.client.0.smithi029.stdout:9/784: creat d0/d7/f115 x:0 0 0 2024-04-23T10:21:35.273 INFO:tasks.workunit.client.0.smithi029.stdout:6/739: getdents d9/df/d16/d1f/d27 0 2024-04-23T10:21:35.274 INFO:tasks.workunit.client.0.smithi029.stdout:9/785: truncate d0/d7/d3f/f82 571014 0 2024-04-23T10:21:35.275 INFO:tasks.workunit.client.0.smithi029.stdout:7/694: getdents d5/d71 0 2024-04-23T10:21:35.276 INFO:tasks.workunit.client.0.smithi029.stdout:9/786: chown d0/d7/d1d/d35/d3b/cb1 166031 1 2024-04-23T10:21:35.278 INFO:tasks.workunit.client.0.smithi029.stdout:4/652: link d0/d3c/d52/d20/cb8 d0/d3c/d52/d20/ce3 0 2024-04-23T10:21:35.280 INFO:tasks.workunit.client.0.smithi029.stdout:6/740: rename d9/df/d16/daf to d9/df/d16/d44/d4c/dd9/df6 0 2024-04-23T10:21:35.281 INFO:tasks.workunit.client.0.smithi029.stdout:4/653: mknod d0/d3c/ce4 0 2024-04-23T10:21:35.287 INFO:tasks.workunit.client.0.smithi029.stdout:7/695: write d5/d29/d4a/f56 [1038180,53486] 0 2024-04-23T10:21:35.288 INFO:tasks.workunit.client.0.smithi029.stdout:7/696: fdatasync d5/d71/f72 0 2024-04-23T10:21:35.293 INFO:tasks.workunit.client.0.smithi029.stdout:7/697: getdents d5/d8/d1a/d9c/dd3 0 2024-04-23T10:21:35.295 INFO:tasks.workunit.client.0.smithi029.stdout:6/741: dwrite d9/df/d16/d1f/d27/d33/da4/d66/d95/f98 [0,4194304] 0 2024-04-23T10:21:35.300 INFO:tasks.workunit.client.0.smithi029.stdout:4/654: dwrite d0/d3c/d52/f1d [0,4194304] 0 2024-04-23T10:21:35.300 INFO:tasks.workunit.client.0.smithi029.stdout:7/698: rename d5/d29/f38 to d5/d71/d92/fe6 0 2024-04-23T10:21:35.303 INFO:tasks.workunit.client.0.smithi029.stdout:6/742: truncate d9/df/d16/d1f/fae 1884078 0 2024-04-23T10:21:35.305 INFO:tasks.workunit.client.0.smithi029.stdout:7/699: truncate d5/d29/f5b 285442 0 2024-04-23T10:21:35.306 INFO:tasks.workunit.client.0.smithi029.stdout:6/743: creat d9/df/d16/d34/ff7 x:0 0 0 2024-04-23T10:21:35.308 INFO:tasks.workunit.client.0.smithi029.stdout:7/700: creat d5/d8/d51/fe7 x:0 0 0 2024-04-23T10:21:35.309 INFO:tasks.workunit.client.0.smithi029.stdout:7/701: dread - d5/d8/d51/fdf zero size 2024-04-23T10:21:35.309 INFO:tasks.workunit.client.0.smithi029.stdout:6/744: chown d9/df/d16/d44/d4c/l79 2484 1 2024-04-23T10:21:35.313 INFO:tasks.workunit.client.0.smithi029.stdout:4/655: write d0/d3c/d52/f90 [1036126,48876] 0 2024-04-23T10:21:35.319 INFO:tasks.workunit.client.0.smithi029.stdout:7/702: rename d5/d8/d1a/d8e/ld0 to d5/d29/dc9/le8 0 2024-04-23T10:21:35.320 INFO:tasks.workunit.client.0.smithi029.stdout:7/703: write d5/f2c [6229737,72636] 0 2024-04-23T10:21:35.320 INFO:tasks.workunit.client.0.smithi029.stdout:4/656: fsync d0/d3c/d52/d20/fc5 0 2024-04-23T10:21:35.325 INFO:tasks.workunit.client.0.smithi029.stdout:4/657: dread d0/d3c/fc8 [0,4194304] 0 2024-04-23T10:21:35.327 INFO:tasks.workunit.client.0.smithi029.stdout:6/745: rename d9/df/d16/f2a to d9/df/d16/d34/d84/ff8 0 2024-04-23T10:21:35.330 INFO:tasks.workunit.client.0.smithi029.stdout:6/746: chown d9/df/d16/f1e 1652 1 2024-04-23T10:21:35.332 INFO:tasks.workunit.client.0.smithi029.stdout:4/658: dread - d0/d5a/fb2 zero size 2024-04-23T10:21:35.337 INFO:tasks.workunit.client.0.smithi029.stdout:7/704: link d5/d29/d4a/dc1/fc4 d5/d8/d51/d9e/fe9 0 2024-04-23T10:21:35.340 INFO:tasks.workunit.client.0.smithi029.stdout:6/747: rename d9/df/d25/c47 to d9/df/d16/d1f/d27/dad/dbd/cf9 0 2024-04-23T10:21:35.342 INFO:tasks.workunit.client.0.smithi029.stdout:7/705: creat d5/dc8/fea x:0 0 0 2024-04-23T10:21:35.345 INFO:tasks.workunit.client.0.smithi029.stdout:6/748: mknod d9/df/d16/d34/d36/d63/cfa 0 2024-04-23T10:21:35.348 INFO:tasks.workunit.client.0.smithi029.stdout:6/749: creat d9/df/d16/d1f/d27/d33/da4/d58/ffb x:0 0 0 2024-04-23T10:21:35.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/750: rmdir d9/df/d16/d34/d84 39 2024-04-23T10:21:35.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/751: dread - d9/df/d16/d34/ff7 zero size 2024-04-23T10:21:35.356 INFO:tasks.workunit.client.0.smithi029.stdout:6/752: symlink d9/df/d16/d44/lfc 0 2024-04-23T10:21:35.358 INFO:tasks.workunit.client.0.smithi029.stdout:6/753: readlink d9/df/d16/d1f/d27/d33/da4/d66/l8e 0 2024-04-23T10:21:35.360 INFO:tasks.workunit.client.0.smithi029.stdout:6/754: readlink d9/df/d16/d34/d36/d63/ld2 0 2024-04-23T10:21:35.369 INFO:tasks.workunit.client.0.smithi029.stdout:6/755: dwrite d9/df/d41/d49/d69/fc4 [0,4194304] 0 2024-04-23T10:21:36.181 INFO:tasks.workunit.client.0.smithi029.stdout:5/642: sync 2024-04-23T10:21:36.185 INFO:tasks.workunit.client.0.smithi029.stdout:5/643: rmdir d0/d35/d38/d3e/d66 39 2024-04-23T10:21:36.202 INFO:tasks.workunit.client.0.smithi029.stdout:5/644: write d0/d35/d38/d3e/d66/d5a/f80 [940645,22266] 0 2024-04-23T10:21:36.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/645: link d0/d35/d38/d39/f94 d0/d35/d38/d3e/d66/fd1 0 2024-04-23T10:21:36.231 INFO:tasks.workunit.client.0.smithi029.stdout:5/646: write d0/d35/d38/d3e/d66/f6c [3338470,113847] 0 2024-04-23T10:21:36.259 INFO:tasks.workunit.client.0.smithi029.stdout:5/647: dwrite d0/d35/d38/d39/d3f/fc0 [0,4194304] 0 2024-04-23T10:21:36.270 INFO:tasks.workunit.client.0.smithi029.stdout:5/648: write d0/d35/d38/d3e/d66/f82 [769535,1982] 0 2024-04-23T10:21:36.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/649: symlink d0/d35/da1/ld2 0 2024-04-23T10:21:36.288 INFO:tasks.workunit.client.0.smithi029.stdout:5/650: stat d0/d35/d38/d39/f73 0 2024-04-23T10:21:36.722 INFO:tasks.workunit.client.0.smithi029.stdout:0/480: sync 2024-04-23T10:21:36.730 INFO:tasks.workunit.client.0.smithi029.stdout:0/481: mknod d0/dc/d26/d44/d5c/d6a/ca2 0 2024-04-23T10:21:36.759 INFO:tasks.workunit.client.0.smithi029.stdout:0/482: dwrite d0/dc/d26/d44/d4c/f9c [0,4194304] 0 2024-04-23T10:21:36.792 INFO:tasks.workunit.client.0.smithi029.stdout:0/483: dwrite d0/d1b/d67/f8c [0,4194304] 0 2024-04-23T10:21:36.823 INFO:tasks.workunit.client.0.smithi029.stdout:0/484: dwrite d0/d3e/d4e/d7c/f9a [0,4194304] 0 2024-04-23T10:21:36.828 INFO:tasks.workunit.client.0.smithi029.stdout:2/566: sync 2024-04-23T10:21:36.832 INFO:tasks.workunit.client.0.smithi029.stdout:0/485: creat d0/d3e/d4e/d7c/fa3 x:0 0 0 2024-04-23T10:21:36.833 INFO:tasks.workunit.client.0.smithi029.stdout:2/567: chown d1/c24 2 1 2024-04-23T10:21:36.834 INFO:tasks.workunit.client.0.smithi029.stdout:0/486: fdatasync d0/dc/f16 0 2024-04-23T10:21:36.859 INFO:tasks.workunit.client.0.smithi029.stdout:2/568: dwrite d1/dd/d22/f54 [0,4194304] 0 2024-04-23T10:21:36.866 INFO:tasks.workunit.client.0.smithi029.stdout:2/569: fdatasync d1/d3e/d5a/d6d/fa1 0 2024-04-23T10:21:36.868 INFO:tasks.workunit.client.0.smithi029.stdout:2/570: chown d1/d3e/d5a 726 1 2024-04-23T10:21:36.880 INFO:tasks.workunit.client.0.smithi029.stdout:3/544: sync 2024-04-23T10:21:36.881 INFO:tasks.workunit.client.0.smithi029.stdout:6/756: sync 2024-04-23T10:21:36.881 INFO:tasks.workunit.client.0.smithi029.stdout:1/491: sync 2024-04-23T10:21:36.881 INFO:tasks.workunit.client.0.smithi029.stdout:9/787: sync 2024-04-23T10:21:36.881 INFO:tasks.workunit.client.0.smithi029.stdout:4/659: sync 2024-04-23T10:21:36.881 INFO:tasks.workunit.client.0.smithi029.stdout:8/622: sync 2024-04-23T10:21:36.881 INFO:tasks.workunit.client.0.smithi029.stdout:7/706: sync 2024-04-23T10:21:36.881 INFO:tasks.workunit.client.0.smithi029.stdout:5/651: sync 2024-04-23T10:21:36.881 INFO:tasks.workunit.client.0.smithi029.stdout:0/487: dread d0/f6 [0,4194304] 0 2024-04-23T10:21:36.882 INFO:tasks.workunit.client.0.smithi029.stdout:2/571: truncate d1/d31/d3d/f74 467639 0 2024-04-23T10:21:36.894 INFO:tasks.workunit.client.0.smithi029.stdout:0/488: rmdir d0/dc/d26/d44 39 2024-04-23T10:21:36.899 INFO:tasks.workunit.client.0.smithi029.stdout:1/492: write d5/d6/ff [697900,8599] 0 2024-04-23T10:21:36.902 INFO:tasks.workunit.client.0.smithi029.stdout:3/545: write d3/f2a [1024920,20445] 0 2024-04-23T10:21:36.905 INFO:tasks.workunit.client.0.smithi029.stdout:9/788: truncate d0/d7/d3f/f96 658569 0 2024-04-23T10:21:36.909 INFO:tasks.workunit.client.0.smithi029.stdout:7/707: fsync d5/d8/fc 0 2024-04-23T10:21:36.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/708: write d5/d8/d51/fe7 [976975,9167] 0 2024-04-23T10:21:36.912 INFO:tasks.workunit.client.0.smithi029.stdout:4/660: mkdir d0/d3c/de5 0 2024-04-23T10:21:36.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/572: write d1/dd/d47/d63/d64/fb4 [745401,125795] 0 2024-04-23T10:21:36.939 INFO:tasks.workunit.client.0.smithi029.stdout:6/757: creat d9/df/d16/d34/ffd x:0 0 0 2024-04-23T10:21:36.944 INFO:tasks.workunit.client.0.smithi029.stdout:8/623: creat d3/d50/d6a/d95/d36/d97/fc4 x:0 0 0 2024-04-23T10:21:36.947 INFO:tasks.workunit.client.0.smithi029.stdout:0/489: mkdir d0/d3e/d4e/d50/d71/da4 0 2024-04-23T10:21:36.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/546: unlink d3/d10/de/d2e/c78 0 2024-04-23T10:21:36.959 INFO:tasks.workunit.client.0.smithi029.stdout:4/661: fdatasync d0/f3f 0 2024-04-23T10:21:36.965 INFO:tasks.workunit.client.0.smithi029.stdout:1/493: creat d5/fa0 x:0 0 0 2024-04-23T10:21:36.965 INFO:tasks.workunit.client.0.smithi029.stdout:1/494: chown d5/d6/de/d22/d77/c9d 70 1 2024-04-23T10:21:36.968 INFO:tasks.workunit.client.0.smithi029.stdout:5/652: unlink d0/d35/d10/d26/db2/f9e 0 2024-04-23T10:21:36.975 INFO:tasks.workunit.client.0.smithi029.stdout:9/789: creat d0/d7/f116 x:0 0 0 2024-04-23T10:21:36.983 INFO:tasks.workunit.client.0.smithi029.stdout:8/624: mknod d3/d50/d6a/d95/d36/d3e/cc5 0 2024-04-23T10:21:36.986 INFO:tasks.workunit.client.0.smithi029.stdout:6/758: truncate d9/df/d16/d1f/d27/d33/da4/d66/d95/faa 411638 0 2024-04-23T10:21:36.994 INFO:tasks.workunit.client.0.smithi029.stdout:2/573: creat d1/d31/fbf x:0 0 0 2024-04-23T10:21:36.999 INFO:tasks.workunit.client.0.smithi029.stdout:7/709: creat d5/d71/d92/db7/dc3/dcc/feb x:0 0 0 2024-04-23T10:21:37.002 INFO:tasks.workunit.client.0.smithi029.stdout:8/625: dread - d3/f30 zero size 2024-04-23T10:21:37.006 INFO:tasks.workunit.client.0.smithi029.stdout:0/490: write d0/d21/d7f/f8f [252924,17337] 0 2024-04-23T10:21:37.009 INFO:tasks.workunit.client.0.smithi029.stdout:5/653: symlink d0/d35/d38/ld3 0 2024-04-23T10:21:37.013 INFO:tasks.workunit.client.0.smithi029.stdout:7/710: creat d5/d8/d51/d9e/db2/fec x:0 0 0 2024-04-23T10:21:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:3/547: dwrite d3/f69 [0,4194304] 0 2024-04-23T10:21:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:6/759: mknod d9/df/d25/cfe 0 2024-04-23T10:21:37.017 INFO:tasks.workunit.client.0.smithi029.stdout:7/711: read d5/dc8/fd8 [4092153,118440] 0 2024-04-23T10:21:37.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/495: creat d5/d6/de/d22/d6c/fa1 x:0 0 0 2024-04-23T10:21:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:7/712: chown d5/d8/f32 1846673 1 2024-04-23T10:21:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:6/760: symlink d9/df/d41/d49/lff 0 2024-04-23T10:21:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:1/496: dread d5/d6/de/d15/d7b/f82 [0,4194304] 0 2024-04-23T10:21:37.031 INFO:tasks.workunit.client.0.smithi029.stdout:3/548: dread - d3/d15/d4b/f50 zero size 2024-04-23T10:21:37.032 INFO:tasks.workunit.client.0.smithi029.stdout:0/491: symlink d0/dc/d26/d44/d4c/d6d/la5 0 2024-04-23T10:21:37.034 INFO:tasks.workunit.client.0.smithi029.stdout:4/662: link d0/d3c/d52/d1b/l2f d0/d3c/d52/d1b/d9f/d92/dd8/d7a/le6 0 2024-04-23T10:21:37.036 INFO:tasks.workunit.client.0.smithi029.stdout:3/549: chown d3/d10/fa1 0 1 2024-04-23T10:21:37.045 INFO:tasks.workunit.client.0.smithi029.stdout:4/663: read d0/d3c/fc9 [68450,122435] 0 2024-04-23T10:21:37.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/654: link d0/d35/d38/d39/f73 d0/d35/d10/d26/db2/fd4 0 2024-04-23T10:21:37.046 INFO:tasks.workunit.client.0.smithi029.stdout:8/626: write d3/d50/d6a/d95/d36/d68/f8b [1032828,63651] 0 2024-04-23T10:21:37.050 INFO:tasks.workunit.client.0.smithi029.stdout:7/713: write d5/d8/d1a/d4d/f52 [1952364,23625] 0 2024-04-23T10:21:37.056 INFO:tasks.workunit.client.0.smithi029.stdout:6/761: unlink d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/fac 0 2024-04-23T10:21:37.058 INFO:tasks.workunit.client.0.smithi029.stdout:3/550: mknod d3/d45/d4f/d6b/cc9 0 2024-04-23T10:21:37.059 INFO:tasks.workunit.client.0.smithi029.stdout:8/627: truncate d3/f67 609627 0 2024-04-23T10:21:37.061 INFO:tasks.workunit.client.0.smithi029.stdout:4/664: rename d0/d3c/d52/d1b/d36/d45/d4f/c94 to d0/d3c/d52/d1b/d9f/d92/ce7 0 2024-04-23T10:21:37.063 INFO:tasks.workunit.client.0.smithi029.stdout:6/762: creat d9/df/d16/d1f/d27/f100 x:0 0 0 2024-04-23T10:21:37.063 INFO:tasks.workunit.client.0.smithi029.stdout:5/655: mknod d0/d35/d83/cd5 0 2024-04-23T10:21:37.064 INFO:tasks.workunit.client.0.smithi029.stdout:1/497: getdents d5/d6/de/d27/d38/d47 0 2024-04-23T10:21:37.067 INFO:tasks.workunit.client.0.smithi029.stdout:6/763: stat d9/df/d16/f2e 0 2024-04-23T10:21:37.068 INFO:tasks.workunit.client.0.smithi029.stdout:4/665: read d0/d3c/d52/d20/f57 [3204674,36032] 0 2024-04-23T10:21:37.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/628: fsync d3/d50/d6a/d95/d36/d68/f87 0 2024-04-23T10:21:37.074 INFO:tasks.workunit.client.0.smithi029.stdout:1/498: rmdir d5/d3e 39 2024-04-23T10:21:37.075 INFO:tasks.workunit.client.0.smithi029.stdout:6/764: read d9/df/f13 [2219971,38014] 0 2024-04-23T10:21:37.075 INFO:tasks.workunit.client.0.smithi029.stdout:4/666: chown d0/d3c/d52/d1b/d36/d45/l4e 1662 1 2024-04-23T10:21:37.079 INFO:tasks.workunit.client.0.smithi029.stdout:7/714: rename d5/d8/d1a to d5/d29/ded 0 2024-04-23T10:21:37.084 INFO:tasks.workunit.client.0.smithi029.stdout:8/629: unlink d3/d50/d6a/d95/d36/d68/f8b 0 2024-04-23T10:21:37.092 INFO:tasks.workunit.client.0.smithi029.stdout:8/630: rmdir d3/d50/d6a/d95/d36/d3e 39 2024-04-23T10:21:37.097 INFO:tasks.workunit.client.0.smithi029.stdout:8/631: rename d3/d50 to d3/d50/d6a/d95/d36/d97/da4/dc6 22 2024-04-23T10:21:37.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/499: creat d5/d6/d34/d63/fa2 x:0 0 0 2024-04-23T10:21:37.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/656: dwrite d0/d35/d10/d26/db2/fd4 [0,4194304] 0 2024-04-23T10:21:37.101 INFO:tasks.workunit.client.0.smithi029.stdout:3/551: dwrite d3/d45/d4f/f6e [0,4194304] 0 2024-04-23T10:21:37.103 INFO:tasks.workunit.client.0.smithi029.stdout:1/500: chown d5/d6/f19 25562109 1 2024-04-23T10:21:37.106 INFO:tasks.workunit.client.0.smithi029.stdout:8/632: read d3/d50/d6a/d95/f88 [558523,23412] 0 2024-04-23T10:21:37.106 INFO:tasks.workunit.client.0.smithi029.stdout:4/667: creat d0/d12/da9/fe8 x:0 0 0 2024-04-23T10:21:37.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/657: chown d0/d35/d10/d26/db2/cc1 0 1 2024-04-23T10:21:37.109 INFO:tasks.workunit.client.0.smithi029.stdout:3/552: chown d3/d10/de/l1b 209 1 2024-04-23T10:21:37.122 INFO:tasks.workunit.client.0.smithi029.stdout:8/633: fsync d3/d50/d6a/d95/d36/d3e/f4f 0 2024-04-23T10:21:37.122 INFO:tasks.workunit.client.0.smithi029.stdout:5/658: symlink d0/d35/d10/d26/db2/ld6 0 2024-04-23T10:21:37.123 INFO:tasks.workunit.client.0.smithi029.stdout:3/553: readlink d3/d10/d48/l8f 0 2024-04-23T10:21:37.128 INFO:tasks.workunit.client.0.smithi029.stdout:1/501: dwrite d5/d6/de/d22/f5e [0,4194304] 0 2024-04-23T10:21:37.129 INFO:tasks.workunit.client.0.smithi029.stdout:4/668: write d0/d3c/d52/d1b/d5b/d65/f6d [1498559,15125] 0 2024-04-23T10:21:37.136 INFO:tasks.workunit.client.0.smithi029.stdout:4/669: fdatasync d0/d3c/d52/f75 0 2024-04-23T10:21:37.142 INFO:tasks.workunit.client.0.smithi029.stdout:3/554: write d3/f63 [2201065,64214] 0 2024-04-23T10:21:37.143 INFO:tasks.workunit.client.0.smithi029.stdout:7/715: read d5/d29/f3b [3605710,101174] 0 2024-04-23T10:21:37.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/670: creat d0/fe9 x:0 0 0 2024-04-23T10:21:37.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/502: link d5/d6/de/d27/d38/f67 d5/fa3 0 2024-04-23T10:21:37.148 INFO:tasks.workunit.client.0.smithi029.stdout:7/716: chown d5/fbc 330571 1 2024-04-23T10:21:37.150 INFO:tasks.workunit.client.0.smithi029.stdout:3/555: symlink d3/d10/de/d2e/daa/lca 0 2024-04-23T10:21:37.151 INFO:tasks.workunit.client.0.smithi029.stdout:8/634: dwrite d3/d38/fb0 [0,4194304] 0 2024-04-23T10:21:37.154 INFO:tasks.workunit.client.0.smithi029.stdout:4/671: read d0/d3c/d52/d74/d8a/fb4 [2900217,42819] 0 2024-04-23T10:21:37.154 INFO:tasks.workunit.client.0.smithi029.stdout:5/659: dwrite d0/d6a/f7f [0,4194304] 0 2024-04-23T10:21:37.154 INFO:tasks.workunit.client.0.smithi029.stdout:7/717: symlink d5/d29/lee 0 2024-04-23T10:21:37.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/503: mknod d5/d6/de/d27/d38/d47/ca4 0 2024-04-23T10:21:37.163 INFO:tasks.workunit.client.0.smithi029.stdout:7/718: unlink d5/d29/ded/d4d/fcd 0 2024-04-23T10:21:37.165 INFO:tasks.workunit.client.0.smithi029.stdout:1/504: read d5/d6/d34/d63/f7d [530970,32369] 0 2024-04-23T10:21:37.168 INFO:tasks.workunit.client.0.smithi029.stdout:5/660: dread d0/d35/d10/d26/db2/fd4 [0,4194304] 0 2024-04-23T10:21:37.170 INFO:tasks.workunit.client.0.smithi029.stdout:3/556: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d31/f1a [0,4194304] 0 2024-04-23T10:21:37.172 INFO:tasks.workunit.client.0.smithi029.stdout:4/672: mknod d0/d3c/d52/d1b/d9f/d92/da3/cea 0 2024-04-23T10:21:37.173 INFO:tasks.workunit.client.0.smithi029.stdout:5/661: readlink d0/l1 0 2024-04-23T10:21:37.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/557: chown d3/d10/de/d2e/d36/d40/d46/d72/d31/c8c 1809 1 2024-04-23T10:21:37.175 INFO:tasks.workunit.client.0.smithi029.stdout:1/505: mkdir d5/d6/da5 0 2024-04-23T10:21:37.177 INFO:tasks.workunit.client.0.smithi029.stdout:5/662: dread - d0/f65 zero size 2024-04-23T10:21:37.178 INFO:tasks.workunit.client.0.smithi029.stdout:4/673: mknod d0/d3c/d52/d1b/d9f/d92/da3/ceb 0 2024-04-23T10:21:37.179 INFO:tasks.workunit.client.0.smithi029.stdout:1/506: chown d5/d6/de/l97 241750057 1 2024-04-23T10:21:37.180 INFO:tasks.workunit.client.0.smithi029.stdout:3/558: fdatasync d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7/dab/fc0 0 2024-04-23T10:21:37.182 INFO:tasks.workunit.client.0.smithi029.stdout:7/719: rename d5/d8/d51/d55/cbf to d5/d29/d4a/cef 0 2024-04-23T10:21:37.188 INFO:tasks.workunit.client.0.smithi029.stdout:1/507: dread - d5/d6/f7c zero size 2024-04-23T10:21:37.188 INFO:tasks.workunit.client.0.smithi029.stdout:4/674: mknod d0/d3c/d52/d1b/d36/d45/d68/d98/cec 0 2024-04-23T10:21:37.190 INFO:tasks.workunit.client.0.smithi029.stdout:7/720: mkdir d5/d29/df0 0 2024-04-23T10:21:37.194 INFO:tasks.workunit.client.0.smithi029.stdout:1/508: unlink d5/d6/de/c81 0 2024-04-23T10:21:37.194 INFO:tasks.workunit.client.0.smithi029.stdout:4/675: mknod d0/d3c/d52/d1b/d36/ced 0 2024-04-23T10:21:37.195 INFO:tasks.workunit.client.0.smithi029.stdout:7/721: mknod d5/d71/cf1 0 2024-04-23T10:21:37.196 INFO:tasks.workunit.client.0.smithi029.stdout:5/663: dread d0/d35/d38/d3e/d66/d5a/d78/d3d/fbe [0,4194304] 0 2024-04-23T10:21:37.196 INFO:tasks.workunit.client.0.smithi029.stdout:4/676: stat d0/d3c/d52/d1b/d36/c8b 0 2024-04-23T10:21:37.197 INFO:tasks.workunit.client.0.smithi029.stdout:3/559: link d3/d10/de/d2e/d36/d40/d46/d72/c3f d3/d10/de/d2e/d36/d8a/ccb 0 2024-04-23T10:21:37.203 INFO:tasks.workunit.client.0.smithi029.stdout:3/560: unlink d3/d10/de/c6c 0 2024-04-23T10:21:37.206 INFO:tasks.workunit.client.0.smithi029.stdout:8/635: write d3/d50/d6a/d95/d36/d68/f6d [694287,25856] 0 2024-04-23T10:21:37.207 INFO:tasks.workunit.client.0.smithi029.stdout:9/790: sync 2024-04-23T10:21:37.209 INFO:tasks.workunit.client.0.smithi029.stdout:4/677: rename d0/d3c/d52/d1b/d36/d45/d4f/f7f to d0/d3c/d52/d74/d8a/dba/fee 0 2024-04-23T10:21:37.210 INFO:tasks.workunit.client.0.smithi029.stdout:9/791: rmdir d0/d7/d1d/d35/dd9/d49 39 2024-04-23T10:21:37.212 INFO:tasks.workunit.client.0.smithi029.stdout:1/509: dread d5/d6/f61 [0,4194304] 0 2024-04-23T10:21:37.214 INFO:tasks.workunit.client.0.smithi029.stdout:3/561: link d3/d45/fc7 d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/fcc 0 2024-04-23T10:21:37.232 INFO:tasks.workunit.client.0.smithi029.stdout:9/792: mknod d0/d1b/d39/d50/d67/db6/d10f/c117 0 2024-04-23T10:21:37.233 INFO:tasks.workunit.client.0.smithi029.stdout:1/510: readlink d5/d6/de/d27/d38/l3f 0 2024-04-23T10:21:37.233 INFO:tasks.workunit.client.0.smithi029.stdout:3/562: dread - d3/d15/fb0 zero size 2024-04-23T10:21:37.236 INFO:tasks.workunit.client.0.smithi029.stdout:1/511: dread d5/d6/f74 [0,4194304] 0 2024-04-23T10:21:37.239 INFO:tasks.workunit.client.0.smithi029.stdout:9/793: creat d0/d7/d1d/d35/dd9/d49/f118 x:0 0 0 2024-04-23T10:21:37.242 INFO:tasks.workunit.client.0.smithi029.stdout:4/678: dread d0/d12/f5f [0,4194304] 0 2024-04-23T10:21:37.245 INFO:tasks.workunit.client.0.smithi029.stdout:4/679: write d0/d3c/d52/d74/d91/fcd [787020,20948] 0 2024-04-23T10:21:37.248 INFO:tasks.workunit.client.0.smithi029.stdout:8/636: dread d3/d50/d6a/d95/d36/d3e/f41 [4194304,4194304] 0 2024-04-23T10:21:37.249 INFO:tasks.workunit.client.0.smithi029.stdout:9/794: rename d0/d7/d1d/d35/d3b/d68/dbd/ced to d0/d7/d1d/d35/d3b/c119 0 2024-04-23T10:21:37.252 INFO:tasks.workunit.client.0.smithi029.stdout:9/795: write d0/d7/d1d/d35/dd5/df2/f101 [1046957,103834] 0 2024-04-23T10:21:37.256 INFO:tasks.workunit.client.0.smithi029.stdout:4/680: creat d0/d3c/d52/d1b/d36/d45/d68/fef x:0 0 0 2024-04-23T10:21:37.258 INFO:tasks.workunit.client.0.smithi029.stdout:9/796: readlink d0/d7/lb2 0 2024-04-23T10:21:37.261 INFO:tasks.workunit.client.0.smithi029.stdout:1/512: dread d5/f70 [0,4194304] 0 2024-04-23T10:21:37.262 INFO:tasks.workunit.client.0.smithi029.stdout:5/664: dwrite d0/f40 [0,4194304] 0 2024-04-23T10:21:37.262 INFO:tasks.workunit.client.0.smithi029.stdout:7/722: rename d5/d29/ded/c4b to d5/d71/d92/dda/cf2 0 2024-04-23T10:21:37.263 INFO:tasks.workunit.client.0.smithi029.stdout:4/681: rename d0/d3c/d52/d20 to d0/d3c/d52/d20/df0 22 2024-04-23T10:21:37.265 INFO:tasks.workunit.client.0.smithi029.stdout:5/665: chown d0/d6a/f7f 98 1 2024-04-23T10:21:37.267 INFO:tasks.workunit.client.0.smithi029.stdout:9/797: rename d0/d7/f17 to d0/d1b/d24/f11a 0 2024-04-23T10:21:37.270 INFO:tasks.workunit.client.0.smithi029.stdout:3/563: dwrite d3/d10/de/d2e/d36/f39 [0,4194304] 0 2024-04-23T10:21:37.270 INFO:tasks.workunit.client.0.smithi029.stdout:5/666: mkdir d0/d6a/dd7 0 2024-04-23T10:21:37.277 INFO:tasks.workunit.client.0.smithi029.stdout:4/682: rename d0/d3c/d52/d20/c71 to d0/d3c/d52/d1b/d5b/d65/d6a/dda/cf1 0 2024-04-23T10:21:37.277 INFO:tasks.workunit.client.0.smithi029.stdout:9/798: mknod d0/d1b/d39/d50/c11b 0 2024-04-23T10:21:37.281 INFO:tasks.workunit.client.0.smithi029.stdout:5/667: symlink d0/d35/d38/d3e/d66/d5a/ld8 0 2024-04-23T10:21:37.287 INFO:tasks.workunit.client.0.smithi029.stdout:9/799: chown d0/d7/d3f/f53 250698062 1 2024-04-23T10:21:37.287 INFO:tasks.workunit.client.0.smithi029.stdout:4/683: write d0/d3c/d52/f42 [4382271,113944] 0 2024-04-23T10:21:37.290 INFO:tasks.workunit.client.0.smithi029.stdout:4/684: mkdir d0/d3c/d52/d1b/d36/d45/d4f/df2 0 2024-04-23T10:21:37.291 INFO:tasks.workunit.client.0.smithi029.stdout:9/800: creat d0/d7/d1d/d35/d3b/db8/f11c x:0 0 0 2024-04-23T10:21:37.291 INFO:tasks.workunit.client.0.smithi029.stdout:4/685: write d0/d3c/d52/d1b/f39 [3974667,29127] 0 2024-04-23T10:21:37.294 INFO:tasks.workunit.client.0.smithi029.stdout:8/637: write d3/d50/d6a/d95/d36/d68/f87 [941921,24194] 0 2024-04-23T10:21:37.300 INFO:tasks.workunit.client.0.smithi029.stdout:1/513: write d5/d6/de/d27/d38/d47/f79 [59891,28543] 0 2024-04-23T10:21:37.301 INFO:tasks.workunit.client.0.smithi029.stdout:1/514: chown d5/d6/de/d27/d38/l3f 7331639 1 2024-04-23T10:21:37.306 INFO:tasks.workunit.client.0.smithi029.stdout:8/638: dread d3/d50/d6a/d95/f39 [4194304,4194304] 0 2024-04-23T10:21:37.309 INFO:tasks.workunit.client.0.smithi029.stdout:8/639: mknod d3/d44/cc7 0 2024-04-23T10:21:37.310 INFO:tasks.workunit.client.0.smithi029.stdout:8/640: write d3/fd [3335585,17616] 0 2024-04-23T10:21:37.311 INFO:tasks.workunit.client.0.smithi029.stdout:1/515: dread d5/d6/de/d27/d38/f44 [0,4194304] 0 2024-04-23T10:21:37.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/668: dread d0/f75 [0,4194304] 0 2024-04-23T10:21:37.316 INFO:tasks.workunit.client.0.smithi029.stdout:3/564: write d3/d45/f4a [2819830,24673] 0 2024-04-23T10:21:37.318 INFO:tasks.workunit.client.0.smithi029.stdout:5/669: creat d0/d35/d38/d39/dcb/fd9 x:0 0 0 2024-04-23T10:21:37.320 INFO:tasks.workunit.client.0.smithi029.stdout:9/801: write d0/d7/d6/fe [3750650,14893] 0 2024-04-23T10:21:37.323 INFO:tasks.workunit.client.0.smithi029.stdout:3/565: fdatasync d3/d10/de/d2e/d36/d40/f7e 0 2024-04-23T10:21:37.325 INFO:tasks.workunit.client.0.smithi029.stdout:9/802: chown d0/d7/d1d/c87 1216999 1 2024-04-23T10:21:37.325 INFO:tasks.workunit.client.0.smithi029.stdout:3/566: write f0 [540531,31272] 0 2024-04-23T10:21:37.327 INFO:tasks.workunit.client.0.smithi029.stdout:5/670: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6 434934878 1 2024-04-23T10:21:37.331 INFO:tasks.workunit.client.0.smithi029.stdout:3/567: creat d3/d10/de/d2e/d36/d40/d46/fcd x:0 0 0 2024-04-23T10:21:37.331 INFO:tasks.workunit.client.0.smithi029.stdout:5/671: write d0/d35/d38/d3e/d66/f6c [1079804,59763] 0 2024-04-23T10:21:37.334 INFO:tasks.workunit.client.0.smithi029.stdout:8/641: dwrite d3/d50/d6a/f70 [0,4194304] 0 2024-04-23T10:21:37.336 INFO:tasks.workunit.client.0.smithi029.stdout:3/568: unlink d3/d10/de/f12 0 2024-04-23T10:21:37.336 INFO:tasks.workunit.client.0.smithi029.stdout:1/516: write d5/d3e/f54 [665415,73485] 0 2024-04-23T10:21:37.340 INFO:tasks.workunit.client.0.smithi029.stdout:1/517: truncate d5/d6/f7c 28006 0 2024-04-23T10:21:37.341 INFO:tasks.workunit.client.0.smithi029.stdout:3/569: mknod d3/d45/d4f/d6b/cce 0 2024-04-23T10:21:37.345 INFO:tasks.workunit.client.0.smithi029.stdout:9/803: dread d0/f11 [0,4194304] 0 2024-04-23T10:21:37.348 INFO:tasks.workunit.client.0.smithi029.stdout:3/570: link d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/c9d d3/d15/d4b/d52/ccf 0 2024-04-23T10:21:37.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/804: creat d0/d7/d1d/d35/d3b/f11d x:0 0 0 2024-04-23T10:21:37.351 INFO:tasks.workunit.client.0.smithi029.stdout:9/805: truncate d0/d1b/ff6 778999 0 2024-04-23T10:21:37.352 INFO:tasks.workunit.client.0.smithi029.stdout:9/806: dread - d0/d7/d1d/d35/dd9/ffd zero size 2024-04-23T10:21:37.358 INFO:tasks.workunit.client.0.smithi029.stdout:8/642: write d3/d50/d6a/d95/d36/d3e/fc2 [83452,58857] 0 2024-04-23T10:21:37.363 INFO:tasks.workunit.client.0.smithi029.stdout:8/643: creat d3/d7d/fc8 x:0 0 0 2024-04-23T10:21:37.365 INFO:tasks.workunit.client.0.smithi029.stdout:8/644: readlink d3/d44/l69 0 2024-04-23T10:21:37.367 INFO:tasks.workunit.client.0.smithi029.stdout:3/571: write d3/d45/d4f/d6b/f74 [5117136,38229] 0 2024-04-23T10:21:37.367 INFO:tasks.workunit.client.0.smithi029.stdout:8/645: chown d3/d50/d6a/d95/d36/f3b 4984945 1 2024-04-23T10:21:37.369 INFO:tasks.workunit.client.0.smithi029.stdout:3/572: chown d3/d10/de/d2e/f2f 4039 1 2024-04-23T10:21:37.371 INFO:tasks.workunit.client.0.smithi029.stdout:8/646: rename d3/d38/fb0 to d3/d50/d6a/d95/d36/d94/fc9 0 2024-04-23T10:21:37.373 INFO:tasks.workunit.client.0.smithi029.stdout:3/573: mknod d3/d10/de/d2e/d36/d40/d46/d72/d28/cd0 0 2024-04-23T10:21:37.374 INFO:tasks.workunit.client.0.smithi029.stdout:8/647: creat d3/d44/db1/fca x:0 0 0 2024-04-23T10:21:37.378 INFO:tasks.workunit.client.0.smithi029.stdout:3/574: truncate d3/d10/f6d 637009 0 2024-04-23T10:21:37.378 INFO:tasks.workunit.client.0.smithi029.stdout:8/648: fsync d3/d50/d6a/d95/d36/d3e/f60 0 2024-04-23T10:21:37.380 INFO:tasks.workunit.client.0.smithi029.stdout:9/807: dwrite d0/d7/d1d/d35/dde/f94 [0,4194304] 0 2024-04-23T10:21:37.385 INFO:tasks.workunit.client.0.smithi029.stdout:3/575: symlink d3/d10/de/d2e/d36/d40/d46/d72/ld1 0 2024-04-23T10:21:37.390 INFO:tasks.workunit.client.0.smithi029.stdout:8/649: rename d3/d50/d6a/d95/d36/d68/d8c/cab to d3/d50/d6a/d95/d36/d97/da4/ccb 0 2024-04-23T10:21:37.391 INFO:tasks.workunit.client.0.smithi029.stdout:3/576: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2 0 2024-04-23T10:21:37.406 INFO:tasks.workunit.client.0.smithi029.stdout:8/650: symlink d3/d50/d6a/d95/d36/d97/da4/lcc 0 2024-04-23T10:21:37.406 INFO:tasks.workunit.client.0.smithi029.stdout:3/577: write d3/d10/de/d2e/d36/d40/d46/d72/d28/f8e [768552,72314] 0 2024-04-23T10:21:37.413 INFO:tasks.workunit.client.0.smithi029.stdout:9/808: dread d0/d7/d1d/d35/dde/dba/fc2 [0,4194304] 0 2024-04-23T10:21:37.415 INFO:tasks.workunit.client.0.smithi029.stdout:9/809: symlink d0/d7/d1d/d35/d3b/db8/l11e 0 2024-04-23T10:21:37.416 INFO:tasks.workunit.client.0.smithi029.stdout:3/578: write d3/d10/de/d2e/d36/d40/d46/f4d [4841258,107409] 0 2024-04-23T10:21:37.416 INFO:tasks.workunit.client.0.smithi029.stdout:9/810: chown d0/d7/d1d/d35/c77 4539 1 2024-04-23T10:21:37.422 INFO:tasks.workunit.client.0.smithi029.stdout:9/811: link d0/d7/d1d/d35/dd9/d49/d65/f8a d0/d1b/f11f 0 2024-04-23T10:21:37.424 INFO:tasks.workunit.client.0.smithi029.stdout:9/812: rename d0/d7/d1d/d35/d3b/db8 to d0/d7/d1d/d35/d3b/db8/d120 22 2024-04-23T10:21:37.426 INFO:tasks.workunit.client.0.smithi029.stdout:9/813: symlink d0/d7/d1d/d35/dd5/dec/l121 0 2024-04-23T10:21:37.427 INFO:tasks.workunit.client.0.smithi029.stdout:9/814: chown d0/d1b/d60/dbf/f110 0 1 2024-04-23T10:21:37.455 INFO:tasks.workunit.client.0.smithi029.stdout:2/574: sync 2024-04-23T10:21:37.456 INFO:tasks.workunit.client.0.smithi029.stdout:2/575: fdatasync d1/d3e/d5a/d6d/fbe 0 2024-04-23T10:21:37.639 INFO:tasks.workunit.client.0.smithi029.stdout:3/579: write d3/d15/f5d [655560,72732] 0 2024-04-23T10:21:37.640 INFO:tasks.workunit.client.0.smithi029.stdout:3/580: readlink d3/d10/d48/l8f 0 2024-04-23T10:21:37.658 INFO:tasks.workunit.client.0.smithi029.stdout:3/581: write d3/d10/de/d2e/d36/d40/d46/d65/f98 [801966,73963] 0 2024-04-23T10:21:37.668 INFO:tasks.workunit.client.0.smithi029.stdout:3/582: truncate d3/d10/de/d2e/d36/d40/f99 215571 0 2024-04-23T10:21:37.677 INFO:tasks.workunit.client.0.smithi029.stdout:3/583: dread d3/f69 [0,4194304] 0 2024-04-23T10:21:37.749 INFO:tasks.workunit.client.0.smithi029.stdout:0/492: sync 2024-04-23T10:21:37.749 INFO:tasks.workunit.client.0.smithi029.stdout:6/765: sync 2024-04-23T10:21:37.773 INFO:tasks.workunit.client.0.smithi029.stdout:3/584: dwrite d3/d10/f58 [0,4194304] 0 2024-04-23T10:21:37.779 INFO:tasks.workunit.client.0.smithi029.stdout:0/493: link d0/dc/d26/d44/d4c/d6d/f82 d0/d3e/d4e/d50/d71/fa6 0 2024-04-23T10:21:37.793 INFO:tasks.workunit.client.0.smithi029.stdout:0/494: mkdir d0/dc/d26/d44/d4c/da7 0 2024-04-23T10:21:37.806 INFO:tasks.workunit.client.0.smithi029.stdout:3/585: link d3/d10/d48/ca6 d3/d10/de/d2e/d36/d40/cd3 0 2024-04-23T10:21:37.808 INFO:tasks.workunit.client.0.smithi029.stdout:3/586: read d3/d10/de/d2e/d36/f39 [2452982,5010] 0 2024-04-23T10:21:37.814 INFO:tasks.workunit.client.0.smithi029.stdout:0/495: creat d0/d3e/d4e/d50/d73/d7e/fa8 x:0 0 0 2024-04-23T10:21:37.821 INFO:tasks.workunit.client.0.smithi029.stdout:3/587: mkdir d3/d10/de/d2e/d36/d40/d46/dd4 0 2024-04-23T10:21:37.827 INFO:tasks.workunit.client.0.smithi029.stdout:3/588: chown d3/d10/de/d2e/d36/d40/d43/f57 367 1 2024-04-23T10:21:37.842 INFO:tasks.workunit.client.0.smithi029.stdout:0/496: rename d0/dc/d26/d44 to d0/da9 0 2024-04-23T10:21:37.852 INFO:tasks.workunit.client.0.smithi029.stdout:0/497: chown d0/dc/d26/f33 15 1 2024-04-23T10:21:37.852 INFO:tasks.workunit.client.0.smithi029.stdout:1/518: sync 2024-04-23T10:21:37.852 INFO:tasks.workunit.client.0.smithi029.stdout:8/651: sync 2024-04-23T10:21:37.852 INFO:tasks.workunit.client.0.smithi029.stdout:5/672: sync 2024-04-23T10:21:37.852 INFO:tasks.workunit.client.0.smithi029.stdout:2/576: sync 2024-04-23T10:21:37.853 INFO:tasks.workunit.client.0.smithi029.stdout:7/723: sync 2024-04-23T10:21:37.853 INFO:tasks.workunit.client.0.smithi029.stdout:9/815: sync 2024-04-23T10:21:37.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/686: sync 2024-04-23T10:21:37.856 INFO:tasks.workunit.client.0.smithi029.stdout:3/589: creat d3/d10/de/d2e/d36/d40/d46/d72/fd5 x:0 0 0 2024-04-23T10:21:37.857 INFO:tasks.workunit.client.0.smithi029.stdout:0/498: fdatasync d0/f4a 0 2024-04-23T10:21:37.858 INFO:tasks.workunit.client.0.smithi029.stdout:3/590: truncate f0 4847230 0 2024-04-23T10:21:37.858 INFO:tasks.workunit.client.0.smithi029.stdout:1/519: fsync d5/d6/de/d22/f5b 0 2024-04-23T10:21:37.864 INFO:tasks.workunit.client.0.smithi029.stdout:7/724: rmdir d5/d29/ded/d9c/dd3 39 2024-04-23T10:21:37.864 INFO:tasks.workunit.client.0.smithi029.stdout:7/725: chown d5/d29/d4a 16607952 1 2024-04-23T10:21:37.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/652: readlink d3/d50/d6a/d95/d36/d97/da4/lbc 0 2024-04-23T10:21:37.870 INFO:tasks.workunit.client.0.smithi029.stdout:9/816: symlink d0/d1b/d60/l122 0 2024-04-23T10:21:37.876 INFO:tasks.workunit.client.0.smithi029.stdout:0/499: read d0/f4f [46586,101446] 0 2024-04-23T10:21:37.881 INFO:tasks.workunit.client.0.smithi029.stdout:2/577: dwrite d1/dd/d22/f90 [0,4194304] 0 2024-04-23T10:21:37.884 INFO:tasks.workunit.client.0.smithi029.stdout:4/687: dread d0/d3c/d52/d74/d8a/fb4 [0,4194304] 0 2024-04-23T10:21:37.885 INFO:tasks.workunit.client.0.smithi029.stdout:5/673: mkdir d0/d35/d38/d3e/d66/d8c/dda 0 2024-04-23T10:21:37.887 INFO:tasks.workunit.client.0.smithi029.stdout:8/653: mkdir d3/d50/d6a/d95/d36/d94/dcd 0 2024-04-23T10:21:37.893 INFO:tasks.workunit.client.0.smithi029.stdout:3/591: creat d3/d45/d4f/fd6 x:0 0 0 2024-04-23T10:21:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:1/520: creat d5/d6/de/d27/d38/d47/fa6 x:0 0 0 2024-04-23T10:21:37.898 INFO:tasks.workunit.client.0.smithi029.stdout:9/817: truncate d0/fee 986574 0 2024-04-23T10:21:37.898 INFO:tasks.workunit.client.0.smithi029.stdout:9/818: dread - d0/d7/d1d/d35/d3b/db8/f113 zero size 2024-04-23T10:21:37.910 INFO:tasks.workunit.client.0.smithi029.stdout:1/521: readlink d5/d6/d34/l36 0 2024-04-23T10:21:37.916 INFO:tasks.workunit.client.0.smithi029.stdout:2/578: dwrite d1/f2e [0,4194304] 0 2024-04-23T10:21:37.920 INFO:tasks.workunit.client.0.smithi029.stdout:1/522: dread d5/d6/f7c [0,4194304] 0 2024-04-23T10:21:37.921 INFO:tasks.workunit.client.0.smithi029.stdout:7/726: link d5/d8/d51/l60 d5/d8/d51/d55/da5/lf3 0 2024-04-23T10:21:37.922 INFO:tasks.workunit.client.0.smithi029.stdout:4/688: dread d0/d3c/d52/d1b/d5b/f93 [0,4194304] 0 2024-04-23T10:21:37.931 INFO:tasks.workunit.client.0.smithi029.stdout:3/592: rename d3/d10/de/d2e/f2f to d3/d10/de/d2e/daa/fd7 0 2024-04-23T10:21:37.931 INFO:tasks.workunit.client.0.smithi029.stdout:7/727: truncate d5/d8/d51/d55/f87 956419 0 2024-04-23T10:21:37.935 INFO:tasks.workunit.client.0.smithi029.stdout:3/593: dread - d3/d45/d4f/fd6 zero size 2024-04-23T10:21:37.935 INFO:tasks.workunit.client.0.smithi029.stdout:1/523: mkdir d5/d3e/da7 0 2024-04-23T10:21:37.936 INFO:tasks.workunit.client.0.smithi029.stdout:4/689: mknod d0/d3c/d52/d1b/d5b/d65/cf3 0 2024-04-23T10:21:37.937 INFO:tasks.workunit.client.0.smithi029.stdout:8/654: dwrite d3/f42 [0,4194304] 0 2024-04-23T10:21:37.939 INFO:tasks.workunit.client.0.smithi029.stdout:4/690: truncate d0/d3c/d52/f1d 4977903 0 2024-04-23T10:21:37.945 INFO:tasks.workunit.client.0.smithi029.stdout:9/819: dread d0/d7/d1d/f20 [0,4194304] 0 2024-04-23T10:21:37.947 INFO:tasks.workunit.client.0.smithi029.stdout:2/579: dread d1/d3e/d3b/f52 [0,4194304] 0 2024-04-23T10:21:37.949 INFO:tasks.workunit.client.0.smithi029.stdout:1/524: truncate d5/d6/de/d22/d77/f88 1016158 0 2024-04-23T10:21:37.959 INFO:tasks.workunit.client.0.smithi029.stdout:8/655: dwrite d3/d50/d6a/d95/d36/f3b [0,4194304] 0 2024-04-23T10:21:37.962 INFO:tasks.workunit.client.0.smithi029.stdout:1/525: chown d5/d6/de/d22/f56 981 1 2024-04-23T10:21:37.962 INFO:tasks.workunit.client.0.smithi029.stdout:4/691: readlink d0/d3c/d52/d1b/d9f/d92/dd8/da1/la7 0 2024-04-23T10:21:37.963 INFO:tasks.workunit.client.0.smithi029.stdout:7/728: mknod d5/d8/d51/d55/da5/cf4 0 2024-04-23T10:21:37.965 INFO:tasks.workunit.client.0.smithi029.stdout:9/820: truncate d0/d1b/d39/d112/fa6 789758 0 2024-04-23T10:21:37.967 INFO:tasks.workunit.client.0.smithi029.stdout:3/594: dwrite d3/d10/de/d2e/d36/d40/d46/d72/f53 [0,4194304] 0 2024-04-23T10:21:37.969 INFO:tasks.workunit.client.0.smithi029.stdout:4/692: stat d0/d3c/d52/d1b/d66/fd9 0 2024-04-23T10:21:37.971 INFO:tasks.workunit.client.0.smithi029.stdout:3/595: dread - d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7/dab/fc0 zero size 2024-04-23T10:21:37.972 INFO:tasks.workunit.client.0.smithi029.stdout:7/729: chown d5/d71/d92/fb6 20630220 1 2024-04-23T10:21:37.977 INFO:tasks.workunit.client.0.smithi029.stdout:2/580: rename d1/dd/d22/c91 to d1/dd/d22/cc0 0 2024-04-23T10:21:37.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/766: sync 2024-04-23T10:21:37.978 INFO:tasks.workunit.client.0.smithi029.stdout:9/821: mkdir d0/d1b/d60/d123 0 2024-04-23T10:21:37.980 INFO:tasks.workunit.client.0.smithi029.stdout:8/656: rename d3/d50/d6a/d95/d36/d97 to d3/d50/d6a/d95/d36/d3e/dce 0 2024-04-23T10:21:37.985 INFO:tasks.workunit.client.0.smithi029.stdout:3/596: dread d3/d10/de/d2e/fbc [0,4194304] 0 2024-04-23T10:21:37.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/581: readlink d1/dd/d60/lb1 0 2024-04-23T10:21:37.987 INFO:tasks.workunit.client.0.smithi029.stdout:8/657: rmdir d3/d50/d6a/d95/d36/d94 39 2024-04-23T10:21:37.990 INFO:tasks.workunit.client.0.smithi029.stdout:3/597: dread - d3/d15/f66 zero size 2024-04-23T10:21:37.994 INFO:tasks.workunit.client.0.smithi029.stdout:1/526: dwrite d5/fa3 [0,4194304] 0 2024-04-23T10:21:37.999 INFO:tasks.workunit.client.0.smithi029.stdout:9/822: write d0/d1b/ff6 [337538,35303] 0 2024-04-23T10:21:38.000 INFO:tasks.workunit.client.0.smithi029.stdout:2/582: symlink d1/d31/lc1 0 2024-04-23T10:21:38.000 INFO:tasks.workunit.client.0.smithi029.stdout:0/500: sync 2024-04-23T10:21:38.004 INFO:tasks.workunit.client.0.smithi029.stdout:4/693: rename d0/d3c/d52/d1b/d9f/d92/dd8/fa0 to d0/d3c/d52/d1b/d36/d45/d68/ff4 0 2024-04-23T10:21:38.006 INFO:tasks.workunit.client.0.smithi029.stdout:7/730: dwrite d5/f63 [0,4194304] 0 2024-04-23T10:21:38.007 INFO:tasks.workunit.client.0.smithi029.stdout:9/823: dread - d0/d7/d3f/dbb/ffe zero size 2024-04-23T10:21:38.010 INFO:tasks.workunit.client.0.smithi029.stdout:2/583: read d1/dd/d47/d63/d64/f80 [2697155,80730] 0 2024-04-23T10:21:38.011 INFO:tasks.workunit.client.0.smithi029.stdout:5/674: dread d0/d35/d38/d3e/f4e [0,4194304] 0 2024-04-23T10:21:38.011 INFO:tasks.workunit.client.0.smithi029.stdout:3/598: write d3/d10/de/d2e/d36/d40/d46/d72/f6f [338993,130206] 0 2024-04-23T10:21:38.012 INFO:tasks.workunit.client.0.smithi029.stdout:1/527: creat d5/d6/de/d27/d38/d47/fa8 x:0 0 0 2024-04-23T10:21:38.015 INFO:tasks.workunit.client.0.smithi029.stdout:8/658: dread d3/d38/f8a [0,4194304] 0 2024-04-23T10:21:38.017 INFO:tasks.workunit.client.0.smithi029.stdout:6/767: dwrite d9/df/d41/d49/d69/fd6 [0,4194304] 0 2024-04-23T10:21:38.034 INFO:tasks.workunit.client.0.smithi029.stdout:1/528: unlink d5/d6/ff 0 2024-04-23T10:21:38.035 INFO:tasks.workunit.client.0.smithi029.stdout:5/675: mknod d0/d6a/cdb 0 2024-04-23T10:21:38.035 INFO:tasks.workunit.client.0.smithi029.stdout:4/694: creat d0/d3c/d52/d1b/d36/d45/d4f/df2/ff5 x:0 0 0 2024-04-23T10:21:38.038 INFO:tasks.workunit.client.0.smithi029.stdout:9/824: mknod d0/d1b/d24/c124 0 2024-04-23T10:21:38.040 INFO:tasks.workunit.client.0.smithi029.stdout:0/501: symlink d0/d3e/d4e/d50/d73/laa 0 2024-04-23T10:21:38.041 INFO:tasks.workunit.client.0.smithi029.stdout:3/599: fsync d3/d10/de/d2e/d36/d40/d46/d65/f81 0 2024-04-23T10:21:38.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/731: dread d5/d29/ded/f1e [0,4194304] 0 2024-04-23T10:21:38.044 INFO:tasks.workunit.client.0.smithi029.stdout:1/529: chown d5/d6/de/d27/d38/f73 1143090052 1 2024-04-23T10:21:38.044 INFO:tasks.workunit.client.0.smithi029.stdout:5/676: readlink d0/d35/l6b 0 2024-04-23T10:21:38.044 INFO:tasks.workunit.client.0.smithi029.stdout:9/825: stat d0/d1b/d39/d4f/ldd 0 2024-04-23T10:21:38.046 INFO:tasks.workunit.client.0.smithi029.stdout:4/695: symlink d0/d5a/lf6 0 2024-04-23T10:21:38.054 INFO:tasks.workunit.client.0.smithi029.stdout:7/732: mkdir d5/d71/df5 0 2024-04-23T10:21:38.056 INFO:tasks.workunit.client.0.smithi029.stdout:2/584: link d1/c1b d1/dd/d22/cc2 0 2024-04-23T10:21:38.059 INFO:tasks.workunit.client.0.smithi029.stdout:0/502: dread d0/f4a [0,4194304] 0 2024-04-23T10:21:38.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/530: dread d5/d6/de/d22/f23 [0,4194304] 0 2024-04-23T10:21:38.067 INFO:tasks.workunit.client.0.smithi029.stdout:9/826: write d0/d7/d1d/d35/f62 [2367117,86806] 0 2024-04-23T10:21:38.068 INFO:tasks.workunit.client.0.smithi029.stdout:2/585: symlink d1/d3e/d5a/lc3 0 2024-04-23T10:21:38.069 INFO:tasks.workunit.client.0.smithi029.stdout:3/600: truncate d3/d10/de/d2e/d36/d40/d46/d72/f53 220676 0 2024-04-23T10:21:38.070 INFO:tasks.workunit.client.0.smithi029.stdout:4/696: mkdir d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7 0 2024-04-23T10:21:38.072 INFO:tasks.workunit.client.0.smithi029.stdout:5/677: fdatasync d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/fae 0 2024-04-23T10:21:38.073 INFO:tasks.workunit.client.0.smithi029.stdout:7/733: creat d5/d8/d51/d55/d59/ff6 x:0 0 0 2024-04-23T10:21:38.081 INFO:tasks.workunit.client.0.smithi029.stdout:1/531: mkdir d5/d6/de/d27/da9 0 2024-04-23T10:21:38.082 INFO:tasks.workunit.client.0.smithi029.stdout:0/503: write d0/d21/f39 [113177,9828] 0 2024-04-23T10:21:38.084 INFO:tasks.workunit.client.0.smithi029.stdout:4/697: symlink d0/d3c/d52/d1b/d36/d45/lf8 0 2024-04-23T10:21:38.084 INFO:tasks.workunit.client.0.smithi029.stdout:0/504: write d0/da9/d4c/f9c [435981,98310] 0 2024-04-23T10:21:38.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/586: creat d1/d31/d50/d9b/fc4 x:0 0 0 2024-04-23T10:21:38.094 INFO:tasks.workunit.client.0.smithi029.stdout:5/678: write d0/d35/d38/d39/f86 [377241,127220] 0 2024-04-23T10:21:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:7/734: truncate d5/d9/fb3 1397277 0 2024-04-23T10:21:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/601: dwrite d3/d10/de/d2e/d36/d40/f99 [0,4194304] 0 2024-04-23T10:21:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:1/532: write d5/d6/f7c [299937,65706] 0 2024-04-23T10:21:38.098 INFO:tasks.workunit.client.0.smithi029.stdout:0/505: getdents d0/da9/d5c/d92/da0 0 2024-04-23T10:21:38.100 INFO:tasks.workunit.client.0.smithi029.stdout:9/827: dread d0/d7/d6/fa3 [0,4194304] 0 2024-04-23T10:21:38.102 INFO:tasks.workunit.client.0.smithi029.stdout:9/828: write d0/d1b/d39/d50/fb4 [3476454,87067] 0 2024-04-23T10:21:38.108 INFO:tasks.workunit.client.0.smithi029.stdout:7/735: chown d5/d8/d80/cac 1540 1 2024-04-23T10:21:38.113 INFO:tasks.workunit.client.0.smithi029.stdout:1/533: symlink d5/d6/d34/laa 0 2024-04-23T10:21:38.116 INFO:tasks.workunit.client.0.smithi029.stdout:1/534: stat d5/d6/d34/d63/f7d 0 2024-04-23T10:21:38.118 INFO:tasks.workunit.client.0.smithi029.stdout:7/736: chown d5/d9/l1c 25567152 1 2024-04-23T10:21:38.118 INFO:tasks.workunit.client.0.smithi029.stdout:0/506: fsync d0/d21/d7f/d55/f58 0 2024-04-23T10:21:38.120 INFO:tasks.workunit.client.0.smithi029.stdout:4/698: dwrite d0/d3c/d52/d74/fa4 [0,4194304] 0 2024-04-23T10:21:38.121 INFO:tasks.workunit.client.0.smithi029.stdout:2/587: link d1/d31/l55 d1/d3e/d5a/lc5 0 2024-04-23T10:21:38.122 INFO:tasks.workunit.client.0.smithi029.stdout:4/699: read - d0/d3c/d52/d74/d91/fa5 zero size 2024-04-23T10:21:38.129 INFO:tasks.workunit.client.0.smithi029.stdout:9/829: creat d0/d1b/d60/dbf/f125 x:0 0 0 2024-04-23T10:21:38.130 INFO:tasks.workunit.client.0.smithi029.stdout:5/679: write d0/d35/d49/f67 [5185124,42699] 0 2024-04-23T10:21:38.134 INFO:tasks.workunit.client.0.smithi029.stdout:3/602: write d3/d10/f20 [9236118,121937] 0 2024-04-23T10:21:38.135 INFO:tasks.workunit.client.0.smithi029.stdout:4/700: symlink d0/d3c/d52/dd6/lf9 0 2024-04-23T10:21:38.139 INFO:tasks.workunit.client.0.smithi029.stdout:0/507: creat d0/d1b/fab x:0 0 0 2024-04-23T10:21:38.140 INFO:tasks.workunit.client.0.smithi029.stdout:0/508: write d0/d21/f39 [2303377,28901] 0 2024-04-23T10:21:38.141 INFO:tasks.workunit.client.0.smithi029.stdout:1/535: creat d5/d6/de/d22/d6c/fab x:0 0 0 2024-04-23T10:21:38.142 INFO:tasks.workunit.client.0.smithi029.stdout:9/830: rename d0/d7/d1d/d35/d3b/d10b to d0/d7/d1d/d35/dd5/df2/d126 0 2024-04-23T10:21:38.144 INFO:tasks.workunit.client.0.smithi029.stdout:3/603: truncate d3/f25 632711 0 2024-04-23T10:21:38.145 INFO:tasks.workunit.client.0.smithi029.stdout:5/680: symlink d0/d9a/dc8/ldc 0 2024-04-23T10:21:38.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/701: dwrite d0/d3c/d52/d74/fa4 [0,4194304] 0 2024-04-23T10:21:38.147 INFO:tasks.workunit.client.0.smithi029.stdout:9/831: read - d0/fa2 zero size 2024-04-23T10:21:38.153 INFO:tasks.workunit.client.0.smithi029.stdout:0/509: creat d0/da9/d5c/d92/fac x:0 0 0 2024-04-23T10:21:38.155 INFO:tasks.workunit.client.0.smithi029.stdout:2/588: write d1/d3e/d3b/d75/fa4 [5001357,32775] 0 2024-04-23T10:21:38.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/681: chown d0/d35/d38/d3e/d66/d8c/fc7 28613 1 2024-04-23T10:21:38.155 INFO:tasks.workunit.client.0.smithi029.stdout:7/737: dwrite d5/d29/ded/d8a/d8b/d8d/fbe [0,4194304] 0 2024-04-23T10:21:38.158 INFO:tasks.workunit.client.0.smithi029.stdout:0/510: stat d0/da9/c75 0 2024-04-23T10:21:38.160 INFO:tasks.workunit.client.0.smithi029.stdout:3/604: truncate d3/d10/de/d2e/d36/d40/d46/f9f 3995422 0 2024-04-23T10:21:38.165 INFO:tasks.workunit.client.0.smithi029.stdout:4/702: getdents d0/d3c/d52/dd6 0 2024-04-23T10:21:38.166 INFO:tasks.workunit.client.0.smithi029.stdout:0/511: readlink d0/d1b/d67/d6c/l80 0 2024-04-23T10:21:38.166 INFO:tasks.workunit.client.0.smithi029.stdout:7/738: write d5/d9/fce [370797,88198] 0 2024-04-23T10:21:38.168 INFO:tasks.workunit.client.0.smithi029.stdout:4/703: write d0/d3c/d52/d74/d91/fcd [341192,37307] 0 2024-04-23T10:21:38.171 INFO:tasks.workunit.client.0.smithi029.stdout:5/682: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/ddd 0 2024-04-23T10:21:38.177 INFO:tasks.workunit.client.0.smithi029.stdout:0/512: mknod d0/da9/d4c/da7/cad 0 2024-04-23T10:21:38.178 INFO:tasks.workunit.client.0.smithi029.stdout:3/605: symlink d3/d10/de/d2e/d36/d40/d46/d65/dba/ld8 0 2024-04-23T10:21:38.179 INFO:tasks.workunit.client.0.smithi029.stdout:5/683: readlink d0/d35/d38/d3e/d66/d5a/la4 0 2024-04-23T10:21:38.184 INFO:tasks.workunit.client.0.smithi029.stdout:2/589: write d1/d4/f44 [1697341,98729] 0 2024-04-23T10:21:38.185 INFO:tasks.workunit.client.0.smithi029.stdout:3/606: truncate d3/d15/fb0 949073 0 2024-04-23T10:21:38.186 INFO:tasks.workunit.client.0.smithi029.stdout:3/607: chown d3/d10 0 1 2024-04-23T10:21:38.187 INFO:tasks.workunit.client.0.smithi029.stdout:5/684: symlink d0/d35/d83/lde 0 2024-04-23T10:21:38.187 INFO:tasks.workunit.client.0.smithi029.stdout:2/590: write d1/dd/d47/d63/d64/fb4 [17200,88173] 0 2024-04-23T10:21:38.189 INFO:tasks.workunit.client.0.smithi029.stdout:7/739: write d5/d9/f65 [852628,117011] 0 2024-04-23T10:21:38.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/513: getdents d0/d3e/d4e/d50 0 2024-04-23T10:21:38.193 INFO:tasks.workunit.client.0.smithi029.stdout:5/685: chown d0/d35/d49/c76 20 1 2024-04-23T10:21:38.193 INFO:tasks.workunit.client.0.smithi029.stdout:9/832: dread d0/d1b/d39/d50/f80 [0,4194304] 0 2024-04-23T10:21:38.198 INFO:tasks.workunit.client.0.smithi029.stdout:5/686: stat d0/d35/d38/d3e/d66/d5a/d78/l5f 0 2024-04-23T10:21:38.199 INFO:tasks.workunit.client.0.smithi029.stdout:2/591: creat d1/d3e/fc6 x:0 0 0 2024-04-23T10:21:38.201 INFO:tasks.workunit.client.0.smithi029.stdout:7/740: dwrite d5/d9/f65 [0,4194304] 0 2024-04-23T10:21:38.205 INFO:tasks.workunit.client.0.smithi029.stdout:2/592: truncate d1/d31/d50/f82 862234 0 2024-04-23T10:21:38.207 INFO:tasks.workunit.client.0.smithi029.stdout:4/704: dwrite d0/d3c/d52/d1b/d9f/d92/dd8/f88 [4194304,4194304] 0 2024-04-23T10:21:38.208 INFO:tasks.workunit.client.0.smithi029.stdout:2/593: dread - d1/d3e/d3b/d75/f85 zero size 2024-04-23T10:21:38.209 INFO:tasks.workunit.client.0.smithi029.stdout:7/741: dread - d5/d71/d92/db7/dc3/dcc/feb zero size 2024-04-23T10:21:38.209 INFO:tasks.workunit.client.0.smithi029.stdout:9/833: link d0/d7/d1d/d35/d3b/db8/l11e d0/d7/d1d/d35/d3b/d68/l127 0 2024-04-23T10:21:38.216 INFO:tasks.workunit.client.0.smithi029.stdout:7/742: rmdir d5/d8/d51/d55/d59/daf 39 2024-04-23T10:21:38.217 INFO:tasks.workunit.client.0.smithi029.stdout:5/687: link d0/l24 d0/d35/d38/db3/dcf/ldf 0 2024-04-23T10:21:38.218 INFO:tasks.workunit.client.0.smithi029.stdout:3/608: write d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/fcc [3653442,103464] 0 2024-04-23T10:21:38.218 INFO:tasks.workunit.client.0.smithi029.stdout:4/705: creat d0/d3c/d52/d1b/d9f/d92/dd8/ffa x:0 0 0 2024-04-23T10:21:38.221 INFO:tasks.workunit.client.0.smithi029.stdout:7/743: truncate d5/d29/d4a/fd1 951442 0 2024-04-23T10:21:38.224 INFO:tasks.workunit.client.0.smithi029.stdout:9/834: rename d0/d1b/ca5 to d0/d7/d1d/d35/d3b/db8/de3/c128 0 2024-04-23T10:21:38.224 INFO:tasks.workunit.client.0.smithi029.stdout:7/744: dread - d5/d29/ded/f78 zero size 2024-04-23T10:21:38.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/688: mknod d0/d35/d38/d3e/d66/d5a/d78/ce0 0 2024-04-23T10:21:38.226 INFO:tasks.workunit.client.0.smithi029.stdout:3/609: creat d3/d10/de/d2e/d36/d40/d46/d72/d31/db6/fd9 x:0 0 0 2024-04-23T10:21:38.228 INFO:tasks.workunit.client.0.smithi029.stdout:9/835: read d0/d7/d3f/f96 [25655,5349] 0 2024-04-23T10:21:38.231 INFO:tasks.workunit.client.0.smithi029.stdout:4/706: rename d0/d3c/d52/d1b/d5b/d65/d6a/f95 to d0/d3c/d52/d1b/d36/d45/ffb 0 2024-04-23T10:21:38.234 INFO:tasks.workunit.client.0.smithi029.stdout:0/514: write d0/d21/d7f/f7b [954074,58568] 0 2024-04-23T10:21:38.234 INFO:tasks.workunit.client.0.smithi029.stdout:3/610: getdents d3/d10/de/d2e/d36/d40/d43 0 2024-04-23T10:21:38.235 INFO:tasks.workunit.client.0.smithi029.stdout:9/836: creat d0/d1b/d39/f129 x:0 0 0 2024-04-23T10:21:38.237 INFO:tasks.workunit.client.0.smithi029.stdout:4/707: creat d0/d3c/d52/d1b/d36/ffc x:0 0 0 2024-04-23T10:21:38.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/689: rename d0/d35/d38/d3e/d66/d5a/d78/f98 to d0/d35/d10/d26/db2/dbc/fe1 0 2024-04-23T10:21:38.240 INFO:tasks.workunit.client.0.smithi029.stdout:9/837: chown d0/d1b/d39/d50/c59 106440076 1 2024-04-23T10:21:38.241 INFO:tasks.workunit.client.0.smithi029.stdout:5/690: dread - d0/d35/d38/d39/dcb/fd9 zero size 2024-04-23T10:21:38.243 INFO:tasks.workunit.client.0.smithi029.stdout:0/515: rename d0/da9/d5c to d0/d1b/d67/dae 0 2024-04-23T10:21:38.244 INFO:tasks.workunit.client.0.smithi029.stdout:4/708: creat d0/d3c/d52/d1b/d9f/d92/dd8/d7a/ffd x:0 0 0 2024-04-23T10:21:38.246 INFO:tasks.workunit.client.0.smithi029.stdout:9/838: read d0/d1b/d24/f11a [1055974,55999] 0 2024-04-23T10:21:38.246 INFO:tasks.workunit.client.0.smithi029.stdout:5/691: rmdir d0/d35/d38/d3e/d66/d5a/dcc 39 2024-04-23T10:21:38.247 INFO:tasks.workunit.client.0.smithi029.stdout:0/516: mkdir d0/da9/d4c/daf 0 2024-04-23T10:21:38.248 INFO:tasks.workunit.client.0.smithi029.stdout:3/611: rename d3/d10/de/d2e/d36/d40/d46/d72/fd5 to d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/fda 0 2024-04-23T10:21:38.250 INFO:tasks.workunit.client.0.smithi029.stdout:4/709: mkdir d0/d3c/d52/d74/d8a/dba/dfe 0 2024-04-23T10:21:38.252 INFO:tasks.workunit.client.0.smithi029.stdout:5/692: truncate d0/d35/d38/d39/d3f/fb1 759502 0 2024-04-23T10:21:38.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/710: mknod d0/d3c/d52/d1b/d9f/cff 0 2024-04-23T10:21:38.255 INFO:tasks.workunit.client.0.smithi029.stdout:9/839: creat d0/d7/d1d/d35/dd5/df2/f12a x:0 0 0 2024-04-23T10:21:38.264 INFO:tasks.workunit.client.0.smithi029.stdout:8/659: dread d3/d50/d6a/d95/f39 [0,4194304] 0 2024-04-23T10:21:38.265 INFO:tasks.workunit.client.0.smithi029.stdout:3/612: dread d3/f5 [0,4194304] 0 2024-04-23T10:21:38.265 INFO:tasks.workunit.client.0.smithi029.stdout:3/613: chown d3/d45/fc7 240646 1 2024-04-23T10:21:38.266 INFO:tasks.workunit.client.0.smithi029.stdout:7/745: write d5/d29/ded/d9c/faa [1475766,39560] 0 2024-04-23T10:21:38.268 INFO:tasks.workunit.client.0.smithi029.stdout:8/660: creat d3/d50/d6a/d95/fcf x:0 0 0 2024-04-23T10:21:38.271 INFO:tasks.workunit.client.0.smithi029.stdout:7/746: symlink d5/d9/de3/lf7 0 2024-04-23T10:21:38.274 INFO:tasks.workunit.client.0.smithi029.stdout:7/747: dread - d5/d29/ded/d9c/fc0 zero size 2024-04-23T10:21:38.275 INFO:tasks.workunit.client.0.smithi029.stdout:8/661: creat d3/d50/d6a/d95/d36/dbf/fd0 x:0 0 0 2024-04-23T10:21:38.276 INFO:tasks.workunit.client.0.smithi029.stdout:0/517: write d0/da9/d4c/d6d/f82 [4692937,99698] 0 2024-04-23T10:21:38.277 INFO:tasks.workunit.client.0.smithi029.stdout:3/614: link d3/d10/de/d2e/c5a d3/d10/de/d2e/d36/d40/d43/cdb 0 2024-04-23T10:21:38.281 INFO:tasks.workunit.client.0.smithi029.stdout:0/518: creat d0/dc/d26/fb0 x:0 0 0 2024-04-23T10:21:38.282 INFO:tasks.workunit.client.0.smithi029.stdout:3/615: creat d3/d45/d4f/d6b/fdc x:0 0 0 2024-04-23T10:21:38.283 INFO:tasks.workunit.client.0.smithi029.stdout:0/519: readlink d0/d21/d7f/d3a/l7d 0 2024-04-23T10:21:38.286 INFO:tasks.workunit.client.0.smithi029.stdout:0/520: chown d0/d21/f77 0 1 2024-04-23T10:21:38.289 INFO:tasks.workunit.client.0.smithi029.stdout:3/616: symlink d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7/dab/ldd 0 2024-04-23T10:21:38.290 INFO:tasks.workunit.client.0.smithi029.stdout:9/840: write d0/d7/d3f/f41 [1035857,12419] 0 2024-04-23T10:21:38.291 INFO:tasks.workunit.client.0.smithi029.stdout:5/693: dwrite d0/d35/d10/d26/db2/fb4 [0,4194304] 0 2024-04-23T10:21:38.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/617: chown d3/d10/de/d2e/d36/d40/d46/d72/d28/cd0 2689 1 2024-04-23T10:21:38.296 INFO:tasks.workunit.client.0.smithi029.stdout:7/748: dread d5/d29/ded/f76 [0,4194304] 0 2024-04-23T10:21:38.298 INFO:tasks.workunit.client.0.smithi029.stdout:7/749: fsync d5/d9/fce 0 2024-04-23T10:21:38.298 INFO:tasks.workunit.client.0.smithi029.stdout:9/841: read d0/f1e [499029,23004] 0 2024-04-23T10:21:38.299 INFO:tasks.workunit.client.0.smithi029.stdout:0/521: dwrite d0/f4a [4194304,4194304] 0 2024-04-23T10:21:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:5/694: dread d0/d6a/f7f [0,4194304] 0 2024-04-23T10:21:38.306 INFO:tasks.workunit.client.0.smithi029.stdout:7/750: unlink d5/d8/fa7 0 2024-04-23T10:21:38.308 INFO:tasks.workunit.client.0.smithi029.stdout:3/618: dwrite d3/d45/d4f/fb4 [4194304,4194304] 0 2024-04-23T10:21:38.309 INFO:tasks.workunit.client.0.smithi029.stdout:9/842: mkdir d0/d1b/d12b 0 2024-04-23T10:21:38.309 INFO:tasks.workunit.client.0.smithi029.stdout:0/522: chown d0/c1c 8 1 2024-04-23T10:21:38.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/695: stat d0/d35/d38/d3e/d66/d5a/d78/cc9 0 2024-04-23T10:21:38.310 INFO:tasks.workunit.client.0.smithi029.stdout:8/662: dwrite d3/d50/d6a/d95/f82 [0,4194304] 0 2024-04-23T10:21:38.315 INFO:tasks.workunit.client.0.smithi029.stdout:0/523: read - d0/d21/d7f/d55/f91 zero size 2024-04-23T10:21:38.318 INFO:tasks.workunit.client.0.smithi029.stdout:0/524: truncate d0/dc/f16 5842124 0 2024-04-23T10:21:38.321 INFO:tasks.workunit.client.0.smithi029.stdout:7/751: rename d5/d8/d80/cac to d5/d29/d4a/cf8 0 2024-04-23T10:21:38.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/752: write d5/f2c [4535659,43669] 0 2024-04-23T10:21:38.326 INFO:tasks.workunit.client.0.smithi029.stdout:4/711: dread d0/fe [0,4194304] 0 2024-04-23T10:21:38.327 INFO:tasks.workunit.client.0.smithi029.stdout:5/696: chown d0/d35/d38/d3e/d66/d5a/f77 1128098 1 2024-04-23T10:21:38.329 INFO:tasks.workunit.client.0.smithi029.stdout:9/843: getdents d0/d7/d1d/d35/dd5/dec/d108 0 2024-04-23T10:21:38.331 INFO:tasks.workunit.client.0.smithi029.stdout:8/663: fsync d3/d50/d6a/d95/d36/d3e/dce/da4/fb5 0 2024-04-23T10:21:38.332 INFO:tasks.workunit.client.0.smithi029.stdout:0/525: read d0/da9/f45 [295980,127375] 0 2024-04-23T10:21:38.334 INFO:tasks.workunit.client.0.smithi029.stdout:0/526: write d0/d1b/fab [978659,48855] 0 2024-04-23T10:21:38.342 INFO:tasks.workunit.client.0.smithi029.stdout:3/619: write d3/d10/de/d2e/d36/d40/d46/d72/f68 [1452533,23464] 0 2024-04-23T10:21:38.344 INFO:tasks.workunit.client.0.smithi029.stdout:8/664: mknod d3/d50/dad/cd1 0 2024-04-23T10:21:38.345 INFO:tasks.workunit.client.0.smithi029.stdout:0/527: creat d0/d3e/fb1 x:0 0 0 2024-04-23T10:21:38.347 INFO:tasks.workunit.client.0.smithi029.stdout:0/528: chown d0/f2b 267 1 2024-04-23T10:21:38.348 INFO:tasks.workunit.client.0.smithi029.stdout:0/529: stat d0/d21/d7f/d55/f91 0 2024-04-23T10:21:38.351 INFO:tasks.workunit.client.0.smithi029.stdout:3/620: dwrite d3/d10/de/d2e/d36/d40/d46/d72/f68 [0,4194304] 0 2024-04-23T10:21:38.352 INFO:tasks.workunit.client.0.smithi029.stdout:8/665: creat d3/d50/d6a/d95/d36/d3e/fd2 x:0 0 0 2024-04-23T10:21:38.354 INFO:tasks.workunit.client.0.smithi029.stdout:0/530: creat d0/d3e/d4e/d50/d73/fb2 x:0 0 0 2024-04-23T10:21:38.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/844: dread d0/f1e [0,4194304] 0 2024-04-23T10:21:38.356 INFO:tasks.workunit.client.0.smithi029.stdout:9/845: chown d0/d1b/d39 96 1 2024-04-23T10:21:38.358 INFO:tasks.workunit.client.0.smithi029.stdout:3/621: mkdir d3/d10/de/d2e/d36/d40/d43/dde 0 2024-04-23T10:21:38.358 INFO:tasks.workunit.client.0.smithi029.stdout:0/531: dread d0/d1b/f5d [0,4194304] 0 2024-04-23T10:21:38.358 INFO:tasks.workunit.client.0.smithi029.stdout:8/666: truncate d3/d50/d6a/d95/d36/f4a 1284020 0 2024-04-23T10:21:38.362 INFO:tasks.workunit.client.0.smithi029.stdout:9/846: unlink d0/d1b/d39/d4f/ldd 0 2024-04-23T10:21:38.364 INFO:tasks.workunit.client.0.smithi029.stdout:3/622: unlink d3/d10/f6d 0 2024-04-23T10:21:38.366 INFO:tasks.workunit.client.0.smithi029.stdout:9/847: fdatasync d0/d7/d1d/d35/dd9/fd6 0 2024-04-23T10:21:38.367 INFO:tasks.workunit.client.0.smithi029.stdout:3/623: write d3/f69 [2734631,64913] 0 2024-04-23T10:21:38.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/532: creat d0/d3e/d4e/fb3 x:0 0 0 2024-04-23T10:21:38.368 INFO:tasks.workunit.client.0.smithi029.stdout:9/848: write d0/d1b/d39/f129 [171529,101116] 0 2024-04-23T10:21:38.370 INFO:tasks.workunit.client.0.smithi029.stdout:5/697: truncate d0/d35/d38/d3e/d66/d5a/f80 582602 0 2024-04-23T10:21:38.371 INFO:tasks.workunit.client.0.smithi029.stdout:8/667: dread d3/d50/d6a/d95/d36/d68/f6d [0,4194304] 0 2024-04-23T10:21:38.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/624: truncate d3/f25 1260530 0 2024-04-23T10:21:38.376 INFO:tasks.workunit.client.0.smithi029.stdout:4/712: dwrite d0/fa [4194304,4194304] 0 2024-04-23T10:21:38.377 INFO:tasks.workunit.client.0.smithi029.stdout:4/713: dread - d0/d3c/d52/d20/fc5 zero size 2024-04-23T10:21:38.378 INFO:tasks.workunit.client.0.smithi029.stdout:0/533: creat d0/dc/d90/fb4 x:0 0 0 2024-04-23T10:21:38.380 INFO:tasks.workunit.client.0.smithi029.stdout:9/849: write d0/d7/d1d/d35/dde/dba/fc2 [2671407,58327] 0 2024-04-23T10:21:38.383 INFO:tasks.workunit.client.0.smithi029.stdout:8/668: fsync d3/d50/d6a/d95/d36/d94/fc9 0 2024-04-23T10:21:38.384 INFO:tasks.workunit.client.0.smithi029.stdout:4/714: mknod d0/d3c/de5/c100 0 2024-04-23T10:21:38.386 INFO:tasks.workunit.client.0.smithi029.stdout:5/698: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/fe2 x:0 0 0 2024-04-23T10:21:38.393 INFO:tasks.workunit.client.0.smithi029.stdout:0/534: creat d0/d1b/d67/dae/d92/fb5 x:0 0 0 2024-04-23T10:21:38.396 INFO:tasks.workunit.client.0.smithi029.stdout:8/669: creat d3/d50/d6a/d95/d36/fd3 x:0 0 0 2024-04-23T10:21:38.396 INFO:tasks.workunit.client.0.smithi029.stdout:4/715: creat d0/d3c/d52/d74/f101 x:0 0 0 2024-04-23T10:21:38.401 INFO:tasks.workunit.client.0.smithi029.stdout:8/670: unlink d3/d38/l83 0 2024-04-23T10:21:38.402 INFO:tasks.workunit.client.0.smithi029.stdout:3/625: truncate d3/d15/f18 2284277 0 2024-04-23T10:21:38.404 INFO:tasks.workunit.client.0.smithi029.stdout:4/716: mknod d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7/c102 0 2024-04-23T10:21:38.404 INFO:tasks.workunit.client.0.smithi029.stdout:9/850: dwrite d0/d1b/d39/d50/d67/fc7 [0,4194304] 0 2024-04-23T10:21:38.405 INFO:tasks.workunit.client.0.smithi029.stdout:5/699: write d0/d35/d38/d3e/d66/d5a/d78/d6d/f58 [777,130132] 0 2024-04-23T10:21:38.405 INFO:tasks.workunit.client.0.smithi029.stdout:0/535: link d0/dc/c18 d0/da9/d4c/d6d/cb6 0 2024-04-23T10:21:38.406 INFO:tasks.workunit.client.0.smithi029.stdout:8/671: chown d3/d50/d6a/d95/d36/d3e/dce/c98 339 1 2024-04-23T10:21:38.407 INFO:tasks.workunit.client.0.smithi029.stdout:4/717: dread - d0/d3c/d52/d1b/d9f/d92/dd8/da1/fc7 zero size 2024-04-23T10:21:38.410 INFO:tasks.workunit.client.0.smithi029.stdout:0/536: symlink d0/d21/d7f/lb7 0 2024-04-23T10:21:38.411 INFO:tasks.workunit.client.0.smithi029.stdout:9/851: unlink d0/d7/d1d/d35/dde/dba/cdc 0 2024-04-23T10:21:38.413 INFO:tasks.workunit.client.0.smithi029.stdout:5/700: creat d0/d9a/dc8/fe3 x:0 0 0 2024-04-23T10:21:38.414 INFO:tasks.workunit.client.0.smithi029.stdout:3/626: rename d3/d10/de/d2e/daa to d3/d45/d4f/d6b/ddf 0 2024-04-23T10:21:38.417 INFO:tasks.workunit.client.0.smithi029.stdout:4/718: dwrite d0/fe9 [0,4194304] 0 2024-04-23T10:21:38.421 INFO:tasks.workunit.client.0.smithi029.stdout:3/627: fdatasync d3/d45/f7b 0 2024-04-23T10:21:38.421 INFO:tasks.workunit.client.0.smithi029.stdout:8/672: link d3/d50/d6a/d95/d36/d3e/f60 d3/fd4 0 2024-04-23T10:21:38.422 INFO:tasks.workunit.client.0.smithi029.stdout:5/701: fdatasync d0/d35/d38/d3e/d66/fd1 0 2024-04-23T10:21:38.422 INFO:tasks.workunit.client.0.smithi029.stdout:0/537: getdents d0/d1b/d67/dae 0 2024-04-23T10:21:38.440 INFO:tasks.workunit.client.0.smithi029.stdout:9/852: write d0/d1b/d39/d112/ff4 [591541,22609] 0 2024-04-23T10:21:38.441 INFO:tasks.workunit.client.0.smithi029.stdout:8/673: write d3/d50/d6a/d95/d36/d3e/f3f [1759551,100507] 0 2024-04-23T10:21:38.442 INFO:tasks.workunit.client.0.smithi029.stdout:0/538: getdents d0/d1b/d67/d6c 0 2024-04-23T10:21:38.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/628: truncate d3/d10/de/d2e/d36/d40/d46/d72/f68 585621 0 2024-04-23T10:21:38.449 INFO:tasks.workunit.client.0.smithi029.stdout:8/674: fdatasync d3/d50/d6a/d95/d36/d3e/fc2 0 2024-04-23T10:21:38.452 INFO:tasks.workunit.client.0.smithi029.stdout:5/702: dwrite d0/d35/d49/f54 [0,4194304] 0 2024-04-23T10:21:38.454 INFO:tasks.workunit.client.0.smithi029.stdout:4/719: dwrite d0/d3c/d52/d1b/d5b/d65/d6a/f6c [0,4194304] 0 2024-04-23T10:21:38.455 INFO:tasks.workunit.client.0.smithi029.stdout:0/539: mknod d0/d1b/d67/dae/d92/da0/cb8 0 2024-04-23T10:21:38.457 INFO:tasks.workunit.client.0.smithi029.stdout:0/540: fdatasync d0/dc/d26/fb0 0 2024-04-23T10:21:38.457 INFO:tasks.workunit.client.0.smithi029.stdout:4/720: read - d0/d3c/d52/d1b/d36/d45/d68/fef zero size 2024-04-23T10:21:38.460 INFO:tasks.workunit.client.0.smithi029.stdout:8/675: readlink d3/d50/d6a/d95/d36/d68/l6e 0 2024-04-23T10:21:38.462 INFO:tasks.workunit.client.0.smithi029.stdout:5/703: mkdir d0/d35/d38/d3e/d66/d5a/d78/de4 0 2024-04-23T10:21:38.466 INFO:tasks.workunit.client.0.smithi029.stdout:0/541: rename d0/da9/d4c/da7/cad to d0/d1b/cb9 0 2024-04-23T10:21:38.470 INFO:tasks.workunit.client.0.smithi029.stdout:4/721: creat d0/d12/da9/f103 x:0 0 0 2024-04-23T10:21:38.473 INFO:tasks.workunit.client.0.smithi029.stdout:5/704: dwrite d0/d35/d38/d3e/d66/f82 [0,4194304] 0 2024-04-23T10:21:38.474 INFO:tasks.workunit.client.0.smithi029.stdout:0/542: symlink d0/d3e/d4e/d50/lba 0 2024-04-23T10:21:38.475 INFO:tasks.workunit.client.0.smithi029.stdout:5/705: rmdir d0/d35/d38/d3e/d66/d5a 39 2024-04-23T10:21:38.476 INFO:tasks.workunit.client.0.smithi029.stdout:0/543: stat d0/da9/c6f 0 2024-04-23T10:21:38.481 INFO:tasks.workunit.client.0.smithi029.stdout:7/753: dread d5/d8/d51/d55/f66 [0,4194304] 0 2024-04-23T10:21:38.483 INFO:tasks.workunit.client.0.smithi029.stdout:3/629: dread d3/d10/de/d2e/d36/d40/d46/f9f [0,4194304] 0 2024-04-23T10:21:38.490 INFO:tasks.workunit.client.0.smithi029.stdout:7/754: mknod d5/d71/cf9 0 2024-04-23T10:21:38.491 INFO:tasks.workunit.client.0.smithi029.stdout:5/706: dread d0/d35/d38/d39/d3f/f7d [4194304,4194304] 0 2024-04-23T10:21:38.493 INFO:tasks.workunit.client.0.smithi029.stdout:3/630: mknod d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/ce0 0 2024-04-23T10:21:38.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/676: dwrite d3/d38/f79 [0,4194304] 0 2024-04-23T10:21:38.495 INFO:tasks.workunit.client.0.smithi029.stdout:5/707: fdatasync d0/d35/d38/d3e/d66/d5a/d78/d6d/f58 0 2024-04-23T10:21:38.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/755: fsync d5/d29/d4a/dc1/fc4 0 2024-04-23T10:21:38.502 INFO:tasks.workunit.client.0.smithi029.stdout:8/677: truncate d3/f11 163313 0 2024-04-23T10:21:38.507 INFO:tasks.workunit.client.0.smithi029.stdout:7/756: mknod d5/d71/d92/dda/cfa 0 2024-04-23T10:21:38.508 INFO:tasks.workunit.client.0.smithi029.stdout:5/708: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/de5 0 2024-04-23T10:21:38.512 INFO:tasks.workunit.client.0.smithi029.stdout:4/722: dwrite d0/d3c/d52/d1b/d36/d45/d68/f73 [0,4194304] 0 2024-04-23T10:21:38.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/544: dwrite d0/f3f [0,4194304] 0 2024-04-23T10:21:38.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/757: getdents d5/d29/ded/d9c/dd3 0 2024-04-23T10:21:38.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/723: chown d0/d3c/d52/d1b/d36/l67 38604 1 2024-04-23T10:21:38.524 INFO:tasks.workunit.client.0.smithi029.stdout:3/631: dwrite d3/d10/f2b [4194304,4194304] 0 2024-04-23T10:21:38.527 INFO:tasks.workunit.client.0.smithi029.stdout:5/709: rename d0/d35/d38/d39/f99 to d0/d35/d83/fe6 0 2024-04-23T10:21:38.527 INFO:tasks.workunit.client.0.smithi029.stdout:0/545: creat d0/d21/d7f/d3a/fbb x:0 0 0 2024-04-23T10:21:38.528 INFO:tasks.workunit.client.0.smithi029.stdout:8/678: write d3/f7 [1093088,124798] 0 2024-04-23T10:21:38.529 INFO:tasks.workunit.client.0.smithi029.stdout:3/632: chown d3/d10/de/d2e/d36/d40/d46/d65/dba 592 1 2024-04-23T10:21:38.541 INFO:tasks.workunit.client.0.smithi029.stdout:5/710: dwrite d0/d35/d38/f4b [8388608,4194304] 0 2024-04-23T10:21:38.542 INFO:tasks.workunit.client.0.smithi029.stdout:7/758: write d5/d9/fb3 [1784795,60173] 0 2024-04-23T10:21:38.544 INFO:tasks.workunit.client.0.smithi029.stdout:7/759: fsync d5/d29/ded/f78 0 2024-04-23T10:21:38.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/760: chown d5/d29/ded/d8a/f9d 3 1 2024-04-23T10:21:38.547 INFO:tasks.workunit.client.0.smithi029.stdout:8/679: write d3/d50/d6a/d95/f35 [1801724,109990] 0 2024-04-23T10:21:38.554 INFO:tasks.workunit.client.0.smithi029.stdout:5/711: dwrite d0/d35/d38/d3e/d66/f6c [0,4194304] 0 2024-04-23T10:21:38.557 INFO:tasks.workunit.client.0.smithi029.stdout:7/761: rename d5/d71/cf9 to d5/d9/de3/cfb 0 2024-04-23T10:21:38.558 INFO:tasks.workunit.client.0.smithi029.stdout:9/853: dread d0/d7/d1d/fbe [0,4194304] 0 2024-04-23T10:21:38.559 INFO:tasks.workunit.client.0.smithi029.stdout:7/762: stat d5/d8/d51/d9e/db2/fec 0 2024-04-23T10:21:38.561 INFO:tasks.workunit.client.0.smithi029.stdout:5/712: getdents d0/d9a 0 2024-04-23T10:21:38.562 INFO:tasks.workunit.client.0.smithi029.stdout:7/763: creat d5/d71/df5/ffc x:0 0 0 2024-04-23T10:21:38.568 INFO:tasks.workunit.client.0.smithi029.stdout:9/854: dread d0/d7/d3f/dbb/fc1 [0,4194304] 0 2024-04-23T10:21:38.568 INFO:tasks.workunit.client.0.smithi029.stdout:7/764: unlink d5/d9/ld 0 2024-04-23T10:21:38.568 INFO:tasks.workunit.client.0.smithi029.stdout:8/680: dwrite d3/d7d/fc8 [0,4194304] 0 2024-04-23T10:21:38.569 INFO:tasks.workunit.client.0.smithi029.stdout:0/546: dread d0/d21/d7f/f48 [0,4194304] 0 2024-04-23T10:21:38.572 INFO:tasks.workunit.client.0.smithi029.stdout:9/855: chown d0/d7/d1d/d35/d3b/d68/l127 439841 1 2024-04-23T10:21:38.575 INFO:tasks.workunit.client.0.smithi029.stdout:8/681: getdents d3/d50/d6a/d95/d36 0 2024-04-23T10:21:38.575 INFO:tasks.workunit.client.0.smithi029.stdout:7/765: truncate d5/d8/d51/d55/d59/f5d 456817 0 2024-04-23T10:21:38.577 INFO:tasks.workunit.client.0.smithi029.stdout:3/633: dwrite d3/d10/de/d2e/d36/fa5 [0,4194304] 0 2024-04-23T10:21:38.583 INFO:tasks.workunit.client.0.smithi029.stdout:0/547: dwrite d0/d1b/d67/dae/d92/fac [0,4194304] 0 2024-04-23T10:21:38.585 INFO:tasks.workunit.client.0.smithi029.stdout:8/682: link d3/d50/d6a/d95/d36/d3e/fd2 d3/fd5 0 2024-04-23T10:21:38.587 INFO:tasks.workunit.client.0.smithi029.stdout:5/713: write d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/fa6 [2084654,61135] 0 2024-04-23T10:21:38.593 INFO:tasks.workunit.client.0.smithi029.stdout:5/714: fdatasync d0/d35/d38/d3e/d66/d5a/d78/d3d/fba 0 2024-04-23T10:21:38.594 INFO:tasks.workunit.client.0.smithi029.stdout:0/548: symlink d0/d3e/d4e/d50/d73/d7e/lbc 0 2024-04-23T10:21:38.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/715: write d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/fe2 [372240,47393] 0 2024-04-23T10:21:38.598 INFO:tasks.workunit.client.0.smithi029.stdout:0/549: creat d0/da9/d4c/d6d/fbd x:0 0 0 2024-04-23T10:21:38.601 INFO:tasks.workunit.client.0.smithi029.stdout:0/550: mkdir d0/d1b/d67/dae/d92/da0/dbe 0 2024-04-23T10:21:38.603 INFO:tasks.workunit.client.0.smithi029.stdout:5/716: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/fe7 x:0 0 0 2024-04-23T10:21:38.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/551: rmdir d0/d21/d7f 39 2024-04-23T10:21:38.612 INFO:tasks.workunit.client.0.smithi029.stdout:7/766: truncate d5/d29/ded/d8a/d8b/d8d/fbe 3603349 0 2024-04-23T10:21:38.616 INFO:tasks.workunit.client.0.smithi029.stdout:8/683: truncate d3/d38/f49 315246 0 2024-04-23T10:21:38.696 INFO:tasks.workunit.client.0.smithi029.stdout:0/552: dread d0/da9/d4c/f9c [0,4194304] 0 2024-04-23T10:21:38.719 INFO:tasks.workunit.client.0.smithi029.stdout:0/553: dwrite d0/da9/d4c/d6d/fbd [0,4194304] 0 2024-04-23T10:21:38.725 INFO:tasks.workunit.client.0.smithi029.stdout:0/554: dread - d0/d21/d7f/d55/f8a zero size 2024-04-23T10:21:38.727 INFO:tasks.workunit.client.0.smithi029.stdout:0/555: chown d0/f3f 14063244 1 2024-04-23T10:21:38.731 INFO:tasks.workunit.client.0.smithi029.stdout:0/556: mknod d0/da9/d4c/da7/cbf 0 2024-04-23T10:21:38.819 INFO:tasks.workunit.client.0.smithi029.stdout:5/717: write d0/f75 [855291,55106] 0 2024-04-23T10:21:38.825 INFO:tasks.workunit.client.0.smithi029.stdout:6/768: sync 2024-04-23T10:21:38.826 INFO:tasks.workunit.client.0.smithi029.stdout:5/718: getdents d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/ddd 0 2024-04-23T10:21:38.836 INFO:tasks.workunit.client.0.smithi029.stdout:5/719: dread d0/d35/d38/d3e/f4e [0,4194304] 0 2024-04-23T10:21:38.836 INFO:tasks.workunit.client.0.smithi029.stdout:6/769: fdatasync d9/df/d16/d1f/d27/dad/dd0/dea/f71 0 2024-04-23T10:21:38.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/770: mkdir d9/df/d16/d44/d101 0 2024-04-23T10:21:38.844 INFO:tasks.workunit.client.0.smithi029.stdout:5/720: truncate d0/d6a/fce 2977077 0 2024-04-23T10:21:38.845 INFO:tasks.workunit.client.0.smithi029.stdout:5/721: fdatasync d0/d35/d38/d39/f86 0 2024-04-23T10:21:38.859 INFO:tasks.workunit.client.0.smithi029.stdout:5/722: creat d0/d35/da1/fe8 x:0 0 0 2024-04-23T10:21:38.860 INFO:tasks.workunit.client.0.smithi029.stdout:7/767: write d5/d29/ded/d8a/f7d [4934858,99907] 0 2024-04-23T10:21:38.869 INFO:tasks.workunit.client.0.smithi029.stdout:7/768: creat d5/d71/df5/ffd x:0 0 0 2024-04-23T10:21:38.870 INFO:tasks.workunit.client.0.smithi029.stdout:5/723: chown d0/d35/d38/d3e/d66/d5a/d78/lcd 27 1 2024-04-23T10:21:38.880 INFO:tasks.workunit.client.0.smithi029.stdout:7/769: mkdir d5/dfe 0 2024-04-23T10:21:38.882 INFO:tasks.workunit.client.0.smithi029.stdout:5/724: read d0/d35/d10/d26/db2/fd4 [213132,55251] 0 2024-04-23T10:21:38.887 INFO:tasks.workunit.client.0.smithi029.stdout:7/770: chown d5/d8/d51/d9e/cae 7861 1 2024-04-23T10:21:38.892 INFO:tasks.workunit.client.0.smithi029.stdout:7/771: write d5/d29/ded/d8a/f7d [535752,82894] 0 2024-04-23T10:21:38.892 INFO:tasks.workunit.client.0.smithi029.stdout:6/771: dwrite d9/df/d41/fe7 [0,4194304] 0 2024-04-23T10:21:38.908 INFO:tasks.workunit.client.0.smithi029.stdout:5/725: link d0/d35/d38/d3e/d66/d5a/d78/l1d d0/d35/d38/d3e/d66/d5a/dcc/le9 0 2024-04-23T10:21:38.911 INFO:tasks.workunit.client.0.smithi029.stdout:7/772: mknod d5/d8/d51/d55/d59/daf/cff 0 2024-04-23T10:21:38.913 INFO:tasks.workunit.client.0.smithi029.stdout:7/773: write d5/d29/ded/d9c/dd3/fe5 [661144,90113] 0 2024-04-23T10:21:38.915 INFO:tasks.workunit.client.0.smithi029.stdout:6/772: symlink d9/df/d16/d1f/d27/d33/da4/d58/d7e/l102 0 2024-04-23T10:21:38.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/726: chown d0/d35/d38/d3e/d66/d5a/d78/d3d/l5c 1648307 1 2024-04-23T10:21:38.917 INFO:tasks.workunit.client.0.smithi029.stdout:7/774: rmdir d5/d9/de3 39 2024-04-23T10:21:38.919 INFO:tasks.workunit.client.0.smithi029.stdout:7/775: stat d5/d8/d51 0 2024-04-23T10:21:38.923 INFO:tasks.workunit.client.0.smithi029.stdout:6/773: read d9/fe [2750597,80158] 0 2024-04-23T10:21:38.926 INFO:tasks.workunit.client.0.smithi029.stdout:7/776: rename d5/d29/d4a/dc1/fc4 to d5/d29/dc9/f100 0 2024-04-23T10:21:38.927 INFO:tasks.workunit.client.0.smithi029.stdout:5/727: read d0/d35/d38/d3e/d66/d5a/d78/d3d/f4f [1595395,119837] 0 2024-04-23T10:21:38.936 INFO:tasks.workunit.client.0.smithi029.stdout:5/728: link d0/d35/d49/f67 d0/d35/d38/d3e/d66/d8c/dda/fea 0 2024-04-23T10:21:38.943 INFO:tasks.workunit.client.0.smithi029.stdout:5/729: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/feb x:0 0 0 2024-04-23T10:21:38.954 INFO:tasks.workunit.client.0.smithi029.stdout:5/730: dread d0/d35/d38/d3e/d66/d5a/d78/d3d/f4f [0,4194304] 0 2024-04-23T10:21:38.967 INFO:tasks.workunit.client.0.smithi029.stdout:5/731: rename d0/d35/d38/d3e/d66/d5a/d78/c3c to d0/d35/d10/d26/db2/dbc/cec 0 2024-04-23T10:21:39.117 INFO:tasks.workunit.client.0.smithi029.stdout:1/536: sync 2024-04-23T10:21:39.133 INFO:tasks.workunit.client.0.smithi029.stdout:1/537: dwrite d5/d6/f7c [0,4194304] 0 2024-04-23T10:21:39.136 INFO:tasks.workunit.client.0.smithi029.stdout:1/538: read - d5/d6/de/d22/d6c/fab zero size 2024-04-23T10:21:39.145 INFO:tasks.workunit.client.0.smithi029.stdout:1/539: creat d5/d6/de/d27/d38/d47/fac x:0 0 0 2024-04-23T10:21:39.231 INFO:tasks.workunit.client.0.smithi029.stdout:1/540: read d5/d6/de/d22/f51 [10496,21353] 0 2024-04-23T10:21:39.316 INFO:tasks.workunit.client.0.smithi029.stdout:2/594: sync 2024-04-23T10:21:39.334 INFO:tasks.workunit.client.0.smithi029.stdout:1/541: mkdir d5/d6/de/d27/da9/dad 0 2024-04-23T10:21:39.337 INFO:tasks.workunit.client.0.smithi029.stdout:2/595: mknod d1/cc7 0 2024-04-23T10:21:39.345 INFO:tasks.workunit.client.0.smithi029.stdout:1/542: unlink d5/d3e/f4b 0 2024-04-23T10:21:39.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/774: dwrite d9/df/d16/d1f/d27/dad/dbd/fca [0,4194304] 0 2024-04-23T10:21:39.365 INFO:tasks.workunit.client.0.smithi029.stdout:1/543: mkdir d5/d6/de/d22/d77/dae 0 2024-04-23T10:21:39.366 INFO:tasks.workunit.client.0.smithi029.stdout:5/732: dwrite d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/f8b [0,4194304] 0 2024-04-23T10:21:39.380 INFO:tasks.workunit.client.0.smithi029.stdout:6/775: creat d9/df/d16/d34/f103 x:0 0 0 2024-04-23T10:21:39.391 INFO:tasks.workunit.client.0.smithi029.stdout:1/544: truncate d5/f66 710070 0 2024-04-23T10:21:39.391 INFO:tasks.workunit.client.0.smithi029.stdout:2/596: link d1/dd/d47/l73 d1/d3e/d5a/lc8 0 2024-04-23T10:21:39.405 INFO:tasks.workunit.client.0.smithi029.stdout:5/733: creat d0/d35/d10/d26/db2/dbc/fed x:0 0 0 2024-04-23T10:21:39.412 INFO:tasks.workunit.client.0.smithi029.stdout:6/776: write f4 [9404669,33669] 0 2024-04-23T10:21:39.414 INFO:tasks.workunit.client.0.smithi029.stdout:1/545: creat d5/d6/de/d22/d77/faf x:0 0 0 2024-04-23T10:21:39.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/734: dread - d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/fa5 zero size 2024-04-23T10:21:39.431 INFO:tasks.workunit.client.0.smithi029.stdout:1/546: mkdir d5/d6/de/d27/d38/d47/db0 0 2024-04-23T10:21:39.434 INFO:tasks.workunit.client.0.smithi029.stdout:1/547: dread - d5/d6/de/d27/d38/d47/fa6 zero size 2024-04-23T10:21:39.435 INFO:tasks.workunit.client.0.smithi029.stdout:2/597: dread d1/dd/f49 [0,4194304] 0 2024-04-23T10:21:39.436 INFO:tasks.workunit.client.0.smithi029.stdout:6/777: rename d9/df/d16/d44/d4c/dbb to d9/df/d16/d1f/d27/dad/dd0/dea/d104 0 2024-04-23T10:21:39.437 INFO:tasks.workunit.client.0.smithi029.stdout:2/598: chown d1/dd/d60/lb1 921548 1 2024-04-23T10:21:39.440 INFO:tasks.workunit.client.0.smithi029.stdout:2/599: dread - d1/d3e/d3b/f7d zero size 2024-04-23T10:21:39.441 INFO:tasks.workunit.client.0.smithi029.stdout:5/735: write d0/f2f [1531917,34045] 0 2024-04-23T10:21:39.443 INFO:tasks.workunit.client.0.smithi029.stdout:1/548: getdents d5/d6/de/d27 0 2024-04-23T10:21:39.445 INFO:tasks.workunit.client.0.smithi029.stdout:6/778: creat d9/df/d16/d1f/d27/d33/da4/d58/f105 x:0 0 0 2024-04-23T10:21:39.448 INFO:tasks.workunit.client.0.smithi029.stdout:5/736: rmdir d0/d35/d38/d3e/d66/d5a/d78/d6d 39 2024-04-23T10:21:39.449 INFO:tasks.workunit.client.0.smithi029.stdout:1/549: truncate d5/d6/de/d27/f99 787448 0 2024-04-23T10:21:39.455 INFO:tasks.workunit.client.0.smithi029.stdout:5/737: truncate d0/d35/d38/d3e/d66/d5a/d78/d3d/fba 701900 0 2024-04-23T10:21:39.456 INFO:tasks.workunit.client.0.smithi029.stdout:9/856: sync 2024-04-23T10:21:39.457 INFO:tasks.workunit.client.0.smithi029.stdout:4/724: sync 2024-04-23T10:21:39.457 INFO:tasks.workunit.client.0.smithi029.stdout:1/550: symlink d5/d6/d34/lb1 0 2024-04-23T10:21:39.459 INFO:tasks.workunit.client.0.smithi029.stdout:9/857: chown d0/d7/d1d/d35/d3b/d68/l127 115319954 1 2024-04-23T10:21:39.460 INFO:tasks.workunit.client.0.smithi029.stdout:9/858: stat d0/d1b/d60/d123 0 2024-04-23T10:21:39.462 INFO:tasks.workunit.client.0.smithi029.stdout:9/859: dread - d0/d7/d1d/d35/d3b/f11d zero size 2024-04-23T10:21:39.464 INFO:tasks.workunit.client.0.smithi029.stdout:4/725: symlink d0/d3c/d52/dd6/l104 0 2024-04-23T10:21:39.464 INFO:tasks.workunit.client.0.smithi029.stdout:1/551: rmdir d5/d6/de/d15 39 2024-04-23T10:21:39.466 INFO:tasks.workunit.client.0.smithi029.stdout:6/779: creat d9/df/d16/d1f/d27/dad/dd0/dea/d104/ddc/f106 x:0 0 0 2024-04-23T10:21:39.468 INFO:tasks.workunit.client.0.smithi029.stdout:5/738: mknod d0/d35/d38/db3/cee 0 2024-04-23T10:21:39.475 INFO:tasks.workunit.client.0.smithi029.stdout:1/552: creat d5/d3e/da7/fb2 x:0 0 0 2024-04-23T10:21:39.475 INFO:tasks.workunit.client.0.smithi029.stdout:2/600: dwrite d1/d3e/d3b/f7f [0,4194304] 0 2024-04-23T10:21:39.477 INFO:tasks.workunit.client.0.smithi029.stdout:5/739: readlink d0/d35/d10/lbf 0 2024-04-23T10:21:39.481 INFO:tasks.workunit.client.0.smithi029.stdout:4/726: creat d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7/f105 x:0 0 0 2024-04-23T10:21:39.486 INFO:tasks.workunit.client.0.smithi029.stdout:2/601: dread - d1/fb3 zero size 2024-04-23T10:21:39.490 INFO:tasks.workunit.client.0.smithi029.stdout:9/860: truncate d0/d7/d1d/d35/dde/dba/fc6 1818848 0 2024-04-23T10:21:39.492 INFO:tasks.workunit.client.0.smithi029.stdout:9/861: chown d0/d1b/d39/fdf 246452 1 2024-04-23T10:21:39.494 INFO:tasks.workunit.client.0.smithi029.stdout:5/740: read d0/d35/d38/d3e/f56 [9901997,25638] 0 2024-04-23T10:21:39.503 INFO:tasks.workunit.client.0.smithi029.stdout:9/862: fdatasync d0/d7/d6/fa3 0 2024-04-23T10:21:39.504 INFO:tasks.workunit.client.0.smithi029.stdout:5/741: chown d0/d35/d83 233 1 2024-04-23T10:21:39.506 INFO:tasks.workunit.client.0.smithi029.stdout:4/727: creat d0/d3c/d52/d74/d8a/dba/dfe/f106 x:0 0 0 2024-04-23T10:21:39.506 INFO:tasks.workunit.client.0.smithi029.stdout:6/780: dwrite d9/df/d16/f1a [0,4194304] 0 2024-04-23T10:21:39.513 INFO:tasks.workunit.client.0.smithi029.stdout:3/634: sync 2024-04-23T10:21:39.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/557: sync 2024-04-23T10:21:39.514 INFO:tasks.workunit.client.0.smithi029.stdout:8/684: sync 2024-04-23T10:21:39.514 INFO:tasks.workunit.client.0.smithi029.stdout:7/777: sync 2024-04-23T10:21:39.516 INFO:tasks.workunit.client.0.smithi029.stdout:9/863: mkdir d0/d7/d6/d12c 0 2024-04-23T10:21:39.517 INFO:tasks.workunit.client.0.smithi029.stdout:1/553: dwrite d5/d6/de/d22/f51 [0,4194304] 0 2024-04-23T10:21:39.517 INFO:tasks.workunit.client.0.smithi029.stdout:7/778: fdatasync d5/d9/f65 0 2024-04-23T10:21:39.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/781: dread d9/df/d16/d34/f93 [0,4194304] 0 2024-04-23T10:21:39.524 INFO:tasks.workunit.client.0.smithi029.stdout:4/728: symlink d0/d3c/d52/d1b/d36/d45/l107 0 2024-04-23T10:21:39.525 INFO:tasks.workunit.client.0.smithi029.stdout:2/602: dwrite d1/f2e [0,4194304] 0 2024-04-23T10:21:39.531 INFO:tasks.workunit.client.0.smithi029.stdout:0/558: symlink d0/d1b/lc0 0 2024-04-23T10:21:39.532 INFO:tasks.workunit.client.0.smithi029.stdout:3/635: mkdir d3/d10/de/de1 0 2024-04-23T10:21:39.535 INFO:tasks.workunit.client.0.smithi029.stdout:7/779: dwrite d5/dc8/fea [0,4194304] 0 2024-04-23T10:21:39.543 INFO:tasks.workunit.client.0.smithi029.stdout:6/782: fsync d9/df/d16/d34/d36/d63/fce 0 2024-04-23T10:21:39.546 INFO:tasks.workunit.client.0.smithi029.stdout:0/559: read d0/f2f [1978374,40895] 0 2024-04-23T10:21:39.548 INFO:tasks.workunit.client.0.smithi029.stdout:7/780: dwrite d5/d29/d4a/f56 [0,4194304] 0 2024-04-23T10:21:39.549 INFO:tasks.workunit.client.0.smithi029.stdout:8/685: write d3/d50/d6a/d95/d36/d3e/f60 [706369,8670] 0 2024-04-23T10:21:39.550 INFO:tasks.workunit.client.0.smithi029.stdout:4/729: mkdir d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108 0 2024-04-23T10:21:39.556 INFO:tasks.workunit.client.0.smithi029.stdout:4/730: dread - d0/d5a/fb2 zero size 2024-04-23T10:21:39.570 INFO:tasks.workunit.client.0.smithi029.stdout:4/731: read - d0/d3c/d52/d1b/d36/d45/d4f/df2/ff5 zero size 2024-04-23T10:21:39.571 INFO:tasks.workunit.client.0.smithi029.stdout:5/742: dread d0/d35/d38/fa0 [0,4194304] 0 2024-04-23T10:21:39.571 INFO:tasks.workunit.client.0.smithi029.stdout:1/554: dwrite d5/d6/f40 [0,4194304] 0 2024-04-23T10:21:39.571 INFO:tasks.workunit.client.0.smithi029.stdout:2/603: dwrite d1/dd/d47/d63/d64/f80 [0,4194304] 0 2024-04-23T10:21:39.571 INFO:tasks.workunit.client.0.smithi029.stdout:8/686: creat d3/d50/fd6 x:0 0 0 2024-04-23T10:21:39.574 INFO:tasks.workunit.client.0.smithi029.stdout:3/636: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d31/db6/fd9 [0,4194304] 0 2024-04-23T10:21:39.576 INFO:tasks.workunit.client.0.smithi029.stdout:9/864: dwrite d0/d1b/d39/d50/f16 [0,4194304] 0 2024-04-23T10:21:39.577 INFO:tasks.workunit.client.0.smithi029.stdout:4/732: chown d0/d3c/d52/d74/d8a/dba 34142 1 2024-04-23T10:21:39.581 INFO:tasks.workunit.client.0.smithi029.stdout:3/637: write d3/d10/de/d2e/d36/d40/d46/d65/f98 [681269,35379] 0 2024-04-23T10:21:39.581 INFO:tasks.workunit.client.0.smithi029.stdout:9/865: chown d0/d7/d1d/d35/d3b/d68/dbd 933 1 2024-04-23T10:21:39.582 INFO:tasks.workunit.client.0.smithi029.stdout:7/781: write d5/fa0 [4053468,104850] 0 2024-04-23T10:21:39.584 INFO:tasks.workunit.client.0.smithi029.stdout:6/783: dwrite d9/f10 [0,4194304] 0 2024-04-23T10:21:39.594 INFO:tasks.workunit.client.0.smithi029.stdout:4/733: chown d0/d3c/d52/d1b/d36/d45/l76 61604158 1 2024-04-23T10:21:39.595 INFO:tasks.workunit.client.0.smithi029.stdout:6/784: fsync d9/df/d16/d34/d36/d63/fce 0 2024-04-23T10:21:39.596 INFO:tasks.workunit.client.0.smithi029.stdout:0/560: dread d0/f6 [0,4194304] 0 2024-04-23T10:21:39.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/743: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c 130575 1 2024-04-23T10:21:39.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/744: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6 3278 1 2024-04-23T10:21:39.601 INFO:tasks.workunit.client.0.smithi029.stdout:9/866: mkdir d0/d7/d1d/d35/dd9/d12d 0 2024-04-23T10:21:39.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/782: mknod d5/d29/ded/d8a/d8b/c101 0 2024-04-23T10:21:39.608 INFO:tasks.workunit.client.0.smithi029.stdout:1/555: truncate d5/f70 2587503 0 2024-04-23T10:21:39.608 INFO:tasks.workunit.client.0.smithi029.stdout:3/638: mkdir d3/d10/de/d2e/de2 0 2024-04-23T10:21:39.611 INFO:tasks.workunit.client.0.smithi029.stdout:2/604: creat d1/dd/d60/fc9 x:0 0 0 2024-04-23T10:21:39.614 INFO:tasks.workunit.client.0.smithi029.stdout:0/561: stat d0/d3e/d4e/d50/c83 0 2024-04-23T10:21:39.615 INFO:tasks.workunit.client.0.smithi029.stdout:4/734: dread d0/d3c/d52/f42 [4194304,4194304] 0 2024-04-23T10:21:39.615 INFO:tasks.workunit.client.0.smithi029.stdout:9/867: stat d0/d1b/l2a 0 2024-04-23T10:21:39.622 INFO:tasks.workunit.client.0.smithi029.stdout:1/556: chown d5/d6/de/d22/f2f 1182941 1 2024-04-23T10:21:39.623 INFO:tasks.workunit.client.0.smithi029.stdout:7/783: mknod d5/d29/c102 0 2024-04-23T10:21:39.625 INFO:tasks.workunit.client.0.smithi029.stdout:5/745: dread d0/d35/d38/d39/d3f/fc0 [0,4194304] 0 2024-04-23T10:21:39.626 INFO:tasks.workunit.client.0.smithi029.stdout:3/639: mknod d3/d10/de/d2e/d36/d40/d46/d65/ce3 0 2024-04-23T10:21:39.627 INFO:tasks.workunit.client.0.smithi029.stdout:6/785: truncate d9/df/d16/d1f/d27/f57 587797 0 2024-04-23T10:21:39.627 INFO:tasks.workunit.client.0.smithi029.stdout:8/687: dwrite d3/d44/f62 [4194304,4194304] 0 2024-04-23T10:21:39.627 INFO:tasks.workunit.client.0.smithi029.stdout:2/605: truncate d1/d31/d50/d9b/fc4 305405 0 2024-04-23T10:21:39.627 INFO:tasks.workunit.client.0.smithi029.stdout:0/562: mknod d0/d3e/d4e/cc1 0 2024-04-23T10:21:39.629 INFO:tasks.workunit.client.0.smithi029.stdout:1/557: write d5/d6/de/d27/d38/d47/fa8 [21420,16345] 0 2024-04-23T10:21:39.631 INFO:tasks.workunit.client.0.smithi029.stdout:4/735: rename d0/d3c/d52/d74/f101 to d0/d3c/d52/d74/f109 0 2024-04-23T10:21:39.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/606: rmdir d1/dd/d22 39 2024-04-23T10:21:39.639 INFO:tasks.workunit.client.0.smithi029.stdout:2/607: write d1/dd/d47/d63/d64/f6b [5196562,117331] 0 2024-04-23T10:21:39.639 INFO:tasks.workunit.client.0.smithi029.stdout:7/784: write d5/d8/d51/f53 [1371283,122749] 0 2024-04-23T10:21:39.641 INFO:tasks.workunit.client.0.smithi029.stdout:8/688: truncate d3/d50/d6a/d95/f54 2806465 0 2024-04-23T10:21:39.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/640: write d3/d10/de/d2e/d36/d40/d46/f9f [2123260,44705] 0 2024-04-23T10:21:39.644 INFO:tasks.workunit.client.0.smithi029.stdout:1/558: dread - d5/d6/de/d22/d77/faf zero size 2024-04-23T10:21:39.646 INFO:tasks.workunit.client.0.smithi029.stdout:6/786: mkdir d9/df/d16/d44/d75/d90/d107 0 2024-04-23T10:21:39.649 INFO:tasks.workunit.client.0.smithi029.stdout:0/563: rename d0/d21/d7f/f48 to d0/da9/d4c/d6d/fc2 0 2024-04-23T10:21:39.649 INFO:tasks.workunit.client.0.smithi029.stdout:7/785: readlink d5/d29/ded/lad 0 2024-04-23T10:21:39.654 INFO:tasks.workunit.client.0.smithi029.stdout:4/736: dwrite d0/fa [0,4194304] 0 2024-04-23T10:21:39.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/746: dwrite d0/d35/f1c [0,4194304] 0 2024-04-23T10:21:39.661 INFO:tasks.workunit.client.0.smithi029.stdout:8/689: dread d3/d50/d6a/d95/f82 [0,4194304] 0 2024-04-23T10:21:39.661 INFO:tasks.workunit.client.0.smithi029.stdout:7/786: fdatasync d5/d9/fc5 0 2024-04-23T10:21:39.662 INFO:tasks.workunit.client.0.smithi029.stdout:0/564: creat d0/d3e/fc3 x:0 0 0 2024-04-23T10:21:39.663 INFO:tasks.workunit.client.0.smithi029.stdout:2/608: rename d1/d3e/fc6 to d1/d3e/d3b/fca 0 2024-04-23T10:21:39.665 INFO:tasks.workunit.client.0.smithi029.stdout:9/868: dread d0/d1b/d39/f42 [0,4194304] 0 2024-04-23T10:21:39.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/559: dread d5/d6/de/d27/d38/d47/fa8 [0,4194304] 0 2024-04-23T10:21:39.672 INFO:tasks.workunit.client.0.smithi029.stdout:0/565: rmdir d0/d3e/d4e 39 2024-04-23T10:21:39.672 INFO:tasks.workunit.client.0.smithi029.stdout:6/787: dwrite d9/df/d16/d44/d75/d90/fee [0,4194304] 0 2024-04-23T10:21:39.681 INFO:tasks.workunit.client.0.smithi029.stdout:3/641: link c1 d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/ce4 0 2024-04-23T10:21:39.682 INFO:tasks.workunit.client.0.smithi029.stdout:5/747: write d0/d35/d38/d39/f8a [3699135,67216] 0 2024-04-23T10:21:39.682 INFO:tasks.workunit.client.0.smithi029.stdout:2/609: symlink d1/dd/d22/lcb 0 2024-04-23T10:21:39.690 INFO:tasks.workunit.client.0.smithi029.stdout:4/737: dread d0/d3c/d52/d74/fa4 [0,4194304] 0 2024-04-23T10:21:39.695 INFO:tasks.workunit.client.0.smithi029.stdout:7/787: getdents d5/d8/d51/d55/da5 0 2024-04-23T10:21:39.695 INFO:tasks.workunit.client.0.smithi029.stdout:1/560: dwrite d5/d6/de/d22/f2f [0,4194304] 0 2024-04-23T10:21:39.697 INFO:tasks.workunit.client.0.smithi029.stdout:3/642: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/de5 0 2024-04-23T10:21:39.697 INFO:tasks.workunit.client.0.smithi029.stdout:9/869: dwrite d0/d7/d1d/d35/dd9/d49/d65/f8a [4194304,4194304] 0 2024-04-23T10:21:39.697 INFO:tasks.workunit.client.0.smithi029.stdout:0/566: getdents d0/d3e/d4e/d50 0 2024-04-23T10:21:39.700 INFO:tasks.workunit.client.0.smithi029.stdout:0/567: read - d0/d3e/d4e/d7c/fa3 zero size 2024-04-23T10:21:39.702 INFO:tasks.workunit.client.0.smithi029.stdout:1/561: chown d5/l96 0 1 2024-04-23T10:21:39.703 INFO:tasks.workunit.client.0.smithi029.stdout:7/788: symlink d5/d29/d4a/l103 0 2024-04-23T10:21:39.704 INFO:tasks.workunit.client.0.smithi029.stdout:6/788: dwrite d9/df/d16/d44/d4c/dd9/df6/fc2 [0,4194304] 0 2024-04-23T10:21:39.705 INFO:tasks.workunit.client.0.smithi029.stdout:1/562: write d5/d8c/f93 [245550,72501] 0 2024-04-23T10:21:39.705 INFO:tasks.workunit.client.0.smithi029.stdout:7/789: read - d5/d71/df5/ffc zero size 2024-04-23T10:21:39.706 INFO:tasks.workunit.client.0.smithi029.stdout:0/568: symlink d0/d1b/d67/dae/d92/da0/lc4 0 2024-04-23T10:21:39.714 INFO:tasks.workunit.client.0.smithi029.stdout:2/610: rename d1/d31/d50/faa to d1/dd/d47/d63/d64/fcc 0 2024-04-23T10:21:39.718 INFO:tasks.workunit.client.0.smithi029.stdout:7/790: read d5/d9/f65 [1310065,86118] 0 2024-04-23T10:21:39.721 INFO:tasks.workunit.client.0.smithi029.stdout:1/563: symlink d5/d6/de/d27/d38/d47/lb3 0 2024-04-23T10:21:39.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/870: getdents d0/d1b/d39/d50/dd4 0 2024-04-23T10:21:39.726 INFO:tasks.workunit.client.0.smithi029.stdout:7/791: mknod d5/d9/de3/c104 0 2024-04-23T10:21:39.727 INFO:tasks.workunit.client.0.smithi029.stdout:0/569: dread d0/dc/f36 [0,4194304] 0 2024-04-23T10:21:39.727 INFO:tasks.workunit.client.0.smithi029.stdout:4/738: rename d0/d3c/d52/d20/f81 to d0/d12/da9/f10a 0 2024-04-23T10:21:39.731 INFO:tasks.workunit.client.0.smithi029.stdout:7/792: mkdir d5/d71/df5/d105 0 2024-04-23T10:21:39.734 INFO:tasks.workunit.client.0.smithi029.stdout:1/564: write d5/d6/de/d22/f23 [2692374,84074] 0 2024-04-23T10:21:39.734 INFO:tasks.workunit.client.0.smithi029.stdout:6/789: write d9/df/d16/d1f/d27/d33/da4/d58/d7e/fd4 [211963,81519] 0 2024-04-23T10:21:39.737 INFO:tasks.workunit.client.0.smithi029.stdout:1/565: fsync d5/d6/d34/d63/fa2 0 2024-04-23T10:21:39.739 INFO:tasks.workunit.client.0.smithi029.stdout:9/871: dread d0/d1b/d39/d112/fa6 [0,4194304] 0 2024-04-23T10:21:39.743 INFO:tasks.workunit.client.0.smithi029.stdout:2/611: dwrite d1/d3e/d5a/f84 [0,4194304] 0 2024-04-23T10:21:39.743 INFO:tasks.workunit.client.0.smithi029.stdout:0/570: symlink d0/d1b/d67/dae/d6a/lc5 0 2024-04-23T10:21:39.746 INFO:tasks.workunit.client.0.smithi029.stdout:4/739: dread d0/d3c/d52/d74/d8a/dba/fee [0,4194304] 0 2024-04-23T10:21:39.746 INFO:tasks.workunit.client.0.smithi029.stdout:0/571: stat d0/d21/d7f/d3a/f87 0 2024-04-23T10:21:39.747 INFO:tasks.workunit.client.0.smithi029.stdout:6/790: mknod d9/df/d16/d44/d4c/dd9/df6/c108 0 2024-04-23T10:21:39.748 INFO:tasks.workunit.client.0.smithi029.stdout:2/612: fsync d1/dd/f51 0 2024-04-23T10:21:39.750 INFO:tasks.workunit.client.0.smithi029.stdout:7/793: creat d5/d8/d80/f106 x:0 0 0 2024-04-23T10:21:39.752 INFO:tasks.workunit.client.0.smithi029.stdout:6/791: stat d9/df/d16/d34/f51 0 2024-04-23T10:21:39.755 INFO:tasks.workunit.client.0.smithi029.stdout:4/740: mkdir d0/d12/d10b 0 2024-04-23T10:21:39.757 INFO:tasks.workunit.client.0.smithi029.stdout:0/572: symlink d0/d3e/d4e/d50/d71/da4/lc6 0 2024-04-23T10:21:39.758 INFO:tasks.workunit.client.0.smithi029.stdout:2/613: chown d1/d31/d3d/c4f 37476 1 2024-04-23T10:21:39.759 INFO:tasks.workunit.client.0.smithi029.stdout:6/792: truncate d9/df/d25/fe9 263413 0 2024-04-23T10:21:39.759 INFO:tasks.workunit.client.0.smithi029.stdout:1/566: write d5/d6/d34/d63/f75 [1747582,14926] 0 2024-04-23T10:21:39.763 INFO:tasks.workunit.client.0.smithi029.stdout:9/872: link d0/d7/d1d/d35/dd5/df2/f101 d0/d7/d1d/f12e 0 2024-04-23T10:21:39.763 INFO:tasks.workunit.client.0.smithi029.stdout:0/573: mkdir d0/da9/d4c/da7/dc7 0 2024-04-23T10:21:39.764 INFO:tasks.workunit.client.0.smithi029.stdout:1/567: dread d5/d6/de/d27/f99 [0,4194304] 0 2024-04-23T10:21:39.764 INFO:tasks.workunit.client.0.smithi029.stdout:7/794: fsync d5/d29/ded/d8a/fa3 0 2024-04-23T10:21:39.766 INFO:tasks.workunit.client.0.smithi029.stdout:7/795: chown d5/f2c 117955 1 2024-04-23T10:21:39.770 INFO:tasks.workunit.client.0.smithi029.stdout:4/741: dwrite d0/d12/da9/f103 [0,4194304] 0 2024-04-23T10:21:39.771 INFO:tasks.workunit.client.0.smithi029.stdout:4/742: chown d0/d3c/d52/d1b/d36/d45/l107 587 1 2024-04-23T10:21:39.772 INFO:tasks.workunit.client.0.smithi029.stdout:0/574: fsync d0/d21/d7f/d55/f8a 0 2024-04-23T10:21:39.773 INFO:tasks.workunit.client.0.smithi029.stdout:2/614: mkdir d1/d3e/d5a/dcd 0 2024-04-23T10:21:39.773 INFO:tasks.workunit.client.0.smithi029.stdout:2/615: stat d1/dd/f51 0 2024-04-23T10:21:39.779 INFO:tasks.workunit.client.0.smithi029.stdout:4/743: readlink d0/d3c/d52/d1b/l24 0 2024-04-23T10:21:39.783 INFO:tasks.workunit.client.0.smithi029.stdout:6/793: write d9/df/d16/d1f/d27/d33/da4/d66/d95/fe2 [203760,58762] 0 2024-04-23T10:21:39.783 INFO:tasks.workunit.client.0.smithi029.stdout:2/616: write d1/d3e/d5a/f93 [2447090,98165] 0 2024-04-23T10:21:39.785 INFO:tasks.workunit.client.0.smithi029.stdout:9/873: mkdir d0/d7/d1d/d35/d3b/d68/d12f 0 2024-04-23T10:21:39.785 INFO:tasks.workunit.client.0.smithi029.stdout:0/575: write d0/f2b [1525762,3301] 0 2024-04-23T10:21:39.788 INFO:tasks.workunit.client.0.smithi029.stdout:7/796: creat d5/d8/d51/d9e/f107 x:0 0 0 2024-04-23T10:21:39.788 INFO:tasks.workunit.client.0.smithi029.stdout:6/794: fdatasync d9/df/d16/d34/f93 0 2024-04-23T10:21:39.793 INFO:tasks.workunit.client.0.smithi029.stdout:9/874: chown d0/d1b/d39/d112/l9e 1238 1 2024-04-23T10:21:39.793 INFO:tasks.workunit.client.0.smithi029.stdout:1/568: dwrite d5/f70 [0,4194304] 0 2024-04-23T10:21:39.795 INFO:tasks.workunit.client.0.smithi029.stdout:4/744: symlink d0/d3c/d52/d1b/d5b/d65/d6a/d7c/l10c 0 2024-04-23T10:21:39.797 INFO:tasks.workunit.client.0.smithi029.stdout:4/745: chown d0/d3c/d52/d1b/l24 0 1 2024-04-23T10:21:39.799 INFO:tasks.workunit.client.0.smithi029.stdout:4/746: write d0/d3c/d52/d1b/d36/d45/f78 [2770619,77744] 0 2024-04-23T10:21:39.804 INFO:tasks.workunit.client.0.smithi029.stdout:2/617: link d1/dd/d60/fc9 d1/dd/d47/d63/d64/d78/fce 0 2024-04-23T10:21:39.804 INFO:tasks.workunit.client.0.smithi029.stdout:0/576: creat d0/d1b/d67/dae/d92/fc8 x:0 0 0 2024-04-23T10:21:39.805 INFO:tasks.workunit.client.0.smithi029.stdout:9/875: write d0/fa2 [44416,11532] 0 2024-04-23T10:21:39.813 INFO:tasks.workunit.client.0.smithi029.stdout:4/747: dread - d0/d3c/d52/d74/fd2 zero size 2024-04-23T10:21:39.816 INFO:tasks.workunit.client.0.smithi029.stdout:0/577: stat d0/dc/d26/f41 0 2024-04-23T10:21:39.818 INFO:tasks.workunit.client.0.smithi029.stdout:9/876: read d0/d7/d1d/f74 [485303,85767] 0 2024-04-23T10:21:39.819 INFO:tasks.workunit.client.0.smithi029.stdout:6/795: dwrite d9/df/d16/d1f/d27/d33/f32 [0,4194304] 0 2024-04-23T10:21:39.819 INFO:tasks.workunit.client.0.smithi029.stdout:2/618: write d1/d31/d50/d9b/d9e/fa3 [1005775,67513] 0 2024-04-23T10:21:39.821 INFO:tasks.workunit.client.0.smithi029.stdout:6/796: fdatasync d9/df/d16/d1f/d2c/f4a 0 2024-04-23T10:21:39.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/797: chown d9/df/d16/d34/d36 3605 1 2024-04-23T10:21:39.825 INFO:tasks.workunit.client.0.smithi029.stdout:7/797: dread d5/d29/ded/d8a/f9b [4194304,4194304] 0 2024-04-23T10:21:39.829 INFO:tasks.workunit.client.0.smithi029.stdout:1/569: dread d5/f37 [0,4194304] 0 2024-04-23T10:21:39.830 INFO:tasks.workunit.client.0.smithi029.stdout:1/570: chown d5/d6/de/d22/d77/f98 111388194 1 2024-04-23T10:21:39.831 INFO:tasks.workunit.client.0.smithi029.stdout:4/748: mknod d0/d3c/d52/d1b/d5b/d65/c10d 0 2024-04-23T10:21:39.832 INFO:tasks.workunit.client.0.smithi029.stdout:9/877: mknod d0/d7/d1d/d35/dde/dba/c130 0 2024-04-23T10:21:39.833 INFO:tasks.workunit.client.0.smithi029.stdout:9/878: stat d0/d7/d6 0 2024-04-23T10:21:39.835 INFO:tasks.workunit.client.0.smithi029.stdout:6/798: mknod d9/df/d16/d1f/d27/dad/c109 0 2024-04-23T10:21:39.836 INFO:tasks.workunit.client.0.smithi029.stdout:2/619: mkdir d1/dd/d47/d63/d64/d78/da6/dcf 0 2024-04-23T10:21:39.836 INFO:tasks.workunit.client.0.smithi029.stdout:4/749: readlink d0/d3c/d52/l5d 0 2024-04-23T10:21:39.838 INFO:tasks.workunit.client.0.smithi029.stdout:9/879: stat d0/d7/d1d/fbe 0 2024-04-23T10:21:39.840 INFO:tasks.workunit.client.0.smithi029.stdout:1/571: creat d5/d6/de/d15/d7b/fb4 x:0 0 0 2024-04-23T10:21:39.842 INFO:tasks.workunit.client.0.smithi029.stdout:0/578: dwrite d0/f1 [8388608,4194304] 0 2024-04-23T10:21:39.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/799: fsync d9/df/d16/d44/d4c/dd9/df6/fbf 0 2024-04-23T10:21:39.845 INFO:tasks.workunit.client.0.smithi029.stdout:9/880: mkdir d0/d7/d1d/d35/d131 0 2024-04-23T10:21:39.851 INFO:tasks.workunit.client.0.smithi029.stdout:4/750: write d0/d3c/d52/f75 [7755003,72090] 0 2024-04-23T10:21:39.851 INFO:tasks.workunit.client.0.smithi029.stdout:9/881: readlink d0/d1b/d39/l5e 0 2024-04-23T10:21:39.856 INFO:tasks.workunit.client.0.smithi029.stdout:6/800: symlink d9/df/d16/d1f/d27/dad/dd0/l10a 0 2024-04-23T10:21:39.858 INFO:tasks.workunit.client.0.smithi029.stdout:9/882: chown d0/d7/d3f/f4c 19843 1 2024-04-23T10:21:39.858 INFO:tasks.workunit.client.0.smithi029.stdout:2/620: link d1/d3e/fa9 d1/dd/d47/d63/d64/d78/da6/dcf/fd0 0 2024-04-23T10:21:39.860 INFO:tasks.workunit.client.0.smithi029.stdout:2/621: rmdir d1/dd 39 2024-04-23T10:21:39.861 INFO:tasks.workunit.client.0.smithi029.stdout:4/751: unlink d0/d5a/d96/le1 0 2024-04-23T10:21:39.863 INFO:tasks.workunit.client.0.smithi029.stdout:4/752: chown d0/fa 5929 1 2024-04-23T10:21:39.864 INFO:tasks.workunit.client.0.smithi029.stdout:6/801: dread d9/df/d25/fe9 [0,4194304] 0 2024-04-23T10:21:39.864 INFO:tasks.workunit.client.0.smithi029.stdout:2/622: fdatasync d1/d3e/d5a/f6e 0 2024-04-23T10:21:39.866 INFO:tasks.workunit.client.0.smithi029.stdout:6/802: stat d9/df/d16/d1f/d27/d33/da4/d66/cf1 0 2024-04-23T10:21:39.868 INFO:tasks.workunit.client.0.smithi029.stdout:2/623: fsync d1/dd/d47/d63/d64/fb4 0 2024-04-23T10:21:39.868 INFO:tasks.workunit.client.0.smithi029.stdout:4/753: truncate d0/d3c/d52/d1b/d36/d45/d4f/df2/ff5 902791 0 2024-04-23T10:21:39.869 INFO:tasks.workunit.client.0.smithi029.stdout:6/803: stat d9/df/d16/d44/d4c/ce0 0 2024-04-23T10:21:39.872 INFO:tasks.workunit.client.0.smithi029.stdout:0/579: dwrite d0/da9/f70 [0,4194304] 0 2024-04-23T10:21:39.872 INFO:tasks.workunit.client.0.smithi029.stdout:2/624: mkdir d1/d3e/d3b/d75/dd1 0 2024-04-23T10:21:39.873 INFO:tasks.workunit.client.0.smithi029.stdout:1/572: truncate d5/d6/d34/d63/f75 1773016 0 2024-04-23T10:21:39.876 INFO:tasks.workunit.client.0.smithi029.stdout:0/580: truncate d0/d1b/d67/dae/d92/fc8 978192 0 2024-04-23T10:21:39.878 INFO:tasks.workunit.client.0.smithi029.stdout:1/573: mknod d5/d6/de/d27/da9/dad/cb5 0 2024-04-23T10:21:39.881 INFO:tasks.workunit.client.0.smithi029.stdout:4/754: rename d0/d3c/d52/d20/cb8 to d0/d3c/d52/d74/d8a/dba/c10e 0 2024-04-23T10:21:39.884 INFO:tasks.workunit.client.0.smithi029.stdout:9/883: write d0/d1b/d39/d4f/f5f [468271,97811] 0 2024-04-23T10:21:39.890 INFO:tasks.workunit.client.0.smithi029.stdout:0/581: dwrite d0/d21/f53 [0,4194304] 0 2024-04-23T10:21:39.893 INFO:tasks.workunit.client.0.smithi029.stdout:1/574: dwrite d5/d6/de/d27/d38/d47/fa6 [0,4194304] 0 2024-04-23T10:21:39.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/884: getdents d0/d7/d1d/d35/d3b/d68/d12f 0 2024-04-23T10:21:39.899 INFO:tasks.workunit.client.0.smithi029.stdout:4/755: write d0/d3c/d52/d1b/d5b/d65/f85 [3747904,566] 0 2024-04-23T10:21:39.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/885: readlink d0/d1b/l4e 0 2024-04-23T10:21:39.901 INFO:tasks.workunit.client.0.smithi029.stdout:4/756: chown d0/d3c/d52/d74/d8a/fb4 0 1 2024-04-23T10:21:39.904 INFO:tasks.workunit.client.0.smithi029.stdout:2/625: dwrite d1/f8c [4194304,4194304] 0 2024-04-23T10:21:39.910 INFO:tasks.workunit.client.0.smithi029.stdout:2/626: creat d1/d3e/d5a/dcd/fd2 x:0 0 0 2024-04-23T10:21:39.912 INFO:tasks.workunit.client.0.smithi029.stdout:0/582: read d0/d3e/d4e/d7c/f9a [1454494,95850] 0 2024-04-23T10:21:39.913 INFO:tasks.workunit.client.0.smithi029.stdout:2/627: chown d1/d3e/cad 39620457 1 2024-04-23T10:21:39.914 INFO:tasks.workunit.client.0.smithi029.stdout:4/757: rename d0/d3c/d52/d1b/d5b/d65/c9a to d0/d3c/d52/d1b/d9f/d92/da3/c10f 0 2024-04-23T10:21:39.915 INFO:tasks.workunit.client.0.smithi029.stdout:2/628: chown d1/d3e/c86 34417519 1 2024-04-23T10:21:39.916 INFO:tasks.workunit.client.0.smithi029.stdout:0/583: fdatasync d0/d3e/d4e/d7c/f9b 0 2024-04-23T10:21:39.918 INFO:tasks.workunit.client.0.smithi029.stdout:6/804: dread d9/df/d16/d34/f91 [0,4194304] 0 2024-04-23T10:21:39.919 INFO:tasks.workunit.client.0.smithi029.stdout:0/584: readlink d0/d1b/l1d 0 2024-04-23T10:21:39.919 INFO:tasks.workunit.client.0.smithi029.stdout:2/629: write d1/d3e/d5a/f93 [1647217,7415] 0 2024-04-23T10:21:39.921 INFO:tasks.workunit.client.0.smithi029.stdout:6/805: readlink d9/df/d16/d34/l8f 0 2024-04-23T10:21:39.926 INFO:tasks.workunit.client.0.smithi029.stdout:2/630: creat d1/d3e/d3b/d75/dd1/fd3 x:0 0 0 2024-04-23T10:21:39.929 INFO:tasks.workunit.client.0.smithi029.stdout:9/886: dwrite d0/d7/d3f/f96 [0,4194304] 0 2024-04-23T10:21:39.929 INFO:tasks.workunit.client.0.smithi029.stdout:2/631: readlink d1/dd/d22/lcb 0 2024-04-23T10:21:39.930 INFO:tasks.workunit.client.0.smithi029.stdout:0/585: rename d0/d1b/d67/d6c/l80 to d0/d21/d7f/d3a/lc9 0 2024-04-23T10:21:39.931 INFO:tasks.workunit.client.0.smithi029.stdout:6/806: dread d9/df/d16/d1f/d27/d33/da4/d66/d95/faa [0,4194304] 0 2024-04-23T10:21:39.932 INFO:tasks.workunit.client.0.smithi029.stdout:4/758: dwrite d0/d3c/d52/d1b/f6b [0,4194304] 0 2024-04-23T10:21:39.936 INFO:tasks.workunit.client.0.smithi029.stdout:0/586: chown d0/dc/d26/l9f 29519209 1 2024-04-23T10:21:39.941 INFO:tasks.workunit.client.0.smithi029.stdout:4/759: dwrite d0/d3c/d52/d1b/d36/d45/f58 [0,4194304] 0 2024-04-23T10:21:39.947 INFO:tasks.workunit.client.0.smithi029.stdout:1/575: write d5/d6/d34/d63/f75 [857425,14354] 0 2024-04-23T10:21:39.950 INFO:tasks.workunit.client.0.smithi029.stdout:4/760: mknod d0/d3c/d52/d1b/d9f/d92/c110 0 2024-04-23T10:21:39.955 INFO:tasks.workunit.client.0.smithi029.stdout:2/632: truncate d1/d3e/d5a/d6d/fa1 782289 0 2024-04-23T10:21:39.957 INFO:tasks.workunit.client.0.smithi029.stdout:1/576: symlink d5/d6/de/d15/d7b/lb6 0 2024-04-23T10:21:39.958 INFO:tasks.workunit.client.0.smithi029.stdout:4/761: stat d0/d3c/d52/d1b/d36/d45/cb9 0 2024-04-23T10:21:39.959 INFO:tasks.workunit.client.0.smithi029.stdout:1/577: chown d5/d6/d34/d63/fa2 21309398 1 2024-04-23T10:21:39.960 INFO:tasks.workunit.client.0.smithi029.stdout:7/798: dread d5/d29/ded/d8a/f7d [0,4194304] 0 2024-04-23T10:21:39.961 INFO:tasks.workunit.client.0.smithi029.stdout:7/799: dread - d5/d29/ded/f78 zero size 2024-04-23T10:21:39.962 INFO:tasks.workunit.client.0.smithi029.stdout:7/800: chown d5/d71/d92/db7/dc3/dcc 6966647 1 2024-04-23T10:21:39.965 INFO:tasks.workunit.client.0.smithi029.stdout:2/633: creat d1/fd4 x:0 0 0 2024-04-23T10:21:39.965 INFO:tasks.workunit.client.0.smithi029.stdout:0/587: write d0/d21/d7f/f31 [514418,115031] 0 2024-04-23T10:21:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:2/634: mkdir d1/dd5 0 2024-04-23T10:21:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:4/762: write d0/d3c/d52/d74/d8a/fb4 [3708834,51645] 0 2024-04-23T10:21:40.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/578: write d5/d6/de/d22/f5f [4856070,86172] 0 2024-04-23T10:21:40.048 INFO:tasks.workunit.client.0.smithi029.stdout:2/635: readlink d1/dd/d47/d63/lb0 0 2024-04-23T10:21:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:7/801: write d5/d71/f72 [433498,68219] 0 2024-04-23T10:21:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:6/807: dwrite d9/df/d16/d44/d75/f85 [0,4194304] 0 2024-04-23T10:21:40.051 INFO:tasks.workunit.client.0.smithi029.stdout:1/579: readlink d5/l2d 0 2024-04-23T10:21:40.061 INFO:tasks.workunit.client.0.smithi029.stdout:6/808: fdatasync d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/fe8 0 2024-04-23T10:21:40.064 INFO:tasks.workunit.client.0.smithi029.stdout:4/763: unlink d0/d3c/d52/d74/d8a/dba/c10e 0 2024-04-23T10:21:40.069 INFO:tasks.workunit.client.0.smithi029.stdout:4/764: fdatasync d0/d3c/d52/d1b/d36/ffc 0 2024-04-23T10:21:40.074 INFO:tasks.workunit.client.0.smithi029.stdout:0/588: write d0/dc/d26/f28 [315983,5082] 0 2024-04-23T10:21:40.077 INFO:tasks.workunit.client.0.smithi029.stdout:0/589: chown d0/d21/d7f/d3a/l7d 141606 1 2024-04-23T10:21:40.086 INFO:tasks.workunit.client.0.smithi029.stdout:0/590: dread d0/da9/f70 [0,4194304] 0 2024-04-23T10:21:40.095 INFO:tasks.workunit.client.0.smithi029.stdout:2/636: dwrite d1/d3e/f66 [0,4194304] 0 2024-04-23T10:21:40.107 INFO:tasks.workunit.client.0.smithi029.stdout:1/580: dwrite d5/d6/de/d22/f5b [0,4194304] 0 2024-04-23T10:21:40.110 INFO:tasks.workunit.client.0.smithi029.stdout:4/765: dread d0/d3c/d52/d1b/f2e [8388608,4194304] 0 2024-04-23T10:21:40.111 INFO:tasks.workunit.client.0.smithi029.stdout:6/809: dread d9/df/d25/f5f [4194304,4194304] 0 2024-04-23T10:21:40.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/637: mknod d1/dd/d47/d63/cd6 0 2024-04-23T10:21:40.121 INFO:tasks.workunit.client.0.smithi029.stdout:4/766: dread d0/d12/da9/f103 [0,4194304] 0 2024-04-23T10:21:40.122 INFO:tasks.workunit.client.0.smithi029.stdout:1/581: creat d5/d6/d34/fb7 x:0 0 0 2024-04-23T10:21:40.123 INFO:tasks.workunit.client.0.smithi029.stdout:2/638: mkdir d1/dd/d60/dd7 0 2024-04-23T10:21:40.129 INFO:tasks.workunit.client.0.smithi029.stdout:6/810: dread d9/df/d16/d1f/d27/d33/da4/d58/d7e/fd4 [0,4194304] 0 2024-04-23T10:21:40.137 INFO:tasks.workunit.client.0.smithi029.stdout:6/811: symlink d9/df/d16/d34/d36/l10b 0 2024-04-23T10:21:40.137 INFO:tasks.workunit.client.0.smithi029.stdout:1/582: dread d5/d6/de/f62 [0,4194304] 0 2024-04-23T10:21:40.139 INFO:tasks.workunit.client.0.smithi029.stdout:1/583: chown d5/d6/f19 39984918 1 2024-04-23T10:21:40.141 INFO:tasks.workunit.client.0.smithi029.stdout:0/591: dwrite d0/da9/f9e [0,4194304] 0 2024-04-23T10:21:40.158 INFO:tasks.workunit.client.0.smithi029.stdout:6/812: getdents d9/df/d41 0 2024-04-23T10:21:40.160 INFO:tasks.workunit.client.0.smithi029.stdout:4/767: dread d0/d3c/d52/d1b/d5b/d65/d6a/f6c [0,4194304] 0 2024-04-23T10:21:40.163 INFO:tasks.workunit.client.0.smithi029.stdout:0/592: link d0/dc/f15 d0/d1b/d67/dae/d92/fca 0 2024-04-23T10:21:40.165 INFO:tasks.workunit.client.0.smithi029.stdout:4/768: creat d0/d3c/d52/d1b/d36/d45/d4f/df2/f111 x:0 0 0 2024-04-23T10:21:40.167 INFO:tasks.workunit.client.0.smithi029.stdout:6/813: rename d9/df/d16/d1f/d2c/fc3 to d9/df/d25/f10c 0 2024-04-23T10:21:40.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/593: mkdir d0/d21/dcb 0 2024-04-23T10:21:40.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/584: dread d5/d6/de/d27/d38/d47/f57 [0,4194304] 0 2024-04-23T10:21:40.179 INFO:tasks.workunit.client.0.smithi029.stdout:0/594: readlink d0/d3e/d4e/d50/d73/d7e/l93 0 2024-04-23T10:21:40.180 INFO:tasks.workunit.client.0.smithi029.stdout:2/639: dwrite d1/dd/f49 [0,4194304] 0 2024-04-23T10:21:40.183 INFO:tasks.workunit.client.0.smithi029.stdout:1/585: symlink d5/d6/de/d27/d38/d47/db0/lb8 0 2024-04-23T10:21:40.188 INFO:tasks.workunit.client.0.smithi029.stdout:2/640: truncate d1/d3e/f71 34528 0 2024-04-23T10:21:40.189 INFO:tasks.workunit.client.0.smithi029.stdout:0/595: creat d0/dc/fcc x:0 0 0 2024-04-23T10:21:40.194 INFO:tasks.workunit.client.0.smithi029.stdout:1/586: rmdir d5/d6/de/d22/d77/dae 0 2024-04-23T10:21:40.194 INFO:tasks.workunit.client.0.smithi029.stdout:4/769: dread d0/d3c/d52/d1b/d9f/d92/dd8/f88 [4194304,4194304] 0 2024-04-23T10:21:40.207 INFO:tasks.workunit.client.0.smithi029.stdout:4/770: dwrite d0/d3c/d52/d1b/d5b/d65/d6a/f6c [0,4194304] 0 2024-04-23T10:21:40.208 INFO:tasks.workunit.client.0.smithi029.stdout:0/596: dread d0/f3f [0,4194304] 0 2024-04-23T10:21:40.212 INFO:tasks.workunit.client.0.smithi029.stdout:0/597: fdatasync d0/da9/f70 0 2024-04-23T10:21:40.216 INFO:tasks.workunit.client.0.smithi029.stdout:2/641: mkdir d1/d4/db7/db8/dd8 0 2024-04-23T10:21:40.218 INFO:tasks.workunit.client.0.smithi029.stdout:7/802: dread d5/d8/d51/d9e/db2/fba [0,4194304] 0 2024-04-23T10:21:40.223 INFO:tasks.workunit.client.0.smithi029.stdout:4/771: rename d0/d5a/c83 to d0/d3c/d52/d1b/d66/c112 0 2024-04-23T10:21:40.224 INFO:tasks.workunit.client.0.smithi029.stdout:6/814: write d9/df/d16/d34/f93 [1048669,89615] 0 2024-04-23T10:21:40.226 INFO:tasks.workunit.client.0.smithi029.stdout:2/642: getdents d1/dd/d47 0 2024-04-23T10:21:40.228 INFO:tasks.workunit.client.0.smithi029.stdout:4/772: truncate d0/d12/da9/f10a 269037 0 2024-04-23T10:21:40.229 INFO:tasks.workunit.client.0.smithi029.stdout:4/773: fsync d0/d3c/d52/d74/d91/fbc 0 2024-04-23T10:21:40.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/803: rename d5/d9/fce to d5/d29/ded/d9c/f108 0 2024-04-23T10:21:40.233 INFO:tasks.workunit.client.0.smithi029.stdout:4/774: creat d0/d3c/de5/f113 x:0 0 0 2024-04-23T10:21:40.234 INFO:tasks.workunit.client.0.smithi029.stdout:2/643: creat d1/d3e/d3b/fd9 x:0 0 0 2024-04-23T10:21:40.236 INFO:tasks.workunit.client.0.smithi029.stdout:2/644: chown d1/dd/d47/d63/d64/f72 181 1 2024-04-23T10:21:40.238 INFO:tasks.workunit.client.0.smithi029.stdout:7/804: truncate d5/d9/f2e 185885 0 2024-04-23T10:21:40.240 INFO:tasks.workunit.client.0.smithi029.stdout:6/815: rename d9/df/d16/d44/d75/d90/fa3 to d9/df/d16/d34/d36/f10d 0 2024-04-23T10:21:40.241 INFO:tasks.workunit.client.0.smithi029.stdout:6/816: readlink d9/df/d16/d1f/d27/d33/da4/d58/l59 0 2024-04-23T10:21:40.241 INFO:tasks.workunit.client.0.smithi029.stdout:2/645: mkdir d1/dda 0 2024-04-23T10:21:40.248 INFO:tasks.workunit.client.0.smithi029.stdout:6/817: chown d9/df/d16/d44/d4c/dd9/df6/fc2 340845135 1 2024-04-23T10:21:40.248 INFO:tasks.workunit.client.0.smithi029.stdout:2/646: truncate d1/dd/f51 5095567 0 2024-04-23T10:21:40.249 INFO:tasks.workunit.client.0.smithi029.stdout:7/805: symlink d5/d8/d51/d55/d59/l109 0 2024-04-23T10:21:40.252 INFO:tasks.workunit.client.0.smithi029.stdout:1/587: read - d5/d6/de/d22/d77/f89 zero size 2024-04-23T10:21:40.254 INFO:tasks.workunit.client.0.smithi029.stdout:0/598: dwrite d0/d3e/d4e/d7c/f9b [0,4194304] 0 2024-04-23T10:21:40.257 INFO:tasks.workunit.client.0.smithi029.stdout:6/818: truncate d9/df/d16/d1f/d27/d33/da4/d66/d95/faa 868353 0 2024-04-23T10:21:40.261 INFO:tasks.workunit.client.0.smithi029.stdout:6/819: write d9/df/d16/d34/f65 [4600282,34895] 0 2024-04-23T10:21:40.261 INFO:tasks.workunit.client.0.smithi029.stdout:4/775: truncate d0/fa 5022813 0 2024-04-23T10:21:40.267 INFO:tasks.workunit.client.0.smithi029.stdout:6/820: stat d9/l2f 0 2024-04-23T10:21:40.268 INFO:tasks.workunit.client.0.smithi029.stdout:1/588: dwrite d5/d6/de/d15/f3b [0,4194304] 0 2024-04-23T10:21:40.271 INFO:tasks.workunit.client.0.smithi029.stdout:7/806: chown d5/d29/ded/d8a/d8b/d8d/d96/lc7 0 1 2024-04-23T10:21:40.276 INFO:tasks.workunit.client.0.smithi029.stdout:0/599: dwrite d0/da9/d4c/f9c [0,4194304] 0 2024-04-23T10:21:40.285 INFO:tasks.workunit.client.0.smithi029.stdout:7/807: rmdir d5/d29/dc9 39 2024-04-23T10:21:40.288 INFO:tasks.workunit.client.0.smithi029.stdout:7/808: chown d5/d71/d92/fe6 6 1 2024-04-23T10:21:40.289 INFO:tasks.workunit.client.0.smithi029.stdout:7/809: readlink d5/d9/l1c 0 2024-04-23T10:21:40.296 INFO:tasks.workunit.client.0.smithi029.stdout:4/776: truncate d0/d3c/d52/d1b/f1c 1008690 0 2024-04-23T10:21:40.298 INFO:tasks.workunit.client.0.smithi029.stdout:0/600: write d0/da9/d4c/d6d/fc2 [1950747,61270] 0 2024-04-23T10:21:40.306 INFO:tasks.workunit.client.0.smithi029.stdout:1/589: dread d5/d6/f7c [0,4194304] 0 2024-04-23T10:21:40.307 INFO:tasks.workunit.client.0.smithi029.stdout:7/810: dwrite d5/d71/d92/db7/dc3/dcc/feb [0,4194304] 0 2024-04-23T10:21:40.307 INFO:tasks.workunit.client.0.smithi029.stdout:6/821: dwrite d9/df/d16/d1f/d27/d33/f53 [0,4194304] 0 2024-04-23T10:21:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:1/590: chown d5/d6/de/d15/l69 176 1 2024-04-23T10:21:40.312 INFO:tasks.workunit.client.0.smithi029.stdout:7/811: rmdir d5/d29/ded/d9c/dd3 39 2024-04-23T10:21:40.314 INFO:tasks.workunit.client.0.smithi029.stdout:4/777: creat d0/d3c/d52/d1b/d66/f114 x:0 0 0 2024-04-23T10:21:40.315 INFO:tasks.workunit.client.0.smithi029.stdout:1/591: rename d5/d6/de/d22/d6c/fab to d5/d6/de/d27/da9/fb9 0 2024-04-23T10:21:40.316 INFO:tasks.workunit.client.0.smithi029.stdout:1/592: fsync d5/d6/d34/d63/fa2 0 2024-04-23T10:21:40.325 INFO:tasks.workunit.client.0.smithi029.stdout:7/812: mknod d5/dc8/c10a 0 2024-04-23T10:21:40.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/601: write d0/d21/d7f/d3a/f87 [619973,3300] 0 2024-04-23T10:21:40.325 INFO:tasks.workunit.client.0.smithi029.stdout:7/813: dread - d5/d71/df5/ffd zero size 2024-04-23T10:21:40.329 INFO:tasks.workunit.client.0.smithi029.stdout:4/778: creat d0/d5a/d96/f115 x:0 0 0 2024-04-23T10:21:40.330 INFO:tasks.workunit.client.0.smithi029.stdout:0/602: truncate d0/d1b/f3b 5312177 0 2024-04-23T10:21:40.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/814: mknod d5/d29/ded/d4d/c10b 0 2024-04-23T10:21:40.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/815: write d5/d8/d51/fdf [687383,111471] 0 2024-04-23T10:21:40.335 INFO:tasks.workunit.client.0.smithi029.stdout:6/822: write d9/f92 [1323262,52504] 0 2024-04-23T10:21:40.338 INFO:tasks.workunit.client.0.smithi029.stdout:0/603: mknod d0/d3e/d4e/d7c/ccd 0 2024-04-23T10:21:40.340 INFO:tasks.workunit.client.0.smithi029.stdout:7/816: fdatasync d5/d29/f37 0 2024-04-23T10:21:40.343 INFO:tasks.workunit.client.0.smithi029.stdout:7/817: mkdir d5/d71/df5/d10c 0 2024-04-23T10:21:40.344 INFO:tasks.workunit.client.0.smithi029.stdout:6/823: symlink d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/l10e 0 2024-04-23T10:21:40.346 INFO:tasks.workunit.client.0.smithi029.stdout:0/604: symlink d0/dc/d90/lce 0 2024-04-23T10:21:40.347 INFO:tasks.workunit.client.0.smithi029.stdout:7/818: unlink d5/d8/f32 0 2024-04-23T10:21:40.349 INFO:tasks.workunit.client.0.smithi029.stdout:1/593: dwrite d5/d6/de/f62 [0,4194304] 0 2024-04-23T10:21:40.352 INFO:tasks.workunit.client.0.smithi029.stdout:7/819: read d5/d29/ded/d8a/f9d [2964266,88939] 0 2024-04-23T10:21:40.356 INFO:tasks.workunit.client.0.smithi029.stdout:4/779: write d0/d12/f5f [2941671,59787] 0 2024-04-23T10:21:40.357 INFO:tasks.workunit.client.0.smithi029.stdout:6/824: dwrite d9/df/d25/f10c [0,4194304] 0 2024-04-23T10:21:40.357 INFO:tasks.workunit.client.0.smithi029.stdout:7/820: chown d5/d29/ded/d4d/f64 0 1 2024-04-23T10:21:40.362 INFO:tasks.workunit.client.0.smithi029.stdout:0/605: creat d0/d3e/d4e/fcf x:0 0 0 2024-04-23T10:21:40.364 INFO:tasks.workunit.client.0.smithi029.stdout:4/780: creat d0/d3c/d52/d1b/d5b/d65/d6a/dda/f116 x:0 0 0 2024-04-23T10:21:40.365 INFO:tasks.workunit.client.0.smithi029.stdout:7/821: read - d5/d29/ded/fcf zero size 2024-04-23T10:21:40.369 INFO:tasks.workunit.client.0.smithi029.stdout:7/822: unlink d5/d29/ded/fcf 0 2024-04-23T10:21:40.371 INFO:tasks.workunit.client.0.smithi029.stdout:4/781: fdatasync d0/d3c/d52/d74/d91/fa5 0 2024-04-23T10:21:40.372 INFO:tasks.workunit.client.0.smithi029.stdout:7/823: readlink d5/d29/ded/d9c/le2 0 2024-04-23T10:21:40.373 INFO:tasks.workunit.client.0.smithi029.stdout:7/824: write d5/f2c [5539946,61934] 0 2024-04-23T10:21:40.378 INFO:tasks.workunit.client.0.smithi029.stdout:1/594: truncate d5/f70 753061 0 2024-04-23T10:21:40.380 INFO:tasks.workunit.client.0.smithi029.stdout:4/782: dwrite d0/d3c/d52/f90 [0,4194304] 0 2024-04-23T10:21:40.380 INFO:tasks.workunit.client.0.smithi029.stdout:1/595: readlink l2 0 2024-04-23T10:21:40.384 INFO:tasks.workunit.client.0.smithi029.stdout:7/825: creat d5/d29/ded/d8a/f10d x:0 0 0 2024-04-23T10:21:40.385 INFO:tasks.workunit.client.0.smithi029.stdout:1/596: symlink d5/d6/lba 0 2024-04-23T10:21:40.385 INFO:tasks.workunit.client.0.smithi029.stdout:1/597: fsync d5/fa3 0 2024-04-23T10:21:40.388 INFO:tasks.workunit.client.0.smithi029.stdout:7/826: unlink d5/d29/ded/f1e 0 2024-04-23T10:21:40.391 INFO:tasks.workunit.client.0.smithi029.stdout:4/783: link d0/d3c/d52/d1b/d9f/d92/ce7 d0/d3c/d52/d74/d91/c117 0 2024-04-23T10:21:40.392 INFO:tasks.workunit.client.0.smithi029.stdout:1/598: mknod d5/d3e/cbb 0 2024-04-23T10:21:40.392 INFO:tasks.workunit.client.0.smithi029.stdout:4/784: dread - d0/d3c/d52/d74/f77 zero size 2024-04-23T10:21:40.394 INFO:tasks.workunit.client.0.smithi029.stdout:7/827: rename d5/c6 to d5/d71/df5/c10e 0 2024-04-23T10:21:40.398 INFO:tasks.workunit.client.0.smithi029.stdout:4/785: mknod d0/d3c/d52/d1b/d9f/d92/dd8/da1/c118 0 2024-04-23T10:21:40.401 INFO:tasks.workunit.client.0.smithi029.stdout:1/599: creat d5/d6/fbc x:0 0 0 2024-04-23T10:21:40.403 INFO:tasks.workunit.client.0.smithi029.stdout:6/825: dwrite d9/df/d41/d49/f81 [0,4194304] 0 2024-04-23T10:21:40.406 INFO:tasks.workunit.client.0.smithi029.stdout:7/828: creat d5/f10f x:0 0 0 2024-04-23T10:21:40.414 INFO:tasks.workunit.client.0.smithi029.stdout:7/829: symlink d5/d9/de3/l110 0 2024-04-23T10:21:40.415 INFO:tasks.workunit.client.0.smithi029.stdout:4/786: creat d0/d3c/d52/d1b/d9f/d92/dd8/f119 x:0 0 0 2024-04-23T10:21:40.417 INFO:tasks.workunit.client.0.smithi029.stdout:1/600: symlink d5/d6/de/d22/d77/lbd 0 2024-04-23T10:21:40.419 INFO:tasks.workunit.client.0.smithi029.stdout:4/787: dread - d0/d3c/d52/d1b/d66/fd9 zero size 2024-04-23T10:21:40.422 INFO:tasks.workunit.client.0.smithi029.stdout:7/830: fsync d5/d9/f2b 0 2024-04-23T10:21:40.424 INFO:tasks.workunit.client.0.smithi029.stdout:6/826: write d9/f82 [2746384,104548] 0 2024-04-23T10:21:40.429 INFO:tasks.workunit.client.0.smithi029.stdout:1/601: rename d5/d6/de/f2e to d5/d6/d34/d8a/fbe 0 2024-04-23T10:21:40.431 INFO:tasks.workunit.client.0.smithi029.stdout:1/602: chown d5/d6/de/d27/d38 46 1 2024-04-23T10:21:40.432 INFO:tasks.workunit.client.0.smithi029.stdout:4/788: dwrite d0/d3c/d52/d74/f109 [0,4194304] 0 2024-04-23T10:21:40.439 INFO:tasks.workunit.client.0.smithi029.stdout:1/603: dwrite d5/d6/de/d22/f5f [0,4194304] 0 2024-04-23T10:21:40.442 INFO:tasks.workunit.client.0.smithi029.stdout:7/831: rename d5/d8/d51/d55/d59/c70 to d5/d71/df5/d10c/c111 0 2024-04-23T10:21:40.443 INFO:tasks.workunit.client.0.smithi029.stdout:1/604: readlink d5/d6/de/d15/l85 0 2024-04-23T10:21:40.448 INFO:tasks.workunit.client.0.smithi029.stdout:4/789: rename d0/d3c/d52/d1b/d36/c8b to d0/d3c/d52/d1b/d36/d45/c11a 0 2024-04-23T10:21:40.450 INFO:tasks.workunit.client.0.smithi029.stdout:7/832: creat d5/d29/ded/f112 x:0 0 0 2024-04-23T10:21:40.451 INFO:tasks.workunit.client.0.smithi029.stdout:4/790: stat d0/d3c/d52/d1b/d5b/d65/d6a/l9d 0 2024-04-23T10:21:40.453 INFO:tasks.workunit.client.0.smithi029.stdout:1/605: rename d5/d6/de/d27/d38/d47/f57 to d5/fbf 0 2024-04-23T10:21:40.454 INFO:tasks.workunit.client.0.smithi029.stdout:7/833: dread d5/d29/d4a/f8f [0,4194304] 0 2024-04-23T10:21:40.455 INFO:tasks.workunit.client.0.smithi029.stdout:7/834: dread - d5/d8/d51/d55/d59/ff6 zero size 2024-04-23T10:21:40.462 INFO:tasks.workunit.client.0.smithi029.stdout:1/606: dwrite d5/d6/de/f62 [4194304,4194304] 0 2024-04-23T10:21:40.465 INFO:tasks.workunit.client.0.smithi029.stdout:7/835: rmdir d5/d29 39 2024-04-23T10:21:40.465 INFO:tasks.workunit.client.0.smithi029.stdout:4/791: truncate d0/d3c/d52/d1b/d9f/d92/dd8/da1/fab 411435 0 2024-04-23T10:21:40.469 INFO:tasks.workunit.client.0.smithi029.stdout:4/792: rmdir d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7 39 2024-04-23T10:21:40.471 INFO:tasks.workunit.client.0.smithi029.stdout:4/793: fdatasync d0/d12/f5f 0 2024-04-23T10:21:40.471 INFO:tasks.workunit.client.0.smithi029.stdout:6/827: truncate d9/df/d41/d49/d69/fc4 4706468 0 2024-04-23T10:21:40.474 INFO:tasks.workunit.client.0.smithi029.stdout:1/607: creat d5/d6/d34/d8a/fc0 x:0 0 0 2024-04-23T10:21:40.474 INFO:tasks.workunit.client.0.smithi029.stdout:6/828: mkdir d9/d10f 0 2024-04-23T10:21:40.475 INFO:tasks.workunit.client.0.smithi029.stdout:7/836: getdents d5/d71/d92/db7 0 2024-04-23T10:21:40.475 INFO:tasks.workunit.client.0.smithi029.stdout:1/608: write d5/d6/f16 [20599,48349] 0 2024-04-23T10:21:40.478 INFO:tasks.workunit.client.0.smithi029.stdout:7/837: mknod d5/d8/d51/d9e/c113 0 2024-04-23T10:21:40.492 INFO:tasks.workunit.client.0.smithi029.stdout:1/609: symlink d5/d6/de/d22/d84/lc1 0 2024-04-23T10:21:40.493 INFO:tasks.workunit.client.0.smithi029.stdout:4/794: getdents d0/d3c/d52/d1b/d36/d45/d4f/df2 0 2024-04-23T10:21:40.494 INFO:tasks.workunit.client.0.smithi029.stdout:4/795: dread - d0/d3c/d52/d1b/d5b/d65/d6a/dda/f116 zero size 2024-04-23T10:21:40.496 INFO:tasks.workunit.client.0.smithi029.stdout:7/838: rmdir d5/d29/ded/d8a/d8b/d8d 39 2024-04-23T10:21:40.498 INFO:tasks.workunit.client.0.smithi029.stdout:6/829: rename d9/df/d16/d1f/d27/d33/da4/la8 to d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/l110 0 2024-04-23T10:21:40.498 INFO:tasks.workunit.client.0.smithi029.stdout:7/839: chown d5/d8/f6f 289 1 2024-04-23T10:21:40.499 INFO:tasks.workunit.client.0.smithi029.stdout:4/796: mkdir d0/d3c/d52/d1b/d5b/d65/d6a/d11b 0 2024-04-23T10:21:40.500 INFO:tasks.workunit.client.0.smithi029.stdout:1/610: getdents d5/d6/de/d27/d38 0 2024-04-23T10:21:40.508 INFO:tasks.workunit.client.0.smithi029.stdout:1/611: rename d5/lb to d5/d6/de/d27/da9/lc2 0 2024-04-23T10:21:40.514 INFO:tasks.workunit.client.0.smithi029.stdout:7/840: dread d5/f63 [0,4194304] 0 2024-04-23T10:21:40.516 INFO:tasks.workunit.client.0.smithi029.stdout:1/612: truncate d5/fd 8384663 0 2024-04-23T10:21:40.547 INFO:tasks.workunit.client.0.smithi029.stdout:7/841: truncate d5/d8/d51/d55/d59/daf/fd5 16846 0 2024-04-23T10:21:40.548 INFO:tasks.workunit.client.0.smithi029.stdout:7/842: write d5/d29/ded/d4d/f52 [1539414,129909] 0 2024-04-23T10:21:40.552 INFO:tasks.workunit.client.0.smithi029.stdout:7/843: write d5/d29/ded/d8a/f7d [1336804,98321] 0 2024-04-23T10:21:40.560 INFO:tasks.workunit.client.0.smithi029.stdout:7/844: rename d5/d8/d51/d55 to d5/d71/d114 0 2024-04-23T10:21:40.561 INFO:tasks.workunit.client.0.smithi029.stdout:7/845: chown d5/d71/d92/db7/dc3/dcc/fd7 1983675 1 2024-04-23T10:21:40.563 INFO:tasks.workunit.client.0.smithi029.stdout:7/846: rmdir d5/d29/d4a/dc1 39 2024-04-23T10:21:40.566 INFO:tasks.workunit.client.0.smithi029.stdout:7/847: chown d5/d8/d51/l6e 29746893 1 2024-04-23T10:21:40.575 INFO:tasks.workunit.client.0.smithi029.stdout:7/848: rename d5/d8/f43 to d5/d29/dc9/f115 0 2024-04-23T10:21:40.580 INFO:tasks.workunit.client.0.smithi029.stdout:7/849: truncate d5/d8/f6f 412865 0 2024-04-23T10:21:40.586 INFO:tasks.workunit.client.0.smithi029.stdout:7/850: truncate d5/d9/f3a 643069 0 2024-04-23T10:21:40.814 INFO:tasks.workunit.client.0.smithi029.stdout:4/797: write d0/d3c/d52/d1b/f6b [172657,25988] 0 2024-04-23T10:21:40.842 INFO:tasks.workunit.client.0.smithi029.stdout:8/690: sync 2024-04-23T10:21:40.848 INFO:tasks.workunit.client.0.smithi029.stdout:4/798: write d0/d3c/d52/d1b/d36/d45/dd0/fdc [719501,40743] 0 2024-04-23T10:21:40.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/799: chown d0/d3c/d52/d1b/d36/d45/d68/l82 28146823 1 2024-04-23T10:21:40.857 INFO:tasks.workunit.client.0.smithi029.stdout:4/800: write d0/d3c/d52/d1b/d9f/d92/dd8/d7a/ffd [453286,38962] 0 2024-04-23T10:21:40.871 INFO:tasks.workunit.client.0.smithi029.stdout:8/691: rename d3/d50/d6a/d95/d36/d3e/f60 to d3/d7d/fd7 0 2024-04-23T10:21:40.872 INFO:tasks.workunit.client.0.smithi029.stdout:4/801: link d0/d3c/d52/d1b/d9f/d92/dd8/f119 d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7/f11c 0 2024-04-23T10:21:40.881 INFO:tasks.workunit.client.0.smithi029.stdout:8/692: rename d3/l16 to d3/d50/d6a/d95/d36/ld8 0 2024-04-23T10:21:40.884 INFO:tasks.workunit.client.0.smithi029.stdout:4/802: mkdir d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d 0 2024-04-23T10:21:40.913 INFO:tasks.workunit.client.0.smithi029.stdout:8/693: dread d3/f42 [0,4194304] 0 2024-04-23T10:21:40.921 INFO:tasks.workunit.client.0.smithi029.stdout:4/803: write d0/d12/f43 [504260,107600] 0 2024-04-23T10:21:41.020 INFO:tasks.workunit.client.0.smithi029.stdout:5/748: sync 2024-04-23T10:21:41.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/694: dwrite d3/f19 [0,4194304] 0 2024-04-23T10:21:41.042 INFO:tasks.workunit.client.0.smithi029.stdout:5/749: mknod d0/d6a/cef 0 2024-04-23T10:21:41.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/750: stat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/fa5 0 2024-04-23T10:21:41.117 INFO:tasks.workunit.client.0.smithi029.stdout:8/695: dwrite d3/f7 [0,4194304] 0 2024-04-23T10:21:41.138 INFO:tasks.workunit.client.0.smithi029.stdout:8/696: write d3/d50/d6a/fa3 [939255,63855] 0 2024-04-23T10:21:41.151 INFO:tasks.workunit.client.0.smithi029.stdout:8/697: write d3/f26 [8604715,23054] 0 2024-04-23T10:21:41.158 INFO:tasks.workunit.client.0.smithi029.stdout:8/698: dread - d3/d50/d6a/d95/fba zero size 2024-04-23T10:21:41.162 INFO:tasks.workunit.client.0.smithi029.stdout:8/699: dread - d3/d44/fa7 zero size 2024-04-23T10:21:41.162 INFO:tasks.workunit.client.0.smithi029.stdout:5/751: dread d0/d35/d10/f42 [0,4194304] 0 2024-04-23T10:21:41.171 INFO:tasks.workunit.client.0.smithi029.stdout:3/643: sync 2024-04-23T10:21:41.171 INFO:tasks.workunit.client.0.smithi029.stdout:5/752: mknod d0/d35/d38/d3e/d66/d5a/d78/de4/cf0 0 2024-04-23T10:21:41.181 INFO:tasks.workunit.client.0.smithi029.stdout:5/753: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/cf1 0 2024-04-23T10:21:41.183 INFO:tasks.workunit.client.0.smithi029.stdout:5/754: write d0/f2f [1395932,6806] 0 2024-04-23T10:21:41.184 INFO:tasks.workunit.client.0.smithi029.stdout:3/644: creat d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/fe6 x:0 0 0 2024-04-23T10:21:41.193 INFO:tasks.workunit.client.0.smithi029.stdout:3/645: creat d3/d10/de/fe7 x:0 0 0 2024-04-23T10:21:41.200 INFO:tasks.workunit.client.0.smithi029.stdout:8/700: dread d3/d50/f64 [0,4194304] 0 2024-04-23T10:21:41.202 INFO:tasks.workunit.client.0.smithi029.stdout:8/701: chown d3/d50/d6a/cc1 28563 1 2024-04-23T10:21:41.211 INFO:tasks.workunit.client.0.smithi029.stdout:8/702: mkdir d3/d50/d6a/dd9 0 2024-04-23T10:21:41.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/755: dread d0/d35/d38/d3e/f70 [8388608,4194304] 0 2024-04-23T10:21:41.219 INFO:tasks.workunit.client.0.smithi029.stdout:3/646: write d3/d10/de/d2e/d36/d40/d46/d65/f81 [1516076,112657] 0 2024-04-23T10:21:41.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/756: link d0/d35/d38/d3e/d66/d5a/d78/l1d d0/d35/d38/d3e/d66/lf2 0 2024-04-23T10:21:41.242 INFO:tasks.workunit.client.0.smithi029.stdout:3/647: dwrite d3/d45/d4f/fb3 [0,4194304] 0 2024-04-23T10:21:41.244 INFO:tasks.workunit.client.0.smithi029.stdout:5/757: getdents d0/d9a 0 2024-04-23T10:21:41.251 INFO:tasks.workunit.client.0.smithi029.stdout:5/758: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/cf3 0 2024-04-23T10:21:41.252 INFO:tasks.workunit.client.0.smithi029.stdout:8/703: dread d3/d50/d6a/d95/d36/d3e/f41 [4194304,4194304] 0 2024-04-23T10:21:41.253 INFO:tasks.workunit.client.0.smithi029.stdout:3/648: dread d3/d10/f79 [0,4194304] 0 2024-04-23T10:21:41.259 INFO:tasks.workunit.client.0.smithi029.stdout:8/704: mkdir d3/d50/d6a/d95/dda 0 2024-04-23T10:21:41.263 INFO:tasks.workunit.client.0.smithi029.stdout:5/759: rename d0/d35/d38/d3e/d66/d5a/la4 to d0/d35/d38/d3e/d66/d5a/lf4 0 2024-04-23T10:21:41.266 INFO:tasks.workunit.client.0.smithi029.stdout:3/649: dwrite d3/d45/f4a [0,4194304] 0 2024-04-23T10:21:41.268 INFO:tasks.workunit.client.0.smithi029.stdout:8/705: unlink d3/d44/l6f 0 2024-04-23T10:21:41.274 INFO:tasks.workunit.client.0.smithi029.stdout:5/760: creat d0/d35/d10/d26/db2/ff5 x:0 0 0 2024-04-23T10:21:41.278 INFO:tasks.workunit.client.0.smithi029.stdout:3/650: creat d3/d45/d4f/fe8 x:0 0 0 2024-04-23T10:21:41.279 INFO:tasks.workunit.client.0.smithi029.stdout:8/706: creat d3/d50/fdb x:0 0 0 2024-04-23T10:21:41.281 INFO:tasks.workunit.client.0.smithi029.stdout:3/651: fdatasync d3/d10/de/d2e/d36/d40/d46/d65/f81 0 2024-04-23T10:21:41.286 INFO:tasks.workunit.client.0.smithi029.stdout:8/707: creat d3/d71/fdc x:0 0 0 2024-04-23T10:21:41.290 INFO:tasks.workunit.client.0.smithi029.stdout:8/708: chown d3/d50/d6a/d95/d36/l6b 6 1 2024-04-23T10:21:41.294 INFO:tasks.workunit.client.0.smithi029.stdout:8/709: dread - d3/fa5 zero size 2024-04-23T10:21:41.296 INFO:tasks.workunit.client.0.smithi029.stdout:3/652: creat d3/d10/de/d2e/d36/d40/d43/fe9 x:0 0 0 2024-04-23T10:21:41.303 INFO:tasks.workunit.client.0.smithi029.stdout:5/761: write d0/d35/d38/d3e/d66/d8c/dda/fea [1415852,116158] 0 2024-04-23T10:21:41.308 INFO:tasks.workunit.client.0.smithi029.stdout:5/762: symlink d0/d35/d38/d3e/d66/d5a/d78/de4/lf6 0 2024-04-23T10:21:41.309 INFO:tasks.workunit.client.0.smithi029.stdout:8/710: dread d3/d50/d6a/d95/d36/d68/f9e [0,4194304] 0 2024-04-23T10:21:41.315 INFO:tasks.workunit.client.0.smithi029.stdout:5/763: symlink d0/d35/lf7 0 2024-04-23T10:21:41.316 INFO:tasks.workunit.client.0.smithi029.stdout:8/711: mkdir d3/d50/d6a/d95/d36/d3e/ddd 0 2024-04-23T10:21:41.320 INFO:tasks.workunit.client.0.smithi029.stdout:5/764: read - d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/feb zero size 2024-04-23T10:21:41.320 INFO:tasks.workunit.client.0.smithi029.stdout:3/653: dwrite d3/d15/fc6 [0,4194304] 0 2024-04-23T10:21:41.326 INFO:tasks.workunit.client.0.smithi029.stdout:5/765: fdatasync d0/d35/d38/d39/d3f/fc5 0 2024-04-23T10:21:41.328 INFO:tasks.workunit.client.0.smithi029.stdout:5/766: write d0/d35/d38/d39/f86 [1526976,6859] 0 2024-04-23T10:21:41.331 INFO:tasks.workunit.client.0.smithi029.stdout:3/654: creat d3/d45/d4f/d6b/fea x:0 0 0 2024-04-23T10:21:41.332 INFO:tasks.workunit.client.0.smithi029.stdout:8/712: dread d3/d7d/fd7 [0,4194304] 0 2024-04-23T10:21:41.335 INFO:tasks.workunit.client.0.smithi029.stdout:8/713: chown d3/d50/d6a/d95/d36/d94/dcd 263 1 2024-04-23T10:21:41.337 INFO:tasks.workunit.client.0.smithi029.stdout:3/655: symlink d3/d10/de/d2e/d36/d40/d46/leb 0 2024-04-23T10:21:41.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/656: chown d3/d45/d4f/cc8 0 1 2024-04-23T10:21:41.339 INFO:tasks.workunit.client.0.smithi029.stdout:9/887: sync 2024-04-23T10:21:41.339 INFO:tasks.workunit.client.0.smithi029.stdout:2/647: sync 2024-04-23T10:21:41.339 INFO:tasks.workunit.client.0.smithi029.stdout:8/714: unlink d3/d50/d6a/d95/d36/d68/f9e 0 2024-04-23T10:21:41.341 INFO:tasks.workunit.client.0.smithi029.stdout:3/657: unlink d3/d10/de/d2e/d36/d40/d46/d72/l3c 0 2024-04-23T10:21:41.344 INFO:tasks.workunit.client.0.smithi029.stdout:8/715: stat d3/d50/d6a/d95/d36/ld8 0 2024-04-23T10:21:41.345 INFO:tasks.workunit.client.0.smithi029.stdout:2/648: mknod d1/dd/d47/d63/cdb 0 2024-04-23T10:21:41.347 INFO:tasks.workunit.client.0.smithi029.stdout:3/658: readlink d3/d10/de/d2e/d36/d40/l77 0 2024-04-23T10:21:41.351 INFO:tasks.workunit.client.0.smithi029.stdout:2/649: symlink d1/dd/ldc 0 2024-04-23T10:21:41.356 INFO:tasks.workunit.client.0.smithi029.stdout:8/716: creat d3/d38/fde x:0 0 0 2024-04-23T10:21:41.362 INFO:tasks.workunit.client.0.smithi029.stdout:9/888: link d0/d7/d1d/d35/d3b/db8/cc8 d0/d7/d1d/d35/dd5/df2/d126/c132 0 2024-04-23T10:21:41.362 INFO:tasks.workunit.client.0.smithi029.stdout:8/717: chown l2 976605 1 2024-04-23T10:21:41.364 INFO:tasks.workunit.client.0.smithi029.stdout:5/767: dread d0/d35/d38/d39/d3f/f7d [0,4194304] 0 2024-04-23T10:21:41.365 INFO:tasks.workunit.client.0.smithi029.stdout:2/650: creat d1/d3e/d3b/d75/fdd x:0 0 0 2024-04-23T10:21:41.372 INFO:tasks.workunit.client.0.smithi029.stdout:8/718: creat d3/d50/d6a/d95/d36/d3e/ddd/fdf x:0 0 0 2024-04-23T10:21:41.373 INFO:tasks.workunit.client.0.smithi029.stdout:8/719: stat d3/d50/d6a/d95/d36/d3e/dce/da4/fb5 0 2024-04-23T10:21:41.383 INFO:tasks.workunit.client.0.smithi029.stdout:8/720: creat d3/d50/d6a/fe0 x:0 0 0 2024-04-23T10:21:41.385 INFO:tasks.workunit.client.0.smithi029.stdout:2/651: write d1/d31/d3d/f41 [900067,100668] 0 2024-04-23T10:21:41.388 INFO:tasks.workunit.client.0.smithi029.stdout:3/659: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/fb9 [0,4194304] 0 2024-04-23T10:21:41.393 INFO:tasks.workunit.client.0.smithi029.stdout:3/660: fdatasync d3/d10/f51 0 2024-04-23T10:21:41.394 INFO:tasks.workunit.client.0.smithi029.stdout:8/721: mkdir d3/d50/dac/de1 0 2024-04-23T10:21:41.395 INFO:tasks.workunit.client.0.smithi029.stdout:3/661: dread - d3/d45/d4f/d6b/fdc zero size 2024-04-23T10:21:41.397 INFO:tasks.workunit.client.0.smithi029.stdout:8/722: readlink d3/d50/d6a/d95/d36/d3e/dce/da4/lcc 0 2024-04-23T10:21:41.403 INFO:tasks.workunit.client.0.smithi029.stdout:9/889: dread d0/d1b/d39/d50/dd4/f114 [0,4194304] 0 2024-04-23T10:21:41.403 INFO:tasks.workunit.client.0.smithi029.stdout:3/662: dread - d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/fe6 zero size 2024-04-23T10:21:41.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/663: stat d3/d10/de/d2e/d36 0 2024-04-23T10:21:41.408 INFO:tasks.workunit.client.0.smithi029.stdout:9/890: mkdir d0/d7/d1d/d35/d3b/d133 0 2024-04-23T10:21:41.411 INFO:tasks.workunit.client.0.smithi029.stdout:3/664: readlink d3/d10/de/d2e/d59/l84 0 2024-04-23T10:21:41.413 INFO:tasks.workunit.client.0.smithi029.stdout:9/891: getdents d0/d7/d1d/d35/dd9/d12d 0 2024-04-23T10:21:41.415 INFO:tasks.workunit.client.0.smithi029.stdout:2/652: dread d1/d3e/d5a/f84 [0,4194304] 0 2024-04-23T10:21:41.415 INFO:tasks.workunit.client.0.smithi029.stdout:9/892: stat d0/d7/d1d/f20 0 2024-04-23T10:21:41.415 INFO:tasks.workunit.client.0.smithi029.stdout:8/723: dwrite d3/f9c [0,4194304] 0 2024-04-23T10:21:41.418 INFO:tasks.workunit.client.0.smithi029.stdout:9/893: chown d0/d7/d3f/f82 513 1 2024-04-23T10:21:41.420 INFO:tasks.workunit.client.0.smithi029.stdout:2/653: mkdir d1/d4/db7/db8/dde 0 2024-04-23T10:21:41.424 INFO:tasks.workunit.client.0.smithi029.stdout:8/724: getdents d3 0 2024-04-23T10:21:41.425 INFO:tasks.workunit.client.0.smithi029.stdout:2/654: chown d1/dd/d47/d63/d64/f80 1767691092 1 2024-04-23T10:21:41.426 INFO:tasks.workunit.client.0.smithi029.stdout:8/725: write d3/fd [3767101,111003] 0 2024-04-23T10:21:41.428 INFO:tasks.workunit.client.0.smithi029.stdout:3/665: dwrite d3/d45/d4f/d6b/fdc [0,4194304] 0 2024-04-23T10:21:41.430 INFO:tasks.workunit.client.0.smithi029.stdout:2/655: chown d1/d31/d50/f82 0 1 2024-04-23T10:21:41.435 INFO:tasks.workunit.client.0.smithi029.stdout:3/666: unlink d3/d10/f79 0 2024-04-23T10:21:41.439 INFO:tasks.workunit.client.0.smithi029.stdout:9/894: dwrite d0/d7/d3f/dbb/fe5 [0,4194304] 0 2024-04-23T10:21:41.442 INFO:tasks.workunit.client.0.smithi029.stdout:8/726: link d3/d50/d6a/d95/f88 d3/d50/d6a/d95/d36/dbf/fe2 0 2024-04-23T10:21:41.443 INFO:tasks.workunit.client.0.smithi029.stdout:9/895: readlink d0/d7/d3f/l93 0 2024-04-23T10:21:41.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/667: truncate d3/d45/d4f/f6e 1310564 0 2024-04-23T10:21:41.445 INFO:tasks.workunit.client.0.smithi029.stdout:2/656: dwrite d1/dd/d47/f53 [4194304,4194304] 0 2024-04-23T10:21:41.447 INFO:tasks.workunit.client.0.smithi029.stdout:2/657: truncate d1/fd4 441340 0 2024-04-23T10:21:41.448 INFO:tasks.workunit.client.0.smithi029.stdout:2/658: chown d1/d3e/d3b/f52 69609 1 2024-04-23T10:21:41.448 INFO:tasks.workunit.client.0.smithi029.stdout:3/668: stat d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/fcc 0 2024-04-23T10:21:41.453 INFO:tasks.workunit.client.0.smithi029.stdout:2/659: truncate d1/dd/f51 3737639 0 2024-04-23T10:21:41.463 INFO:tasks.workunit.client.0.smithi029.stdout:9/896: write d0/d7/d1d/d35/d3b/d68/f10c [867876,34220] 0 2024-04-23T10:21:41.464 INFO:tasks.workunit.client.0.smithi029.stdout:8/727: dwrite d3/d50/d6a/d95/f39 [0,4194304] 0 2024-04-23T10:21:41.467 INFO:tasks.workunit.client.0.smithi029.stdout:2/660: fsync d1/d3e/d3b/f7d 0 2024-04-23T10:21:41.469 INFO:tasks.workunit.client.0.smithi029.stdout:9/897: chown d0/d1b/d39/c105 2 1 2024-04-23T10:21:41.471 INFO:tasks.workunit.client.0.smithi029.stdout:3/669: dwrite d3/d45/d4f/fb4 [0,4194304] 0 2024-04-23T10:21:41.476 INFO:tasks.workunit.client.0.smithi029.stdout:2/661: mkdir d1/dd/ddf 0 2024-04-23T10:21:41.480 INFO:tasks.workunit.client.0.smithi029.stdout:9/898: symlink d0/d7/d1d/d35/d3b/db8/de3/l134 0 2024-04-23T10:21:41.482 INFO:tasks.workunit.client.0.smithi029.stdout:2/662: creat d1/dd/d60/fe0 x:0 0 0 2024-04-23T10:21:41.486 INFO:tasks.workunit.client.0.smithi029.stdout:8/728: dwrite d3/d50/d6a/faf [0,4194304] 0 2024-04-23T10:21:41.488 INFO:tasks.workunit.client.0.smithi029.stdout:3/670: getdents d3/d10/de/d2e/d36/d40 0 2024-04-23T10:21:41.526 INFO:tasks.workunit.client.0.smithi029.stdout:3/671: creat d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/de5/fec x:0 0 0 2024-04-23T10:21:41.527 INFO:tasks.workunit.client.0.smithi029.stdout:2/663: link d1/d4/l43 d1/d31/d50/d9b/d9e/le1 0 2024-04-23T10:21:41.531 INFO:tasks.workunit.client.0.smithi029.stdout:2/664: fsync d1/d3e/d3b/d75/f85 0 2024-04-23T10:21:41.533 INFO:tasks.workunit.client.0.smithi029.stdout:3/672: creat d3/d45/d4f/d6b/ddf/fed x:0 0 0 2024-04-23T10:21:41.536 INFO:tasks.workunit.client.0.smithi029.stdout:3/673: fdatasync d3/d10/de/d2e/d36/d40/d46/d72/d31/db6/fd9 0 2024-04-23T10:21:41.541 INFO:tasks.workunit.client.0.smithi029.stdout:2/665: truncate d1/dd/f62 1113580 0 2024-04-23T10:21:41.542 INFO:tasks.workunit.client.0.smithi029.stdout:9/899: truncate d0/d1b/d39/d50/d67/fc7 1800964 0 2024-04-23T10:21:41.544 INFO:tasks.workunit.client.0.smithi029.stdout:2/666: dread - d1/d3e/d3b/f7d zero size 2024-04-23T10:21:41.544 INFO:tasks.workunit.client.0.smithi029.stdout:9/900: truncate d0/d7/d1d/d35/f62 2944927 0 2024-04-23T10:21:41.555 INFO:tasks.workunit.client.0.smithi029.stdout:0/606: sync 2024-04-23T10:21:41.555 INFO:tasks.workunit.client.0.smithi029.stdout:6/830: sync 2024-04-23T10:21:41.555 INFO:tasks.workunit.client.0.smithi029.stdout:1/613: sync 2024-04-23T10:21:41.557 INFO:tasks.workunit.client.0.smithi029.stdout:0/607: fdatasync d0/f2b 0 2024-04-23T10:21:41.559 INFO:tasks.workunit.client.0.smithi029.stdout:2/667: dwrite d1/dd/d47/d63/d64/f6b [4194304,4194304] 0 2024-04-23T10:21:41.561 INFO:tasks.workunit.client.0.smithi029.stdout:1/614: write d5/d6/de/d27/d38/d47/f79 [1106463,9388] 0 2024-04-23T10:21:41.563 INFO:tasks.workunit.client.0.smithi029.stdout:3/674: rename d3/d10/de/d2e/d36/d40/d43 to d3/d15/d4b/d52/dee 0 2024-04-23T10:21:41.566 INFO:tasks.workunit.client.0.smithi029.stdout:2/668: write d1/d3e/d5a/dcd/fd2 [369174,95455] 0 2024-04-23T10:21:41.573 INFO:tasks.workunit.client.0.smithi029.stdout:0/608: rename d0/d21/d7f/d55/f58 to d0/da9/d4c/daf/fd0 0 2024-04-23T10:21:41.575 INFO:tasks.workunit.client.0.smithi029.stdout:1/615: read d5/f58 [1701375,117620] 0 2024-04-23T10:21:41.578 INFO:tasks.workunit.client.0.smithi029.stdout:9/901: dread d0/d1b/d39/d112/f8b [0,4194304] 0 2024-04-23T10:21:41.580 INFO:tasks.workunit.client.0.smithi029.stdout:1/616: readlink d5/d6/de/d22/d6c/l6d 0 2024-04-23T10:21:41.581 INFO:tasks.workunit.client.0.smithi029.stdout:6/831: getdents d9/df/d16/d44/d75 0 2024-04-23T10:21:41.586 INFO:tasks.workunit.client.0.smithi029.stdout:2/669: dwrite d1/dd/d47/f53 [0,4194304] 0 2024-04-23T10:21:41.590 INFO:tasks.workunit.client.0.smithi029.stdout:0/609: dwrite d0/dc/f16 [0,4194304] 0 2024-04-23T10:21:41.592 INFO:tasks.workunit.client.0.smithi029.stdout:2/670: rmdir d1/d4/db7 39 2024-04-23T10:21:41.602 INFO:tasks.workunit.client.0.smithi029.stdout:0/610: creat d0/d1b/d67/dae/d92/da0/fd1 x:0 0 0 2024-04-23T10:21:41.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/832: creat d9/df/d16/f111 x:0 0 0 2024-04-23T10:21:41.603 INFO:tasks.workunit.client.0.smithi029.stdout:6/833: write d9/df/d16/d1f/d27/f100 [141594,14003] 0 2024-04-23T10:21:41.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/617: rename d5/d6/de/d22/d6c/c78 to d5/d6/de/d22/d6c/cc3 0 2024-04-23T10:21:41.609 INFO:tasks.workunit.client.0.smithi029.stdout:2/671: creat d1/d3e/d3b/d75/fe2 x:0 0 0 2024-04-23T10:21:41.621 INFO:tasks.workunit.client.0.smithi029.stdout:0/611: creat d0/d1b/d67/fd2 x:0 0 0 2024-04-23T10:21:41.625 INFO:tasks.workunit.client.0.smithi029.stdout:2/672: symlink d1/d3e/d3b/d75/le3 0 2024-04-23T10:21:41.629 INFO:tasks.workunit.client.0.smithi029.stdout:0/612: fdatasync d0/d1b/f3b 0 2024-04-23T10:21:41.631 INFO:tasks.workunit.client.0.smithi029.stdout:0/613: chown d0/d3e/d4e/d50 6 1 2024-04-23T10:21:41.631 INFO:tasks.workunit.client.0.smithi029.stdout:1/618: rename d5/d6/de/d27/d38 to d5/d6/de/d22/d84/dc4 0 2024-04-23T10:21:41.633 INFO:tasks.workunit.client.0.smithi029.stdout:2/673: mkdir d1/d31/d3d/de4 0 2024-04-23T10:21:41.633 INFO:tasks.workunit.client.0.smithi029.stdout:0/614: write d0/d3e/d4e/fb3 [4761,114231] 0 2024-04-23T10:21:41.634 INFO:tasks.workunit.client.0.smithi029.stdout:9/902: write d0/d7/d1d/d35/da9/fe8 [571729,9885] 0 2024-04-23T10:21:41.636 INFO:tasks.workunit.client.0.smithi029.stdout:2/674: write d1/dd/d22/f90 [831772,125274] 0 2024-04-23T10:21:41.637 INFO:tasks.workunit.client.0.smithi029.stdout:3/675: dwrite d3/d10/de/d2e/d36/d8a/f95 [0,4194304] 0 2024-04-23T10:21:41.641 INFO:tasks.workunit.client.0.smithi029.stdout:6/834: write d9/df/d16/d34/d36/d63/fce [4299286,128696] 0 2024-04-23T10:21:41.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/675: read d1/d3e/d5a/d6d/fbe [2457384,85512] 0 2024-04-23T10:21:41.653 INFO:tasks.workunit.client.0.smithi029.stdout:6/835: truncate d9/df/d16/d34/d36/fb1 286743 0 2024-04-23T10:21:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/836: stat d9/df/d16/d44/d101 0 2024-04-23T10:21:41.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/619: getdents d5/d3e 0 2024-04-23T10:21:41.658 INFO:tasks.workunit.client.0.smithi029.stdout:2/676: rmdir d1/d4/db7/db8 39 2024-04-23T10:21:41.659 INFO:tasks.workunit.client.0.smithi029.stdout:6/837: mkdir d9/df/d16/d44/d112 0 2024-04-23T10:21:41.660 INFO:tasks.workunit.client.0.smithi029.stdout:1/620: rmdir d5/d6/de/d22/d84 39 2024-04-23T10:21:41.662 INFO:tasks.workunit.client.0.smithi029.stdout:9/903: dwrite d0/d1b/d39/d112/f7d [0,4194304] 0 2024-04-23T10:21:41.663 INFO:tasks.workunit.client.0.smithi029.stdout:6/838: fdatasync d9/df/d41/d49/fc7 0 2024-04-23T10:21:41.668 INFO:tasks.workunit.client.0.smithi029.stdout:2/677: dwrite d1/d3e/d5a/f93 [0,4194304] 0 2024-04-23T10:21:41.669 INFO:tasks.workunit.client.0.smithi029.stdout:6/839: mknod d9/df/d16/d1f/d27/dad/dbd/c113 0 2024-04-23T10:21:41.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/621: getdents d5/d6/de/d22/d77 0 2024-04-23T10:21:41.680 INFO:tasks.workunit.client.0.smithi029.stdout:2/678: dwrite d1/d3e/d3b/d75/dd1/fd3 [0,4194304] 0 2024-04-23T10:21:41.682 INFO:tasks.workunit.client.0.smithi029.stdout:1/622: creat d5/d6/de/d22/d6c/fc5 x:0 0 0 2024-04-23T10:21:41.685 INFO:tasks.workunit.client.0.smithi029.stdout:6/840: creat d9/df/d41/d49/dcc/f114 x:0 0 0 2024-04-23T10:21:41.688 INFO:tasks.workunit.client.0.smithi029.stdout:3/676: dwrite d3/d15/f1d [0,4194304] 0 2024-04-23T10:21:41.690 INFO:tasks.workunit.client.0.smithi029.stdout:2/679: mknod d1/d31/ce5 0 2024-04-23T10:21:41.691 INFO:tasks.workunit.client.0.smithi029.stdout:6/841: symlink d9/df/d16/d1f/d27/dad/l115 0 2024-04-23T10:21:41.694 INFO:tasks.workunit.client.0.smithi029.stdout:9/904: dread d0/d7/d6/fe [0,4194304] 0 2024-04-23T10:21:41.701 INFO:tasks.workunit.client.0.smithi029.stdout:3/677: write d3/d10/de/d2e/d36/d40/d46/f9f [2919076,107422] 0 2024-04-23T10:21:41.701 INFO:tasks.workunit.client.0.smithi029.stdout:2/680: creat d1/fe6 x:0 0 0 2024-04-23T10:21:41.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/842: dread d9/df/d41/fe7 [0,4194304] 0 2024-04-23T10:21:41.727 INFO:tasks.workunit.client.0.smithi029.stdout:9/905: write d0/d7/f115 [607255,105555] 0 2024-04-23T10:21:41.727 INFO:tasks.workunit.client.0.smithi029.stdout:2/681: dread d1/dd/d47/f5d [0,4194304] 0 2024-04-23T10:21:41.727 INFO:tasks.workunit.client.0.smithi029.stdout:6/843: write d9/df/d41/d49/dcc/f114 [1028686,129783] 0 2024-04-23T10:21:41.728 INFO:tasks.workunit.client.0.smithi029.stdout:6/844: write d9/df/d25/f10c [1093908,128469] 0 2024-04-23T10:21:41.730 INFO:tasks.workunit.client.0.smithi029.stdout:3/678: rename d3/d10/de/d2e/d36/d40/d46/d65/dba to d3/d10/d48/def 0 2024-04-23T10:21:41.733 INFO:tasks.workunit.client.0.smithi029.stdout:3/679: chown d3/c9a 32234544 1 2024-04-23T10:21:41.734 INFO:tasks.workunit.client.0.smithi029.stdout:6/845: mkdir d9/df/d16/d34/d116 0 2024-04-23T10:21:41.738 INFO:tasks.workunit.client.0.smithi029.stdout:2/682: rename d1/d3e/d3b/c83 to d1/d31/ce7 0 2024-04-23T10:21:41.739 INFO:tasks.workunit.client.0.smithi029.stdout:2/683: write d1/dd/d22/f90 [4991565,21345] 0 2024-04-23T10:21:41.918 INFO:tasks.workunit.client.0.smithi029.stdout:5/768: sync 2024-04-23T10:21:41.918 INFO:tasks.workunit.client.0.smithi029.stdout:4/804: sync 2024-04-23T10:21:41.918 INFO:tasks.workunit.client.0.smithi029.stdout:7/851: sync 2024-04-23T10:21:41.921 INFO:tasks.workunit.client.0.smithi029.stdout:5/769: dread - d0/d35/d38/d39/dcb/fd9 zero size 2024-04-23T10:21:41.924 INFO:tasks.workunit.client.0.smithi029.stdout:4/805: rename d0 to d0/d3c/d52/d1b/d36/d11e 22 2024-04-23T10:21:41.925 INFO:tasks.workunit.client.0.smithi029.stdout:2/684: read d1/dd/f51 [3298025,88202] 0 2024-04-23T10:21:41.936 INFO:tasks.workunit.client.0.smithi029.stdout:3/680: write d3/d10/de/d2e/d36/f39 [2113545,43514] 0 2024-04-23T10:21:41.946 INFO:tasks.workunit.client.0.smithi029.stdout:4/806: mkdir d0/d3c/d52/d1b/d9f/d92/dd8/da1/db1/d11f 0 2024-04-23T10:21:41.953 INFO:tasks.workunit.client.0.smithi029.stdout:5/770: rename d0/d35/d38/d3e/d66/d5a/dcc/l96 to d0/d35/d38/d39/d3f/lf8 0 2024-04-23T10:21:41.954 INFO:tasks.workunit.client.0.smithi029.stdout:6/846: write d9/df/d16/d44/d75/fd5 [693968,59162] 0 2024-04-23T10:21:42.051 INFO:tasks.workunit.client.0.smithi029.stdout:4/807: unlink d0/d3c/d52/d1b/d5b/d65/d6a/d7c/fdd 0 2024-04-23T10:21:42.053 INFO:tasks.workunit.client.0.smithi029.stdout:7/852: write d5/d29/f2a [1052575,80603] 0 2024-04-23T10:21:42.054 INFO:tasks.workunit.client.0.smithi029.stdout:6/847: chown d9/df/d16/d1f/d27/d33/da4/lf3 63 1 2024-04-23T10:21:42.066 INFO:tasks.workunit.client.0.smithi029.stdout:7/853: readlink d5/d71/dca/ld4 0 2024-04-23T10:21:42.070 INFO:tasks.workunit.client.0.smithi029.stdout:5/771: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/dca/l23 252516296 1 2024-04-23T10:21:42.071 INFO:tasks.workunit.client.0.smithi029.stdout:6/848: truncate d9/df/d41/d49/fc7 931838 0 2024-04-23T10:21:42.074 INFO:tasks.workunit.client.0.smithi029.stdout:0/615: dread d0/dc/f11 [0,4194304] 0 2024-04-23T10:21:42.079 INFO:tasks.workunit.client.0.smithi029.stdout:3/681: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d31/f55 [4194304,4194304] 0 2024-04-23T10:21:42.085 INFO:tasks.workunit.client.0.smithi029.stdout:4/808: dread d0/d3c/d52/d20/f5e [0,4194304] 0 2024-04-23T10:21:42.090 INFO:tasks.workunit.client.0.smithi029.stdout:0/616: mkdir d0/d1b/d67/dae/d92/da0/dd3 0 2024-04-23T10:21:42.097 INFO:tasks.workunit.client.0.smithi029.stdout:5/772: creat d0/d35/da1/ff9 x:0 0 0 2024-04-23T10:21:42.098 INFO:tasks.workunit.client.0.smithi029.stdout:7/854: dwrite d5/d29/d4a/f56 [0,4194304] 0 2024-04-23T10:21:42.101 INFO:tasks.workunit.client.0.smithi029.stdout:3/682: unlink d3/d10/d48/ca3 0 2024-04-23T10:21:42.104 INFO:tasks.workunit.client.0.smithi029.stdout:0/617: chown d0/d1b/c42 53125 1 2024-04-23T10:21:42.106 INFO:tasks.workunit.client.0.smithi029.stdout:3/683: write d3/f69 [682719,113909] 0 2024-04-23T10:21:42.110 INFO:tasks.workunit.client.0.smithi029.stdout:4/809: symlink d0/d3c/d52/d20/l120 0 2024-04-23T10:21:42.111 INFO:tasks.workunit.client.0.smithi029.stdout:5/773: fsync d0/d35/d10/d26/db2/fb4 0 2024-04-23T10:21:42.112 INFO:tasks.workunit.client.0.smithi029.stdout:8/729: sync 2024-04-23T10:21:42.116 INFO:tasks.workunit.client.0.smithi029.stdout:6/849: rename d9/df/d16/d1f/d27/dad/dd0 to d9/df/d16/d34/d36/d117 0 2024-04-23T10:21:42.117 INFO:tasks.workunit.client.0.smithi029.stdout:8/730: write d3/d71/fdc [187182,128782] 0 2024-04-23T10:21:42.119 INFO:tasks.workunit.client.0.smithi029.stdout:0/618: creat d0/da9/d4c/da7/fd4 x:0 0 0 2024-04-23T10:21:42.123 INFO:tasks.workunit.client.0.smithi029.stdout:4/810: readlink d0/d3c/d52/d1b/d5b/d65/d6a/l9d 0 2024-04-23T10:21:42.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/855: mkdir d5/d8/d116 0 2024-04-23T10:21:42.136 INFO:tasks.workunit.client.0.smithi029.stdout:5/774: dwrite d0/d35/d10/d26/db2/fb4 [0,4194304] 0 2024-04-23T10:21:42.149 INFO:tasks.workunit.client.0.smithi029.stdout:3/684: dwrite d3/d15/d4b/d52/f87 [0,4194304] 0 2024-04-23T10:21:42.151 INFO:tasks.workunit.client.0.smithi029.stdout:4/811: mknod d0/d3c/d52/d1b/c121 0 2024-04-23T10:21:42.152 INFO:tasks.workunit.client.0.smithi029.stdout:5/775: stat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/dca/l5e 0 2024-04-23T10:21:42.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/850: creat d9/df/d16/d1f/d27/d33/da4/d66/d95/f118 x:0 0 0 2024-04-23T10:21:42.154 INFO:tasks.workunit.client.0.smithi029.stdout:9/906: sync 2024-04-23T10:21:42.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/623: sync 2024-04-23T10:21:42.156 INFO:tasks.workunit.client.0.smithi029.stdout:7/856: creat d5/d71/d92/db7/dc3/f117 x:0 0 0 2024-04-23T10:21:42.159 INFO:tasks.workunit.client.0.smithi029.stdout:4/812: symlink d0/d5a/l122 0 2024-04-23T10:21:42.169 INFO:tasks.workunit.client.0.smithi029.stdout:8/731: dwrite d3/d50/d6a/d95/d36/d3e/f4f [0,4194304] 0 2024-04-23T10:21:42.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/776: readlink d0/d35/d38/db3/dcf/ldf 0 2024-04-23T10:21:42.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/619: dwrite d0/dc/f15 [4194304,4194304] 0 2024-04-23T10:21:42.173 INFO:tasks.workunit.client.0.smithi029.stdout:5/777: chown d0/d35/d38/d3e/d66/d5a/d78/l5f 14821 1 2024-04-23T10:21:42.182 INFO:tasks.workunit.client.0.smithi029.stdout:4/813: write d0/d5a/fb2 [277757,17424] 0 2024-04-23T10:21:42.187 INFO:tasks.workunit.client.0.smithi029.stdout:5/778: mkdir d0/d35/d38/d3e/d66/d5a/d78/de4/dfa 0 2024-04-23T10:21:42.188 INFO:tasks.workunit.client.0.smithi029.stdout:3/685: rename d3/d10/de/d2e/d36/d40/d46/d72/f6f to d3/d15/d4b/ff0 0 2024-04-23T10:21:42.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/620: creat d0/d1b/d67/d6c/fd5 x:0 0 0 2024-04-23T10:21:42.196 INFO:tasks.workunit.client.0.smithi029.stdout:6/851: rename d9/df/d25 to d9/df/d16/d1f/d27/d33/da4/d66/d95/d119 0 2024-04-23T10:21:42.199 INFO:tasks.workunit.client.0.smithi029.stdout:1/624: dwrite d5/d6/de/d27/f35 [0,4194304] 0 2024-04-23T10:21:42.199 INFO:tasks.workunit.client.0.smithi029.stdout:9/907: dwrite d0/d1b/d24/f6e [0,4194304] 0 2024-04-23T10:21:42.199 INFO:tasks.workunit.client.0.smithi029.stdout:0/621: readlink d0/d21/d7f/d3a/l65 0 2024-04-23T10:21:42.201 INFO:tasks.workunit.client.0.smithi029.stdout:7/857: dwrite d5/d71/d114/f87 [0,4194304] 0 2024-04-23T10:21:42.204 INFO:tasks.workunit.client.0.smithi029.stdout:1/625: write d5/d6/de/d22/f5b [2202862,84050] 0 2024-04-23T10:21:42.208 INFO:tasks.workunit.client.0.smithi029.stdout:4/814: dwrite d0/d3c/d52/d1b/d66/f114 [0,4194304] 0 2024-04-23T10:21:42.212 INFO:tasks.workunit.client.0.smithi029.stdout:8/732: rename d3/d38 to d3/d50/dac/de1/de3 0 2024-04-23T10:21:42.214 INFO:tasks.workunit.client.0.smithi029.stdout:6/852: write d9/df/d41/fe7 [1196948,44950] 0 2024-04-23T10:21:42.217 INFO:tasks.workunit.client.0.smithi029.stdout:3/686: fsync d3/d10/de/d2e/d36/d40/d46/f7f 0 2024-04-23T10:21:42.219 INFO:tasks.workunit.client.0.smithi029.stdout:9/908: stat d0/d7/d1d/d35/da9/fc5 0 2024-04-23T10:21:42.226 INFO:tasks.workunit.client.0.smithi029.stdout:1/626: rename d5/d6/f40 to d5/d6/de/d22/d77/fc6 0 2024-04-23T10:21:42.230 INFO:tasks.workunit.client.0.smithi029.stdout:6/853: rmdir d9/df/d16/d1f/d27/d33 39 2024-04-23T10:21:42.232 INFO:tasks.workunit.client.0.smithi029.stdout:3/687: mknod d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/cf1 0 2024-04-23T10:21:42.236 INFO:tasks.workunit.client.0.smithi029.stdout:5/779: dwrite d0/d35/d38/d3e/d66/d5a/d78/d3d/fba [0,4194304] 0 2024-04-23T10:21:42.236 INFO:tasks.workunit.client.0.smithi029.stdout:2/685: sync 2024-04-23T10:21:42.239 INFO:tasks.workunit.client.0.smithi029.stdout:0/622: link d0/dc/d26/fb0 d0/d3e/d4e/d50/d71/fd6 0 2024-04-23T10:21:42.240 INFO:tasks.workunit.client.0.smithi029.stdout:4/815: creat d0/d3c/d52/d1b/f123 x:0 0 0 2024-04-23T10:21:42.242 INFO:tasks.workunit.client.0.smithi029.stdout:9/909: rename d0/d1b/d39/d50/d67/db6/l9a to d0/d1b/d39/d50/dd4/l135 0 2024-04-23T10:21:42.249 INFO:tasks.workunit.client.0.smithi029.stdout:5/780: dread d0/d35/d10/f42 [0,4194304] 0 2024-04-23T10:21:42.251 INFO:tasks.workunit.client.0.smithi029.stdout:1/627: write d5/d6/de/d22/d84/dc4/d47/fac [80126,98233] 0 2024-04-23T10:21:42.251 INFO:tasks.workunit.client.0.smithi029.stdout:6/854: unlink d9/df/d16/d1f/d27/d33/da4/d58/d7e/lf4 0 2024-04-23T10:21:42.255 INFO:tasks.workunit.client.0.smithi029.stdout:2/686: fdatasync d1/d3e/d5a/f6f 0 2024-04-23T10:21:42.256 INFO:tasks.workunit.client.0.smithi029.stdout:3/688: dwrite d3/d10/de/fe7 [0,4194304] 0 2024-04-23T10:21:42.258 INFO:tasks.workunit.client.0.smithi029.stdout:0/623: truncate d0/da9/f70 1974794 0 2024-04-23T10:21:42.260 INFO:tasks.workunit.client.0.smithi029.stdout:8/733: truncate d3/d50/d6a/d95/d36/fa6 244979 0 2024-04-23T10:21:42.262 INFO:tasks.workunit.client.0.smithi029.stdout:7/858: dwrite d5/d29/ded/d4d/f97 [0,4194304] 0 2024-04-23T10:21:42.263 INFO:tasks.workunit.client.0.smithi029.stdout:3/689: chown d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/de5/fec 20 1 2024-04-23T10:21:42.270 INFO:tasks.workunit.client.0.smithi029.stdout:5/781: dread d0/d35/d38/d3e/d66/fd1 [0,4194304] 0 2024-04-23T10:21:42.270 INFO:tasks.workunit.client.0.smithi029.stdout:1/628: rename d5/d6/f74 to d5/d6/de/d22/d84/dc4/fc7 0 2024-04-23T10:21:42.270 INFO:tasks.workunit.client.0.smithi029.stdout:9/910: rmdir d0/d7/d1d/d35/dd9/d12d 0 2024-04-23T10:21:42.271 INFO:tasks.workunit.client.0.smithi029.stdout:7/859: write d5/d8/d51/f53 [771158,126932] 0 2024-04-23T10:21:42.272 INFO:tasks.workunit.client.0.smithi029.stdout:2/687: creat d1/fe8 x:0 0 0 2024-04-23T10:21:42.273 INFO:tasks.workunit.client.0.smithi029.stdout:0/624: rename d0/d3e/d4e/d50 to d0/da9/d4c/da7/dc7/dd7 0 2024-04-23T10:21:42.273 INFO:tasks.workunit.client.0.smithi029.stdout:4/816: creat d0/d3c/d52/d1b/d9f/d92/dd8/da1/db1/f124 x:0 0 0 2024-04-23T10:21:42.277 INFO:tasks.workunit.client.0.smithi029.stdout:8/734: mknod d3/d50/d6a/d95/d36/d3e/dce/ce4 0 2024-04-23T10:21:42.282 INFO:tasks.workunit.client.0.smithi029.stdout:6/855: link d9/df/d16/d34/d36/d117/dea/d104/le6 d9/df/d16/d44/d75/l11a 0 2024-04-23T10:21:42.282 INFO:tasks.workunit.client.0.smithi029.stdout:0/625: rename d0/da9/d4c to d0/da9/d4c/da7/dc7/dd7/d71/dd8 22 2024-04-23T10:21:42.287 INFO:tasks.workunit.client.0.smithi029.stdout:4/817: write d0/f17 [4267794,72271] 0 2024-04-23T10:21:42.288 INFO:tasks.workunit.client.0.smithi029.stdout:8/735: dwrite d3/d50/fd6 [0,4194304] 0 2024-04-23T10:21:42.288 INFO:tasks.workunit.client.0.smithi029.stdout:5/782: creat d0/d35/d38/d3e/d66/d5a/d78/ffb x:0 0 0 2024-04-23T10:21:42.294 INFO:tasks.workunit.client.0.smithi029.stdout:9/911: write d0/d7/d1d/d35/dd9/f86 [527700,50102] 0 2024-04-23T10:21:42.297 INFO:tasks.workunit.client.0.smithi029.stdout:3/690: link d3/d10/de/d2e/d36/d40/d46/d72/d31/c8c d3/d10/de/de1/cf2 0 2024-04-23T10:21:42.302 INFO:tasks.workunit.client.0.smithi029.stdout:8/736: dwrite d3/d50/fd6 [0,4194304] 0 2024-04-23T10:21:42.303 INFO:tasks.workunit.client.0.smithi029.stdout:5/783: rmdir d0/d35/d38/d39/d3f 39 2024-04-23T10:21:42.303 INFO:tasks.workunit.client.0.smithi029.stdout:1/629: truncate d5/d6/de/d22/d84/dc4/f67 4309087 0 2024-04-23T10:21:42.304 INFO:tasks.workunit.client.0.smithi029.stdout:3/691: chown d3/d10/de/d2e/d36/d40/d46/d72/d31/db6 29 1 2024-04-23T10:21:42.304 INFO:tasks.workunit.client.0.smithi029.stdout:6/856: fdatasync d9/df/f73 0 2024-04-23T10:21:42.305 INFO:tasks.workunit.client.0.smithi029.stdout:0/626: mkdir d0/dc/dd9 0 2024-04-23T10:21:42.309 INFO:tasks.workunit.client.0.smithi029.stdout:6/857: fdatasync d9/df/f73 0 2024-04-23T10:21:42.310 INFO:tasks.workunit.client.0.smithi029.stdout:0/627: dread - d0/d3e/d4e/fcf zero size 2024-04-23T10:21:42.310 INFO:tasks.workunit.client.0.smithi029.stdout:4/818: truncate d0/d3c/d52/d74/d91/fcd 289657 0 2024-04-23T10:21:42.315 INFO:tasks.workunit.client.0.smithi029.stdout:4/819: write d0/d12/da9/fe8 [534005,127889] 0 2024-04-23T10:21:42.316 INFO:tasks.workunit.client.0.smithi029.stdout:3/692: creat d3/d10/d48/ff3 x:0 0 0 2024-04-23T10:21:42.317 INFO:tasks.workunit.client.0.smithi029.stdout:9/912: dwrite d0/d1b/ff6 [0,4194304] 0 2024-04-23T10:21:42.322 INFO:tasks.workunit.client.0.smithi029.stdout:1/630: mknod d5/d6/de/d22/d84/dc4/d6a/cc8 0 2024-04-23T10:21:42.324 INFO:tasks.workunit.client.0.smithi029.stdout:3/693: fdatasync d3/d15/d4b/f50 0 2024-04-23T10:21:42.324 INFO:tasks.workunit.client.0.smithi029.stdout:7/860: dwrite d5/d29/ded/f83 [0,4194304] 0 2024-04-23T10:21:42.326 INFO:tasks.workunit.client.0.smithi029.stdout:1/631: chown d5/d6/de/d22/f5b 1287426 1 2024-04-23T10:21:42.327 INFO:tasks.workunit.client.0.smithi029.stdout:9/913: unlink d0/d1b/d39/d50/d67/db6/f107 0 2024-04-23T10:21:42.342 INFO:tasks.workunit.client.0.smithi029.stdout:0/628: dwrite d0/da9/d4c/da7/fd4 [0,4194304] 0 2024-04-23T10:21:42.346 INFO:tasks.workunit.client.0.smithi029.stdout:5/784: dread d0/d35/d38/d3e/d66/d8c/dda/fea [4194304,4194304] 0 2024-04-23T10:21:42.350 INFO:tasks.workunit.client.0.smithi029.stdout:7/861: truncate d5/d8/f23 1434303 0 2024-04-23T10:21:42.359 INFO:tasks.workunit.client.0.smithi029.stdout:5/785: creat d0/ffc x:0 0 0 2024-04-23T10:21:42.362 INFO:tasks.workunit.client.0.smithi029.stdout:7/862: symlink d5/d29/ded/d8e/l118 0 2024-04-23T10:21:42.363 INFO:tasks.workunit.client.0.smithi029.stdout:9/914: dwrite d0/d7/d1d/d35/d3b/db8/ff3 [0,4194304] 0 2024-04-23T10:21:42.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/632: dwrite d5/d6/de/d22/d77/f88 [0,4194304] 0 2024-04-23T10:21:42.371 INFO:tasks.workunit.client.0.smithi029.stdout:3/694: dwrite d3/d15/f66 [0,4194304] 0 2024-04-23T10:21:42.372 INFO:tasks.workunit.client.0.smithi029.stdout:4/820: dread d0/d3c/d52/d74/d91/fbc [0,4194304] 0 2024-04-23T10:21:42.375 INFO:tasks.workunit.client.0.smithi029.stdout:5/786: creat d0/d35/d38/d39/dcb/ffd x:0 0 0 2024-04-23T10:21:42.379 INFO:tasks.workunit.client.0.smithi029.stdout:1/633: truncate d5/d6/d34/d8a/fbe 2094152 0 2024-04-23T10:21:42.379 INFO:tasks.workunit.client.0.smithi029.stdout:0/629: dwrite d0/d21/d7f/f8f [0,4194304] 0 2024-04-23T10:21:42.380 INFO:tasks.workunit.client.0.smithi029.stdout:9/915: truncate d0/d7/d1d/d35/d3b/fe7 499797 0 2024-04-23T10:21:42.381 INFO:tasks.workunit.client.0.smithi029.stdout:0/630: readlink d0/d1b/lc0 0 2024-04-23T10:21:42.385 INFO:tasks.workunit.client.0.smithi029.stdout:1/634: mkdir d5/d6/de/d27/da9/dad/dc9 0 2024-04-23T10:21:42.386 INFO:tasks.workunit.client.0.smithi029.stdout:5/787: symlink d0/d35/d10/d26/db2/lfe 0 2024-04-23T10:21:42.389 INFO:tasks.workunit.client.0.smithi029.stdout:3/695: dread d3/d10/de/d2e/fbc [0,4194304] 0 2024-04-23T10:21:42.390 INFO:tasks.workunit.client.0.smithi029.stdout:1/635: dread - d5/d6/de/d22/f56 zero size 2024-04-23T10:21:42.391 INFO:tasks.workunit.client.0.smithi029.stdout:0/631: mknod d0/da9/d4c/da7/dc7/dd7/d73/d7e/cda 0 2024-04-23T10:21:42.391 INFO:tasks.workunit.client.0.smithi029.stdout:7/863: dwrite d5/d8/fb [0,4194304] 0 2024-04-23T10:21:42.395 INFO:tasks.workunit.client.0.smithi029.stdout:9/916: creat d0/d7/d1d/d35/dd5/dec/f136 x:0 0 0 2024-04-23T10:21:42.396 INFO:tasks.workunit.client.0.smithi029.stdout:4/821: link d0/d3c/d52/d74/d8a/lb6 d0/d3c/d52/d1b/d36/d45/dd0/l125 0 2024-04-23T10:21:42.397 INFO:tasks.workunit.client.0.smithi029.stdout:3/696: unlink d3/d10/de/d2e/d36/d40/d46/d72/d28/cd0 0 2024-04-23T10:21:42.399 INFO:tasks.workunit.client.0.smithi029.stdout:7/864: getdents d5/d29/ded/d4d/ddb 0 2024-04-23T10:21:42.399 INFO:tasks.workunit.client.0.smithi029.stdout:3/697: chown d3/d10/d48/ff3 9 1 2024-04-23T10:21:42.400 INFO:tasks.workunit.client.0.smithi029.stdout:5/788: creat d0/d35/d38/db3/fff x:0 0 0 2024-04-23T10:21:42.401 INFO:tasks.workunit.client.0.smithi029.stdout:0/632: creat d0/d1b/d67/dae/d6a/fdb x:0 0 0 2024-04-23T10:21:42.402 INFO:tasks.workunit.client.0.smithi029.stdout:7/865: readlink d5/d29/ded/d8e/l118 0 2024-04-23T10:21:42.403 INFO:tasks.workunit.client.0.smithi029.stdout:9/917: creat d0/d7/d1d/d35/dd5/df2/f137 x:0 0 0 2024-04-23T10:21:42.404 INFO:tasks.workunit.client.0.smithi029.stdout:5/789: fdatasync d0/d35/da1/fe8 0 2024-04-23T10:21:42.404 INFO:tasks.workunit.client.0.smithi029.stdout:0/633: fdatasync d0/f6 0 2024-04-23T10:21:42.407 INFO:tasks.workunit.client.0.smithi029.stdout:5/790: chown d0/d35/d38/d3e/d66/d5a/d78/de4/cf0 172681279 1 2024-04-23T10:21:42.412 INFO:tasks.workunit.client.0.smithi029.stdout:7/866: creat d5/d71/df5/f119 x:0 0 0 2024-04-23T10:21:42.415 INFO:tasks.workunit.client.0.smithi029.stdout:9/918: fdatasync d0/d7/d1d/f57 0 2024-04-23T10:21:42.416 INFO:tasks.workunit.client.0.smithi029.stdout:7/867: dread d5/f24 [0,4194304] 0 2024-04-23T10:21:42.418 INFO:tasks.workunit.client.0.smithi029.stdout:3/698: mknod d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/cf4 0 2024-04-23T10:21:42.422 INFO:tasks.workunit.client.0.smithi029.stdout:5/791: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d100 0 2024-04-23T10:21:42.422 INFO:tasks.workunit.client.0.smithi029.stdout:0/634: dwrite d0/f3f [0,4194304] 0 2024-04-23T10:21:42.426 INFO:tasks.workunit.client.0.smithi029.stdout:7/868: symlink d5/d8/d51/d9e/db2/l11a 0 2024-04-23T10:21:42.427 INFO:tasks.workunit.client.0.smithi029.stdout:0/635: mkdir d0/da9/d4c/daf/ddc 0 2024-04-23T10:21:42.428 INFO:tasks.workunit.client.0.smithi029.stdout:9/919: unlink d0/d7/d1d/d35/da9/dd0/l106 0 2024-04-23T10:21:42.430 INFO:tasks.workunit.client.0.smithi029.stdout:3/699: mkdir d3/d45/d4f/df5 0 2024-04-23T10:21:42.432 INFO:tasks.workunit.client.0.smithi029.stdout:5/792: symlink d0/d35/d83/l101 0 2024-04-23T10:21:42.433 INFO:tasks.workunit.client.0.smithi029.stdout:0/636: mkdir d0/d3e/ddd 0 2024-04-23T10:21:42.434 INFO:tasks.workunit.client.0.smithi029.stdout:3/700: unlink d3/f8 0 2024-04-23T10:21:42.436 INFO:tasks.workunit.client.0.smithi029.stdout:0/637: write d0/d3e/f72 [6320521,6039] 0 2024-04-23T10:21:42.437 INFO:tasks.workunit.client.0.smithi029.stdout:5/793: mknod d0/d35/da1/c102 0 2024-04-23T10:21:42.440 INFO:tasks.workunit.client.0.smithi029.stdout:0/638: mkdir d0/da9/d4c/daf/dde 0 2024-04-23T10:21:42.442 INFO:tasks.workunit.client.0.smithi029.stdout:3/701: mknod d3/d10/de/de1/cf6 0 2024-04-23T10:21:42.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/702: chown d3/c9a 84 1 2024-04-23T10:21:42.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/794: read d0/d6a/fce [745933,78723] 0 2024-04-23T10:21:42.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/920: write d0/f21 [3297120,94578] 0 2024-04-23T10:21:42.448 INFO:tasks.workunit.client.0.smithi029.stdout:3/703: read d3/d45/f4a [3118279,20175] 0 2024-04-23T10:21:42.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/921: write d0/d7/d1d/d35/f62 [1253451,109386] 0 2024-04-23T10:21:42.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/639: write d0/d3e/f8d [711534,47775] 0 2024-04-23T10:21:42.451 INFO:tasks.workunit.client.0.smithi029.stdout:0/640: write d0/da9/d4c/f9c [4416459,32248] 0 2024-04-23T10:21:42.456 INFO:tasks.workunit.client.0.smithi029.stdout:0/641: creat d0/da9/d4c/da7/dc7/fdf x:0 0 0 2024-04-23T10:21:42.457 INFO:tasks.workunit.client.0.smithi029.stdout:5/795: getdents d0/d35/d38/d3e/d66/d5a 0 2024-04-23T10:21:42.458 INFO:tasks.workunit.client.0.smithi029.stdout:0/642: chown d0/d21/d7f/d3a/l65 15 1 2024-04-23T10:21:42.462 INFO:tasks.workunit.client.0.smithi029.stdout:5/796: write d0/d35/d38/d39/d3f/f7d [5468824,69280] 0 2024-04-23T10:21:42.466 INFO:tasks.workunit.client.0.smithi029.stdout:5/797: creat d0/d35/d38/d3e/d66/d8c/dda/f103 x:0 0 0 2024-04-23T10:21:42.468 INFO:tasks.workunit.client.0.smithi029.stdout:9/922: dread d0/d7/d6/fa3 [0,4194304] 0 2024-04-23T10:21:42.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/923: dwrite d0/d7/d3f/f82 [0,4194304] 0 2024-04-23T10:21:42.479 INFO:tasks.workunit.client.0.smithi029.stdout:9/924: rmdir d0/d1b/d39/d4f 39 2024-04-23T10:21:42.485 INFO:tasks.workunit.client.0.smithi029.stdout:9/925: dread d0/d1b/d39/d112/f7d [0,4194304] 0 2024-04-23T10:21:42.489 INFO:tasks.workunit.client.0.smithi029.stdout:5/798: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/f88 [4194304,4194304] 0 2024-04-23T10:21:42.491 INFO:tasks.workunit.client.0.smithi029.stdout:5/799: rmdir d0/d35/d38/d3e/d66/d5a/d78 39 2024-04-23T10:21:42.492 INFO:tasks.workunit.client.0.smithi029.stdout:9/926: write d0/f1e [268901,114501] 0 2024-04-23T10:21:42.494 INFO:tasks.workunit.client.0.smithi029.stdout:9/927: fdatasync d0/d7/d1d/d35/da9/f103 0 2024-04-23T10:21:42.496 INFO:tasks.workunit.client.0.smithi029.stdout:9/928: write d0/d7/d3f/dbb/ffe [653570,62285] 0 2024-04-23T10:21:42.496 INFO:tasks.workunit.client.0.smithi029.stdout:5/800: rename d0/f75 to d0/d9a/f104 0 2024-04-23T10:21:42.500 INFO:tasks.workunit.client.0.smithi029.stdout:5/801: write d0/d35/d10/d26/db2/dbc/fed [98239,2756] 0 2024-04-23T10:21:42.502 INFO:tasks.workunit.client.0.smithi029.stdout:5/802: chown d0/la2 1 1 2024-04-23T10:21:42.502 INFO:tasks.workunit.client.0.smithi029.stdout:9/929: link d0/d1b/d39/d50/f6a d0/d7/d1d/d35/dd5/dec/d108/f138 0 2024-04-23T10:21:42.504 INFO:tasks.workunit.client.0.smithi029.stdout:9/930: read d0/d7/d1d/d35/dd9/f86 [548627,70729] 0 2024-04-23T10:21:42.505 INFO:tasks.workunit.client.0.smithi029.stdout:5/803: read d0/d35/d38/d39/f8a [516548,38380] 0 2024-04-23T10:21:42.508 INFO:tasks.workunit.client.0.smithi029.stdout:5/804: symlink d0/d35/d49/l105 0 2024-04-23T10:21:42.512 INFO:tasks.workunit.client.0.smithi029.stdout:5/805: creat d0/d35/d38/d3e/d66/d5a/d78/de4/f106 x:0 0 0 2024-04-23T10:21:42.514 INFO:tasks.workunit.client.0.smithi029.stdout:5/806: dread - d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/fe7 zero size 2024-04-23T10:21:42.517 INFO:tasks.workunit.client.0.smithi029.stdout:9/931: dwrite d0/d7/d1d/d35/dd5/dec/d108/f138 [0,4194304] 0 2024-04-23T10:21:42.521 INFO:tasks.workunit.client.0.smithi029.stdout:9/932: getdents d0/d7/d1d/d35/dd5/dec 0 2024-04-23T10:21:42.529 INFO:tasks.workunit.client.0.smithi029.stdout:5/807: dwrite d0/d35/d83/fe6 [0,4194304] 0 2024-04-23T10:21:42.529 INFO:tasks.workunit.client.0.smithi029.stdout:5/808: readlink d0/d35/lf7 0 2024-04-23T10:21:42.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/809: fdatasync d0/d35/da1/ff9 0 2024-04-23T10:21:42.533 INFO:tasks.workunit.client.0.smithi029.stdout:9/933: write d0/d1b/d39/d4f/f9c [992324,126906] 0 2024-04-23T10:21:42.537 INFO:tasks.workunit.client.0.smithi029.stdout:9/934: creat d0/d1b/d39/d50/dd4/f139 x:0 0 0 2024-04-23T10:21:42.544 INFO:tasks.workunit.client.0.smithi029.stdout:5/810: dwrite d0/d35/d38/f4b [8388608,4194304] 0 2024-04-23T10:21:42.544 INFO:tasks.workunit.client.0.smithi029.stdout:9/935: link d0/d1b/d39/d50/f6a d0/d7/d1d/d35/dde/f13a 0 2024-04-23T10:21:42.550 INFO:tasks.workunit.client.0.smithi029.stdout:9/936: creat d0/d7/d1d/d35/dde/f13b x:0 0 0 2024-04-23T10:21:42.553 INFO:tasks.workunit.client.0.smithi029.stdout:5/811: write d0/d35/d10/d26/db2/d89/fb0 [271856,642] 0 2024-04-23T10:21:42.555 INFO:tasks.workunit.client.0.smithi029.stdout:5/812: stat d0/d35/d10/f71 0 2024-04-23T10:21:42.556 INFO:tasks.workunit.client.0.smithi029.stdout:9/937: truncate d0/d1b/d39/d4f/ff0 439624 0 2024-04-23T10:21:42.558 INFO:tasks.workunit.client.0.smithi029.stdout:9/938: stat d0/d7/d1d/d35/dd9/fd6 0 2024-04-23T10:21:42.558 INFO:tasks.workunit.client.0.smithi029.stdout:5/813: chown d0/d35/d38/d3e/d66/d5a/d78/de4/lf6 884 1 2024-04-23T10:21:42.560 INFO:tasks.workunit.client.0.smithi029.stdout:9/939: dread - d0/d7/d1d/d35/dd9/ffd zero size 2024-04-23T10:21:42.561 INFO:tasks.workunit.client.0.smithi029.stdout:5/814: creat d0/d6a/dd7/f107 x:0 0 0 2024-04-23T10:21:42.562 INFO:tasks.workunit.client.0.smithi029.stdout:9/940: mknod d0/d7/d6/d12c/c13c 0 2024-04-23T10:21:42.564 INFO:tasks.workunit.client.0.smithi029.stdout:9/941: creat d0/d1b/d12b/f13d x:0 0 0 2024-04-23T10:21:42.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/815: rename d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/cc4 to d0/d6a/dd7/c108 0 2024-04-23T10:21:42.567 INFO:tasks.workunit.client.0.smithi029.stdout:9/942: creat d0/d7/d1d/d35/d3b/d68/f13e x:0 0 0 2024-04-23T10:21:42.568 INFO:tasks.workunit.client.0.smithi029.stdout:9/943: chown d0/d1b/d60/dbf/f125 102065006 1 2024-04-23T10:21:42.570 INFO:tasks.workunit.client.0.smithi029.stdout:9/944: unlink d0/d7/c19 0 2024-04-23T10:21:42.573 INFO:tasks.workunit.client.0.smithi029.stdout:9/945: symlink d0/d7/d1d/d35/dd9/d49/l13f 0 2024-04-23T10:21:42.574 INFO:tasks.workunit.client.0.smithi029.stdout:9/946: symlink d0/d1b/d12b/l140 0 2024-04-23T10:21:42.576 INFO:tasks.workunit.client.0.smithi029.stdout:9/947: dread - d0/d7/d1d/d35/da9/fcb zero size 2024-04-23T10:21:42.579 INFO:tasks.workunit.client.0.smithi029.stdout:5/816: dwrite d0/d35/d38/d39/f94 [0,4194304] 0 2024-04-23T10:21:42.579 INFO:tasks.workunit.client.0.smithi029.stdout:9/948: mknod d0/d1b/d39/d50/dd4/c141 0 2024-04-23T10:21:42.584 INFO:tasks.workunit.client.0.smithi029.stdout:5/817: truncate d0/d35/d38/d3e/d66/d5a/d78/d3d/f4f 1366637 0 2024-04-23T10:21:42.588 INFO:tasks.workunit.client.0.smithi029.stdout:5/818: getdents d0/d35/d38/d39/dcb 0 2024-04-23T10:21:42.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/819: dread - d0/ffc zero size 2024-04-23T10:21:42.591 INFO:tasks.workunit.client.0.smithi029.stdout:9/949: dwrite d0/d7/d1d/d35/d3b/d68/f91 [0,4194304] 0 2024-04-23T10:21:42.592 INFO:tasks.workunit.client.0.smithi029.stdout:5/820: fsync d0/d9a/faa 0 2024-04-23T10:21:42.605 INFO:tasks.workunit.client.0.smithi029.stdout:5/821: dwrite d0/d35/d38/d39/dcb/ffd [0,4194304] 0 2024-04-23T10:21:42.617 INFO:tasks.workunit.client.0.smithi029.stdout:5/822: write d0/f57 [3422002,44089] 0 2024-04-23T10:21:42.619 INFO:tasks.workunit.client.0.smithi029.stdout:5/823: readlink d0/d35/d38/d3e/d66/lf2 0 2024-04-23T10:21:42.622 INFO:tasks.workunit.client.0.smithi029.stdout:5/824: chown d0/d35/d38/d3e/d66/d5a/d78/l60 405 1 2024-04-23T10:21:42.624 INFO:tasks.workunit.client.0.smithi029.stdout:5/825: mknod d0/d35/d38/d3e/d66/c109 0 2024-04-23T10:21:42.626 INFO:tasks.workunit.client.0.smithi029.stdout:5/826: stat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/lac 0 2024-04-23T10:21:42.626 INFO:tasks.workunit.client.0.smithi029.stdout:5/827: chown d0/d35/d10/d26 85 1 2024-04-23T10:21:42.629 INFO:tasks.workunit.client.0.smithi029.stdout:5/828: mknod d0/d35/d10/d26/db2/d89/c10a 0 2024-04-23T10:21:42.632 INFO:tasks.workunit.client.0.smithi029.stdout:5/829: creat d0/d35/d38/d3e/d66/f10b x:0 0 0 2024-04-23T10:21:42.648 INFO:tasks.workunit.client.0.smithi029.stdout:5/830: dread d0/d35/d38/d3e/d66/d8c/dda/fea [0,4194304] 0 2024-04-23T10:21:42.653 INFO:tasks.workunit.client.0.smithi029.stdout:5/831: dread d0/f81 [0,4194304] 0 2024-04-23T10:21:42.664 INFO:tasks.workunit.client.0.smithi029.stdout:5/832: dwrite d0/d35/d83/fb9 [0,4194304] 0 2024-04-23T10:21:42.669 INFO:tasks.workunit.client.0.smithi029.stdout:5/833: creat d0/d35/d38/d3e/d66/d5a/d78/de4/f10c x:0 0 0 2024-04-23T10:21:42.683 INFO:tasks.workunit.client.0.smithi029.stdout:5/834: dwrite d0/f31 [0,4194304] 0 2024-04-23T10:21:42.687 INFO:tasks.workunit.client.0.smithi029.stdout:5/835: stat d0/d35/d10/d26/db2/c52 0 2024-04-23T10:21:42.688 INFO:tasks.workunit.client.0.smithi029.stdout:5/836: chown d0/d35/d38/d39/f94 126 1 2024-04-23T10:21:42.689 INFO:tasks.workunit.client.0.smithi029.stdout:5/837: truncate d0/d9a/dc8/fe3 682398 0 2024-04-23T10:21:42.695 INFO:tasks.workunit.client.0.smithi029.stdout:5/838: creat d0/d35/d38/d3e/d66/d5a/d78/d3d/f10d x:0 0 0 2024-04-23T10:21:42.702 INFO:tasks.workunit.client.0.smithi029.stdout:5/839: getdents d0/d35/d38/d3e/d66 0 2024-04-23T10:21:42.702 INFO:tasks.workunit.client.0.smithi029.stdout:5/840: stat d0/d35/d38/d3e/d66/d5a 0 2024-04-23T10:21:42.705 INFO:tasks.workunit.client.0.smithi029.stdout:5/841: mkdir d0/d35/d83/d10e 0 2024-04-23T10:21:42.708 INFO:tasks.workunit.client.0.smithi029.stdout:5/842: unlink d0/d35/da1/ld2 0 2024-04-23T10:21:42.828 INFO:tasks.workunit.client.0.smithi029.stdout:5/843: write d0/d35/d38/d3e/d66/d5a/f80 [1524808,99337] 0 2024-04-23T10:21:42.989 INFO:tasks.workunit.client.0.smithi029.stdout:2/688: sync 2024-04-23T10:21:42.996 INFO:tasks.workunit.client.0.smithi029.stdout:2/689: creat d1/d31/d3d/fe9 x:0 0 0 2024-04-23T10:21:43.003 INFO:tasks.workunit.client.0.smithi029.stdout:2/690: truncate d1/dd/d22/f2c 3281116 0 2024-04-23T10:21:43.043 INFO:tasks.workunit.client.0.smithi029.stdout:2/691: dwrite d1/d4/f98 [8388608,4194304] 0 2024-04-23T10:21:43.049 INFO:tasks.workunit.client.0.smithi029.stdout:2/692: mkdir d1/d3e/d3b/d75/dd1/dea 0 2024-04-23T10:21:43.055 INFO:tasks.workunit.client.0.smithi029.stdout:2/693: mkdir d1/d4/db7/deb 0 2024-04-23T10:21:43.055 INFO:tasks.workunit.client.0.smithi029.stdout:3/704: sync 2024-04-23T10:21:43.055 INFO:tasks.workunit.client.0.smithi029.stdout:9/950: sync 2024-04-23T10:21:43.055 INFO:tasks.workunit.client.0.smithi029.stdout:4/822: sync 2024-04-23T10:21:43.055 INFO:tasks.workunit.client.0.smithi029.stdout:0/643: sync 2024-04-23T10:21:43.055 INFO:tasks.workunit.client.0.smithi029.stdout:5/844: sync 2024-04-23T10:21:43.056 INFO:tasks.workunit.client.0.smithi029.stdout:1/636: sync 2024-04-23T10:21:43.056 INFO:tasks.workunit.client.0.smithi029.stdout:8/737: sync 2024-04-23T10:21:43.056 INFO:tasks.workunit.client.0.smithi029.stdout:6/858: sync 2024-04-23T10:21:43.056 INFO:tasks.workunit.client.0.smithi029.stdout:7/869: sync 2024-04-23T10:21:43.060 INFO:tasks.workunit.client.0.smithi029.stdout:9/951: chown d0/d1b/d39/c105 2 1 2024-04-23T10:21:43.067 INFO:tasks.workunit.client.0.smithi029.stdout:3/705: stat d3/d10/de/d2e/d59/c6a 0 2024-04-23T10:21:43.069 INFO:tasks.workunit.client.0.smithi029.stdout:3/706: write d3/d45/d4f/fd6 [191319,107404] 0 2024-04-23T10:21:43.070 INFO:tasks.workunit.client.0.smithi029.stdout:0/644: symlink d0/d21/le0 0 2024-04-23T10:21:43.071 INFO:tasks.workunit.client.0.smithi029.stdout:0/645: write d0/d1b/d67/dae/d6a/fdb [771953,5919] 0 2024-04-23T10:21:43.076 INFO:tasks.workunit.client.0.smithi029.stdout:6/859: unlink d9/df/d16/d34/f91 0 2024-04-23T10:21:43.084 INFO:tasks.workunit.client.0.smithi029.stdout:1/637: read d5/d6/de/d22/d84/dc4/f44 [684494,29519] 0 2024-04-23T10:21:43.087 INFO:tasks.workunit.client.0.smithi029.stdout:1/638: read - d5/d6/de/d22/d77/faf zero size 2024-04-23T10:21:43.087 INFO:tasks.workunit.client.0.smithi029.stdout:2/694: dwrite d1/f2e [0,4194304] 0 2024-04-23T10:21:43.093 INFO:tasks.workunit.client.0.smithi029.stdout:7/870: rename d5/d29/ded/f78 to d5/d29/ded/d4d/ddb/f11b 0 2024-04-23T10:21:43.101 INFO:tasks.workunit.client.0.smithi029.stdout:1/639: dwrite d5/d6/de/d22/d84/dc4/f67 [0,4194304] 0 2024-04-23T10:21:43.108 INFO:tasks.workunit.client.0.smithi029.stdout:4/823: dwrite d0/d3c/d52/d74/fd2 [0,4194304] 0 2024-04-23T10:21:43.108 INFO:tasks.workunit.client.0.smithi029.stdout:0/646: dread d0/d1b/d67/dae/d6a/fdb [0,4194304] 0 2024-04-23T10:21:43.117 INFO:tasks.workunit.client.0.smithi029.stdout:8/738: dread d3/d50/d6a/d95/d36/f3b [0,4194304] 0 2024-04-23T10:21:43.118 INFO:tasks.workunit.client.0.smithi029.stdout:6/860: dread d9/df/d16/d34/d36/d63/f68 [0,4194304] 0 2024-04-23T10:21:43.120 INFO:tasks.workunit.client.0.smithi029.stdout:6/861: write d9/df/d16/d1f/d27/d33/da4/d66/d95/f118 [624999,96933] 0 2024-04-23T10:21:43.166 INFO:tasks.workunit.client.0.smithi029.stdout:7/871: mkdir d5/d29/ded/d4d/ddb/d11c 0 2024-04-23T10:21:43.166 INFO:tasks.workunit.client.0.smithi029.stdout:7/872: fsync d5/d9/f65 0 2024-04-23T10:21:43.167 INFO:tasks.workunit.client.0.smithi029.stdout:7/873: chown d5/d29/ded/d8e/fe0 282575055 1 2024-04-23T10:21:43.176 INFO:tasks.workunit.client.0.smithi029.stdout:0/647: chown d0/f4 2899 1 2024-04-23T10:21:43.179 INFO:tasks.workunit.client.0.smithi029.stdout:6/862: chown d9/df/d16/f56 4781 1 2024-04-23T10:21:43.181 INFO:tasks.workunit.client.0.smithi029.stdout:2/695: sync 2024-04-23T10:21:43.182 INFO:tasks.workunit.client.0.smithi029.stdout:3/707: fsync d3/d15/d4b/d52/fa4 0 2024-04-23T10:21:43.188 INFO:tasks.workunit.client.0.smithi029.stdout:9/952: rename d0/d1b/d39/d50/d67/db6/d10f/c117 to d0/d1b/d39/d112/c142 0 2024-04-23T10:21:43.204 INFO:tasks.workunit.client.0.smithi029.stdout:6/863: truncate d9/df/d16/d1f/d27/d33/da4/d58/d7e/fe4 1329882 0 2024-04-23T10:21:43.215 INFO:tasks.workunit.client.0.smithi029.stdout:2/696: getdents d1/d3e/d3b/d75 0 2024-04-23T10:21:43.218 INFO:tasks.workunit.client.0.smithi029.stdout:9/953: creat d0/d7/d1d/d35/dd9/d49/d65/de4/f143 x:0 0 0 2024-04-23T10:21:43.219 INFO:tasks.workunit.client.0.smithi029.stdout:9/954: write d0/d7/d3f/f82 [2478281,99576] 0 2024-04-23T10:21:43.227 INFO:tasks.workunit.client.0.smithi029.stdout:6/864: creat d9/df/d16/d1f/d27/d33/da4/d58/f11b x:0 0 0 2024-04-23T10:21:43.231 INFO:tasks.workunit.client.0.smithi029.stdout:6/865: mknod d9/df/d16/d1f/d27/d33/da4/dd8/c11c 0 2024-04-23T10:21:43.232 INFO:tasks.workunit.client.0.smithi029.stdout:5/845: mkdir d0/d35/d10/d26/d10f 0 2024-04-23T10:21:43.233 INFO:tasks.workunit.client.0.smithi029.stdout:6/866: fsync d9/df/d16/f24 0 2024-04-23T10:21:43.235 INFO:tasks.workunit.client.0.smithi029.stdout:5/846: truncate d0/d35/d38/d3e/d66/d5a/d78/ffb 423767 0 2024-04-23T10:21:43.237 INFO:tasks.workunit.client.0.smithi029.stdout:6/867: symlink d9/df/d16/d44/d4c/dd9/l11d 0 2024-04-23T10:21:43.240 INFO:tasks.workunit.client.0.smithi029.stdout:6/868: read d9/df/d16/f1a [2428235,127448] 0 2024-04-23T10:21:43.241 INFO:tasks.workunit.client.0.smithi029.stdout:6/869: stat d9/df/d16/d1f/d27/d33/da4 0 2024-04-23T10:21:43.247 INFO:tasks.workunit.client.0.smithi029.stdout:6/870: mkdir d9/df/d16/d44/d75/d90/d107/d11e 0 2024-04-23T10:21:43.253 INFO:tasks.workunit.client.0.smithi029.stdout:6/871: dread d9/df/d16/d1f/d27/d33/da4/d58/d7e/fd4 [0,4194304] 0 2024-04-23T10:21:43.262 INFO:tasks.workunit.client.0.smithi029.stdout:7/874: truncate d5/d71/d114/f87 358119 0 2024-04-23T10:21:43.263 INFO:tasks.workunit.client.0.smithi029.stdout:6/872: link d9/df/d16/d34/d84/ff8 d9/df/d16/d1f/d27/d33/da4/d66/d95/d119/f11f 0 2024-04-23T10:21:43.266 INFO:tasks.workunit.client.0.smithi029.stdout:8/739: write d3/d44/db1/fbe [17926,25022] 0 2024-04-23T10:21:43.271 INFO:tasks.workunit.client.0.smithi029.stdout:2/697: rmdir d1/d3e/d3b 39 2024-04-23T10:21:43.279 INFO:tasks.workunit.client.0.smithi029.stdout:0/648: dwrite d0/d21/f89 [0,4194304] 0 2024-04-23T10:21:43.280 INFO:tasks.workunit.client.0.smithi029.stdout:7/875: dwrite d5/f10f [0,4194304] 0 2024-04-23T10:21:43.281 INFO:tasks.workunit.client.0.smithi029.stdout:1/640: rmdir d5/d6/de/d22/d84/dc4/d9f 0 2024-04-23T10:21:43.285 INFO:tasks.workunit.client.0.smithi029.stdout:1/641: read d5/d6/de/d22/d77/f88 [1650171,53357] 0 2024-04-23T10:21:43.286 INFO:tasks.workunit.client.0.smithi029.stdout:0/649: dread - d0/d3e/d4e/fcf zero size 2024-04-23T10:21:43.288 INFO:tasks.workunit.client.0.smithi029.stdout:5/847: rmdir d0/d35 39 2024-04-23T10:21:43.298 INFO:tasks.workunit.client.0.smithi029.stdout:9/955: dwrite d0/d7/d1d/f20 [4194304,4194304] 0 2024-04-23T10:21:43.300 INFO:tasks.workunit.client.0.smithi029.stdout:3/708: symlink d3/d10/de/d2e/d36/d40/d46/lf7 0 2024-04-23T10:21:43.302 INFO:tasks.workunit.client.0.smithi029.stdout:6/873: dread d9/df/d16/d1f/d27/d33/da4/d66/d95/f98 [0,4194304] 0 2024-04-23T10:21:43.302 INFO:tasks.workunit.client.0.smithi029.stdout:4/824: rename d0/d3c/d52/d1b/d9f/l9b to d0/d3c/d52/d74/d8a/dba/l126 0 2024-04-23T10:21:43.303 INFO:tasks.workunit.client.0.smithi029.stdout:2/698: write d1/dd/d60/fc9 [263533,24078] 0 2024-04-23T10:21:43.304 INFO:tasks.workunit.client.0.smithi029.stdout:8/740: dwrite d3/fd4 [0,4194304] 0 2024-04-23T10:21:43.310 INFO:tasks.workunit.client.0.smithi029.stdout:3/709: chown d3/d10/de/d2e/c34 52303 1 2024-04-23T10:21:43.310 INFO:tasks.workunit.client.0.smithi029.stdout:6/874: readlink d9/df/l94 0 2024-04-23T10:21:43.311 INFO:tasks.workunit.client.0.smithi029.stdout:4/825: readlink d0/d12/l4c 0 2024-04-23T10:21:43.313 INFO:tasks.workunit.client.0.smithi029.stdout:8/741: readlink d3/d50/d6a/l72 0 2024-04-23T10:21:43.314 INFO:tasks.workunit.client.0.smithi029.stdout:5/848: mkdir d0/d35/d38/d3e/d66/d5a/d110 0 2024-04-23T10:21:43.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/956: symlink d0/d1b/d39/d50/l144 0 2024-04-23T10:21:43.316 INFO:tasks.workunit.client.0.smithi029.stdout:1/642: dwrite d5/d6/de/d15/f3b [0,4194304] 0 2024-04-23T10:21:43.318 INFO:tasks.workunit.client.0.smithi029.stdout:2/699: link d1/d31/d3d/f41 d1/d4/db7/deb/fec 0 2024-04-23T10:21:43.321 INFO:tasks.workunit.client.0.smithi029.stdout:6/875: unlink d9/df/d16/d44/d4c/dd9/df6/fbf 0 2024-04-23T10:21:43.328 INFO:tasks.workunit.client.0.smithi029.stdout:1/643: stat d5/d6/de/d22/f59 0 2024-04-23T10:21:43.330 INFO:tasks.workunit.client.0.smithi029.stdout:2/700: rmdir d1/dd/d60 39 2024-04-23T10:21:43.332 INFO:tasks.workunit.client.0.smithi029.stdout:4/826: mknod d0/d3c/d52/d1b/d5b/c127 0 2024-04-23T10:21:43.335 INFO:tasks.workunit.client.0.smithi029.stdout:5/849: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d100/d111 0 2024-04-23T10:21:43.336 INFO:tasks.workunit.client.0.smithi029.stdout:0/650: dwrite d0/da9/d4c/da7/dc7/dd7/d73/d7e/fa8 [0,4194304] 0 2024-04-23T10:21:43.338 INFO:tasks.workunit.client.0.smithi029.stdout:6/876: truncate d9/df/d16/d34/d84/ff8 2826038 0 2024-04-23T10:21:43.338 INFO:tasks.workunit.client.0.smithi029.stdout:8/742: creat d3/d50/fe5 x:0 0 0 2024-04-23T10:21:43.338 INFO:tasks.workunit.client.0.smithi029.stdout:4/827: unlink d0/d3c/d52/d1b/f6b 0 2024-04-23T10:21:43.341 INFO:tasks.workunit.client.0.smithi029.stdout:2/701: mkdir d1/dd/d47/d63/d64/ded 0 2024-04-23T10:21:43.341 INFO:tasks.workunit.client.0.smithi029.stdout:2/702: dread - d1/fb3 zero size 2024-04-23T10:21:43.345 INFO:tasks.workunit.client.0.smithi029.stdout:6/877: mknod d9/df/d16/d44/c120 0 2024-04-23T10:21:43.346 INFO:tasks.workunit.client.0.smithi029.stdout:8/743: mkdir d3/d50/dac/de6 0 2024-04-23T10:21:43.346 INFO:tasks.workunit.client.0.smithi029.stdout:0/651: dread d0/d21/d7f/d3a/f87 [0,4194304] 0 2024-04-23T10:21:43.348 INFO:tasks.workunit.client.0.smithi029.stdout:4/828: mknod d0/d3c/d52/d1b/d9f/d92/dd8/da1/c128 0 2024-04-23T10:21:43.350 INFO:tasks.workunit.client.0.smithi029.stdout:1/644: rename d5/c2b to d5/d6/de/d22/d77/cca 0 2024-04-23T10:21:43.351 INFO:tasks.workunit.client.0.smithi029.stdout:2/703: mknod d1/dd/d22/cee 0 2024-04-23T10:21:43.356 INFO:tasks.workunit.client.0.smithi029.stdout:8/744: dread d3/d44/db1/fbe [0,4194304] 0 2024-04-23T10:21:43.356 INFO:tasks.workunit.client.0.smithi029.stdout:4/829: chown d0/d3c/d52/d1b/l2f 11517689 1 2024-04-23T10:21:43.358 INFO:tasks.workunit.client.0.smithi029.stdout:9/957: dwrite d0/d1b/d39/f42 [0,4194304] 0 2024-04-23T10:21:43.358 INFO:tasks.workunit.client.0.smithi029.stdout:1/645: getdents d5/d6/de/d27/da9/dad/dc9 0 2024-04-23T10:21:43.360 INFO:tasks.workunit.client.0.smithi029.stdout:8/745: stat d3/f29 0 2024-04-23T10:21:43.362 INFO:tasks.workunit.client.0.smithi029.stdout:1/646: write d5/d3e/da7/fb2 [289296,39875] 0 2024-04-23T10:21:43.364 INFO:tasks.workunit.client.0.smithi029.stdout:3/710: rename d3/l4 to d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/lf8 0 2024-04-23T10:21:43.367 INFO:tasks.workunit.client.0.smithi029.stdout:6/878: dwrite d9/df/d16/d1f/d27/d33/da4/d66/d95/d119/f5f [4194304,4194304] 0 2024-04-23T10:21:43.368 INFO:tasks.workunit.client.0.smithi029.stdout:5/850: write d0/d35/d38/d3e/d66/d5a/d78/d3d/fbe [1004830,97005] 0 2024-04-23T10:21:43.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/647: rmdir d5/d6/de/d27 39 2024-04-23T10:21:43.372 INFO:tasks.workunit.client.0.smithi029.stdout:9/958: symlink d0/d1b/d39/l145 0 2024-04-23T10:21:43.372 INFO:tasks.workunit.client.0.smithi029.stdout:6/879: fsync d9/df/d16/d34/f103 0 2024-04-23T10:21:43.373 INFO:tasks.workunit.client.0.smithi029.stdout:8/746: symlink d3/d50/d6a/d95/d36/d68/le7 0 2024-04-23T10:21:43.385 INFO:tasks.workunit.client.0.smithi029.stdout:5/851: dwrite d0/d35/d49/f54 [4194304,4194304] 0 2024-04-23T10:21:43.385 INFO:tasks.workunit.client.0.smithi029.stdout:2/704: rename d1/d3e/d3b/d75/le3 to d1/d31/d3d/lef 0 2024-04-23T10:21:43.386 INFO:tasks.workunit.client.0.smithi029.stdout:1/648: truncate d5/d6/f7f 51907 0 2024-04-23T10:21:43.394 INFO:tasks.workunit.client.0.smithi029.stdout:9/959: dwrite d0/d7/d3f/f96 [0,4194304] 0 2024-04-23T10:21:43.398 INFO:tasks.workunit.client.0.smithi029.stdout:0/652: dwrite d0/da9/d4c/f6b [0,4194304] 0 2024-04-23T10:21:43.398 INFO:tasks.workunit.client.0.smithi029.stdout:0/653: dread - d0/d1b/d67/fd2 zero size 2024-04-23T10:21:43.400 INFO:tasks.workunit.client.0.smithi029.stdout:8/747: rename d3/d50/d6a/d95/d36/d3e/dce/lbb to d3/d50/d6a/d95/d36/d3e/ddd/le8 0 2024-04-23T10:21:43.402 INFO:tasks.workunit.client.0.smithi029.stdout:6/880: truncate d9/df/d16/d1f/d27/d33/da4/d58/f6b 696904 0 2024-04-23T10:21:43.403 INFO:tasks.workunit.client.0.smithi029.stdout:9/960: dread - d0/d7/f116 zero size 2024-04-23T10:21:43.405 INFO:tasks.workunit.client.0.smithi029.stdout:5/852: mknod d0/d35/d38/db3/dcf/c112 0 2024-04-23T10:21:43.406 INFO:tasks.workunit.client.0.smithi029.stdout:4/830: dread d0/d3c/d52/d20/f57 [0,4194304] 0 2024-04-23T10:21:43.409 INFO:tasks.workunit.client.0.smithi029.stdout:8/748: mknod d3/d44/ce9 0 2024-04-23T10:21:43.412 INFO:tasks.workunit.client.0.smithi029.stdout:9/961: write d0/d7/d6/fe [1307053,49597] 0 2024-04-23T10:21:43.412 INFO:tasks.workunit.client.0.smithi029.stdout:3/711: dwrite d3/d10/d48/fbe [0,4194304] 0 2024-04-23T10:21:43.418 INFO:tasks.workunit.client.0.smithi029.stdout:0/654: dwrite d0/d21/d7f/f8f [0,4194304] 0 2024-04-23T10:21:43.419 INFO:tasks.workunit.client.0.smithi029.stdout:6/881: unlink d9/c89 0 2024-04-23T10:21:43.424 INFO:tasks.workunit.client.0.smithi029.stdout:1/649: write d5/fbf [940907,97954] 0 2024-04-23T10:21:43.424 INFO:tasks.workunit.client.0.smithi029.stdout:3/712: write d3/d10/de/d2e/d36/d40/d46/d65/f81 [351621,45980] 0 2024-04-23T10:21:43.428 INFO:tasks.workunit.client.0.smithi029.stdout:1/650: chown d5/d6/f16 781 1 2024-04-23T10:21:43.429 INFO:tasks.workunit.client.0.smithi029.stdout:8/749: rename d3/f19 to d3/d50/d6a/d95/d36/dbf/fea 0 2024-04-23T10:21:43.431 INFO:tasks.workunit.client.0.smithi029.stdout:4/831: creat d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d/f129 x:0 0 0 2024-04-23T10:21:43.432 INFO:tasks.workunit.client.0.smithi029.stdout:2/705: fdatasync d1/d3e/d3b/d75/f7a 0 2024-04-23T10:21:43.434 INFO:tasks.workunit.client.0.smithi029.stdout:5/853: creat d0/d35/d10/d26/db2/f113 x:0 0 0 2024-04-23T10:21:43.436 INFO:tasks.workunit.client.0.smithi029.stdout:6/882: symlink d9/df/d16/l121 0 2024-04-23T10:21:43.438 INFO:tasks.workunit.client.0.smithi029.stdout:1/651: chown d5/d6/de/d27/da9/fb9 1 1 2024-04-23T10:21:43.439 INFO:tasks.workunit.client.0.smithi029.stdout:0/655: creat d0/d1b/d67/dae/d92/da0/dbe/fe1 x:0 0 0 2024-04-23T10:21:43.440 INFO:tasks.workunit.client.0.smithi029.stdout:1/652: chown d5/d6/f19 8757696 1 2024-04-23T10:21:43.441 INFO:tasks.workunit.client.0.smithi029.stdout:2/706: rmdir d1/d3e 39 2024-04-23T10:21:43.442 INFO:tasks.workunit.client.0.smithi029.stdout:6/883: rmdir d9/df/d16/d34/d36/d117 39 2024-04-23T10:21:43.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/713: creat d3/d15/d4b/ff9 x:0 0 0 2024-04-23T10:21:43.446 INFO:tasks.workunit.client.0.smithi029.stdout:6/884: chown d9/df/d16/l52 88060 1 2024-04-23T10:21:43.451 INFO:tasks.workunit.client.0.smithi029.stdout:3/714: readlink d3/d45/d4f/l67 0 2024-04-23T10:21:43.453 INFO:tasks.workunit.client.0.smithi029.stdout:9/962: rename d0/c46 to d0/d7/d1d/d35/d3b/d68/dbd/c146 0 2024-04-23T10:21:43.456 INFO:tasks.workunit.client.0.smithi029.stdout:1/653: creat d5/d6/de/fcb x:0 0 0 2024-04-23T10:21:43.457 INFO:tasks.workunit.client.0.smithi029.stdout:0/656: getdents d0/d1b/d67/dae 0 2024-04-23T10:21:43.459 INFO:tasks.workunit.client.0.smithi029.stdout:2/707: getdents d1/d3e/d3b/d75/dd1/dea 0 2024-04-23T10:21:43.461 INFO:tasks.workunit.client.0.smithi029.stdout:3/715: getdents d3/d10/de/d2e/de2 0 2024-04-23T10:21:43.461 INFO:tasks.workunit.client.0.smithi029.stdout:9/963: symlink d0/d7/d1d/d35/d3b/d133/l147 0 2024-04-23T10:21:43.462 INFO:tasks.workunit.client.0.smithi029.stdout:8/750: mknod d3/d50/d6a/ceb 0 2024-04-23T10:21:43.464 INFO:tasks.workunit.client.0.smithi029.stdout:6/885: dread d9/df/d16/d1f/d27/d33/da4/d58/d7e/fe4 [0,4194304] 0 2024-04-23T10:21:43.465 INFO:tasks.workunit.client.0.smithi029.stdout:9/964: read - d0/d7/d1d/d35/d3b/d68/f13e zero size 2024-04-23T10:21:43.465 INFO:tasks.workunit.client.0.smithi029.stdout:2/708: link d1/fb3 d1/dda/ff0 0 2024-04-23T10:21:43.465 INFO:tasks.workunit.client.0.smithi029.stdout:8/751: truncate d3/d50/d6a/fe0 769833 0 2024-04-23T10:21:43.465 INFO:tasks.workunit.client.0.smithi029.stdout:5/854: dread d0/d35/f1c [0,4194304] 0 2024-04-23T10:21:43.467 INFO:tasks.workunit.client.0.smithi029.stdout:3/716: dread - d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7/dab/fc0 zero size 2024-04-23T10:21:43.468 INFO:tasks.workunit.client.0.smithi029.stdout:6/886: mkdir d9/df/d16/d44/d112/d122 0 2024-04-23T10:21:43.469 INFO:tasks.workunit.client.0.smithi029.stdout:5/855: write d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/feb [853179,21189] 0 2024-04-23T10:21:43.474 INFO:tasks.workunit.client.0.smithi029.stdout:6/887: fsync d9/df/d16/d1f/d27/d33/da4/d58/d7e/fe4 0 2024-04-23T10:21:43.477 INFO:tasks.workunit.client.0.smithi029.stdout:5/856: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d114 0 2024-04-23T10:21:43.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/965: dwrite d0/d7/d1d/d35/d3b/db8/ff3 [0,4194304] 0 2024-04-23T10:21:43.479 INFO:tasks.workunit.client.0.smithi029.stdout:5/857: stat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d100 0 2024-04-23T10:21:43.481 INFO:tasks.workunit.client.0.smithi029.stdout:1/654: write d5/fa0 [23386,45380] 0 2024-04-23T10:21:43.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/888: truncate d9/df/d16/d34/d36/d117/dea/f9f 103069 0 2024-04-23T10:21:43.485 INFO:tasks.workunit.client.0.smithi029.stdout:0/657: dread d0/d21/d7f/f29 [0,4194304] 0 2024-04-23T10:21:43.486 INFO:tasks.workunit.client.0.smithi029.stdout:5/858: symlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/l115 0 2024-04-23T10:21:43.488 INFO:tasks.workunit.client.0.smithi029.stdout:9/966: dread d0/d7/d1d/d35/dde/dba/fc2 [0,4194304] 0 2024-04-23T10:21:43.491 INFO:tasks.workunit.client.0.smithi029.stdout:0/658: symlink d0/d1b/le2 0 2024-04-23T10:21:43.494 INFO:tasks.workunit.client.0.smithi029.stdout:7/876: dread d5/d29/ded/f76 [0,4194304] 0 2024-04-23T10:21:43.494 INFO:tasks.workunit.client.0.smithi029.stdout:5/859: rename d0/d35/d38/d3e/d66/d5a/lf4 to d0/d35/d38/d39/dcb/l116 0 2024-04-23T10:21:43.496 INFO:tasks.workunit.client.0.smithi029.stdout:9/967: creat d0/d7/d1d/f148 x:0 0 0 2024-04-23T10:21:43.499 INFO:tasks.workunit.client.0.smithi029.stdout:3/717: dread d3/d10/de/d2e/d36/d40/d46/d72/d31/f55 [0,4194304] 0 2024-04-23T10:21:43.499 INFO:tasks.workunit.client.0.smithi029.stdout:7/877: read d5/d8/d51/f53 [826817,74120] 0 2024-04-23T10:21:43.500 INFO:tasks.workunit.client.0.smithi029.stdout:8/752: write d3/f23 [2201560,128891] 0 2024-04-23T10:21:43.504 INFO:tasks.workunit.client.0.smithi029.stdout:3/718: truncate d3/d15/fb0 85538 0 2024-04-23T10:21:43.505 INFO:tasks.workunit.client.0.smithi029.stdout:5/860: truncate d0/d35/d38/d39/d3f/fb1 810533 0 2024-04-23T10:21:43.508 INFO:tasks.workunit.client.0.smithi029.stdout:9/968: rename d0/d7/d1d/f148 to d0/d7/d1d/d35/dde/dba/f149 0 2024-04-23T10:21:43.510 INFO:tasks.workunit.client.0.smithi029.stdout:3/719: symlink d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/lfa 0 2024-04-23T10:21:43.510 INFO:tasks.workunit.client.0.smithi029.stdout:8/753: creat d3/d7d/fec x:0 0 0 2024-04-23T10:21:43.511 INFO:tasks.workunit.client.0.smithi029.stdout:0/659: dread d0/da9/d4c/d6d/fc2 [0,4194304] 0 2024-04-23T10:21:43.513 INFO:tasks.workunit.client.0.smithi029.stdout:8/754: truncate d3/d50/d6a/d95/d36/d68/f6d 1182136 0 2024-04-23T10:21:43.514 INFO:tasks.workunit.client.0.smithi029.stdout:3/720: creat d3/d10/de/d2e/d36/ffb x:0 0 0 2024-04-23T10:21:43.514 INFO:tasks.workunit.client.0.smithi029.stdout:0/660: creat d0/fe3 x:0 0 0 2024-04-23T10:21:43.515 INFO:tasks.workunit.client.0.smithi029.stdout:9/969: getdents d0/d1b/d39 0 2024-04-23T10:21:43.517 INFO:tasks.workunit.client.0.smithi029.stdout:8/755: chown d3/d50/dac/de1/de3/c61 44335 1 2024-04-23T10:21:43.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/970: creat d0/d7/d3f/dbb/f14a x:0 0 0 2024-04-23T10:21:43.518 INFO:tasks.workunit.client.0.smithi029.stdout:0/661: mkdir d0/d3e/ddd/de4 0 2024-04-23T10:21:43.519 INFO:tasks.workunit.client.0.smithi029.stdout:0/662: stat d0/d3e/d4e/d7c/f9a 0 2024-04-23T10:21:43.521 INFO:tasks.workunit.client.0.smithi029.stdout:9/971: rmdir d0/d1b/d39/d112 39 2024-04-23T10:21:43.525 INFO:tasks.workunit.client.0.smithi029.stdout:0/663: mknod d0/da9/d4c/da7/dc7/dd7/d73/d7e/ce5 0 2024-04-23T10:21:43.527 INFO:tasks.workunit.client.0.smithi029.stdout:0/664: truncate d0/d1b/d67/dae/d6a/fdb 972184 0 2024-04-23T10:21:43.527 INFO:tasks.workunit.client.0.smithi029.stdout:9/972: symlink d0/d7/d1d/d35/da9/dd0/l14b 0 2024-04-23T10:21:43.528 INFO:tasks.workunit.client.0.smithi029.stdout:1/655: write d5/d6/de/d22/f59 [833838,13956] 0 2024-04-23T10:21:43.529 INFO:tasks.workunit.client.0.smithi029.stdout:9/973: write d0/d7/d1d/d35/d3b/d68/f10c [1086862,112240] 0 2024-04-23T10:21:43.532 INFO:tasks.workunit.client.0.smithi029.stdout:0/665: fdatasync d0/d21/d7f/d55/f8a 0 2024-04-23T10:21:43.533 INFO:tasks.workunit.client.0.smithi029.stdout:3/721: dread d3/d10/de/d2e/d36/f38 [0,4194304] 0 2024-04-23T10:21:43.540 INFO:tasks.workunit.client.0.smithi029.stdout:0/666: truncate d0/dc/f96 260928 0 2024-04-23T10:21:43.543 INFO:tasks.workunit.client.0.smithi029.stdout:9/974: rename d0/d7/d1d/d35/d3b/db8/f11c to d0/d7/d1d/d35/dde/f14c 0 2024-04-23T10:21:43.545 INFO:tasks.workunit.client.0.smithi029.stdout:9/975: chown d0/d7/d1d/d35/dd9/d49/f118 6 1 2024-04-23T10:21:43.548 INFO:tasks.workunit.client.0.smithi029.stdout:8/756: write d3/d71/fa2 [320326,119249] 0 2024-04-23T10:21:43.549 INFO:tasks.workunit.client.0.smithi029.stdout:5/861: dwrite d0/f81 [0,4194304] 0 2024-04-23T10:21:43.552 INFO:tasks.workunit.client.0.smithi029.stdout:0/667: creat d0/da9/fe6 x:0 0 0 2024-04-23T10:21:43.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/976: unlink d0/d7/d1d/d35/d3b/d68/dbd/c146 0 2024-04-23T10:21:43.556 INFO:tasks.workunit.client.0.smithi029.stdout:8/757: rmdir d3/d50 39 2024-04-23T10:21:43.557 INFO:tasks.workunit.client.0.smithi029.stdout:1/656: write d5/d6/de/d15/f26 [2359120,48707] 0 2024-04-23T10:21:43.559 INFO:tasks.workunit.client.0.smithi029.stdout:5/862: chown d0/d35/d38/d3e/d66/d5a/d78/c64 1 1 2024-04-23T10:21:43.560 INFO:tasks.workunit.client.0.smithi029.stdout:3/722: dread d3/d45/d4f/d6b/f74 [0,4194304] 0 2024-04-23T10:21:43.565 INFO:tasks.workunit.client.0.smithi029.stdout:3/723: chown d3/d10/de/d2e/d36/d40/d46/d65/f98 36891528 1 2024-04-23T10:21:43.566 INFO:tasks.workunit.client.0.smithi029.stdout:0/668: creat d0/da9/d4c/d6d/fe7 x:0 0 0 2024-04-23T10:21:43.568 INFO:tasks.workunit.client.0.smithi029.stdout:5/863: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/c117 0 2024-04-23T10:21:43.570 INFO:tasks.workunit.client.0.smithi029.stdout:0/669: symlink d0/d3e/d4e/le8 0 2024-04-23T10:21:43.572 INFO:tasks.workunit.client.0.smithi029.stdout:8/758: getdents d3/d50/d6a/d95/d36/d3e/dce 0 2024-04-23T10:21:43.572 INFO:tasks.workunit.client.0.smithi029.stdout:5/864: mknod d0/d35/d10/d26/db2/dbc/c118 0 2024-04-23T10:21:43.578 INFO:tasks.workunit.client.0.smithi029.stdout:0/670: dwrite d0/d3e/f8d [0,4194304] 0 2024-04-23T10:21:43.579 INFO:tasks.workunit.client.0.smithi029.stdout:1/657: dread d5/d6/de/d22/f23 [0,4194304] 0 2024-04-23T10:21:43.581 INFO:tasks.workunit.client.0.smithi029.stdout:5/865: link d0/d35/d38/d3e/d66/f82 d0/f119 0 2024-04-23T10:21:43.583 INFO:tasks.workunit.client.0.smithi029.stdout:1/658: fdatasync d5/d6/de/d15/d7b/f9b 0 2024-04-23T10:21:43.585 INFO:tasks.workunit.client.0.smithi029.stdout:8/759: rename d3/d50/dad/cb9 to d3/d44/db1/ced 0 2024-04-23T10:21:43.589 INFO:tasks.workunit.client.0.smithi029.stdout:1/659: write d5/d6/de/d22/d77/fc6 [4554180,91014] 0 2024-04-23T10:21:43.592 INFO:tasks.workunit.client.0.smithi029.stdout:8/760: mkdir d3/d50/d6a/d95/d36/dbf/dee 0 2024-04-23T10:21:43.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/660: mknod d5/d6/de/d22/d77/ccc 0 2024-04-23T10:21:43.599 INFO:tasks.workunit.client.0.smithi029.stdout:8/761: link d3/d50/d6a/d95/fcf d3/d50/d6a/dd9/fef 0 2024-04-23T10:21:43.600 INFO:tasks.workunit.client.0.smithi029.stdout:8/762: dread - d3/d50/d6a/d95/d36/d3e/fd2 zero size 2024-04-23T10:21:43.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/661: write d5/d6/de/d22/d84/dc4/f67 [3905410,92717] 0 2024-04-23T10:21:43.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/671: dread d0/d1b/d67/dae/d92/fca [0,4194304] 0 2024-04-23T10:21:43.605 INFO:tasks.workunit.client.0.smithi029.stdout:3/724: dread d3/f2a [0,4194304] 0 2024-04-23T10:21:43.605 INFO:tasks.workunit.client.0.smithi029.stdout:0/672: readlink d0/d1b/d67/dae/d92/da0/lc4 0 2024-04-23T10:21:43.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/763: mkdir d3/df0 0 2024-04-23T10:21:43.610 INFO:tasks.workunit.client.0.smithi029.stdout:0/673: mkdir d0/d21/dcb/de9 0 2024-04-23T10:21:43.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/764: truncate d3/d50/d6a/d95/d36/d68/d8c/fb8 961524 0 2024-04-23T10:21:43.613 INFO:tasks.workunit.client.0.smithi029.stdout:9/977: write d0/d7/d1d/d35/d3b/d68/fe6 [2333707,66964] 0 2024-04-23T10:21:43.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/765: rename d3 to d3/d44/df1 22 2024-04-23T10:21:43.615 INFO:tasks.workunit.client.0.smithi029.stdout:1/662: dwrite d5/d6/de/d22/d84/dc4/d47/fac [0,4194304] 0 2024-04-23T10:21:43.618 INFO:tasks.workunit.client.0.smithi029.stdout:0/674: getdents d0/da9 0 2024-04-23T10:21:43.620 INFO:tasks.workunit.client.0.smithi029.stdout:0/675: write d0/d1b/d67/dae/d92/da0/dbe/fe1 [488465,8594] 0 2024-04-23T10:21:43.629 INFO:tasks.workunit.client.0.smithi029.stdout:9/978: dwrite d0/d1b/d39/d50/f16 [0,4194304] 0 2024-04-23T10:21:43.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/766: dwrite d3/d71/fb4 [4194304,4194304] 0 2024-04-23T10:21:43.635 INFO:tasks.workunit.client.0.smithi029.stdout:9/979: truncate d0/d7/d1d/d35/d3b/db8/f113 280050 0 2024-04-23T10:21:43.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/676: creat d0/da9/d4c/da7/dc7/dd7/d73/fea x:0 0 0 2024-04-23T10:21:43.645 INFO:tasks.workunit.client.0.smithi029.stdout:6/889: dread d9/df/d16/d1f/d27/d33/f4e [0,4194304] 0 2024-04-23T10:21:43.647 INFO:tasks.workunit.client.0.smithi029.stdout:0/677: creat d0/d3e/feb x:0 0 0 2024-04-23T10:21:43.650 INFO:tasks.workunit.client.0.smithi029.stdout:0/678: write d0/f3f [4120913,9208] 0 2024-04-23T10:21:43.652 INFO:tasks.workunit.client.0.smithi029.stdout:3/725: dwrite d3/f5c [0,4194304] 0 2024-04-23T10:21:43.654 INFO:tasks.workunit.client.0.smithi029.stdout:0/679: write d0/d3e/feb [65868,130534] 0 2024-04-23T10:21:43.657 INFO:tasks.workunit.client.0.smithi029.stdout:6/890: mkdir d9/df/d16/d34/d36/d117/dea/d104/d123 0 2024-04-23T10:21:43.657 INFO:tasks.workunit.client.0.smithi029.stdout:1/663: dwrite d5/d6/de/d22/f83 [0,4194304] 0 2024-04-23T10:21:43.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/866: dread d0/d35/d10/d26/db2/dbc/fed [0,4194304] 0 2024-04-23T10:21:43.661 INFO:tasks.workunit.client.0.smithi029.stdout:0/680: fdatasync d0/da9/d4c/da7/dc7/dd7/d71/fd6 0 2024-04-23T10:21:43.665 INFO:tasks.workunit.client.0.smithi029.stdout:3/726: unlink d3/f5 0 2024-04-23T10:21:43.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/891: mkdir d9/df/d16/d1f/d27/d33/da4/d58/d7e/d124 0 2024-04-23T10:21:43.667 INFO:tasks.workunit.client.0.smithi029.stdout:5/867: fdatasync d0/f40 0 2024-04-23T10:21:43.670 INFO:tasks.workunit.client.0.smithi029.stdout:0/681: unlink d0/d1b/d67/dae/d92/fac 0 2024-04-23T10:21:43.670 INFO:tasks.workunit.client.0.smithi029.stdout:3/727: dread - d3/d10/d48/fb5 zero size 2024-04-23T10:21:43.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/664: creat d5/d6/de/d22/d84/dc4/fcd x:0 0 0 2024-04-23T10:21:43.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/868: readlink d0/d35/d38/d3e/d66/d5a/ld8 0 2024-04-23T10:21:43.677 INFO:tasks.workunit.client.0.smithi029.stdout:0/682: symlink d0/da9/d4c/daf/ddc/lec 0 2024-04-23T10:21:43.680 INFO:tasks.workunit.client.0.smithi029.stdout:1/665: unlink d5/d6/de/d27/da9/lc2 0 2024-04-23T10:21:43.681 INFO:tasks.workunit.client.0.smithi029.stdout:9/980: dwrite d0/d7/fb0 [0,4194304] 0 2024-04-23T10:21:43.682 INFO:tasks.workunit.client.0.smithi029.stdout:0/683: fdatasync d0/d1b/d67/f8c 0 2024-04-23T10:21:43.682 INFO:tasks.workunit.client.0.smithi029.stdout:3/728: dwrite d3/d10/de/d2e/d36/fa5 [0,4194304] 0 2024-04-23T10:21:43.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/892: truncate d9/df/d16/d1f/d27/d33/da4/d66/d95/d119/f5f 1056552 0 2024-04-23T10:21:43.698 INFO:tasks.workunit.client.0.smithi029.stdout:5/869: dread d0/d35/d38/d39/f73 [0,4194304] 0 2024-04-23T10:21:43.700 INFO:tasks.workunit.client.0.smithi029.stdout:3/729: unlink d3/d10/de/d2e/d36/d40/d46/d72/f53 0 2024-04-23T10:21:43.701 INFO:tasks.workunit.client.0.smithi029.stdout:9/981: truncate d0/d7/d3f/dbb/fc1 1267096 0 2024-04-23T10:21:43.708 INFO:tasks.workunit.client.0.smithi029.stdout:3/730: creat d3/d10/d48/ffc x:0 0 0 2024-04-23T10:21:43.712 INFO:tasks.workunit.client.0.smithi029.stdout:1/666: truncate d5/d6/de/d22/d84/dc4/d47/fa6 835919 0 2024-04-23T10:21:43.716 INFO:tasks.workunit.client.0.smithi029.stdout:9/982: rename d0/d7/d3f/f4c to d0/d7/d1d/d35/d3b/d68/dbd/f14d 0 2024-04-23T10:21:43.716 INFO:tasks.workunit.client.0.smithi029.stdout:0/684: dread d0/f3f [0,4194304] 0 2024-04-23T10:21:43.717 INFO:tasks.workunit.client.0.smithi029.stdout:6/893: write d9/df/d16/d1f/d27/fa6 [2577510,53232] 0 2024-04-23T10:21:43.723 INFO:tasks.workunit.client.0.smithi029.stdout:5/870: dwrite d0/d35/d38/d3e/d66/f82 [0,4194304] 0 2024-04-23T10:21:43.725 INFO:tasks.workunit.client.0.smithi029.stdout:5/871: chown d0/d35/d83/fe6 2807121 1 2024-04-23T10:21:43.728 INFO:tasks.workunit.client.0.smithi029.stdout:6/894: creat d9/df/d16/d44/d4c/f125 x:0 0 0 2024-04-23T10:21:43.735 INFO:tasks.workunit.client.0.smithi029.stdout:0/685: dwrite d0/dc/d90/fb4 [0,4194304] 0 2024-04-23T10:21:43.740 INFO:tasks.workunit.client.0.smithi029.stdout:3/731: dwrite d3/d10/d48/fb5 [0,4194304] 0 2024-04-23T10:21:43.741 INFO:tasks.workunit.client.0.smithi029.stdout:6/895: rmdir d9/df/d16/d44/d112 39 2024-04-23T10:21:43.749 INFO:tasks.workunit.client.0.smithi029.stdout:5/872: truncate d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/dca/f4a 2448469 0 2024-04-23T10:21:43.749 INFO:tasks.workunit.client.0.smithi029.stdout:5/873: readlink d0/d35/d38/d3e/d66/d5a/d78/de4/lf6 0 2024-04-23T10:21:43.752 INFO:tasks.workunit.client.0.smithi029.stdout:6/896: creat d9/df/f126 x:0 0 0 2024-04-23T10:21:43.752 INFO:tasks.workunit.client.0.smithi029.stdout:5/874: write d0/d35/d38/d3e/d66/d5a/d78/de4/f106 [978373,93425] 0 2024-04-23T10:21:43.758 INFO:tasks.workunit.client.0.smithi029.stdout:9/983: dread d0/d7/d1d/d35/d3b/d68/fd8 [0,4194304] 0 2024-04-23T10:21:43.761 INFO:tasks.workunit.client.0.smithi029.stdout:1/667: dwrite d5/d6/de/d15/d7b/f9b [0,4194304] 0 2024-04-23T10:21:43.765 INFO:tasks.workunit.client.0.smithi029.stdout:6/897: symlink d9/df/d16/d1f/d2c/l127 0 2024-04-23T10:21:43.765 INFO:tasks.workunit.client.0.smithi029.stdout:9/984: read - d0/d7/d1d/d35/dde/f14c zero size 2024-04-23T10:21:43.766 INFO:tasks.workunit.client.0.smithi029.stdout:6/898: read - d9/df/f126 zero size 2024-04-23T10:21:43.768 INFO:tasks.workunit.client.0.smithi029.stdout:0/686: dread d0/d1b/f3b [0,4194304] 0 2024-04-23T10:21:43.770 INFO:tasks.workunit.client.0.smithi029.stdout:1/668: dread - d5/d6/de/d22/f52 zero size 2024-04-23T10:21:43.770 INFO:tasks.workunit.client.0.smithi029.stdout:0/687: chown d0/da9/d4c/d6d/f82 200183 1 2024-04-23T10:21:43.772 INFO:tasks.workunit.client.0.smithi029.stdout:0/688: chown d0/da9/d4c/da7/dc7/dd7/d71 3014968 1 2024-04-23T10:21:43.773 INFO:tasks.workunit.client.0.smithi029.stdout:0/689: readlink d0/d21/d7f/lb7 0 2024-04-23T10:21:43.773 INFO:tasks.workunit.client.0.smithi029.stdout:0/690: stat d0/d3e/feb 0 2024-04-23T10:21:43.776 INFO:tasks.workunit.client.0.smithi029.stdout:6/899: rename d9/df/d16/d44/d4c to d9/df/d16/d128 0 2024-04-23T10:21:43.777 INFO:tasks.workunit.client.0.smithi029.stdout:9/985: getdents d0/d1b/d39/d50 0 2024-04-23T10:21:43.778 INFO:tasks.workunit.client.0.smithi029.stdout:0/691: rmdir d0 39 2024-04-23T10:21:43.778 INFO:tasks.workunit.client.0.smithi029.stdout:6/900: write d9/df/d16/f111 [402398,64640] 0 2024-04-23T10:21:43.779 INFO:tasks.workunit.client.0.smithi029.stdout:1/669: symlink d5/d6/de/d22/d6c/lce 0 2024-04-23T10:21:43.783 INFO:tasks.workunit.client.0.smithi029.stdout:6/901: mknod d9/df/d16/d1f/d27/d33/c129 0 2024-04-23T10:21:43.784 INFO:tasks.workunit.client.0.smithi029.stdout:9/986: rename d0/d1b/d39/l5e to d0/d7/d1d/d35/d3b/d68/d12f/l14e 0 2024-04-23T10:21:43.787 INFO:tasks.workunit.client.0.smithi029.stdout:0/692: link d0/da9/d4c/f6b d0/d21/dcb/de9/fed 0 2024-04-23T10:21:43.787 INFO:tasks.workunit.client.0.smithi029.stdout:0/693: chown d0/d3e/d4e/le8 175 1 2024-04-23T10:21:43.793 INFO:tasks.workunit.client.0.smithi029.stdout:3/732: write d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/fb1 [194442,51799] 0 2024-04-23T10:21:43.796 INFO:tasks.workunit.client.0.smithi029.stdout:9/987: getdents d0/d1b/d39/d50/d67 0 2024-04-23T10:21:43.800 INFO:tasks.workunit.client.0.smithi029.stdout:9/988: rmdir d0/d1b/d60/d123 0 2024-04-23T10:21:43.801 INFO:tasks.workunit.client.0.smithi029.stdout:3/733: getdents d3/d10/de/d2e/d36/d40/d46/d65 0 2024-04-23T10:21:43.803 INFO:tasks.workunit.client.0.smithi029.stdout:3/734: write d3/d15/fc6 [3009763,67037] 0 2024-04-23T10:21:43.804 INFO:tasks.workunit.client.0.smithi029.stdout:9/989: creat d0/d7/d3f/f14f x:0 0 0 2024-04-23T10:21:43.808 INFO:tasks.workunit.client.0.smithi029.stdout:9/990: symlink d0/d7/d1d/d35/dd5/df2/d126/l150 0 2024-04-23T10:21:43.812 INFO:tasks.workunit.client.0.smithi029.stdout:9/991: truncate d0/f11 1399205 0 2024-04-23T10:21:43.815 INFO:tasks.workunit.client.0.smithi029.stdout:1/670: truncate d5/d6/de/d22/f5f 4347358 0 2024-04-23T10:21:43.818 INFO:tasks.workunit.client.0.smithi029.stdout:9/992: read d0/f81 [582522,40012] 0 2024-04-23T10:21:43.820 INFO:tasks.workunit.client.0.smithi029.stdout:9/993: stat d0/d7/d1d/d35/dd9/d49/c4b 0 2024-04-23T10:21:43.820 INFO:tasks.workunit.client.0.smithi029.stdout:9/994: chown d0/f1e 70959730 1 2024-04-23T10:21:43.822 INFO:tasks.workunit.client.0.smithi029.stdout:1/671: mkdir d5/d6/d34/d63/dcf 0 2024-04-23T10:21:43.825 INFO:tasks.workunit.client.0.smithi029.stdout:1/672: rmdir d5/d6/de/d22/d84 39 2024-04-23T10:21:43.826 INFO:tasks.workunit.client.0.smithi029.stdout:1/673: chown d5/c90 748677 1 2024-04-23T10:21:43.827 INFO:tasks.workunit.client.0.smithi029.stdout:9/995: stat d0/d1b/d39/d4f/c58 0 2024-04-23T10:21:43.828 INFO:tasks.workunit.client.0.smithi029.stdout:9/996: write d0/d1b/ff6 [736210,64933] 0 2024-04-23T10:21:43.831 INFO:tasks.workunit.client.0.smithi029.stdout:1/674: creat d5/d6/de/d22/d84/dc4/d47/db0/fd0 x:0 0 0 2024-04-23T10:21:43.832 INFO:tasks.workunit.client.0.smithi029.stdout:0/694: truncate d0/f3f 2315070 0 2024-04-23T10:21:43.833 INFO:tasks.workunit.client.0.smithi029.stdout:0/695: dread - d0/d1b/d67/dae/d92/da0/fd1 zero size 2024-04-23T10:21:43.834 INFO:tasks.workunit.client.0.smithi029.stdout:9/997: getdents d0/d1b/d39/d50/d67 0 2024-04-23T10:21:43.847 INFO:tasks.workunit.client.0.smithi029.stdout:3/735: dwrite d3/f25 [0,4194304] 0 2024-04-23T10:21:43.858 INFO:tasks.workunit.client.0.smithi029.stdout:1/675: write d5/f66 [1708839,23349] 0 2024-04-23T10:21:43.862 INFO:tasks.workunit.client.0.smithi029.stdout:0/696: dread d0/da9/f45 [8388608,4194304] 0 2024-04-23T10:21:43.867 INFO:tasks.workunit.client.0.smithi029.stdout:0/697: dread d0/d21/f89 [0,4194304] 0 2024-04-23T10:21:43.877 INFO:tasks.workunit.client.0.smithi029.stdout:3/736: dread d3/d15/fc6 [0,4194304] 0 2024-04-23T10:21:43.878 INFO:tasks.workunit.client.0.smithi029.stdout:3/737: read - d3/d10/d48/ff3 zero size 2024-04-23T10:21:43.878 INFO:tasks.workunit.client.0.smithi029.stdout:9/998: creat d0/d1b/d60/f151 x:0 0 0 2024-04-23T10:21:43.882 INFO:tasks.workunit.client.0.smithi029.stdout:3/738: dread d3/d45/d4f/d6b/f74 [0,4194304] 0 2024-04-23T10:21:43.886 INFO:tasks.workunit.client.0.smithi029.stdout:9/999: truncate d0/d7/d1d/d35/dd5/ff9 4978944 0 2024-04-23T10:21:43.898 INFO:tasks.workunit.client.0.smithi029.stdout:1/676: dwrite d5/d6/d34/d8a/fbe [0,4194304] 0 2024-04-23T10:21:43.902 INFO:tasks.workunit.client.0.smithi029.stdout:0/698: creat d0/da9/d4c/da7/dc7/dd7/d73/d7e/fee x:0 0 0 2024-04-23T10:21:43.910 INFO:tasks.workunit.client.0.smithi029.stdout:3/739: write d3/d10/de/d2e/d36/d40/d46/fcd [524968,22613] 0 2024-04-23T10:21:44.038 INFO:tasks.workunit.client.0.smithi029.stdout:8/767: dread d3/f23 [0,4194304] 0 2024-04-23T10:21:44.042 INFO:tasks.workunit.client.0.smithi029.stdout:1/677: creat d5/d6/d34/d63/dcf/fd1 x:0 0 0 2024-04-23T10:21:44.050 INFO:tasks.workunit.client.0.smithi029.stdout:0/699: truncate d0/d3e/f72 4134701 0 2024-04-23T10:21:44.056 INFO:tasks.workunit.client.0.smithi029.stdout:1/678: symlink d5/d3e/da7/ld2 0 2024-04-23T10:21:44.076 INFO:tasks.workunit.client.0.smithi029.stdout:1/679: rmdir d5/d6/de/d15/d7b 39 2024-04-23T10:21:44.083 INFO:tasks.workunit.client.0.smithi029.stdout:8/768: creat d3/d50/dac/de1/de3/ff2 x:0 0 0 2024-04-23T10:21:44.085 INFO:tasks.workunit.client.0.smithi029.stdout:3/740: dwrite d3/d15/d4b/f50 [0,4194304] 0 2024-04-23T10:21:44.094 INFO:tasks.workunit.client.0.smithi029.stdout:3/741: rmdir d3/d45/d4f/d6b/ddf 39 2024-04-23T10:21:44.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/742: write d3/d45/d4f/fd6 [173392,46421] 0 2024-04-23T10:21:44.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/680: mknod d5/d6/de/d22/d84/dc4/cd3 0 2024-04-23T10:21:44.112 INFO:tasks.workunit.client.0.smithi029.stdout:8/769: dwrite d3/f7 [4194304,4194304] 0 2024-04-23T10:21:44.118 INFO:tasks.workunit.client.0.smithi029.stdout:0/700: getdents d0/d1b/d67/d6c 0 2024-04-23T10:21:44.121 INFO:tasks.workunit.client.0.smithi029.stdout:3/743: chown d3/d10/de/d2e/d36/f33 29 1 2024-04-23T10:21:44.233 INFO:tasks.workunit.client.0.smithi029.stdout:3/744: write d3/d10/d48/ff3 [1032737,86582] 0 2024-04-23T10:21:44.237 INFO:tasks.workunit.client.0.smithi029.stdout:3/745: chown d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7 22 1 2024-04-23T10:21:44.240 INFO:tasks.workunit.client.0.smithi029.stdout:0/701: creat d0/da9/d4c/da7/dc7/fef x:0 0 0 2024-04-23T10:21:44.254 INFO:tasks.workunit.client.0.smithi029.stdout:5/875: dread d0/d35/d10/d26/db2/dbc/fe1 [0,4194304] 0 2024-04-23T10:21:44.260 INFO:tasks.workunit.client.0.smithi029.stdout:0/702: chown d0/l84 15 1 2024-04-23T10:21:44.260 INFO:tasks.workunit.client.0.smithi029.stdout:8/770: creat d3/d50/d6a/d95/d36/d3e/dce/da4/ff3 x:0 0 0 2024-04-23T10:21:44.265 INFO:tasks.workunit.client.0.smithi029.stdout:1/681: dwrite d5/d6/de/d27/da9/fb9 [0,4194304] 0 2024-04-23T10:21:44.272 INFO:tasks.workunit.client.0.smithi029.stdout:1/682: fsync d5/d6/de/d22/d84/dc4/f67 0 2024-04-23T10:21:44.275 INFO:tasks.workunit.client.0.smithi029.stdout:0/703: read - d0/da9/d4c/daf/fd0 zero size 2024-04-23T10:21:44.276 INFO:tasks.workunit.client.0.smithi029.stdout:5/876: dread d0/d35/d38/f4b [4194304,4194304] 0 2024-04-23T10:21:44.281 INFO:tasks.workunit.client.0.smithi029.stdout:0/704: write d0/d3e/d4e/d7c/fa3 [509058,130225] 0 2024-04-23T10:21:44.294 INFO:tasks.workunit.client.0.smithi029.stdout:1/683: readlink d5/d6/de/d15/d7b/l86 0 2024-04-23T10:21:44.298 INFO:tasks.workunit.client.0.smithi029.stdout:5/877: rmdir d0/d35/da1 39 2024-04-23T10:21:44.302 INFO:tasks.workunit.client.0.smithi029.stdout:8/771: getdents d3/d7d 0 2024-04-23T10:21:44.310 INFO:tasks.workunit.client.0.smithi029.stdout:0/705: rename d0/d1b/d67/dae/d92/fc8 to d0/d3e/d4e/d7c/ff0 0 2024-04-23T10:21:44.312 INFO:tasks.workunit.client.0.smithi029.stdout:0/706: readlink d0/d3e/d4e/le8 0 2024-04-23T10:21:44.313 INFO:tasks.workunit.client.0.smithi029.stdout:0/707: stat d0/f4a 0 2024-04-23T10:21:44.314 INFO:tasks.workunit.client.0.smithi029.stdout:5/878: truncate d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/fe2 803694 0 2024-04-23T10:21:44.316 INFO:tasks.workunit.client.0.smithi029.stdout:4/832: sync 2024-04-23T10:21:44.320 INFO:tasks.workunit.client.0.smithi029.stdout:5/879: write d0/d35/d38/d3e/d66/d5a/d78/d3d/fbe [1982947,88270] 0 2024-04-23T10:21:44.321 INFO:tasks.workunit.client.0.smithi029.stdout:8/772: mkdir d3/d50/d6a/df4 0 2024-04-23T10:21:44.324 INFO:tasks.workunit.client.0.smithi029.stdout:4/833: dread - d0/d3c/d52/d1b/d36/d45/d4f/df2/f111 zero size 2024-04-23T10:21:44.325 INFO:tasks.workunit.client.0.smithi029.stdout:5/880: chown d0/d6a/cdb 63523976 1 2024-04-23T10:21:44.329 INFO:tasks.workunit.client.0.smithi029.stdout:4/834: chown d0/d3c/d52/d1b/d36/d45/d68/f84 45783498 1 2024-04-23T10:21:44.332 INFO:tasks.workunit.client.0.smithi029.stdout:0/708: creat d0/d1b/d67/dae/d92/da0/dbe/ff1 x:0 0 0 2024-04-23T10:21:44.334 INFO:tasks.workunit.client.0.smithi029.stdout:5/881: truncate d0/d35/d38/d3e/d66/d5a/d78/ffb 983892 0 2024-04-23T10:21:44.337 INFO:tasks.workunit.client.0.smithi029.stdout:1/684: dread d5/d6/de/d22/d84/dc4/f65 [0,4194304] 0 2024-04-23T10:21:44.339 INFO:tasks.workunit.client.0.smithi029.stdout:8/773: read d3/d50/d6a/d95/f54 [642628,95010] 0 2024-04-23T10:21:44.341 INFO:tasks.workunit.client.0.smithi029.stdout:4/835: creat d0/d3c/de5/f12a x:0 0 0 2024-04-23T10:21:44.349 INFO:tasks.workunit.client.0.smithi029.stdout:5/882: fsync d0/d35/d38/d3e/d66/d5a/d78/f32 0 2024-04-23T10:21:44.351 INFO:tasks.workunit.client.0.smithi029.stdout:4/836: fsync d0/d3c/d52/d1b/d9f/d92/dd8/f119 0 2024-04-23T10:21:44.354 INFO:tasks.workunit.client.0.smithi029.stdout:1/685: dwrite d5/f70 [0,4194304] 0 2024-04-23T10:21:44.357 INFO:tasks.workunit.client.0.smithi029.stdout:8/774: symlink d3/d50/d6a/d95/dda/lf5 0 2024-04-23T10:21:44.360 INFO:tasks.workunit.client.0.smithi029.stdout:5/883: chown d0/d35/d38/d3e/d66/d5a/dcc/le9 0 1 2024-04-23T10:21:44.371 INFO:tasks.workunit.client.0.smithi029.stdout:0/709: getdents d0/d21/dcb 0 2024-04-23T10:21:44.372 INFO:tasks.workunit.client.0.smithi029.stdout:1/686: rmdir d5/d6/d34 39 2024-04-23T10:21:44.387 INFO:tasks.workunit.client.0.smithi029.stdout:5/884: symlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d9c/de5/l11a 0 2024-04-23T10:21:44.392 INFO:tasks.workunit.client.0.smithi029.stdout:0/710: fsync d0/d21/d7f/d3a/f43 0 2024-04-23T10:21:44.396 INFO:tasks.workunit.client.0.smithi029.stdout:8/775: truncate d3/d71/d96/f9f 12500 0 2024-04-23T10:21:44.397 INFO:tasks.workunit.client.0.smithi029.stdout:5/885: chown d0/d35/d38/d3e/f79 1721583 1 2024-04-23T10:21:44.398 INFO:tasks.workunit.client.0.smithi029.stdout:4/837: dwrite d0/d3c/d52/d1b/d5b/d65/d6a/d7c/fd7 [0,4194304] 0 2024-04-23T10:21:44.402 INFO:tasks.workunit.client.0.smithi029.stdout:8/776: chown d3/l1d 57952 1 2024-04-23T10:21:44.408 INFO:tasks.workunit.client.0.smithi029.stdout:1/687: dread d5/d6/de/d22/d84/dc4/f67 [0,4194304] 0 2024-04-23T10:21:44.413 INFO:tasks.workunit.client.0.smithi029.stdout:0/711: write d0/dc/d26/f2e [4405131,87906] 0 2024-04-23T10:21:44.414 INFO:tasks.workunit.client.0.smithi029.stdout:8/777: dread - d3/d50/d6a/d95/d36/f89 zero size 2024-04-23T10:21:44.424 INFO:tasks.workunit.client.0.smithi029.stdout:5/886: mkdir d0/d35/d38/d3e/d66/d5a/d78/d3d/d11b 0 2024-04-23T10:21:44.428 INFO:tasks.workunit.client.0.smithi029.stdout:0/712: symlink d0/d1b/d67/dae/lf2 0 2024-04-23T10:21:44.429 INFO:tasks.workunit.client.0.smithi029.stdout:1/688: mknod d5/d8c/cd4 0 2024-04-23T10:21:44.430 INFO:tasks.workunit.client.0.smithi029.stdout:1/689: chown d5/d6/da5 161780 1 2024-04-23T10:21:44.434 INFO:tasks.workunit.client.0.smithi029.stdout:8/778: unlink d3/c2e 0 2024-04-23T10:21:44.438 INFO:tasks.workunit.client.0.smithi029.stdout:4/838: rename d0/fa to d0/d3c/d52/d74/d8a/f12b 0 2024-04-23T10:21:44.442 INFO:tasks.workunit.client.0.smithi029.stdout:5/887: creat d0/d6a/f11c x:0 0 0 2024-04-23T10:21:44.443 INFO:tasks.workunit.client.0.smithi029.stdout:1/690: dwrite d5/d3e/da7/fb2 [0,4194304] 0 2024-04-23T10:21:44.447 INFO:tasks.workunit.client.0.smithi029.stdout:5/888: fsync d0/d9a/dc8/fe3 0 2024-04-23T10:21:44.448 INFO:tasks.workunit.client.0.smithi029.stdout:4/839: fdatasync d0/d12/da9/f10a 0 2024-04-23T10:21:44.452 INFO:tasks.workunit.client.0.smithi029.stdout:5/889: creat d0/d9a/f11d x:0 0 0 2024-04-23T10:21:44.456 INFO:tasks.workunit.client.0.smithi029.stdout:0/713: rename d0/d21/c52 to d0/dc/d90/cf3 0 2024-04-23T10:21:44.457 INFO:tasks.workunit.client.0.smithi029.stdout:4/840: rmdir d0/d3c/d52/d1b/d5b/d65/d6a 39 2024-04-23T10:21:44.459 INFO:tasks.workunit.client.0.smithi029.stdout:0/714: write d0/da9/d4c/d6d/fe7 [296991,97101] 0 2024-04-23T10:21:44.465 INFO:tasks.workunit.client.0.smithi029.stdout:4/841: stat d0/d3c/d52/d74/d91/c117 0 2024-04-23T10:21:44.467 INFO:tasks.workunit.client.0.smithi029.stdout:2/709: sync 2024-04-23T10:21:44.468 INFO:tasks.workunit.client.0.smithi029.stdout:1/691: getdents d5/d3e/da7 0 2024-04-23T10:21:44.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/779: dread d3/f1e [0,4194304] 0 2024-04-23T10:21:44.477 INFO:tasks.workunit.client.0.smithi029.stdout:5/890: getdents d0/d35 0 2024-04-23T10:21:44.479 INFO:tasks.workunit.client.0.smithi029.stdout:5/891: truncate d0/d35/da1/ff9 787739 0 2024-04-23T10:21:44.480 INFO:tasks.workunit.client.0.smithi029.stdout:1/692: mkdir d5/d8c/dd5 0 2024-04-23T10:21:44.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/715: getdents d0/d1b/d67 0 2024-04-23T10:21:44.486 INFO:tasks.workunit.client.0.smithi029.stdout:2/710: rename d1/dd/d22/cc2 to d1/d31/d50/cf1 0 2024-04-23T10:21:44.488 INFO:tasks.workunit.client.0.smithi029.stdout:8/780: link d3/d50/d6a/fe0 d3/d50/d6a/d95/d36/dbf/ff6 0 2024-04-23T10:21:44.490 INFO:tasks.workunit.client.0.smithi029.stdout:0/716: readlink d0/d21/d7f/d3a/lc9 0 2024-04-23T10:21:44.491 INFO:tasks.workunit.client.0.smithi029.stdout:2/711: chown d1/l2d 47228028 1 2024-04-23T10:21:44.492 INFO:tasks.workunit.client.0.smithi029.stdout:5/892: mkdir d0/d35/d38/d3e/d66/d5a/d110/d11e 0 2024-04-23T10:21:44.495 INFO:tasks.workunit.client.0.smithi029.stdout:3/746: dread d3/d10/f58 [0,4194304] 0 2024-04-23T10:21:44.499 INFO:tasks.workunit.client.0.smithi029.stdout:8/781: dread d3/d50/dac/de1/de3/f49 [0,4194304] 0 2024-04-23T10:21:44.500 INFO:tasks.workunit.client.0.smithi029.stdout:0/717: mkdir d0/d1b/d67/dae/d6a/df4 0 2024-04-23T10:21:44.501 INFO:tasks.workunit.client.0.smithi029.stdout:3/747: read d3/f63 [3359862,44788] 0 2024-04-23T10:21:44.502 INFO:tasks.workunit.client.0.smithi029.stdout:1/693: dread d5/d6/f61 [0,4194304] 0 2024-04-23T10:21:44.503 INFO:tasks.workunit.client.0.smithi029.stdout:2/712: rename d1/dd/d47/d63/l95 to d1/dd/d47/lf2 0 2024-04-23T10:21:44.504 INFO:tasks.workunit.client.0.smithi029.stdout:8/782: readlink d3/d50/d6a/d95/d36/l5b 0 2024-04-23T10:21:44.505 INFO:tasks.workunit.client.0.smithi029.stdout:4/842: dread d0/d3c/d52/d74/d8a/fb4 [0,4194304] 0 2024-04-23T10:21:44.505 INFO:tasks.workunit.client.0.smithi029.stdout:3/748: mkdir d3/d10/de/d2e/d36/d40/d46/d65/dfd 0 2024-04-23T10:21:44.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/713: rmdir d1/dd 39 2024-04-23T10:21:44.506 INFO:tasks.workunit.client.0.smithi029.stdout:3/749: chown d3/d10/de/d2e 4358438 1 2024-04-23T10:21:44.507 INFO:tasks.workunit.client.0.smithi029.stdout:0/718: read d0/d21/f38 [1405671,124626] 0 2024-04-23T10:21:44.508 INFO:tasks.workunit.client.0.smithi029.stdout:0/719: chown d0/da9/f70 13959 1 2024-04-23T10:21:44.509 INFO:tasks.workunit.client.0.smithi029.stdout:8/783: mknod d3/d44/cf7 0 2024-04-23T10:21:44.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/750: rmdir d3/d10/d48/def 39 2024-04-23T10:21:44.512 INFO:tasks.workunit.client.0.smithi029.stdout:3/751: truncate d3/d45/d4f/d6b/fdc 4961532 0 2024-04-23T10:21:44.512 INFO:tasks.workunit.client.0.smithi029.stdout:0/720: creat d0/d3e/ddd/de4/ff5 x:0 0 0 2024-04-23T10:21:44.513 INFO:tasks.workunit.client.0.smithi029.stdout:8/784: symlink d3/d50/d6a/d95/lf8 0 2024-04-23T10:21:44.515 INFO:tasks.workunit.client.0.smithi029.stdout:0/721: fsync d0/d3e/d4e/fcf 0 2024-04-23T10:21:44.518 INFO:tasks.workunit.client.0.smithi029.stdout:3/752: mknod d3/d10/cfe 0 2024-04-23T10:21:44.518 INFO:tasks.workunit.client.0.smithi029.stdout:4/843: dwrite d0/d3c/d52/d1b/d5b/d65/d6a/f6c [0,4194304] 0 2024-04-23T10:21:44.521 INFO:tasks.workunit.client.0.smithi029.stdout:8/785: unlink d3/f22 0 2024-04-23T10:21:44.521 INFO:tasks.workunit.client.0.smithi029.stdout:8/786: stat d3/d50 0 2024-04-23T10:21:44.531 INFO:tasks.workunit.client.0.smithi029.stdout:0/722: symlink d0/da9/d4c/daf/dde/lf6 0 2024-04-23T10:21:44.534 INFO:tasks.workunit.client.0.smithi029.stdout:8/787: symlink d3/d50/dac/lf9 0 2024-04-23T10:21:44.535 INFO:tasks.workunit.client.0.smithi029.stdout:7/878: sync 2024-04-23T10:21:44.535 INFO:tasks.workunit.client.0.smithi029.stdout:6/902: sync 2024-04-23T10:21:44.535 INFO:tasks.workunit.client.0.smithi029.stdout:0/723: read d0/d21/d7f/f8f [94333,37800] 0 2024-04-23T10:21:44.537 INFO:tasks.workunit.client.0.smithi029.stdout:4/844: creat d0/d3c/d52/d1b/d9f/d92/dd8/da1/db1/d11f/f12c x:0 0 0 2024-04-23T10:21:44.539 INFO:tasks.workunit.client.0.smithi029.stdout:0/724: fsync d0/da9/d4c/da7/fd4 0 2024-04-23T10:21:44.541 INFO:tasks.workunit.client.0.smithi029.stdout:6/903: write d9/df/d16/d1f/d27/d33/da4/d66/d95/fe2 [1306802,4967] 0 2024-04-23T10:21:44.543 INFO:tasks.workunit.client.0.smithi029.stdout:4/845: chown d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d 568025 1 2024-04-23T10:21:44.550 INFO:tasks.workunit.client.0.smithi029.stdout:7/879: dwrite d5/d29/dc9/f115 [0,4194304] 0 2024-04-23T10:21:44.550 INFO:tasks.workunit.client.0.smithi029.stdout:4/846: chown d0/d3c/d52/d1b/d36/d45/d4f/d7b/cb0 1 1 2024-04-23T10:21:44.551 INFO:tasks.workunit.client.0.smithi029.stdout:8/788: write d3/d44/f74 [4623652,44322] 0 2024-04-23T10:21:44.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/714: rename d1/dd/d47/d63/d64/d78/da6/lbd to d1/dd/d47/d63/lf3 0 2024-04-23T10:21:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:7/880: creat d5/d71/d114/da5/f11d x:0 0 0 2024-04-23T10:21:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:6/904: dwrite d9/df/d16/d1f/d27/d33/f32 [0,4194304] 0 2024-04-23T10:21:44.562 INFO:tasks.workunit.client.0.smithi029.stdout:4/847: symlink d0/d3c/d52/d1b/d36/d45/dd0/l12d 0 2024-04-23T10:21:44.565 INFO:tasks.workunit.client.0.smithi029.stdout:6/905: read d9/f10 [344442,90410] 0 2024-04-23T10:21:44.743 INFO:tasks.workunit.client.0.smithi029.stdout:8/789: dread d3/d7d/fc8 [0,4194304] 0 2024-04-23T10:21:44.748 INFO:tasks.workunit.client.0.smithi029.stdout:4/848: dwrite d0/d3c/d52/d74/fa4 [0,4194304] 0 2024-04-23T10:21:44.755 INFO:tasks.workunit.client.0.smithi029.stdout:8/790: rmdir d3/d50/d6a/d95/d36/d68 39 2024-04-23T10:21:44.757 INFO:tasks.workunit.client.0.smithi029.stdout:8/791: stat d3/d50/dad 0 2024-04-23T10:21:44.758 INFO:tasks.workunit.client.0.smithi029.stdout:7/881: creat d5/d71/dca/f11e x:0 0 0 2024-04-23T10:21:44.759 INFO:tasks.workunit.client.0.smithi029.stdout:2/715: dread d1/dd/f49 [0,4194304] 0 2024-04-23T10:21:44.761 INFO:tasks.workunit.client.0.smithi029.stdout:2/716: chown d1/d31 0 1 2024-04-23T10:21:44.765 INFO:tasks.workunit.client.0.smithi029.stdout:4/849: symlink d0/d3c/d52/d1b/d5b/d65/l12e 0 2024-04-23T10:21:44.765 INFO:tasks.workunit.client.0.smithi029.stdout:2/717: chown d1/d3e/d3b/d75/f7a 3679 1 2024-04-23T10:21:44.771 INFO:tasks.workunit.client.0.smithi029.stdout:2/718: write d1/dd/d47/d63/d64/d78/fce [1217091,78933] 0 2024-04-23T10:21:44.774 INFO:tasks.workunit.client.0.smithi029.stdout:2/719: write d1/d3e/d3b/fd9 [103396,115891] 0 2024-04-23T10:21:44.778 INFO:tasks.workunit.client.0.smithi029.stdout:2/720: fdatasync d1/d31/d3d/fe9 0 2024-04-23T10:21:44.792 INFO:tasks.workunit.client.0.smithi029.stdout:2/721: creat d1/d3e/d3b/d75/dd1/ff4 x:0 0 0 2024-04-23T10:21:44.795 INFO:tasks.workunit.client.0.smithi029.stdout:4/850: write d0/fe9 [1496694,74688] 0 2024-04-23T10:21:44.797 INFO:tasks.workunit.client.0.smithi029.stdout:5/893: sync 2024-04-23T10:21:44.799 INFO:tasks.workunit.client.0.smithi029.stdout:8/792: creat d3/d44/db1/ffa x:0 0 0 2024-04-23T10:21:44.803 INFO:tasks.workunit.client.0.smithi029.stdout:2/722: truncate d1/d3e/d3b/d75/fe2 31484 0 2024-04-23T10:21:44.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/882: rename d5/d71/df5/d10c/c111 to d5/d8/d51/c11f 0 2024-04-23T10:21:44.812 INFO:tasks.workunit.client.0.smithi029.stdout:2/723: rmdir d1/dda 39 2024-04-23T10:21:44.818 INFO:tasks.workunit.client.0.smithi029.stdout:5/894: fsync d0/d35/d10/d26/db2/dbc/fbd 0 2024-04-23T10:21:44.822 INFO:tasks.workunit.client.0.smithi029.stdout:8/793: mknod d3/d50/dad/cfb 0 2024-04-23T10:21:44.833 INFO:tasks.workunit.client.0.smithi029.stdout:8/794: chown d3/d44/c6c 6 1 2024-04-23T10:21:44.839 INFO:tasks.workunit.client.0.smithi029.stdout:4/851: dwrite d0/d3c/d52/d1b/d36/d45/d68/fef [0,4194304] 0 2024-04-23T10:21:44.849 INFO:tasks.workunit.client.0.smithi029.stdout:5/895: rename d0/d35/d38/d39 to d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f 0 2024-04-23T10:21:44.850 INFO:tasks.workunit.client.0.smithi029.stdout:2/724: creat d1/dd/d60/ff5 x:0 0 0 2024-04-23T10:21:44.850 INFO:tasks.workunit.client.0.smithi029.stdout:8/795: mkdir d3/d50/d6a/dd9/dfc 0 2024-04-23T10:21:44.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/852: fdatasync d0/d3c/d52/d1b/d36/d45/d4f/df2/f111 0 2024-04-23T10:21:44.858 INFO:tasks.workunit.client.0.smithi029.stdout:2/725: read - d1/dd/d60/fe0 zero size 2024-04-23T10:21:44.860 INFO:tasks.workunit.client.0.smithi029.stdout:2/726: fdatasync d1/d3e/d5a/f93 0 2024-04-23T10:21:44.862 INFO:tasks.workunit.client.0.smithi029.stdout:4/853: dread d0/d3c/d52/d1b/d36/d45/d4f/df2/ff5 [0,4194304] 0 2024-04-23T10:21:44.863 INFO:tasks.workunit.client.0.smithi029.stdout:2/727: read d1/dd/d60/fc9 [1272446,123297] 0 2024-04-23T10:21:44.866 INFO:tasks.workunit.client.0.smithi029.stdout:4/854: write d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d/f129 [411554,112997] 0 2024-04-23T10:21:44.890 INFO:tasks.workunit.client.0.smithi029.stdout:2/728: stat d1/dd/d47/f5d 0 2024-04-23T10:21:44.894 INFO:tasks.workunit.client.0.smithi029.stdout:8/796: fdatasync d3/d50/d6a/d95/d36/f46 0 2024-04-23T10:21:44.900 INFO:tasks.workunit.client.0.smithi029.stdout:4/855: mknod d0/d3c/d52/d1b/c12f 0 2024-04-23T10:21:44.923 INFO:tasks.workunit.client.0.smithi029.stdout:5/896: dwrite d0/d35/d38/d3e/f4e [0,4194304] 0 2024-04-23T10:21:44.935 INFO:tasks.workunit.client.0.smithi029.stdout:8/797: getdents d3/d50/d6a/d95/d36/dbf/dee 0 2024-04-23T10:21:44.938 INFO:tasks.workunit.client.0.smithi029.stdout:4/856: fsync d0/d3c/d52/d1b/d9f/d92/dd8/d7a/fc6 0 2024-04-23T10:21:44.947 INFO:tasks.workunit.client.0.smithi029.stdout:8/798: write d3/d50/dac/de1/de3/fde [438727,57436] 0 2024-04-23T10:21:44.950 INFO:tasks.workunit.client.0.smithi029.stdout:4/857: fsync d0/d3c/d52/d74/d8a/fb4 0 2024-04-23T10:21:44.956 INFO:tasks.workunit.client.0.smithi029.stdout:5/897: creat d0/d35/da1/f120 x:0 0 0 2024-04-23T10:21:44.958 INFO:tasks.workunit.client.0.smithi029.stdout:2/729: dwrite d1/d31/d50/d9b/d9e/fa3 [0,4194304] 0 2024-04-23T10:21:44.960 INFO:tasks.workunit.client.0.smithi029.stdout:2/730: chown d1/d3e/c86 793937 1 2024-04-23T10:21:44.963 INFO:tasks.workunit.client.0.smithi029.stdout:2/731: read - d1/d3e/d3b/d75/dd1/ff4 zero size 2024-04-23T10:21:44.963 INFO:tasks.workunit.client.0.smithi029.stdout:5/898: dread d0/d35/d38/d3e/d66/d5a/d78/ffb [0,4194304] 0 2024-04-23T10:21:44.970 INFO:tasks.workunit.client.0.smithi029.stdout:8/799: write d3/d50/d6a/d95/d36/d3e/dce/fc4 [785478,72024] 0 2024-04-23T10:21:44.977 INFO:tasks.workunit.client.0.smithi029.stdout:4/858: getdents d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7 0 2024-04-23T10:21:44.983 INFO:tasks.workunit.client.0.smithi029.stdout:8/800: write d3/f30 [631663,119863] 0 2024-04-23T10:21:44.986 INFO:tasks.workunit.client.0.smithi029.stdout:8/801: truncate d3/f1e 4739404 0 2024-04-23T10:21:44.994 INFO:tasks.workunit.client.0.smithi029.stdout:8/802: creat d3/d50/d6a/d95/d36/d68/ffd x:0 0 0 2024-04-23T10:21:44.995 INFO:tasks.workunit.client.0.smithi029.stdout:2/732: dread d1/f8c [0,4194304] 0 2024-04-23T10:21:44.996 INFO:tasks.workunit.client.0.smithi029.stdout:2/733: fsync d1/f2e 0 2024-04-23T10:21:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:8/803: mknod d3/d50/d6a/d95/d36/d3e/cfe 0 2024-04-23T10:21:45.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/804: write d3/d50/fe5 [659229,83649] 0 2024-04-23T10:21:45.008 INFO:tasks.workunit.client.0.smithi029.stdout:2/734: creat d1/dd/d47/d63/d64/d78/ff6 x:0 0 0 2024-04-23T10:21:45.013 INFO:tasks.workunit.client.0.smithi029.stdout:2/735: mknod d1/d4/db7/db8/dde/cf7 0 2024-04-23T10:21:45.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/694: sync 2024-04-23T10:21:45.019 INFO:tasks.workunit.client.0.smithi029.stdout:1/695: dread - d5/d6/de/d22/f52 zero size 2024-04-23T10:21:45.022 INFO:tasks.workunit.client.0.smithi029.stdout:2/736: chown d1/dd/c26 15444 1 2024-04-23T10:21:45.025 INFO:tasks.workunit.client.0.smithi029.stdout:2/737: readlink d1/dd/d60/lb1 0 2024-04-23T10:21:45.030 INFO:tasks.workunit.client.0.smithi029.stdout:1/696: write d5/d6/f16 [4316778,83319] 0 2024-04-23T10:21:45.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/738: unlink d1/d3e/l2b 0 2024-04-23T10:21:45.035 INFO:tasks.workunit.client.0.smithi029.stdout:4/859: dread d0/d12/da9/f10a [0,4194304] 0 2024-04-23T10:21:45.038 INFO:tasks.workunit.client.0.smithi029.stdout:8/805: dwrite d3/d50/d6a/d95/d36/f40 [0,4194304] 0 2024-04-23T10:21:45.043 INFO:tasks.workunit.client.0.smithi029.stdout:2/739: unlink d1/d3e/f71 0 2024-04-23T10:21:45.050 INFO:tasks.workunit.client.0.smithi029.stdout:4/860: write d0/d3c/fc9 [53289,55442] 0 2024-04-23T10:21:45.053 INFO:tasks.workunit.client.0.smithi029.stdout:8/806: dwrite d3/d7d/fec [0,4194304] 0 2024-04-23T10:21:45.053 INFO:tasks.workunit.client.0.smithi029.stdout:2/740: creat d1/d4/db7/ff8 x:0 0 0 2024-04-23T10:21:45.056 INFO:tasks.workunit.client.0.smithi029.stdout:5/899: dread d0/f57 [0,4194304] 0 2024-04-23T10:21:45.059 INFO:tasks.workunit.client.0.smithi029.stdout:1/697: dwrite d5/f17 [0,4194304] 0 2024-04-23T10:21:45.060 INFO:tasks.workunit.client.0.smithi029.stdout:1/698: fsync d5/fa3 0 2024-04-23T10:21:45.062 INFO:tasks.workunit.client.0.smithi029.stdout:2/741: dread - d1/dda/ff0 zero size 2024-04-23T10:21:45.065 INFO:tasks.workunit.client.0.smithi029.stdout:5/900: mknod d0/d35/d38/d3e/d66/c121 0 2024-04-23T10:21:45.066 INFO:tasks.workunit.client.0.smithi029.stdout:1/699: dread - d5/d6/de/fcb zero size 2024-04-23T10:21:45.067 INFO:tasks.workunit.client.0.smithi029.stdout:4/861: mknod d0/d3c/d52/d1b/d36/d45/d4f/c130 0 2024-04-23T10:21:45.073 INFO:tasks.workunit.client.0.smithi029.stdout:8/807: link d3/d50/d6a/d95/dda/lf5 d3/df0/lff 0 2024-04-23T10:21:45.073 INFO:tasks.workunit.client.0.smithi029.stdout:4/862: chown d0/d3c/d52/d74/d8a/dba/l126 1801044778 1 2024-04-23T10:21:45.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/742: truncate d1/d31/d3d/f74 1049949 0 2024-04-23T10:21:45.076 INFO:tasks.workunit.client.0.smithi029.stdout:1/700: mknod d5/d6/da5/cd6 0 2024-04-23T10:21:45.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/701: readlink d5/d6/de/d15/d7b/lb6 0 2024-04-23T10:21:45.078 INFO:tasks.workunit.client.0.smithi029.stdout:2/743: rmdir d1/d4 39 2024-04-23T10:21:45.079 INFO:tasks.workunit.client.0.smithi029.stdout:4/863: rmdir d0/d3c/d52/d1b/d9f/d92/dd8 39 2024-04-23T10:21:45.080 INFO:tasks.workunit.client.0.smithi029.stdout:1/702: read - d5/d6/de/d22/f52 zero size 2024-04-23T10:21:45.081 INFO:tasks.workunit.client.0.smithi029.stdout:8/808: creat d3/d50/d6a/d95/d36/f100 x:0 0 0 2024-04-23T10:21:45.083 INFO:tasks.workunit.client.0.smithi029.stdout:8/809: chown d3/d44/cc7 1049177 1 2024-04-23T10:21:45.084 INFO:tasks.workunit.client.0.smithi029.stdout:2/744: creat d1/dd/d22/ff9 x:0 0 0 2024-04-23T10:21:45.087 INFO:tasks.workunit.client.0.smithi029.stdout:1/703: fdatasync d5/d6/de/d22/d84/dc4/d47/fa6 0 2024-04-23T10:21:45.090 INFO:tasks.workunit.client.0.smithi029.stdout:8/810: creat d3/d50/d6a/f101 x:0 0 0 2024-04-23T10:21:45.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/745: truncate d1/d3e/f4c 4051912 0 2024-04-23T10:21:45.094 INFO:tasks.workunit.client.0.smithi029.stdout:8/811: fsync d3/d50/d6a/d95/f82 0 2024-04-23T10:21:45.095 INFO:tasks.workunit.client.0.smithi029.stdout:4/864: truncate d0/d3c/d52/d1b/d5b/d65/d6a/f6c 2152096 0 2024-04-23T10:21:45.098 INFO:tasks.workunit.client.0.smithi029.stdout:4/865: chown d0/d3c/d52/d74/d91/c117 0 1 2024-04-23T10:21:45.103 INFO:tasks.workunit.client.0.smithi029.stdout:1/704: dwrite d5/d6/de/d22/f5b [4194304,4194304] 0 2024-04-23T10:21:45.103 INFO:tasks.workunit.client.0.smithi029.stdout:8/812: truncate d3/d50/d6a/d95/d36/d94/fc9 1655078 0 2024-04-23T10:21:45.107 INFO:tasks.workunit.client.0.smithi029.stdout:1/705: unlink d5/d6/c8e 0 2024-04-23T10:21:45.108 INFO:tasks.workunit.client.0.smithi029.stdout:8/813: creat d3/d50/d6a/f102 x:0 0 0 2024-04-23T10:21:45.109 INFO:tasks.workunit.client.0.smithi029.stdout:5/901: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/fae [0,4194304] 0 2024-04-23T10:21:45.117 INFO:tasks.workunit.client.0.smithi029.stdout:1/706: getdents d5/d6/de/d22/d77 0 2024-04-23T10:21:45.117 INFO:tasks.workunit.client.0.smithi029.stdout:5/902: rmdir d0/d35/d10/d26/db2 39 2024-04-23T10:21:45.120 INFO:tasks.workunit.client.0.smithi029.stdout:1/707: chown d5/d6/de/d27/da9/dad/dc9 2329 1 2024-04-23T10:21:45.123 INFO:tasks.workunit.client.0.smithi029.stdout:1/708: stat d5/d6/d34/d63/dcf/fd1 0 2024-04-23T10:21:45.124 INFO:tasks.workunit.client.0.smithi029.stdout:4/866: dread d0/d3c/d52/d20/f57 [0,4194304] 0 2024-04-23T10:21:45.125 INFO:tasks.workunit.client.0.smithi029.stdout:5/903: rename d0/d35/d38/d3e/d66/d5a/d78/c1a to d0/d35/d38/d3e/d66/d5a/d110/c122 0 2024-04-23T10:21:45.127 INFO:tasks.workunit.client.0.smithi029.stdout:1/709: symlink d5/d6/de/d15/d7b/ld7 0 2024-04-23T10:21:45.129 INFO:tasks.workunit.client.0.smithi029.stdout:5/904: dread - d0/d35/d38/d3e/d66/d8c/fc7 zero size 2024-04-23T10:21:45.130 INFO:tasks.workunit.client.0.smithi029.stdout:4/867: getdents d0/d3c/d52/d74/d8a/dba/dfe 0 2024-04-23T10:21:45.130 INFO:tasks.workunit.client.0.smithi029.stdout:1/710: write d5/d6/de/d22/d77/faf [949432,130712] 0 2024-04-23T10:21:45.134 INFO:tasks.workunit.client.0.smithi029.stdout:4/868: mknod d0/d3c/d52/d1b/d36/d45/d4f/c131 0 2024-04-23T10:21:45.135 INFO:tasks.workunit.client.0.smithi029.stdout:1/711: rename d5/d3e/f9c to d5/d6/de/d27/da9/fd8 0 2024-04-23T10:21:45.136 INFO:tasks.workunit.client.0.smithi029.stdout:5/905: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/l95 478180343 1 2024-04-23T10:21:45.136 INFO:tasks.workunit.client.0.smithi029.stdout:4/869: chown d0/d3c/d52/d1b/d36/l61 16410575 1 2024-04-23T10:21:45.138 INFO:tasks.workunit.client.0.smithi029.stdout:5/906: creat d0/d6a/dd7/f123 x:0 0 0 2024-04-23T10:21:45.139 INFO:tasks.workunit.client.0.smithi029.stdout:4/870: chown d0/d3c/d52/d1b/d36/d45/d4f/d7b/l8e 145 1 2024-04-23T10:21:45.139 INFO:tasks.workunit.client.0.smithi029.stdout:1/712: mknod d5/d8c/cd9 0 2024-04-23T10:21:45.139 INFO:tasks.workunit.client.0.smithi029.stdout:8/814: dread d3/d50/dac/de1/de3/f4d [0,4194304] 0 2024-04-23T10:21:45.141 INFO:tasks.workunit.client.0.smithi029.stdout:5/907: fdatasync d0/d35/d38/d3e/d66/fd1 0 2024-04-23T10:21:45.143 INFO:tasks.workunit.client.0.smithi029.stdout:8/815: symlink d3/d50/dac/de1/de3/dc3/l103 0 2024-04-23T10:21:45.144 INFO:tasks.workunit.client.0.smithi029.stdout:4/871: truncate d0/d3c/fc8 1184599 0 2024-04-23T10:21:45.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/872: write d0/d3c/d52/d1b/d5b/d65/f85 [3496360,114945] 0 2024-04-23T10:21:45.148 INFO:tasks.workunit.client.0.smithi029.stdout:8/816: rename d3/d50/d6a/d95/c32 to d3/d50/d6a/dd9/dfc/c104 0 2024-04-23T10:21:45.149 INFO:tasks.workunit.client.0.smithi029.stdout:4/873: truncate d0/d3c/d52/d1b/d36/d45/d68/f8f 757671 0 2024-04-23T10:21:45.153 INFO:tasks.workunit.client.0.smithi029.stdout:8/817: link d3/d50/d6a/d95/d36/f100 d3/d50/d6a/d95/d36/d94/f105 0 2024-04-23T10:21:45.156 INFO:tasks.workunit.client.0.smithi029.stdout:1/713: dwrite d5/d6/de/d27/f99 [0,4194304] 0 2024-04-23T10:21:45.156 INFO:tasks.workunit.client.0.smithi029.stdout:4/874: rename d0/d3c/d52/d1b/d36/ffc to d0/d3c/d52/d1b/d5b/f132 0 2024-04-23T10:21:45.157 INFO:tasks.workunit.client.0.smithi029.stdout:8/818: truncate d3/d50/d6a/dd9/fef 913077 0 2024-04-23T10:21:45.160 INFO:tasks.workunit.client.0.smithi029.stdout:1/714: mkdir d5/d3e/dda 0 2024-04-23T10:21:45.161 INFO:tasks.workunit.client.0.smithi029.stdout:4/875: truncate d0/fd 2503600 0 2024-04-23T10:21:45.161 INFO:tasks.workunit.client.0.smithi029.stdout:8/819: creat d3/d50/d6a/d95/d36/d94/dcd/f106 x:0 0 0 2024-04-23T10:21:45.162 INFO:tasks.workunit.client.0.smithi029.stdout:1/715: chown d5/d6/de/d22/d84/dc4/d47/db0/fd0 8738309 1 2024-04-23T10:21:45.163 INFO:tasks.workunit.client.0.smithi029.stdout:4/876: symlink d0/d12/da9/l133 0 2024-04-23T10:21:45.168 INFO:tasks.workunit.client.0.smithi029.stdout:1/716: link d5/d6/de/d22/d84/dc4/d47/f79 d5/d6/fdb 0 2024-04-23T10:21:45.169 INFO:tasks.workunit.client.0.smithi029.stdout:8/820: dread d3/d50/d6a/d95/d36/d3e/fc2 [0,4194304] 0 2024-04-23T10:21:45.169 INFO:tasks.workunit.client.0.smithi029.stdout:4/877: mkdir d0/d12/d10b/d134 0 2024-04-23T10:21:45.171 INFO:tasks.workunit.client.0.smithi029.stdout:4/878: fsync d0/d3c/d52/d20/f5e 0 2024-04-23T10:21:45.174 INFO:tasks.workunit.client.0.smithi029.stdout:8/821: creat d3/d50/dac/f107 x:0 0 0 2024-04-23T10:21:45.175 INFO:tasks.workunit.client.0.smithi029.stdout:8/822: truncate d3/d71/fa2 1062420 0 2024-04-23T10:21:45.178 INFO:tasks.workunit.client.0.smithi029.stdout:4/879: mkdir d0/d3c/d52/d1b/d66/d135 0 2024-04-23T10:21:45.178 INFO:tasks.workunit.client.0.smithi029.stdout:8/823: rename d3/d50 to d3/d50/d6a/d95/d36/d108 22 2024-04-23T10:21:45.180 INFO:tasks.workunit.client.0.smithi029.stdout:1/717: link d5/d6/de/d15/c8b d5/d6/de/d22/d6c/cdc 0 2024-04-23T10:21:45.182 INFO:tasks.workunit.client.0.smithi029.stdout:8/824: mkdir d3/d50/d6a/d95/dda/d109 0 2024-04-23T10:21:45.183 INFO:tasks.workunit.client.0.smithi029.stdout:1/718: mkdir d5/d6/de/d27/da9/dad/ddd 0 2024-04-23T10:21:45.186 INFO:tasks.workunit.client.0.smithi029.stdout:8/825: read d3/d50/d6a/fa3 [102812,57116] 0 2024-04-23T10:21:45.187 INFO:tasks.workunit.client.0.smithi029.stdout:4/880: dwrite d0/d3c/d52/d74/fd2 [0,4194304] 0 2024-04-23T10:21:45.191 INFO:tasks.workunit.client.0.smithi029.stdout:1/719: rename d5/d6/de/d22/f45 to d5/d6/de/d27/da9/fde 0 2024-04-23T10:21:45.194 INFO:tasks.workunit.client.0.smithi029.stdout:4/881: mkdir d0/d3c/d52/d74/d8a/d136 0 2024-04-23T10:21:45.195 INFO:tasks.workunit.client.0.smithi029.stdout:4/882: write d0/d3c/d52/d74/d8a/fb4 [1036649,85407] 0 2024-04-23T10:21:45.197 INFO:tasks.workunit.client.0.smithi029.stdout:1/720: mknod d5/d6/de/d22/d77/cdf 0 2024-04-23T10:21:45.197 INFO:tasks.workunit.client.0.smithi029.stdout:8/826: creat d3/d50/dac/f10a x:0 0 0 2024-04-23T10:21:45.203 INFO:tasks.workunit.client.0.smithi029.stdout:4/883: mknod d0/d3c/d52/c137 0 2024-04-23T10:21:45.209 INFO:tasks.workunit.client.0.smithi029.stdout:4/884: creat d0/d3c/d52/d1b/d9f/d92/dd8/da1/f138 x:0 0 0 2024-04-23T10:21:45.210 INFO:tasks.workunit.client.0.smithi029.stdout:4/885: dread - d0/d3c/d52/d74/f77 zero size 2024-04-23T10:21:45.211 INFO:tasks.workunit.client.0.smithi029.stdout:4/886: chown d0/d3c/d52/d1b/d5b/d65/d6a/d11b 314 1 2024-04-23T10:21:45.212 INFO:tasks.workunit.client.0.smithi029.stdout:8/827: write d3/f2d [1290555,29354] 0 2024-04-23T10:21:45.217 INFO:tasks.workunit.client.0.smithi029.stdout:8/828: rename d3/d50/d6a/d95/d36/f40 to d3/d50/d6a/d95/d36/d68/f10b 0 2024-04-23T10:21:45.219 INFO:tasks.workunit.client.0.smithi029.stdout:8/829: mknod d3/d50/d6a/d95/d36/d3e/ddd/c10c 0 2024-04-23T10:21:45.221 INFO:tasks.workunit.client.0.smithi029.stdout:8/830: read d3/d71/d96/f9f [827,28430] 0 2024-04-23T10:21:45.224 INFO:tasks.workunit.client.0.smithi029.stdout:8/831: creat d3/d50/d6a/d95/d36/d68/d8c/f10d x:0 0 0 2024-04-23T10:21:45.226 INFO:tasks.workunit.client.0.smithi029.stdout:4/887: dread d0/fd [0,4194304] 0 2024-04-23T10:21:45.228 INFO:tasks.workunit.client.0.smithi029.stdout:4/888: dread - d0/d5a/d96/fbf zero size 2024-04-23T10:21:45.228 INFO:tasks.workunit.client.0.smithi029.stdout:4/889: readlink d0/d12/l4c 0 2024-04-23T10:21:45.232 INFO:tasks.workunit.client.0.smithi029.stdout:8/832: dread d3/d50/fe5 [0,4194304] 0 2024-04-23T10:21:45.234 INFO:tasks.workunit.client.0.smithi029.stdout:8/833: write d3/d50/d6a/d95/d36/d68/f6d [2197992,43715] 0 2024-04-23T10:21:45.237 INFO:tasks.workunit.client.0.smithi029.stdout:8/834: mkdir d3/d50/d6a/d95/d36/dbf/d10e 0 2024-04-23T10:21:45.241 INFO:tasks.workunit.client.0.smithi029.stdout:8/835: unlink d3/d50/d6a/d95/d36/caa 0 2024-04-23T10:21:45.241 INFO:tasks.workunit.client.0.smithi029.stdout:4/890: dwrite d0/d3c/d52/f14 [4194304,4194304] 0 2024-04-23T10:21:45.243 INFO:tasks.workunit.client.0.smithi029.stdout:4/891: read d0/d3c/fc9 [136913,86271] 0 2024-04-23T10:21:45.246 INFO:tasks.workunit.client.0.smithi029.stdout:4/892: chown d0/d3c/d52/d74/d8a/dba/dfe/f106 13239400 1 2024-04-23T10:21:45.247 INFO:tasks.workunit.client.0.smithi029.stdout:4/893: write d0/d3c/d52/d1b/d36/d45/dd0/fdc [645316,102] 0 2024-04-23T10:21:45.248 INFO:tasks.workunit.client.0.smithi029.stdout:4/894: stat d0/d3c/d52/d1b/d36/d45 0 2024-04-23T10:21:45.249 INFO:tasks.workunit.client.0.smithi029.stdout:8/836: creat d3/d44/db1/f10f x:0 0 0 2024-04-23T10:21:45.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/895: creat d0/d3c/d52/d74/f139 x:0 0 0 2024-04-23T10:21:45.257 INFO:tasks.workunit.client.0.smithi029.stdout:8/837: rename d3/d50/fe5 to d3/d50/d6a/d95/d36/d68/f110 0 2024-04-23T10:21:45.258 INFO:tasks.workunit.client.0.smithi029.stdout:8/838: chown d3/d50/d6a/d95/d36/d3e/ddd 8766621 1 2024-04-23T10:21:45.261 INFO:tasks.workunit.client.0.smithi029.stdout:8/839: dread - d3/d44/db1/ffa zero size 2024-04-23T10:21:45.262 INFO:tasks.workunit.client.0.smithi029.stdout:4/896: write d0/d3c/d52/d1b/d36/d45/d68/f73 [3086979,124005] 0 2024-04-23T10:21:45.265 INFO:tasks.workunit.client.0.smithi029.stdout:4/897: creat d0/d5a/f13a x:0 0 0 2024-04-23T10:21:45.269 INFO:tasks.workunit.client.0.smithi029.stdout:4/898: creat d0/d3c/d52/d74/d91/f13b x:0 0 0 2024-04-23T10:21:45.275 INFO:tasks.workunit.client.0.smithi029.stdout:4/899: write d0/d3c/d52/d1b/d5b/d65/f6d [726859,121824] 0 2024-04-23T10:21:45.277 INFO:tasks.workunit.client.0.smithi029.stdout:8/840: dread d3/d50/d6a/d95/d36/f3b [0,4194304] 0 2024-04-23T10:21:45.280 INFO:tasks.workunit.client.0.smithi029.stdout:0/725: sync 2024-04-23T10:21:45.280 INFO:tasks.workunit.client.0.smithi029.stdout:3/753: sync 2024-04-23T10:21:45.280 INFO:tasks.workunit.client.0.smithi029.stdout:4/900: rename d0/d3c/d52/d1b/d5b/f132 to d0/d3c/d52/d1b/d9f/f13c 0 2024-04-23T10:21:45.281 INFO:tasks.workunit.client.0.smithi029.stdout:0/726: read d0/d1b/f3b [431052,56585] 0 2024-04-23T10:21:45.281 INFO:tasks.workunit.client.0.smithi029.stdout:3/754: read d3/d10/f58 [3063240,95293] 0 2024-04-23T10:21:45.282 INFO:tasks.workunit.client.0.smithi029.stdout:0/727: fdatasync d0/d3e/d4e/fb3 0 2024-04-23T10:21:45.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/755: link d3/d45/d4f/f91 d3/d10/de/de1/fff 0 2024-04-23T10:21:45.293 INFO:tasks.workunit.client.0.smithi029.stdout:8/841: dwrite d3/d50/d6a/d95/d36/d68/f6d [0,4194304] 0 2024-04-23T10:21:45.297 INFO:tasks.workunit.client.0.smithi029.stdout:3/756: dread - d3/d15/d4b/d52/dee/fe9 zero size 2024-04-23T10:21:45.298 INFO:tasks.workunit.client.0.smithi029.stdout:0/728: link d0/da9/d4c/da7/dc7/dd7/d73/d7e/l93 d0/d1b/d67/dae/d92/lf7 0 2024-04-23T10:21:45.299 INFO:tasks.workunit.client.0.smithi029.stdout:8/842: creat d3/d50/d6a/d95/d36/dbf/d10e/f111 x:0 0 0 2024-04-23T10:21:45.301 INFO:tasks.workunit.client.0.smithi029.stdout:8/843: chown d3/d50/d6a/d95/d36/d3e/fd2 2783 1 2024-04-23T10:21:45.301 INFO:tasks.workunit.client.0.smithi029.stdout:4/901: dread d0/d3c/d52/d1b/d5b/d65/f85 [0,4194304] 0 2024-04-23T10:21:45.310 INFO:tasks.workunit.client.0.smithi029.stdout:8/844: mknod d3/d50/dac/c112 0 2024-04-23T10:21:45.312 INFO:tasks.workunit.client.0.smithi029.stdout:3/757: dwrite d3/d45/d4f/d6b/f74 [4194304,4194304] 0 2024-04-23T10:21:45.312 INFO:tasks.workunit.client.0.smithi029.stdout:0/729: dwrite d0/dc/d90/fb4 [4194304,4194304] 0 2024-04-23T10:21:45.316 INFO:tasks.workunit.client.0.smithi029.stdout:4/902: write d0/d3c/d52/d1b/d9f/d92/dd8/da1/fab [630142,37974] 0 2024-04-23T10:21:45.320 INFO:tasks.workunit.client.0.smithi029.stdout:8/845: rename d3/d50/dad to d3/d50/d6a/d95/d36/dbf/dee/d113 0 2024-04-23T10:21:45.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/730: truncate d0/dc/d26/f33 4333885 0 2024-04-23T10:21:45.326 INFO:tasks.workunit.client.0.smithi029.stdout:4/903: write d0/d3c/d52/d1b/d66/f114 [235690,106772] 0 2024-04-23T10:21:45.328 INFO:tasks.workunit.client.0.smithi029.stdout:3/758: symlink d3/d10/de/d2e/d36/d40/d46/d72/d31/db6/l100 0 2024-04-23T10:21:45.331 INFO:tasks.workunit.client.0.smithi029.stdout:8/846: getdents d3/d50/d6a/d95/d36/d68 0 2024-04-23T10:21:45.335 INFO:tasks.workunit.client.0.smithi029.stdout:8/847: chown d3/d50/d6a/d95/d36/dbf/fe2 45089 1 2024-04-23T10:21:45.336 INFO:tasks.workunit.client.0.smithi029.stdout:8/848: chown d3/d44/db1 141837471 1 2024-04-23T10:21:45.337 INFO:tasks.workunit.client.0.smithi029.stdout:4/904: creat d0/d3c/d52/d74/f13d x:0 0 0 2024-04-23T10:21:45.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/759: write d3/d10/de/d2e/d36/fb2 [1787877,53359] 0 2024-04-23T10:21:45.339 INFO:tasks.workunit.client.0.smithi029.stdout:8/849: dread - d3/d44/db1/fca zero size 2024-04-23T10:21:45.340 INFO:tasks.workunit.client.0.smithi029.stdout:3/760: stat d3/d15/d4b 0 2024-04-23T10:21:45.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/850: dread - d3/d44/f81 zero size 2024-04-23T10:21:45.347 INFO:tasks.workunit.client.0.smithi029.stdout:3/761: link d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/ca8 d3/d10/de/de1/c101 0 2024-04-23T10:21:45.351 INFO:tasks.workunit.client.0.smithi029.stdout:4/905: write d0/d3c/fa2 [97061,114216] 0 2024-04-23T10:21:45.351 INFO:tasks.workunit.client.0.smithi029.stdout:8/851: write d3/d50/d6a/d95/d36/d3e/fd2 [23047,127218] 0 2024-04-23T10:21:45.354 INFO:tasks.workunit.client.0.smithi029.stdout:3/762: rename d3/d10/de/de1 to d3/d102 0 2024-04-23T10:21:45.357 INFO:tasks.workunit.client.0.smithi029.stdout:8/852: unlink d3/d50/d6a/d95/d36/d3e/ddd/fdf 0 2024-04-23T10:21:45.360 INFO:tasks.workunit.client.0.smithi029.stdout:4/906: dwrite d0/d3c/d52/d74/fa4 [0,4194304] 0 2024-04-23T10:21:45.360 INFO:tasks.workunit.client.0.smithi029.stdout:8/853: mkdir d3/d44/db1/d114 0 2024-04-23T10:21:45.363 INFO:tasks.workunit.client.0.smithi029.stdout:3/763: write d3/d10/de/d2e/d36/d40/d46/d72/d28/f64 [155388,86208] 0 2024-04-23T10:21:45.371 INFO:tasks.workunit.client.0.smithi029.stdout:3/764: symlink d3/d15/d4b/d52/dee/l103 0 2024-04-23T10:21:45.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/765: stat d3/d10/de/d2e/d36/d40/d46/d72/d31/c8c 0 2024-04-23T10:21:45.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/766: chown d3/d45/d4f/d6b/ddf 86938 1 2024-04-23T10:21:45.378 INFO:tasks.workunit.client.0.smithi029.stdout:3/767: stat d3/d10/de/d2e/d36/f33 0 2024-04-23T10:21:45.381 INFO:tasks.workunit.client.0.smithi029.stdout:3/768: creat d3/d45/d4f/d6b/ddf/f104 x:0 0 0 2024-04-23T10:21:45.382 INFO:tasks.workunit.client.0.smithi029.stdout:8/854: dread d3/d50/d6a/d95/d36/d3e/f41 [0,4194304] 0 2024-04-23T10:21:45.384 INFO:tasks.workunit.client.0.smithi029.stdout:8/855: chown d3/d50/d6a/d95/d36/d94/fb7 1 1 2024-04-23T10:21:45.385 INFO:tasks.workunit.client.0.smithi029.stdout:8/856: readlink d3/d50/d6a/d95/d36/l6b 0 2024-04-23T10:21:45.385 INFO:tasks.workunit.client.0.smithi029.stdout:8/857: chown d3/d50/d6a/fe0 22140 1 2024-04-23T10:21:45.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/858: write d3/d50/d6a/d95/d36/dbf/d10e/f111 [149200,63999] 0 2024-04-23T10:21:45.389 INFO:tasks.workunit.client.0.smithi029.stdout:8/859: dread - d3/d50/d6a/f101 zero size 2024-04-23T10:21:45.393 INFO:tasks.workunit.client.0.smithi029.stdout:3/769: truncate d3/d10/de/d2e/d36/d40/d46/d72/d31/f55 1841428 0 2024-04-23T10:21:45.395 INFO:tasks.workunit.client.0.smithi029.stdout:8/860: link d3/d44/f81 d3/d50/dac/de1/de3/f115 0 2024-04-23T10:21:45.396 INFO:tasks.workunit.client.0.smithi029.stdout:3/770: creat d3/d45/d4f/f105 x:0 0 0 2024-04-23T10:21:45.397 INFO:tasks.workunit.client.0.smithi029.stdout:8/861: mknod d3/d50/dac/de6/c116 0 2024-04-23T10:21:45.398 INFO:tasks.workunit.client.0.smithi029.stdout:3/771: unlink d3/d10/de/fe7 0 2024-04-23T10:21:45.400 INFO:tasks.workunit.client.0.smithi029.stdout:3/772: dread - d3/d10/de/d2e/d36/d40/d46/d72/fc4 zero size 2024-04-23T10:21:45.402 INFO:tasks.workunit.client.0.smithi029.stdout:3/773: write d3/d45/d4f/d6b/fdc [2701458,63931] 0 2024-04-23T10:21:45.417 INFO:tasks.workunit.client.0.smithi029.stdout:8/862: dwrite d3/d50/dac/de1/de3/f90 [0,4194304] 0 2024-04-23T10:21:45.422 INFO:tasks.workunit.client.0.smithi029.stdout:8/863: write d3/f9c [2319751,17048] 0 2024-04-23T10:21:45.428 INFO:tasks.workunit.client.0.smithi029.stdout:8/864: rename d3/d44/db1/d114 to d3/d50/d6a/d95/d36/d3e/dce/d117 0 2024-04-23T10:21:45.429 INFO:tasks.workunit.client.0.smithi029.stdout:3/774: dread d3/f63 [0,4194304] 0 2024-04-23T10:21:45.431 INFO:tasks.workunit.client.0.smithi029.stdout:3/775: read - d3/d45/d4f/f91 zero size 2024-04-23T10:21:45.437 INFO:tasks.workunit.client.0.smithi029.stdout:3/776: truncate d3/d10/d48/fb5 1184748 0 2024-04-23T10:21:45.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/865: dwrite d3/d50/d6a/d95/d36/d3e/fd2 [0,4194304] 0 2024-04-23T10:21:45.442 INFO:tasks.workunit.client.0.smithi029.stdout:8/866: creat d3/d7d/f118 x:0 0 0 2024-04-23T10:21:45.444 INFO:tasks.workunit.client.0.smithi029.stdout:8/867: rmdir d3/d50/d6a/d95/d36/d3e/dce 39 2024-04-23T10:21:45.450 INFO:tasks.workunit.client.0.smithi029.stdout:8/868: symlink d3/d50/d6a/d95/d36/d3e/dce/da4/l119 0 2024-04-23T10:21:45.451 INFO:tasks.workunit.client.0.smithi029.stdout:3/777: dwrite d3/d45/d4f/d6b/ddf/fd7 [0,4194304] 0 2024-04-23T10:21:45.456 INFO:tasks.workunit.client.0.smithi029.stdout:3/778: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/d106 0 2024-04-23T10:21:45.457 INFO:tasks.workunit.client.0.smithi029.stdout:8/869: mkdir d3/d50/d6a/d95/dda/d11a 0 2024-04-23T10:21:45.459 INFO:tasks.workunit.client.0.smithi029.stdout:3/779: mkdir d3/d10/de/d2e/d36/d107 0 2024-04-23T10:21:45.470 INFO:tasks.workunit.client.0.smithi029.stdout:3/780: dread d3/d45/d4f/f6e [0,4194304] 0 2024-04-23T10:21:45.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/781: truncate d3/d10/de/d2e/d36/d40/d46/fcd 293508 0 2024-04-23T10:21:45.479 INFO:tasks.workunit.client.0.smithi029.stdout:3/782: dread - d3/d45/d4f/d6b/fea zero size 2024-04-23T10:21:45.481 INFO:tasks.workunit.client.0.smithi029.stdout:3/783: symlink d3/d102/l108 0 2024-04-23T10:21:45.484 INFO:tasks.workunit.client.0.smithi029.stdout:8/870: dread d3/d50/d6a/d95/f39 [0,4194304] 0 2024-04-23T10:21:45.489 INFO:tasks.workunit.client.0.smithi029.stdout:8/871: creat d3/d50/d6a/d95/d36/d3e/dce/da4/f11b x:0 0 0 2024-04-23T10:21:45.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/872: truncate d3/d50/fd6 335227 0 2024-04-23T10:21:45.496 INFO:tasks.workunit.client.0.smithi029.stdout:8/873: mkdir d3/d50/d6a/d95/d36/d68/d11c 0 2024-04-23T10:21:45.497 INFO:tasks.workunit.client.0.smithi029.stdout:8/874: chown d3/d50/dac/c112 5138 1 2024-04-23T10:21:45.498 INFO:tasks.workunit.client.0.smithi029.stdout:3/784: dread d3/d15/f66 [0,4194304] 0 2024-04-23T10:21:45.501 INFO:tasks.workunit.client.0.smithi029.stdout:3/785: mknod d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/de5/c109 0 2024-04-23T10:21:45.504 INFO:tasks.workunit.client.0.smithi029.stdout:3/786: mknod d3/d15/d4b/d52/d5f/c10a 0 2024-04-23T10:21:45.506 INFO:tasks.workunit.client.0.smithi029.stdout:3/787: write d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/da7/dab/fc0 [516401,74846] 0 2024-04-23T10:21:45.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/788: truncate d3/d15/fc6 3410598 0 2024-04-23T10:21:45.510 INFO:tasks.workunit.client.0.smithi029.stdout:3/789: dread - d3/d45/d4f/fe8 zero size 2024-04-23T10:21:45.512 INFO:tasks.workunit.client.0.smithi029.stdout:3/790: fsync d3/d10/de/d2e/d36/f33 0 2024-04-23T10:21:45.518 INFO:tasks.workunit.client.0.smithi029.stdout:8/875: dread d3/d71/fb4 [4194304,4194304] 0 2024-04-23T10:21:45.527 INFO:tasks.workunit.client.0.smithi029.stdout:3/791: dwrite d3/d15/d4b/d52/fa4 [0,4194304] 0 2024-04-23T10:21:45.528 INFO:tasks.workunit.client.0.smithi029.stdout:3/792: dread - d3/d45/d4f/f91 zero size 2024-04-23T10:21:45.528 INFO:tasks.workunit.client.0.smithi029.stdout:8/876: dread d3/d50/d6a/d95/d36/f46 [0,4194304] 0 2024-04-23T10:21:45.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/793: chown d3/d10/de/d2e/d36/d40/d46/d72/d31/db6/l100 374075 1 2024-04-23T10:21:45.533 INFO:tasks.workunit.client.0.smithi029.stdout:8/877: creat d3/d50/d6a/d95/f11d x:0 0 0 2024-04-23T10:21:45.534 INFO:tasks.workunit.client.0.smithi029.stdout:6/906: sync 2024-04-23T10:21:45.537 INFO:tasks.workunit.client.0.smithi029.stdout:8/878: unlink d3/d44/cc7 0 2024-04-23T10:21:45.541 INFO:tasks.workunit.client.0.smithi029.stdout:6/907: creat d9/df/d16/d1f/f12a x:0 0 0 2024-04-23T10:21:45.555 INFO:tasks.workunit.client.0.smithi029.stdout:3/794: dread d3/d15/f5d [0,4194304] 0 2024-04-23T10:21:45.556 INFO:tasks.workunit.client.0.smithi029.stdout:8/879: dwrite d3/f7 [0,4194304] 0 2024-04-23T10:21:45.559 INFO:tasks.workunit.client.0.smithi029.stdout:6/908: link d9/df/d16/d1f/d27/d33/da4/d66/d95/d119/fe9 d9/df/d16/d34/d36/d117/dea/f12b 0 2024-04-23T10:21:45.560 INFO:tasks.workunit.client.0.smithi029.stdout:8/880: mkdir d3/d50/d6a/d95/d11e 0 2024-04-23T10:21:45.562 INFO:tasks.workunit.client.0.smithi029.stdout:6/909: creat d9/df/d16/d34/d36/d117/dea/f12c x:0 0 0 2024-04-23T10:21:45.565 INFO:tasks.workunit.client.0.smithi029.stdout:6/910: write d9/df/d16/d1f/d27/d33/f53 [3035856,116323] 0 2024-04-23T10:21:45.571 INFO:tasks.workunit.client.0.smithi029.stdout:8/881: dwrite d3/d44/db1/ffa [0,4194304] 0 2024-04-23T10:21:45.575 INFO:tasks.workunit.client.0.smithi029.stdout:8/882: rmdir d3/d50/d6a/d95/d36/d3e/dce/da4 39 2024-04-23T10:21:45.577 INFO:tasks.workunit.client.0.smithi029.stdout:6/911: dread d9/df/d16/d34/d36/d63/f68 [0,4194304] 0 2024-04-23T10:21:45.580 INFO:tasks.workunit.client.0.smithi029.stdout:6/912: rmdir d9/df/d16/d1f/d27/d33/da4/d66/d95 39 2024-04-23T10:21:45.581 INFO:tasks.workunit.client.0.smithi029.stdout:6/913: rename d9/df to d9/df/d16/d44/d75/d90/d107/d11e/d12d 22 2024-04-23T10:21:45.584 INFO:tasks.workunit.client.0.smithi029.stdout:6/914: truncate d9/fe 970014 0 2024-04-23T10:21:45.588 INFO:tasks.workunit.client.0.smithi029.stdout:8/883: write d3/d50/dac/de1/de3/f115 [751076,2339] 0 2024-04-23T10:21:45.592 INFO:tasks.workunit.client.0.smithi029.stdout:8/884: fsync d3/d50/d6a/d95/d36/d68/f110 0 2024-04-23T10:21:45.595 INFO:tasks.workunit.client.0.smithi029.stdout:8/885: mkdir d3/d50/dac/de6/d11f 0 2024-04-23T10:21:45.600 INFO:tasks.workunit.client.0.smithi029.stdout:8/886: rename d3/d50/d6a to d3/d50/dac/de1/d120 0 2024-04-23T10:21:45.602 INFO:tasks.workunit.client.0.smithi029.stdout:8/887: chown d3/d50/dac/de1/de3/f90 0 1 2024-04-23T10:21:45.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/915: dwrite d9/df/d16/d1f/d27/d33/da4/d66/d95/d119/f11f [0,4194304] 0 2024-04-23T10:21:45.608 INFO:tasks.workunit.client.0.smithi029.stdout:8/888: truncate d3/fd5 588998 0 2024-04-23T10:21:45.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/889: unlink d3/d50/dac/de1/d120/d95/d36/d3e/dce/ce4 0 2024-04-23T10:21:45.615 INFO:tasks.workunit.client.0.smithi029.stdout:6/916: dwrite d9/df/d16/d1f/d27/d33/da4/d58/d7e/fd4 [0,4194304] 0 2024-04-23T10:21:45.618 INFO:tasks.workunit.client.0.smithi029.stdout:8/890: fdatasync d3/d50/dac/de1/d120/fe0 0 2024-04-23T10:21:45.623 INFO:tasks.workunit.client.0.smithi029.stdout:8/891: mknod d3/d50/dac/de1/d120/d95/dda/d11a/c121 0 2024-04-23T10:21:45.628 INFO:tasks.workunit.client.0.smithi029.stdout:8/892: creat d3/d50/f122 x:0 0 0 2024-04-23T10:21:45.630 INFO:tasks.workunit.client.0.smithi029.stdout:6/917: dwrite d9/df/d16/d128/dd9/df6/fc2 [0,4194304] 0 2024-04-23T10:21:45.636 INFO:tasks.workunit.client.0.smithi029.stdout:6/918: rename d9/df/d16/d1f/d27/d33/da4/d66/d95/f118 to d9/df/d16/d1f/d27/dad/f12e 0 2024-04-23T10:21:45.641 INFO:tasks.workunit.client.0.smithi029.stdout:8/893: write d3/d50/dac/de1/de3/f5c [297595,115119] 0 2024-04-23T10:21:45.643 INFO:tasks.workunit.client.0.smithi029.stdout:8/894: readlink d3/d50/dac/de1/d120/d95/d36/ld8 0 2024-04-23T10:21:45.645 INFO:tasks.workunit.client.0.smithi029.stdout:6/919: rename d9/df/d41/l7b to d9/df/d16/d1f/d27/d33/da4/d58/d7e/d124/l12f 0 2024-04-23T10:21:45.647 INFO:tasks.workunit.client.0.smithi029.stdout:6/920: chown d9/df/d16/d34/ff7 2568933 1 2024-04-23T10:21:45.647 INFO:tasks.workunit.client.0.smithi029.stdout:8/895: getdents d3/d50 0 2024-04-23T10:21:45.651 INFO:tasks.workunit.client.0.smithi029.stdout:8/896: link d3/f2d d3/d50/dac/de1/d120/f123 0 2024-04-23T10:21:45.652 INFO:tasks.workunit.client.0.smithi029.stdout:6/921: dread d9/df/d16/d1f/d27/d33/f32 [0,4194304] 0 2024-04-23T10:21:45.654 INFO:tasks.workunit.client.0.smithi029.stdout:8/897: truncate d3/d50/dac/de1/d120/fe0 676676 0 2024-04-23T10:21:45.656 INFO:tasks.workunit.client.0.smithi029.stdout:6/922: truncate d9/df/d16/d1f/d27/d33/da4/d66/d95/d119/fe9 86037 0 2024-04-23T10:21:45.660 INFO:tasks.workunit.client.0.smithi029.stdout:6/923: rename d9/df/d16/d1f/d27/dad/dbd/fca to d9/d10f/f130 0 2024-04-23T10:21:45.661 INFO:tasks.workunit.client.0.smithi029.stdout:8/898: dwrite d3/d44/db1/f10f [0,4194304] 0 2024-04-23T10:21:45.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/924: dread d9/df/d16/d34/d36/fb1 [0,4194304] 0 2024-04-23T10:21:45.669 INFO:tasks.workunit.client.0.smithi029.stdout:8/899: dread d3/d50/dac/de1/d120/d95/d36/d3e/f41 [0,4194304] 0 2024-04-23T10:21:45.673 INFO:tasks.workunit.client.0.smithi029.stdout:6/925: write d9/df/d16/f2e [3870849,36980] 0 2024-04-23T10:21:45.673 INFO:tasks.workunit.client.0.smithi029.stdout:8/900: chown d3/fa5 1093739 1 2024-04-23T10:21:45.677 INFO:tasks.workunit.client.0.smithi029.stdout:6/926: creat d9/df/d16/d44/d101/f131 x:0 0 0 2024-04-23T10:21:45.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/901: mkdir d3/d71/d96/d124 0 2024-04-23T10:21:45.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/927: mknod d9/d10f/c132 0 2024-04-23T10:21:45.685 INFO:tasks.workunit.client.0.smithi029.stdout:6/928: dread d9/df/d16/d1f/d27/d33/da4/d58/d7e/fd4 [0,4194304] 0 2024-04-23T10:21:45.691 INFO:tasks.workunit.client.0.smithi029.stdout:8/902: dwrite d3/d50/dac/de1/de3/f49 [0,4194304] 0 2024-04-23T10:21:45.693 INFO:tasks.workunit.client.0.smithi029.stdout:8/903: fsync d3/d50/dac/f10a 0 2024-04-23T10:21:45.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/929: dwrite d9/df/d16/d1f/d27/d33/da4/d66/d95/d119/f10c [0,4194304] 0 2024-04-23T10:21:45.698 INFO:tasks.workunit.client.0.smithi029.stdout:6/930: chown d9/df/d16/d1f/d27/d33/da4/d58/fab 20 1 2024-04-23T10:21:45.700 INFO:tasks.workunit.client.0.smithi029.stdout:6/931: dread - d9/df/d16/d1f/d27/d33/da4/d58/f105 zero size 2024-04-23T10:21:45.704 INFO:tasks.workunit.client.0.smithi029.stdout:6/932: creat d9/d10f/f133 x:0 0 0 2024-04-23T10:21:45.709 INFO:tasks.workunit.client.0.smithi029.stdout:6/933: dread d9/df/d16/d34/d36/d117/dea/f12b [0,4194304] 0 2024-04-23T10:21:45.710 INFO:tasks.workunit.client.0.smithi029.stdout:6/934: fsync d9/df/d16/f111 0 2024-04-23T10:21:45.719 INFO:tasks.workunit.client.0.smithi029.stdout:6/935: dwrite d9/df/d16/d128/dd9/df6/fc2 [4194304,4194304] 0 2024-04-23T10:21:45.724 INFO:tasks.workunit.client.0.smithi029.stdout:6/936: rename d9/df/d16/d1f/d27/d33/da4/d58/f11b to d9/df/d16/f134 0 2024-04-23T10:21:45.727 INFO:tasks.workunit.client.0.smithi029.stdout:6/937: symlink d9/df/d16/d1f/d27/d33/da4/d58/l135 0 2024-04-23T10:21:45.729 INFO:tasks.workunit.client.0.smithi029.stdout:6/938: truncate d9/df/d16/d1f/d27/d33/f53 4837639 0 2024-04-23T10:21:45.731 INFO:tasks.workunit.client.0.smithi029.stdout:6/939: truncate d9/d10f/f133 262522 0 2024-04-23T10:21:45.732 INFO:tasks.workunit.client.0.smithi029.stdout:6/940: rmdir d9 39 2024-04-23T10:21:45.733 INFO:tasks.workunit.client.0.smithi029.stdout:8/904: dread d3/d50/dac/de1/de3/f8a [0,4194304] 0 2024-04-23T10:21:45.736 INFO:tasks.workunit.client.0.smithi029.stdout:6/941: symlink d9/df/d16/d1f/d27/d33/da4/d58/d7e/l136 0 2024-04-23T10:21:45.737 INFO:tasks.workunit.client.0.smithi029.stdout:6/942: stat d9/df/d16/d34/d36/d63/cfa 0 2024-04-23T10:21:45.740 INFO:tasks.workunit.client.0.smithi029.stdout:8/905: dwrite d3/f9c [0,4194304] 0 2024-04-23T10:21:45.742 INFO:tasks.workunit.client.0.smithi029.stdout:8/906: write d3/d44/db1/f10f [4171469,67361] 0 2024-04-23T10:21:45.742 INFO:tasks.workunit.client.0.smithi029.stdout:6/943: unlink d9/df/d41/d49/fb3 0 2024-04-23T10:21:45.744 INFO:tasks.workunit.client.0.smithi029.stdout:6/944: fdatasync d9/df/d16/d34/d36/d63/fce 0 2024-04-23T10:21:45.750 INFO:tasks.workunit.client.0.smithi029.stdout:6/945: creat d9/f137 x:0 0 0 2024-04-23T10:21:45.760 INFO:tasks.workunit.client.0.smithi029.stdout:6/946: dwrite d9/df/d16/d1f/d27/fa6 [0,4194304] 0 2024-04-23T10:21:45.762 INFO:tasks.workunit.client.0.smithi029.stdout:8/907: dwrite d3/f1e [0,4194304] 0 2024-04-23T10:21:45.875 INFO:tasks.workunit.client.0.smithi029.stdout:7/883: sync 2024-04-23T10:21:45.917 INFO:tasks.workunit.client.0.smithi029.stdout:7/884: dread d5/d29/dc9/f115 [4194304,4194304] 0 2024-04-23T10:21:45.918 INFO:tasks.workunit.client.0.smithi029.stdout:7/885: readlink d5/d29/d4a/l103 0 2024-04-23T10:21:45.920 INFO:tasks.workunit.client.0.smithi029.stdout:6/947: creat d9/df/d16/d1f/d2c/f138 x:0 0 0 2024-04-23T10:21:45.924 INFO:tasks.workunit.client.0.smithi029.stdout:8/908: rename d3/d71/d96/f9f to d3/d50/dac/de1/d120/d95/d11e/f125 0 2024-04-23T10:21:45.928 INFO:tasks.workunit.client.0.smithi029.stdout:6/948: dread - d9/df/d16/d1f/d27/d33/da4/d58/ffb zero size 2024-04-23T10:21:45.941 INFO:tasks.workunit.client.0.smithi029.stdout:8/909: read d3/d7d/fec [2940084,126724] 0 2024-04-23T10:21:45.943 INFO:tasks.workunit.client.0.smithi029.stdout:8/910: write d3/f9c [283042,58297] 0 2024-04-23T10:21:45.956 INFO:tasks.workunit.client.0.smithi029.stdout:8/911: rmdir d3/d50/dac/de1/d120/d95/d36/d3e/dce/da4 39 2024-04-23T10:21:45.974 INFO:tasks.workunit.client.0.smithi029.stdout:7/886: write d5/d8/d51/d9e/f107 [954510,49626] 0 2024-04-23T10:21:45.981 INFO:tasks.workunit.client.0.smithi029.stdout:6/949: dwrite d9/f92 [0,4194304] 0 2024-04-23T10:21:45.982 INFO:tasks.workunit.client.0.smithi029.stdout:8/912: dwrite d3/d71/fb4 [4194304,4194304] 0 2024-04-23T10:21:45.993 INFO:tasks.workunit.client.0.smithi029.stdout:8/913: mkdir d3/d50/dac/de1/d120/d95/d11e/d126 0 2024-04-23T10:21:46.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/914: truncate d3/d50/dac/de1/de3/ff2 96070 0 2024-04-23T10:21:46.023 INFO:tasks.workunit.client.0.smithi029.stdout:6/950: dwrite d9/df/d16/d1f/d27/d33/da4/d66/fe5 [0,4194304] 0 2024-04-23T10:21:46.035 INFO:tasks.workunit.client.0.smithi029.stdout:7/887: dread d5/d29/ded/d9c/fab [0,4194304] 0 2024-04-23T10:21:46.036 INFO:tasks.workunit.client.0.smithi029.stdout:8/915: dread d3/d7d/fc8 [0,4194304] 0 2024-04-23T10:21:46.036 INFO:tasks.workunit.client.0.smithi029.stdout:6/951: creat d9/df/d16/d34/d116/f139 x:0 0 0 2024-04-23T10:21:46.037 INFO:tasks.workunit.client.0.smithi029.stdout:7/888: stat d5/d8/d51/d9e/cae 0 2024-04-23T10:21:46.050 INFO:tasks.workunit.client.0.smithi029.stdout:8/916: creat d3/d44/db1/f127 x:0 0 0 2024-04-23T10:21:46.051 INFO:tasks.workunit.client.0.smithi029.stdout:6/952: symlink d9/df/d16/d44/d112/d122/l13a 0 2024-04-23T10:21:46.054 INFO:tasks.workunit.client.0.smithi029.stdout:8/917: truncate d3/d50/dac/de1/d120/f102 240497 0 2024-04-23T10:21:46.059 INFO:tasks.workunit.client.0.smithi029.stdout:6/953: dread d9/df/d16/d34/d84/ff8 [0,4194304] 0 2024-04-23T10:21:46.063 INFO:tasks.workunit.client.0.smithi029.stdout:6/954: chown d9/df/d16/f46 187431901 1 2024-04-23T10:21:46.065 INFO:tasks.workunit.client.0.smithi029.stdout:6/955: write d9/df/d16/f2e [3751272,39390] 0 2024-04-23T10:21:46.068 INFO:tasks.workunit.client.0.smithi029.stdout:7/889: dwrite d5/d29/ded/d8e/fa4 [0,4194304] 0 2024-04-23T10:21:46.075 INFO:tasks.workunit.client.0.smithi029.stdout:7/890: symlink d5/d71/d92/l120 0 2024-04-23T10:21:46.080 INFO:tasks.workunit.client.0.smithi029.stdout:6/956: mkdir d9/df/d16/d1f/d27/d33/da4/dd8/d13b 0 2024-04-23T10:21:46.082 INFO:tasks.workunit.client.0.smithi029.stdout:6/957: fsync d9/f82 0 2024-04-23T10:21:46.084 INFO:tasks.workunit.client.0.smithi029.stdout:6/958: write d9/f92 [4444982,84755] 0 2024-04-23T10:21:46.086 INFO:tasks.workunit.client.0.smithi029.stdout:6/959: fsync d9/df/d16/f111 0 2024-04-23T10:21:46.104 INFO:tasks.workunit.client.0.smithi029.stdout:6/960: dwrite d9/df/d16/d1f/d27/d33/da4/d58/fab [0,4194304] 0 2024-04-23T10:21:46.108 INFO:tasks.workunit.client.0.smithi029.stdout:7/891: dread d5/d8/f25 [0,4194304] 0 2024-04-23T10:21:46.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/892: readlink d5/d8/l15 0 2024-04-23T10:21:46.114 INFO:tasks.workunit.client.0.smithi029.stdout:7/893: mkdir d5/d71/d121 0 2024-04-23T10:21:46.120 INFO:tasks.workunit.client.0.smithi029.stdout:6/961: dwrite d9/df/d16/d1f/d27/d33/f53 [0,4194304] 0 2024-04-23T10:21:46.121 INFO:tasks.workunit.client.0.smithi029.stdout:6/962: readlink d9/df/d16/d1f/d2c/l50 0 2024-04-23T10:21:46.129 INFO:tasks.workunit.client.0.smithi029.stdout:6/963: getdents d9/df/d16/d1f/d2c 0 2024-04-23T10:21:46.135 INFO:tasks.workunit.client.0.smithi029.stdout:7/894: dwrite d5/d29/d4a/fd1 [0,4194304] 0 2024-04-23T10:21:46.142 INFO:tasks.workunit.client.0.smithi029.stdout:7/895: getdents d5/d29 0 2024-04-23T10:21:46.143 INFO:tasks.workunit.client.0.smithi029.stdout:6/964: write d9/df/d16/d34/d84/fb4 [638146,28731] 0 2024-04-23T10:21:46.147 INFO:tasks.workunit.client.0.smithi029.stdout:7/896: fsync d5/f63 0 2024-04-23T10:21:46.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/965: mknod d9/df/d16/d1f/d27/dad/dbd/c13c 0 2024-04-23T10:21:46.154 INFO:tasks.workunit.client.0.smithi029.stdout:7/897: dread - d5/d71/d114/d59/fb5 zero size 2024-04-23T10:21:46.156 INFO:tasks.workunit.client.0.smithi029.stdout:7/898: fdatasync d5/d71/d114/d59/fb5 0 2024-04-23T10:21:46.157 INFO:tasks.workunit.client.0.smithi029.stdout:6/966: symlink d9/df/d16/d1f/d27/d33/da4/d58/d7e/l13d 0 2024-04-23T10:21:46.159 INFO:tasks.workunit.client.0.smithi029.stdout:6/967: stat d9/df/d41/f6c 0 2024-04-23T10:21:46.162 INFO:tasks.workunit.client.0.smithi029.stdout:6/968: creat d9/df/d16/d1f/d2c/f13e x:0 0 0 2024-04-23T10:21:46.163 INFO:tasks.workunit.client.0.smithi029.stdout:7/899: write d5/d71/d114/d59/f61 [1249395,7467] 0 2024-04-23T10:21:46.164 INFO:tasks.workunit.client.0.smithi029.stdout:6/969: chown d9/df/d16/d1f/d27/c48 356623 1 2024-04-23T10:21:46.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/970: write d9/df/d16/d1f/d27/d33/da4/d66/d95/f98 [4013208,112536] 0 2024-04-23T10:21:46.176 INFO:tasks.workunit.client.0.smithi029.stdout:6/971: mknod d9/df/d16/d44/d75/d90/d107/c13f 0 2024-04-23T10:21:46.178 INFO:tasks.workunit.client.0.smithi029.stdout:7/900: dwrite d5/d71/d114/d59/f73 [4194304,4194304] 0 2024-04-23T10:21:46.181 INFO:tasks.workunit.client.0.smithi029.stdout:7/901: fsync d5/d71/d92/db7/dc3/dcc/feb 0 2024-04-23T10:21:46.186 INFO:tasks.workunit.client.0.smithi029.stdout:7/902: mknod d5/d29/d4a/c122 0 2024-04-23T10:21:46.188 INFO:tasks.workunit.client.0.smithi029.stdout:6/972: dwrite d9/d10f/f133 [0,4194304] 0 2024-04-23T10:21:46.191 INFO:tasks.workunit.client.0.smithi029.stdout:7/903: dread - d5/d29/ded/d8e/fe0 zero size 2024-04-23T10:21:46.193 INFO:tasks.workunit.client.0.smithi029.stdout:6/973: dread - d9/df/d41/f83 zero size 2024-04-23T10:21:46.194 INFO:tasks.workunit.client.0.smithi029.stdout:7/904: fdatasync d5/d71/d92/fe6 0 2024-04-23T10:21:46.196 INFO:tasks.workunit.client.0.smithi029.stdout:6/974: mkdir d9/df/d41/d49/d69/d140 0 2024-04-23T10:21:46.203 INFO:tasks.workunit.client.0.smithi029.stdout:6/975: unlink d9/df/d16/d1f/d2c/l50 0 2024-04-23T10:21:46.209 INFO:tasks.workunit.client.0.smithi029.stdout:7/905: dwrite d5/d29/ded/d4d/f64 [4194304,4194304] 0 2024-04-23T10:21:46.212 INFO:tasks.workunit.client.0.smithi029.stdout:5/908: sync 2024-04-23T10:21:46.212 INFO:tasks.workunit.client.0.smithi029.stdout:2/746: sync 2024-04-23T10:21:46.216 INFO:tasks.workunit.client.0.smithi029.stdout:7/906: chown d5/d8/c11 86 1 2024-04-23T10:21:46.217 INFO:tasks.workunit.client.0.smithi029.stdout:7/907: chown d5/d71/df5/d10c 12 1 2024-04-23T10:21:46.219 INFO:tasks.workunit.client.0.smithi029.stdout:2/747: truncate d1/d3e/f66 4521536 0 2024-04-23T10:21:46.231 INFO:tasks.workunit.client.0.smithi029.stdout:5/909: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/ddd/f124 x:0 0 0 2024-04-23T10:21:46.238 INFO:tasks.workunit.client.0.smithi029.stdout:6/976: dwrite d9/df/d16/d1f/d27/f70 [0,4194304] 0 2024-04-23T10:21:46.240 INFO:tasks.workunit.client.0.smithi029.stdout:7/908: dwrite d5/d71/f72 [0,4194304] 0 2024-04-23T10:21:46.240 INFO:tasks.workunit.client.0.smithi029.stdout:2/748: dread d1/dd/f51 [0,4194304] 0 2024-04-23T10:21:46.243 INFO:tasks.workunit.client.0.smithi029.stdout:7/909: fsync d5/d8/d51/f8c 0 2024-04-23T10:21:46.247 INFO:tasks.workunit.client.0.smithi029.stdout:6/977: read d9/df/d16/f7d [1106034,107537] 0 2024-04-23T10:21:46.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/910: readlink d5/d29/ded/lb4 0 2024-04-23T10:21:46.251 INFO:tasks.workunit.client.0.smithi029.stdout:5/910: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/dcb/d125 0 2024-04-23T10:21:46.252 INFO:tasks.workunit.client.0.smithi029.stdout:5/911: dread - d0/d6a/dd7/f107 zero size 2024-04-23T10:21:46.255 INFO:tasks.workunit.client.0.smithi029.stdout:2/749: rename d1/d3e/cad to d1/d4/db7/db8/dde/cfa 0 2024-04-23T10:21:46.256 INFO:tasks.workunit.client.0.smithi029.stdout:6/978: dread d9/df/d16/d1f/d27/d33/da4/d58/fab [0,4194304] 0 2024-04-23T10:21:46.257 INFO:tasks.workunit.client.0.smithi029.stdout:5/912: mkdir d0/d9a/d126 0 2024-04-23T10:21:46.258 INFO:tasks.workunit.client.0.smithi029.stdout:2/750: mknod d1/dda/cfb 0 2024-04-23T10:21:46.267 INFO:tasks.workunit.client.0.smithi029.stdout:7/911: rename d5/d29/ded/d4d/ddb/f11b to d5/d71/df5/d10c/f123 0 2024-04-23T10:21:46.274 INFO:tasks.workunit.client.0.smithi029.stdout:2/751: mknod d1/dd/d60/cfc 0 2024-04-23T10:21:46.276 INFO:tasks.workunit.client.0.smithi029.stdout:6/979: dwrite d9/df/d16/d1f/d27/d33/da4/d58/f105 [0,4194304] 0 2024-04-23T10:21:46.284 INFO:tasks.workunit.client.0.smithi029.stdout:7/912: dread d5/d8/d51/f7f [0,4194304] 0 2024-04-23T10:21:46.286 INFO:tasks.workunit.client.0.smithi029.stdout:2/752: stat d1/d31/d3d/l40 0 2024-04-23T10:21:46.286 INFO:tasks.workunit.client.0.smithi029.stdout:6/980: dwrite d9/df/d16/d1f/d27/d33/da4/d66/d95/f98 [0,4194304] 0 2024-04-23T10:21:46.291 INFO:tasks.workunit.client.0.smithi029.stdout:7/913: mknod d5/d71/df5/d10c/c124 0 2024-04-23T10:21:46.292 INFO:tasks.workunit.client.0.smithi029.stdout:5/913: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/d3f/f55 [0,4194304] 0 2024-04-23T10:21:46.294 INFO:tasks.workunit.client.0.smithi029.stdout:2/753: readlink d1/d31/d3d/lef 0 2024-04-23T10:21:46.299 INFO:tasks.workunit.client.0.smithi029.stdout:7/914: unlink d5/d8/d51/d9e/db2/fec 0 2024-04-23T10:21:46.300 INFO:tasks.workunit.client.0.smithi029.stdout:2/754: fdatasync d1/dd/d47/f53 0 2024-04-23T10:21:46.300 INFO:tasks.workunit.client.0.smithi029.stdout:6/981: write d9/df/d41/f83 [815067,95638] 0 2024-04-23T10:21:46.304 INFO:tasks.workunit.client.0.smithi029.stdout:5/914: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/c127 0 2024-04-23T10:21:46.308 INFO:tasks.workunit.client.0.smithi029.stdout:5/915: chown d0/d35/d38/d3e/d66/d5a/f77 8158 1 2024-04-23T10:21:46.309 INFO:tasks.workunit.client.0.smithi029.stdout:5/916: truncate d0/d6a/dd7/f107 651835 0 2024-04-23T10:21:46.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/917: fsync d0/d35/d38/d3e/f4e 0 2024-04-23T10:21:46.311 INFO:tasks.workunit.client.0.smithi029.stdout:6/982: symlink d9/df/d16/d44/d75/d90/d107/d11e/l141 0 2024-04-23T10:21:46.312 INFO:tasks.workunit.client.0.smithi029.stdout:2/755: creat d1/dd/ffd x:0 0 0 2024-04-23T10:21:46.315 INFO:tasks.workunit.client.0.smithi029.stdout:5/918: unlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/l115 0 2024-04-23T10:21:46.316 INFO:tasks.workunit.client.0.smithi029.stdout:6/983: readlink d9/df/d16/d1f/l37 0 2024-04-23T10:21:46.320 INFO:tasks.workunit.client.0.smithi029.stdout:5/919: creat d0/d35/d38/db3/dcf/f128 x:0 0 0 2024-04-23T10:21:46.322 INFO:tasks.workunit.client.0.smithi029.stdout:6/984: fdatasync d9/df/d16/d34/d36/d63/f68 0 2024-04-23T10:21:46.324 INFO:tasks.workunit.client.0.smithi029.stdout:5/920: rmdir d0/d6a 39 2024-04-23T10:21:46.329 INFO:tasks.workunit.client.0.smithi029.stdout:2/756: write d1/d3e/d3b/d75/f85 [254648,128965] 0 2024-04-23T10:21:46.331 INFO:tasks.workunit.client.0.smithi029.stdout:5/921: symlink d0/d35/l129 0 2024-04-23T10:21:46.333 INFO:tasks.workunit.client.0.smithi029.stdout:6/985: symlink d9/df/d16/d1f/d27/d33/da4/d58/l142 0 2024-04-23T10:21:46.335 INFO:tasks.workunit.client.0.smithi029.stdout:2/757: readlink d1/dd/l3c 0 2024-04-23T10:21:46.340 INFO:tasks.workunit.client.0.smithi029.stdout:6/986: mkdir d9/df/d16/d44/d112/d143 0 2024-04-23T10:21:46.344 INFO:tasks.workunit.client.0.smithi029.stdout:6/987: dread d9/fe [0,4194304] 0 2024-04-23T10:21:46.345 INFO:tasks.workunit.client.0.smithi029.stdout:6/988: chown d9/df/d16/d34/d36/d63/fce 1502863 1 2024-04-23T10:21:46.347 INFO:tasks.workunit.client.0.smithi029.stdout:2/758: mkdir d1/d4/db7/db8/dde/dfe 0 2024-04-23T10:21:46.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/759: rmdir d1/dd 39 2024-04-23T10:21:46.353 INFO:tasks.workunit.client.0.smithi029.stdout:5/922: rmdir d0/d35/d83/d10e 0 2024-04-23T10:21:46.357 INFO:tasks.workunit.client.0.smithi029.stdout:2/760: rename d1/d3e/d3b/d75/dd1/ff4 to d1/dd/d47/d63/d64/d78/fff 0 2024-04-23T10:21:46.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/761: dread - d1/d4/db7/ff8 zero size 2024-04-23T10:21:46.359 INFO:tasks.workunit.client.0.smithi029.stdout:5/923: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/d12a 0 2024-04-23T10:21:46.359 INFO:tasks.workunit.client.0.smithi029.stdout:6/989: dread d9/df/d16/d1f/fae [0,4194304] 0 2024-04-23T10:21:46.362 INFO:tasks.workunit.client.0.smithi029.stdout:6/990: read d9/f82 [519034,14014] 0 2024-04-23T10:21:46.364 INFO:tasks.workunit.client.0.smithi029.stdout:2/762: link d1/dd/d47/d63/cdb d1/d4/db7/deb/c100 0 2024-04-23T10:21:46.365 INFO:tasks.workunit.client.0.smithi029.stdout:5/924: symlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/dcb/l12b 0 2024-04-23T10:21:46.366 INFO:tasks.workunit.client.0.smithi029.stdout:6/991: mknod d9/df/d16/d44/c144 0 2024-04-23T10:21:46.367 INFO:tasks.workunit.client.0.smithi029.stdout:2/763: symlink d1/d4/db7/db8/l101 0 2024-04-23T10:21:46.369 INFO:tasks.workunit.client.0.smithi029.stdout:5/925: symlink d0/d35/d38/d3e/d66/l12c 0 2024-04-23T10:21:46.369 INFO:tasks.workunit.client.0.smithi029.stdout:2/764: chown d1/dd/d47/d63/d64/d78 0 1 2024-04-23T10:21:46.369 INFO:tasks.workunit.client.0.smithi029.stdout:5/926: chown d0/d6a/fce 1 1 2024-04-23T10:21:46.372 INFO:tasks.workunit.client.0.smithi029.stdout:6/992: link d9/df/d16/d1f/d27/dad/dbd/c13c d9/df/d16/d44/d112/d122/c145 0 2024-04-23T10:21:46.374 INFO:tasks.workunit.client.0.smithi029.stdout:5/927: symlink d0/d35/d38/d3e/d66/d5a/l12d 0 2024-04-23T10:21:46.378 INFO:tasks.workunit.client.0.smithi029.stdout:6/993: truncate d9/df/d16/d44/d75/f85 1340426 0 2024-04-23T10:21:46.382 INFO:tasks.workunit.client.0.smithi029.stdout:6/994: creat d9/df/d16/d34/d36/f146 x:0 0 0 2024-04-23T10:21:46.390 INFO:tasks.workunit.client.0.smithi029.stdout:5/928: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/dca/fa9 [0,4194304] 0 2024-04-23T10:21:46.390 INFO:tasks.workunit.client.0.smithi029.stdout:2/765: dwrite d1/d3e/d3b/f7d [0,4194304] 0 2024-04-23T10:21:46.394 INFO:tasks.workunit.client.0.smithi029.stdout:6/995: truncate d9/df/d16/d128/dd9/df6/fc2 2246637 0 2024-04-23T10:21:46.399 INFO:tasks.workunit.client.0.smithi029.stdout:5/929: getdents d0/d9a/dc8 0 2024-04-23T10:21:46.400 INFO:tasks.workunit.client.0.smithi029.stdout:6/996: creat d9/df/d16/d1f/d27/d33/da4/d66/d95/da7/f147 x:0 0 0 2024-04-23T10:21:46.401 INFO:tasks.workunit.client.0.smithi029.stdout:5/930: chown d0/d6a/dd7/f123 81135 1 2024-04-23T10:21:46.406 INFO:tasks.workunit.client.0.smithi029.stdout:2/766: dwrite d1/d3e/d3b/d75/fdd [0,4194304] 0 2024-04-23T10:21:46.407 INFO:tasks.workunit.client.0.smithi029.stdout:5/931: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d100/c12e 0 2024-04-23T10:21:46.407 INFO:tasks.workunit.client.0.smithi029.stdout:2/767: fsync d1/fd4 0 2024-04-23T10:21:46.408 INFO:tasks.workunit.client.0.smithi029.stdout:6/997: rename f4 to d9/df/d16/d1f/d27/dad/dbd/f148 0 2024-04-23T10:21:46.410 INFO:tasks.workunit.client.0.smithi029.stdout:5/932: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d100/c12e 155607114 1 2024-04-23T10:21:46.412 INFO:tasks.workunit.client.0.smithi029.stdout:5/933: write d0/ffc [787739,16822] 0 2024-04-23T10:21:46.413 INFO:tasks.workunit.client.0.smithi029.stdout:2/768: symlink d1/d4/db7/db8/dde/l102 0 2024-04-23T10:21:46.413 INFO:tasks.workunit.client.0.smithi029.stdout:6/998: mknod d9/df/d16/d34/c149 0 2024-04-23T10:21:46.420 INFO:tasks.workunit.client.0.smithi029.stdout:2/769: creat d1/dd5/f103 x:0 0 0 2024-04-23T10:21:46.425 INFO:tasks.workunit.client.0.smithi029.stdout:6/999: dread d9/d10f/f133 [0,4194304] 0 2024-04-23T10:21:46.426 INFO:tasks.workunit.client.0.smithi029.stdout:5/934: symlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/d3f/l12f 0 2024-04-23T10:21:46.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/935: creat d0/d35/d10/d26/f130 x:0 0 0 2024-04-23T10:21:46.433 INFO:tasks.workunit.client.0.smithi029.stdout:5/936: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d100 1482598008 1 2024-04-23T10:21:46.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/770: dread d1/dd/d47/f53 [0,4194304] 0 2024-04-23T10:21:46.439 INFO:tasks.workunit.client.0.smithi029.stdout:2/771: write d1/d3e/d5a/d6d/fa1 [949475,111995] 0 2024-04-23T10:21:46.439 INFO:tasks.workunit.client.0.smithi029.stdout:1/721: sync 2024-04-23T10:21:46.440 INFO:tasks.workunit.client.0.smithi029.stdout:2/772: write d1/dd/d47/d63/d64/f80 [535040,1132] 0 2024-04-23T10:21:46.443 INFO:tasks.workunit.client.0.smithi029.stdout:2/773: creat d1/dda/f104 x:0 0 0 2024-04-23T10:21:46.444 INFO:tasks.workunit.client.0.smithi029.stdout:2/774: read - d1/dd/d22/ff9 zero size 2024-04-23T10:21:46.446 INFO:tasks.workunit.client.0.smithi029.stdout:2/775: write d1/dd/d47/d63/d64/f80 [2596848,77695] 0 2024-04-23T10:21:46.447 INFO:tasks.workunit.client.0.smithi029.stdout:2/776: chown d1/dd/d47/d63/cd6 4 1 2024-04-23T10:21:46.449 INFO:tasks.workunit.client.0.smithi029.stdout:1/722: dread d5/d6/de/d22/d84/dc4/f44 [0,4194304] 0 2024-04-23T10:21:46.450 INFO:tasks.workunit.client.0.smithi029.stdout:2/777: symlink d1/dda/l105 0 2024-04-23T10:21:46.454 INFO:tasks.workunit.client.0.smithi029.stdout:1/723: creat d5/d6/de/d22/d84/dc4/fe0 x:0 0 0 2024-04-23T10:21:46.455 INFO:tasks.workunit.client.0.smithi029.stdout:1/724: write d5/d6/de/d22/d84/dc4/d47/fac [3498159,103050] 0 2024-04-23T10:21:46.458 INFO:tasks.workunit.client.0.smithi029.stdout:1/725: truncate d5/d6/de/d22/f2f 1769720 0 2024-04-23T10:21:46.463 INFO:tasks.workunit.client.0.smithi029.stdout:1/726: creat d5/d6/de/d22/d77/fe1 x:0 0 0 2024-04-23T10:21:46.464 INFO:tasks.workunit.client.0.smithi029.stdout:2/778: write d1/dd/d47/d63/d64/fcc [782827,115963] 0 2024-04-23T10:21:46.464 INFO:tasks.workunit.client.0.smithi029.stdout:2/779: chown d1/d4/db7/deb 475593906 1 2024-04-23T10:21:46.468 INFO:tasks.workunit.client.0.smithi029.stdout:2/780: getdents d1/d31/d50 0 2024-04-23T10:21:46.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/781: dread - d1/d31/d3d/fe9 zero size 2024-04-23T10:21:46.473 INFO:tasks.workunit.client.0.smithi029.stdout:2/782: read d1/dd/d22/f2c [3203366,14043] 0 2024-04-23T10:21:46.475 INFO:tasks.workunit.client.0.smithi029.stdout:2/783: fsync d1/dd/f51 0 2024-04-23T10:21:46.478 INFO:tasks.workunit.client.0.smithi029.stdout:2/784: symlink d1/d4/db7/db8/l106 0 2024-04-23T10:21:46.482 INFO:tasks.workunit.client.0.smithi029.stdout:2/785: mkdir d1/d3e/d107 0 2024-04-23T10:21:46.484 INFO:tasks.workunit.client.0.smithi029.stdout:1/727: dread d5/d6/f16 [0,4194304] 0 2024-04-23T10:21:46.488 INFO:tasks.workunit.client.0.smithi029.stdout:2/786: rename d1/d3e/f66 to d1/d31/d50/d9b/f108 0 2024-04-23T10:21:46.489 INFO:tasks.workunit.client.0.smithi029.stdout:1/728: rmdir d5/d8c/dd5 0 2024-04-23T10:21:46.490 INFO:tasks.workunit.client.0.smithi029.stdout:2/787: fdatasync d1/dda/ff0 0 2024-04-23T10:21:46.495 INFO:tasks.workunit.client.0.smithi029.stdout:2/788: write d1/dda/ff0 [968088,119337] 0 2024-04-23T10:21:46.496 INFO:tasks.workunit.client.0.smithi029.stdout:2/789: write d1/dd/d47/f53 [3418268,54385] 0 2024-04-23T10:21:46.497 INFO:tasks.workunit.client.0.smithi029.stdout:2/790: chown d1/dd/d60 6164 1 2024-04-23T10:21:46.502 INFO:tasks.workunit.client.0.smithi029.stdout:2/791: mknod d1/d4/db7/db8/dd8/c109 0 2024-04-23T10:21:46.505 INFO:tasks.workunit.client.0.smithi029.stdout:2/792: dread d1/fd4 [0,4194304] 0 2024-04-23T10:21:46.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/793: chown d1/dda 2100781 1 2024-04-23T10:21:46.507 INFO:tasks.workunit.client.0.smithi029.stdout:1/729: dread d5/d3e/da7/fb2 [0,4194304] 0 2024-04-23T10:21:46.508 INFO:tasks.workunit.client.0.smithi029.stdout:2/794: truncate d1/d3e/d5a/d6d/fbe 4720260 0 2024-04-23T10:21:46.519 INFO:tasks.workunit.client.0.smithi029.stdout:1/730: dwrite d5/d6/de/d22/d84/dc4/fc7 [0,4194304] 0 2024-04-23T10:21:46.519 INFO:tasks.workunit.client.0.smithi029.stdout:2/795: dwrite d1/dd/f51 [0,4194304] 0 2024-04-23T10:21:46.524 INFO:tasks.workunit.client.0.smithi029.stdout:2/796: dread d1/d3e/d3b/d75/fdd [0,4194304] 0 2024-04-23T10:21:46.538 INFO:tasks.workunit.client.0.smithi029.stdout:2/797: write d1/dd/f1d [121050,84236] 0 2024-04-23T10:21:46.552 INFO:tasks.workunit.client.0.smithi029.stdout:1/731: dread d5/d6/de/d27/f99 [0,4194304] 0 2024-04-23T10:21:46.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/798: truncate d1/dd/d47/d63/d64/f6b 5636785 0 2024-04-23T10:21:46.557 INFO:tasks.workunit.client.0.smithi029.stdout:1/732: mkdir d5/d6/d34/d8a/de2 0 2024-04-23T10:21:46.559 INFO:tasks.workunit.client.0.smithi029.stdout:2/799: stat d1/dd/d22/c30 0 2024-04-23T10:21:46.560 INFO:tasks.workunit.client.0.smithi029.stdout:2/800: dread - d1/fe6 zero size 2024-04-23T10:21:46.561 INFO:tasks.workunit.client.0.smithi029.stdout:1/733: creat d5/d6/de/d22/d84/dc4/d47/db0/fe3 x:0 0 0 2024-04-23T10:21:46.576 INFO:tasks.workunit.client.0.smithi029.stdout:2/801: dread d1/dd/d22/f54 [0,4194304] 0 2024-04-23T10:21:46.581 INFO:tasks.workunit.client.0.smithi029.stdout:2/802: mknod d1/dd/d47/d63/d64/ded/c10a 0 2024-04-23T10:21:46.582 INFO:tasks.workunit.client.0.smithi029.stdout:2/803: write d1/dd/d60/ff5 [277025,8053] 0 2024-04-23T10:21:46.589 INFO:tasks.workunit.client.0.smithi029.stdout:1/734: rename d5/d6/de/d22/d77/faf to d5/d6/de/d22/fe4 0 2024-04-23T10:21:46.592 INFO:tasks.workunit.client.0.smithi029.stdout:2/804: getdents d1/d31/d50/d9b 0 2024-04-23T10:21:46.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/805: write d1/d3e/d3b/f52 [188760,89741] 0 2024-04-23T10:21:46.605 INFO:tasks.workunit.client.0.smithi029.stdout:1/735: getdents d5/d6/de/d22/d6c 0 2024-04-23T10:21:46.609 INFO:tasks.workunit.client.0.smithi029.stdout:2/806: creat d1/dd/d60/dd7/f10b x:0 0 0 2024-04-23T10:21:46.611 INFO:tasks.workunit.client.0.smithi029.stdout:1/736: creat d5/d3e/dda/fe5 x:0 0 0 2024-04-23T10:21:46.615 INFO:tasks.workunit.client.0.smithi029.stdout:1/737: getdents d5/d6/de/d22/d6c 0 2024-04-23T10:21:46.618 INFO:tasks.workunit.client.0.smithi029.stdout:2/807: mkdir d1/dd/d47/d63/d64/d78/da6/dcf/d10c 0 2024-04-23T10:21:46.622 INFO:tasks.workunit.client.0.smithi029.stdout:2/808: mkdir d1/dd/d47/d63/d64/ded/d10d 0 2024-04-23T10:21:46.625 INFO:tasks.workunit.client.0.smithi029.stdout:1/738: write d5/d6/d34/d8a/fc0 [992905,1699] 0 2024-04-23T10:21:46.628 INFO:tasks.workunit.client.0.smithi029.stdout:1/739: dread - d5/d6/d34/d63/fa2 zero size 2024-04-23T10:21:46.631 INFO:tasks.workunit.client.0.smithi029.stdout:2/809: mknod d1/dd/d47/d63/d64/c10e 0 2024-04-23T10:21:46.638 INFO:tasks.workunit.client.0.smithi029.stdout:1/740: write d5/d6/d34/d63/f7d [918321,113007] 0 2024-04-23T10:21:46.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/810: creat d1/d31/d50/d9b/d9e/f10f x:0 0 0 2024-04-23T10:21:46.645 INFO:tasks.workunit.client.0.smithi029.stdout:1/741: symlink d5/d6/de/d27/da9/dad/dc9/le6 0 2024-04-23T10:21:46.649 INFO:tasks.workunit.client.0.smithi029.stdout:1/742: dread d5/d6/f16 [0,4194304] 0 2024-04-23T10:21:46.657 INFO:tasks.workunit.client.0.smithi029.stdout:2/811: mkdir d1/d110 0 2024-04-23T10:21:46.661 INFO:tasks.workunit.client.0.smithi029.stdout:2/812: fdatasync d1/dd/d60/fc9 0 2024-04-23T10:21:46.662 INFO:tasks.workunit.client.0.smithi029.stdout:2/813: fdatasync d1/dd/d47/f53 0 2024-04-23T10:21:46.665 INFO:tasks.workunit.client.0.smithi029.stdout:1/743: dwrite d5/d6/f61 [0,4194304] 0 2024-04-23T10:21:46.669 INFO:tasks.workunit.client.0.smithi029.stdout:1/744: mknod d5/d6/de/d22/ce7 0 2024-04-23T10:21:46.676 INFO:tasks.workunit.client.0.smithi029.stdout:2/814: dwrite d1/d3e/d3b/d75/f7a [0,4194304] 0 2024-04-23T10:21:46.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/815: write d1/d3e/d5a/f6e [1980678,100901] 0 2024-04-23T10:21:46.694 INFO:tasks.workunit.client.0.smithi029.stdout:2/816: read d1/d3e/d5a/f93 [4165742,109253] 0 2024-04-23T10:21:46.715 INFO:tasks.workunit.client.0.smithi029.stdout:0/731: sync 2024-04-23T10:21:46.723 INFO:tasks.workunit.client.0.smithi029.stdout:0/732: write d0/da9/f70 [2894213,99300] 0 2024-04-23T10:21:46.727 INFO:tasks.workunit.client.0.smithi029.stdout:1/745: getdents d5/d6/de/d22/d84/dc4/d6a 0 2024-04-23T10:21:46.728 INFO:tasks.workunit.client.0.smithi029.stdout:1/746: write d5/f66 [987816,121244] 0 2024-04-23T10:21:46.734 INFO:tasks.workunit.client.0.smithi029.stdout:0/733: creat d0/d1b/d67/dae/d92/da0/dd3/ff8 x:0 0 0 2024-04-23T10:21:46.737 INFO:tasks.workunit.client.0.smithi029.stdout:1/747: mknod d5/d3e/dda/ce8 0 2024-04-23T10:21:46.745 INFO:tasks.workunit.client.0.smithi029.stdout:0/734: dwrite d0/d1b/d67/dae/d92/da0/dbe/fe1 [0,4194304] 0 2024-04-23T10:21:46.756 INFO:tasks.workunit.client.0.smithi029.stdout:0/735: creat d0/da9/d4c/d6d/ff9 x:0 0 0 2024-04-23T10:21:46.758 INFO:tasks.workunit.client.0.smithi029.stdout:1/748: link d5/d6/f7f d5/d6/de/d27/fe9 0 2024-04-23T10:21:46.769 INFO:tasks.workunit.client.0.smithi029.stdout:0/736: dread d0/d1b/fab [0,4194304] 0 2024-04-23T10:21:46.790 INFO:tasks.workunit.client.0.smithi029.stdout:0/737: dread d0/dc/d26/f41 [0,4194304] 0 2024-04-23T10:21:46.791 INFO:tasks.workunit.client.0.smithi029.stdout:0/738: chown d0/d1b/d67/dae/d92/da0/cb8 336 1 2024-04-23T10:21:46.799 INFO:tasks.workunit.client.0.smithi029.stdout:1/749: symlink d5/d6/d34/lea 0 2024-04-23T10:21:46.799 INFO:tasks.workunit.client.0.smithi029.stdout:0/739: dwrite d0/d3e/ddd/de4/ff5 [0,4194304] 0 2024-04-23T10:21:46.800 INFO:tasks.workunit.client.0.smithi029.stdout:1/750: readlink d5/d6/de/d15/d7b/lb6 0 2024-04-23T10:21:46.813 INFO:tasks.workunit.client.0.smithi029.stdout:1/751: read d5/d6/de/d22/d84/dc4/d47/fa8 [17960,79686] 0 2024-04-23T10:21:46.817 INFO:tasks.workunit.client.0.smithi029.stdout:0/740: rename d0/d1b/cb9 to d0/d1b/d67/d6c/cfa 0 2024-04-23T10:21:46.817 INFO:tasks.workunit.client.0.smithi029.stdout:0/741: stat d0/d21/d7f/f7b 0 2024-04-23T10:21:46.820 INFO:tasks.workunit.client.0.smithi029.stdout:1/752: mknod d5/d6/de/d27/da9/dad/dc9/ceb 0 2024-04-23T10:21:46.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/753: creat d5/fec x:0 0 0 2024-04-23T10:21:46.829 INFO:tasks.workunit.client.0.smithi029.stdout:0/742: getdents d0/d21/d7f/d55 0 2024-04-23T10:21:46.834 INFO:tasks.workunit.client.0.smithi029.stdout:0/743: mknod d0/da9/d4c/da7/dc7/cfb 0 2024-04-23T10:21:46.855 INFO:tasks.workunit.client.0.smithi029.stdout:1/754: dread d5/fbf [0,4194304] 0 2024-04-23T10:21:46.858 INFO:tasks.workunit.client.0.smithi029.stdout:0/744: write d0/d3e/d4e/d7c/ff0 [712506,59150] 0 2024-04-23T10:21:46.864 INFO:tasks.workunit.client.0.smithi029.stdout:0/745: mknod d0/da9/d4c/da7/cfc 0 2024-04-23T10:21:46.910 INFO:tasks.workunit.client.0.smithi029.stdout:1/755: dwrite d5/fd [0,4194304] 0 2024-04-23T10:21:46.969 INFO:tasks.workunit.client.0.smithi029.stdout:1/756: unlink d5/d6/de/d22/f51 0 2024-04-23T10:21:46.977 INFO:tasks.workunit.client.0.smithi029.stdout:4/907: sync 2024-04-23T10:21:46.977 INFO:tasks.workunit.client.0.smithi029.stdout:1/757: rename d5/d6/f61 to d5/d6/de/d22/d84/dc4/d47/db0/fed 0 2024-04-23T10:21:46.979 INFO:tasks.workunit.client.0.smithi029.stdout:4/908: chown d0/d3c/d52/d20/f5e 2 1 2024-04-23T10:21:46.981 INFO:tasks.workunit.client.0.smithi029.stdout:1/758: readlink d5/d6/de/d22/d84/dc4/l4d 0 2024-04-23T10:21:46.986 INFO:tasks.workunit.client.0.smithi029.stdout:4/909: truncate d0/d3c/d52/d20/fc5 398011 0 2024-04-23T10:21:46.994 INFO:tasks.workunit.client.0.smithi029.stdout:1/759: dwrite d5/d6/de/d22/f23 [0,4194304] 0 2024-04-23T10:21:46.998 INFO:tasks.workunit.client.0.smithi029.stdout:4/910: rename d0/d3c/d52/d1b/d9f/d92/dd8/da1/f138 to d0/d3c/d52/d1b/d9f/d92/dd8/d7a/f13e 0 2024-04-23T10:21:47.007 INFO:tasks.workunit.client.0.smithi029.stdout:1/760: link d5/d3e/dda/fe5 d5/d6/de/d15/fee 0 2024-04-23T10:21:47.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/911: dwrite d0/d3c/d52/d1b/d9f/d92/dd8/da1/fab [0,4194304] 0 2024-04-23T10:21:47.013 INFO:tasks.workunit.client.0.smithi029.stdout:1/761: unlink d5/c1d 0 2024-04-23T10:21:47.016 INFO:tasks.workunit.client.0.smithi029.stdout:1/762: fsync d5/d6/de/d15/d7b/f9b 0 2024-04-23T10:21:47.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/763: truncate d5/d6/d34/d8a/fc0 1999693 0 2024-04-23T10:21:47.019 INFO:tasks.workunit.client.0.smithi029.stdout:4/912: creat d0/d3c/d52/d74/d8a/dba/dfe/f13f x:0 0 0 2024-04-23T10:21:47.026 INFO:tasks.workunit.client.0.smithi029.stdout:4/913: truncate d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d/f129 636314 0 2024-04-23T10:21:47.031 INFO:tasks.workunit.client.0.smithi029.stdout:4/914: unlink d0/d3c/d52/d1b/l2f 0 2024-04-23T10:21:47.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/764: dwrite d5/d6/de/d15/f3b [0,4194304] 0 2024-04-23T10:21:47.041 INFO:tasks.workunit.client.0.smithi029.stdout:1/765: creat d5/d6/de/fef x:0 0 0 2024-04-23T10:21:47.043 INFO:tasks.workunit.client.0.smithi029.stdout:1/766: write d5/fd [424840,120288] 0 2024-04-23T10:21:47.061 INFO:tasks.workunit.client.0.smithi029.stdout:4/915: rename d0/d3c/d52/d1b/d36/d45/dd0/l125 to d0/d3c/d52/d1b/d5b/d65/d6a/d11b/l140 0 2024-04-23T10:21:47.069 INFO:tasks.workunit.client.0.smithi029.stdout:1/767: mknod d5/d6/de/d15/cf0 0 2024-04-23T10:21:47.073 INFO:tasks.workunit.client.0.smithi029.stdout:4/916: creat d0/d12/d10b/d134/f141 x:0 0 0 2024-04-23T10:21:47.081 INFO:tasks.workunit.client.0.smithi029.stdout:4/917: creat d0/d3c/d52/d1b/d36/d45/d4f/df2/f142 x:0 0 0 2024-04-23T10:21:47.096 INFO:tasks.workunit.client.0.smithi029.stdout:1/768: creat d5/d6/de/d22/ff1 x:0 0 0 2024-04-23T10:21:47.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/769: link d5/d6/de/d27/da9/dad/dc9/le6 d5/d6/d34/d8a/de2/lf2 0 2024-04-23T10:21:47.112 INFO:tasks.workunit.client.0.smithi029.stdout:1/770: write d5/d6/de/fcb [963974,43137] 0 2024-04-23T10:21:47.113 INFO:tasks.workunit.client.0.smithi029.stdout:1/771: read - d5/d6/de/fef zero size 2024-04-23T10:21:47.123 INFO:tasks.workunit.client.0.smithi029.stdout:1/772: creat d5/d6/de/d15/ff3 x:0 0 0 2024-04-23T10:21:47.124 INFO:tasks.workunit.client.0.smithi029.stdout:4/918: write d0/d3c/d52/d1b/d36/d45/d68/ff4 [75440,64867] 0 2024-04-23T10:21:47.134 INFO:tasks.workunit.client.0.smithi029.stdout:4/919: link d0/d3c/d52/d1b/d36/l37 d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d/l143 0 2024-04-23T10:21:47.143 INFO:tasks.workunit.client.0.smithi029.stdout:1/773: truncate d5/d6/de/d22/d77/f98 847995 0 2024-04-23T10:21:47.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/920: creat d0/d3c/d52/d74/d8a/f144 x:0 0 0 2024-04-23T10:21:47.149 INFO:tasks.workunit.client.0.smithi029.stdout:1/774: creat d5/d6/de/d22/ff4 x:0 0 0 2024-04-23T10:21:47.151 INFO:tasks.workunit.client.0.smithi029.stdout:3/795: sync 2024-04-23T10:21:47.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/775: mkdir d5/d6/de/d27/df5 0 2024-04-23T10:21:47.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/776: dread - d5/d6/de/d15/ff3 zero size 2024-04-23T10:21:47.160 INFO:tasks.workunit.client.0.smithi029.stdout:3/796: readlink d3/d15/d4b/l7d 0 2024-04-23T10:21:47.162 INFO:tasks.workunit.client.0.smithi029.stdout:1/777: stat d5/d6/f21 0 2024-04-23T10:21:47.163 INFO:tasks.workunit.client.0.smithi029.stdout:4/921: write d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7/f105 [614365,2119] 0 2024-04-23T10:21:47.164 INFO:tasks.workunit.client.0.smithi029.stdout:4/922: chown d0/d3c/d52 3 1 2024-04-23T10:21:47.165 INFO:tasks.workunit.client.0.smithi029.stdout:1/778: rmdir d5/d6/de/d27 39 2024-04-23T10:21:47.172 INFO:tasks.workunit.client.0.smithi029.stdout:4/923: getdents d0/d3c/d52/d1b/d36/d45/dd0 0 2024-04-23T10:21:47.178 INFO:tasks.workunit.client.0.smithi029.stdout:4/924: write d0/d3c/d52/d1b/f35 [2351924,30897] 0 2024-04-23T10:21:47.187 INFO:tasks.workunit.client.0.smithi029.stdout:1/779: dread d5/f58 [0,4194304] 0 2024-04-23T10:21:47.188 INFO:tasks.workunit.client.0.smithi029.stdout:4/925: rename d0/d3c/d52/d1b/d66 to d0/d3c/d52/d1b/d5b/d65/d6a/d145 0 2024-04-23T10:21:47.188 INFO:tasks.workunit.client.0.smithi029.stdout:1/780: readlink d5/d6/d34/lea 0 2024-04-23T10:21:47.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/926: truncate d0/fe2 43035 0 2024-04-23T10:21:47.196 INFO:tasks.workunit.client.0.smithi029.stdout:1/781: write d5/d6/f21 [4741179,102303] 0 2024-04-23T10:21:47.196 INFO:tasks.workunit.client.0.smithi029.stdout:4/927: write d0/d3c/d52/d74/d8a/dba/fc4 [642575,40829] 0 2024-04-23T10:21:47.201 INFO:tasks.workunit.client.0.smithi029.stdout:1/782: chown d5/d6/de/d22/d77/f98 2769 1 2024-04-23T10:21:47.211 INFO:tasks.workunit.client.0.smithi029.stdout:4/928: dwrite d0/d3c/d52/d1b/d9f/d92/dd8/f119 [0,4194304] 0 2024-04-23T10:21:47.213 INFO:tasks.workunit.client.0.smithi029.stdout:4/929: stat d0/d12/da9 0 2024-04-23T10:21:47.221 INFO:tasks.workunit.client.0.smithi029.stdout:4/930: creat d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d/f146 x:0 0 0 2024-04-23T10:21:47.224 INFO:tasks.workunit.client.0.smithi029.stdout:1/783: dwrite d5/d6/de/d27/f46 [0,4194304] 0 2024-04-23T10:21:47.228 INFO:tasks.workunit.client.0.smithi029.stdout:4/931: creat d0/d3c/d52/d1b/d36/d45/d4f/df2/f147 x:0 0 0 2024-04-23T10:21:47.235 INFO:tasks.workunit.client.0.smithi029.stdout:1/784: link d5/d6/d34/lb1 d5/d6/de/d22/lf6 0 2024-04-23T10:21:47.238 INFO:tasks.workunit.client.0.smithi029.stdout:4/932: creat d0/d3c/d52/d74/d8a/dba/f148 x:0 0 0 2024-04-23T10:21:47.240 INFO:tasks.workunit.client.0.smithi029.stdout:4/933: chown d0/d3c/d52/d1b/d5b/d65/d6a/d145/fd9 52937 1 2024-04-23T10:21:47.252 INFO:tasks.workunit.client.0.smithi029.stdout:4/934: dwrite d0/d3c/d52/d1b/f123 [0,4194304] 0 2024-04-23T10:21:47.258 INFO:tasks.workunit.client.0.smithi029.stdout:4/935: symlink d0/d3c/d52/d1b/d9f/d92/dd8/d7a/l149 0 2024-04-23T10:21:47.261 INFO:tasks.workunit.client.0.smithi029.stdout:1/785: dread d5/d6/de/d22/f5e [0,4194304] 0 2024-04-23T10:21:47.261 INFO:tasks.workunit.client.0.smithi029.stdout:4/936: write d0/d3c/d52/d1b/d9f/d92/dd8/f119 [3148725,41649] 0 2024-04-23T10:21:47.263 INFO:tasks.workunit.client.0.smithi029.stdout:1/786: rmdir d5/d6/de/d15 39 2024-04-23T10:21:47.267 INFO:tasks.workunit.client.0.smithi029.stdout:4/937: unlink d0/d3c/d52/d74/d8a/fb4 0 2024-04-23T10:21:47.271 INFO:tasks.workunit.client.0.smithi029.stdout:1/787: mknod d5/d6/de/d22/d84/dc4/d47/cf7 0 2024-04-23T10:21:47.278 INFO:tasks.workunit.client.0.smithi029.stdout:4/938: truncate d0/d3c/d52/d1b/f35 2835582 0 2024-04-23T10:21:47.283 INFO:tasks.workunit.client.0.smithi029.stdout:1/788: mknod d5/d6/de/d15/cf8 0 2024-04-23T10:21:47.286 INFO:tasks.workunit.client.0.smithi029.stdout:1/789: read d5/d6/de/d15/d7b/f9b [1573477,127820] 0 2024-04-23T10:21:47.290 INFO:tasks.workunit.client.0.smithi029.stdout:4/939: creat d0/d3c/d52/d1b/d9f/d92/dd8/f14a x:0 0 0 2024-04-23T10:21:47.291 INFO:tasks.workunit.client.0.smithi029.stdout:4/940: dread - d0/d3c/d52/d1b/d9f/f13c zero size 2024-04-23T10:21:47.293 INFO:tasks.workunit.client.0.smithi029.stdout:4/941: dread - d0/d3c/d52/d1b/d9f/d92/dd8/f14a zero size 2024-04-23T10:21:47.293 INFO:tasks.workunit.client.0.smithi029.stdout:4/942: stat d0/d3c/d52/d1b/d9f/d92/dd8/da1/db1/f124 0 2024-04-23T10:21:47.314 INFO:tasks.workunit.client.0.smithi029.stdout:4/943: dread d0/d3c/d52/f75 [4194304,4194304] 0 2024-04-23T10:21:47.317 INFO:tasks.workunit.client.0.smithi029.stdout:1/790: creat d5/d6/de/d22/d84/dc4/ff9 x:0 0 0 2024-04-23T10:21:47.324 INFO:tasks.workunit.client.0.smithi029.stdout:4/944: rename d0/d3c/d52/d1b/d36/d45/l107 to d0/d3c/d52/d20/l14b 0 2024-04-23T10:21:47.330 INFO:tasks.workunit.client.0.smithi029.stdout:4/945: creat d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7/f14c x:0 0 0 2024-04-23T10:21:47.335 INFO:tasks.workunit.client.0.smithi029.stdout:4/946: chown d0/d3c/d52/d74/d91/cb7 13 1 2024-04-23T10:21:47.338 INFO:tasks.workunit.client.0.smithi029.stdout:1/791: link d5/d6/de/d22/f7a d5/d6/de/d22/ffa 0 2024-04-23T10:21:47.339 INFO:tasks.workunit.client.0.smithi029.stdout:1/792: fsync d5/d6/de/d27/da9/fb9 0 2024-04-23T10:21:47.346 INFO:tasks.workunit.client.0.smithi029.stdout:1/793: symlink d5/d6/d34/d8a/lfb 0 2024-04-23T10:21:47.350 INFO:tasks.workunit.client.0.smithi029.stdout:4/947: creat d0/d3c/d52/d1b/d9f/d92/dd8/da1/f14d x:0 0 0 2024-04-23T10:21:47.361 INFO:tasks.workunit.client.0.smithi029.stdout:7/915: sync 2024-04-23T10:21:47.361 INFO:tasks.workunit.client.0.smithi029.stdout:8/918: sync 2024-04-23T10:21:47.364 INFO:tasks.workunit.client.0.smithi029.stdout:4/948: write d0/d3c/d52/d1b/d36/d45/d4f/f87 [552910,65368] 0 2024-04-23T10:21:47.366 INFO:tasks.workunit.client.0.smithi029.stdout:1/794: dwrite d5/d6/de/d22/d77/f88 [0,4194304] 0 2024-04-23T10:21:47.369 INFO:tasks.workunit.client.0.smithi029.stdout:8/919: dread d3/d50/dac/de1/d120/d95/f4c [0,4194304] 0 2024-04-23T10:21:47.375 INFO:tasks.workunit.client.0.smithi029.stdout:8/920: dread - d3/d50/dac/de1/d120/d95/d36/dbf/fd0 zero size 2024-04-23T10:21:47.376 INFO:tasks.workunit.client.0.smithi029.stdout:7/916: dread d5/d71/d92/fe6 [0,4194304] 0 2024-04-23T10:21:47.378 INFO:tasks.workunit.client.0.smithi029.stdout:4/949: dwrite d0/fe2 [0,4194304] 0 2024-04-23T10:21:47.381 INFO:tasks.workunit.client.0.smithi029.stdout:1/795: getdents d5/d3e/dda 0 2024-04-23T10:21:47.383 INFO:tasks.workunit.client.0.smithi029.stdout:1/796: read d5/d6/de/d22/f5e [1860475,110687] 0 2024-04-23T10:21:47.385 INFO:tasks.workunit.client.0.smithi029.stdout:8/921: rename d3/d44/fa7 to d3/d50/dac/de1/d120/dd9/f128 0 2024-04-23T10:21:47.386 INFO:tasks.workunit.client.0.smithi029.stdout:8/922: fsync d3/f1e 0 2024-04-23T10:21:47.388 INFO:tasks.workunit.client.0.smithi029.stdout:7/917: write d5/d29/ded/d9c/f108 [1432110,53109] 0 2024-04-23T10:21:47.397 INFO:tasks.workunit.client.0.smithi029.stdout:8/923: dwrite d3/d44/f81 [0,4194304] 0 2024-04-23T10:21:47.408 INFO:tasks.workunit.client.0.smithi029.stdout:4/950: rename d0/d12/f5f to d0/d12/da9/f14e 0 2024-04-23T10:21:47.409 INFO:tasks.workunit.client.0.smithi029.stdout:8/924: mkdir d3/d50/dac/de1/d120/dd9/d129 0 2024-04-23T10:21:47.409 INFO:tasks.workunit.client.0.smithi029.stdout:8/925: chown d3/d44/ce9 77023 1 2024-04-23T10:21:47.409 INFO:tasks.workunit.client.0.smithi029.stdout:4/951: fdatasync d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7/f11c 0 2024-04-23T10:21:47.412 INFO:tasks.workunit.client.0.smithi029.stdout:7/918: write d5/d8/fb0 [1700629,123744] 0 2024-04-23T10:21:47.416 INFO:tasks.workunit.client.0.smithi029.stdout:8/926: creat d3/d50/dac/de1/f12a x:0 0 0 2024-04-23T10:21:47.423 INFO:tasks.workunit.client.0.smithi029.stdout:1/797: rename d5/d6/de/d22/d84 to d5/d6/d34/d63/dfc 0 2024-04-23T10:21:47.424 INFO:tasks.workunit.client.0.smithi029.stdout:1/798: chown d5/d6/d34/d63 46260 1 2024-04-23T10:21:47.429 INFO:tasks.workunit.client.0.smithi029.stdout:7/919: dread d5/d71/d114/d59/f61 [0,4194304] 0 2024-04-23T10:21:47.431 INFO:tasks.workunit.client.0.smithi029.stdout:8/927: link d3/d50/dac/c112 d3/d44/c12b 0 2024-04-23T10:21:47.437 INFO:tasks.workunit.client.0.smithi029.stdout:1/799: truncate d5/fd 7210902 0 2024-04-23T10:21:47.440 INFO:tasks.workunit.client.0.smithi029.stdout:7/920: dread d5/d8/d51/fe7 [0,4194304] 0 2024-04-23T10:21:47.441 INFO:tasks.workunit.client.0.smithi029.stdout:1/800: truncate d5/d6/de/d22/f5e 5224613 0 2024-04-23T10:21:47.442 INFO:tasks.workunit.client.0.smithi029.stdout:7/921: creat d5/d29/dc9/f125 x:0 0 0 2024-04-23T10:21:47.444 INFO:tasks.workunit.client.0.smithi029.stdout:4/952: dread d0/fe9 [0,4194304] 0 2024-04-23T10:21:47.444 INFO:tasks.workunit.client.0.smithi029.stdout:8/928: link d3/d50/dac/de1/d120/d95/d36/ld8 d3/d50/dac/de1/d120/d95/d36/d94/l12c 0 2024-04-23T10:21:47.445 INFO:tasks.workunit.client.0.smithi029.stdout:4/953: chown d0/d3c/d52/d1b/d5b/d65/d6a/d145/fd9 2046 1 2024-04-23T10:21:47.446 INFO:tasks.workunit.client.0.smithi029.stdout:1/801: symlink d5/d6/de/lfd 0 2024-04-23T10:21:47.447 INFO:tasks.workunit.client.0.smithi029.stdout:8/929: rmdir d3/d44 39 2024-04-23T10:21:47.449 INFO:tasks.workunit.client.0.smithi029.stdout:1/802: mkdir d5/d6/de/d15/dfe 0 2024-04-23T10:21:47.450 INFO:tasks.workunit.client.0.smithi029.stdout:8/930: write d3/d44/db1/f10f [343013,84183] 0 2024-04-23T10:21:47.450 INFO:tasks.workunit.client.0.smithi029.stdout:4/954: creat d0/d12/f14f x:0 0 0 2024-04-23T10:21:47.453 INFO:tasks.workunit.client.0.smithi029.stdout:7/922: dwrite d5/d9/f65 [4194304,4194304] 0 2024-04-23T10:21:47.462 INFO:tasks.workunit.client.0.smithi029.stdout:1/803: dwrite d5/d6/de/d15/f1a [0,4194304] 0 2024-04-23T10:21:47.469 INFO:tasks.workunit.client.0.smithi029.stdout:5/937: sync 2024-04-23T10:21:47.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/817: sync 2024-04-23T10:21:47.471 INFO:tasks.workunit.client.0.smithi029.stdout:8/931: truncate d3/d50/dac/de1/d120/d95/d36/d68/d8c/f8d 539401 0 2024-04-23T10:21:47.473 INFO:tasks.workunit.client.0.smithi029.stdout:4/955: creat d0/d3c/d52/d1b/d36/d45/d4f/d7b/f150 x:0 0 0 2024-04-23T10:21:47.475 INFO:tasks.workunit.client.0.smithi029.stdout:2/818: fdatasync d1/dd/d60/fc9 0 2024-04-23T10:21:47.478 INFO:tasks.workunit.client.0.smithi029.stdout:7/923: truncate d5/d8/d51/d9e/f107 329149 0 2024-04-23T10:21:47.485 INFO:tasks.workunit.client.0.smithi029.stdout:5/938: creat d0/f131 x:0 0 0 2024-04-23T10:21:47.486 INFO:tasks.workunit.client.0.smithi029.stdout:4/956: mkdir d0/d3c/d52/d1b/d5b/d65/d151 0 2024-04-23T10:21:47.487 INFO:tasks.workunit.client.0.smithi029.stdout:7/924: readlink d5/d71/d114/l74 0 2024-04-23T10:21:47.488 INFO:tasks.workunit.client.0.smithi029.stdout:8/932: rename d3/d50/dac/de1/d120/d95/d36/d3e/ddd to d3/d50/dac/de1/d120/d95/d36/d68/d8c/d12d 0 2024-04-23T10:21:47.490 INFO:tasks.workunit.client.0.smithi029.stdout:5/939: dread - d0/d35/d38/d3e/d66/d8c/fc7 zero size 2024-04-23T10:21:47.490 INFO:tasks.workunit.client.0.smithi029.stdout:7/925: fsync d5/d8/d51/d9e/db2/fba 0 2024-04-23T10:21:47.491 INFO:tasks.workunit.client.0.smithi029.stdout:8/933: truncate d3/d44/db1/fbe 1071411 0 2024-04-23T10:21:47.492 INFO:tasks.workunit.client.0.smithi029.stdout:8/934: read - d3/d50/dac/de1/d120/d95/d36/d94/f105 zero size 2024-04-23T10:21:47.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/935: chown d3/d50/dac/de1/d120/d95/d36/d68 175383109 1 2024-04-23T10:21:47.499 INFO:tasks.workunit.client.0.smithi029.stdout:2/819: rename d1/dd/d47/d63/cd6 to d1/dd/d47/d63/d64/d78/da6/c111 0 2024-04-23T10:21:47.500 INFO:tasks.workunit.client.0.smithi029.stdout:2/820: chown d1/dd5/f103 6 1 2024-04-23T10:21:47.500 INFO:tasks.workunit.client.0.smithi029.stdout:5/940: mkdir d0/d35/d38/db3/d132 0 2024-04-23T10:21:47.501 INFO:tasks.workunit.client.0.smithi029.stdout:7/926: mknod d5/d71/d92/c126 0 2024-04-23T10:21:47.502 INFO:tasks.workunit.client.0.smithi029.stdout:8/936: unlink d3/d50/dac/de1/de3/f49 0 2024-04-23T10:21:47.505 INFO:tasks.workunit.client.0.smithi029.stdout:7/927: mkdir d5/d8/d116/d127 0 2024-04-23T10:21:47.507 INFO:tasks.workunit.client.0.smithi029.stdout:4/957: rename d0/d3c/d52/d74/fa4 to d0/d3c/d52/d1b/f152 0 2024-04-23T10:21:47.508 INFO:tasks.workunit.client.0.smithi029.stdout:8/937: fsync d3/d50/dac/de1/d120/d95/f35 0 2024-04-23T10:21:47.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/958: fdatasync d0/d12/f14f 0 2024-04-23T10:21:47.508 INFO:tasks.workunit.client.0.smithi029.stdout:5/941: dwrite d0/f131 [0,4194304] 0 2024-04-23T10:21:47.512 INFO:tasks.workunit.client.0.smithi029.stdout:7/928: creat d5/d29/f128 x:0 0 0 2024-04-23T10:21:47.513 INFO:tasks.workunit.client.0.smithi029.stdout:7/929: fsync d5/d71/dca/f11e 0 2024-04-23T10:21:47.515 INFO:tasks.workunit.client.0.smithi029.stdout:5/942: fdatasync d0/d6a/fce 0 2024-04-23T10:21:47.518 INFO:tasks.workunit.client.0.smithi029.stdout:8/938: symlink d3/d50/dac/de1/d120/d95/d36/d68/d8c/d12d/l12e 0 2024-04-23T10:21:47.521 INFO:tasks.workunit.client.0.smithi029.stdout:4/959: mkdir d0/d3c/d52/d1b/d5b/d65/d6a/d145/d135/d153 0 2024-04-23T10:21:47.522 INFO:tasks.workunit.client.0.smithi029.stdout:5/943: fdatasync d0/d6a/f7f 0 2024-04-23T10:21:47.523 INFO:tasks.workunit.client.0.smithi029.stdout:8/939: creat d3/d50/f12f x:0 0 0 2024-04-23T10:21:47.523 INFO:tasks.workunit.client.0.smithi029.stdout:2/821: dwrite d1/d3e/f79 [0,4194304] 0 2024-04-23T10:21:47.526 INFO:tasks.workunit.client.0.smithi029.stdout:4/960: fdatasync d0/fe 0 2024-04-23T10:21:47.531 INFO:tasks.workunit.client.0.smithi029.stdout:2/822: creat d1/d3e/d107/f112 x:0 0 0 2024-04-23T10:21:47.535 INFO:tasks.workunit.client.0.smithi029.stdout:2/823: chown d1/c18 14404 1 2024-04-23T10:21:47.539 INFO:tasks.workunit.client.0.smithi029.stdout:4/961: dwrite d0/d3c/d52/d1b/d9f/d92/dd8/da1/db1/f124 [0,4194304] 0 2024-04-23T10:21:47.540 INFO:tasks.workunit.client.0.smithi029.stdout:8/940: dwrite d3/d7d/fd7 [0,4194304] 0 2024-04-23T10:21:47.541 INFO:tasks.workunit.client.0.smithi029.stdout:2/824: write d1/dd/ffd [596505,105639] 0 2024-04-23T10:21:47.542 INFO:tasks.workunit.client.0.smithi029.stdout:5/944: link d0/d35/d38/d3e/d66/c121 d0/d35/d38/d3e/d66/d8c/dda/c133 0 2024-04-23T10:21:47.546 INFO:tasks.workunit.client.0.smithi029.stdout:4/962: read d0/d3c/d52/d74/d91/fbc [2948084,63546] 0 2024-04-23T10:21:47.549 INFO:tasks.workunit.client.0.smithi029.stdout:2/825: dwrite d1/f2e [0,4194304] 0 2024-04-23T10:21:47.552 INFO:tasks.workunit.client.0.smithi029.stdout:4/963: mknod d0/d3c/d52/d1b/d5b/d65/d6a/d11b/c154 0 2024-04-23T10:21:47.555 INFO:tasks.workunit.client.0.smithi029.stdout:2/826: creat d1/dd/d60/dd7/f113 x:0 0 0 2024-04-23T10:21:47.555 INFO:tasks.workunit.client.0.smithi029.stdout:8/941: truncate d3/d50/dac/de1/d120/d95/d36/d3e/fc2 577618 0 2024-04-23T10:21:47.557 INFO:tasks.workunit.client.0.smithi029.stdout:4/964: mkdir d0/d3c/d52/d1b/d36/d45/dd0/d155 0 2024-04-23T10:21:47.558 INFO:tasks.workunit.client.0.smithi029.stdout:8/942: truncate d3/d50/dac/f107 156445 0 2024-04-23T10:21:47.564 INFO:tasks.workunit.client.0.smithi029.stdout:2/827: symlink d1/dd/d47/d63/d64/l114 0 2024-04-23T10:21:47.567 INFO:tasks.workunit.client.0.smithi029.stdout:4/965: rename d0/d3c/d52/d1b/d5b/d65/d6a/f6c to d0/d3c/d52/dd6/f156 0 2024-04-23T10:21:47.571 INFO:tasks.workunit.client.0.smithi029.stdout:8/943: rename d3/d50/dac/de1/d120/d95/d36/f3b to d3/d50/dac/de1/d120/d95/d36/dbf/dee/f130 0 2024-04-23T10:21:47.571 INFO:tasks.workunit.client.0.smithi029.stdout:4/966: symlink d0/d12/l157 0 2024-04-23T10:21:47.573 INFO:tasks.workunit.client.0.smithi029.stdout:8/944: write d3/d50/dac/de1/de3/f5c [821796,114247] 0 2024-04-23T10:21:47.577 INFO:tasks.workunit.client.0.smithi029.stdout:8/945: rmdir d3/d50/dac/de1/d120 39 2024-04-23T10:21:47.580 INFO:tasks.workunit.client.0.smithi029.stdout:4/967: write d0/d3c/d52/d74/f77 [389059,118810] 0 2024-04-23T10:21:47.586 INFO:tasks.workunit.client.0.smithi029.stdout:2/828: dwrite d1/dd/d47/d63/d64/d78/fce [0,4194304] 0 2024-04-23T10:21:47.597 INFO:tasks.workunit.client.0.smithi029.stdout:8/946: dread d3/d44/db1/f10f [0,4194304] 0 2024-04-23T10:21:47.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/968: dread d0/d3c/d52/f90 [0,4194304] 0 2024-04-23T10:21:47.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/829: rename d1/d3e/d3b/d75/dd1/fd3 to d1/dd/d47/d63/d64/f115 0 2024-04-23T10:21:47.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/947: symlink d3/d50/dac/de1/d120/d95/d11e/d126/l131 0 2024-04-23T10:21:47.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/948: chown d3/d50/dac/de1/d120/ceb 166446513 1 2024-04-23T10:21:47.606 INFO:tasks.workunit.client.0.smithi029.stdout:2/830: creat d1/d3e/d3b/d75/dd1/f116 x:0 0 0 2024-04-23T10:21:47.608 INFO:tasks.workunit.client.0.smithi029.stdout:8/949: creat d3/d50/dac/de1/d120/d95/d36/d68/d8c/d12d/f132 x:0 0 0 2024-04-23T10:21:47.610 INFO:tasks.workunit.client.0.smithi029.stdout:4/969: rename d0/fe2 to d0/d3c/d52/d1b/d5b/d65/f158 0 2024-04-23T10:21:47.615 INFO:tasks.workunit.client.0.smithi029.stdout:8/950: dwrite d3/d71/fb4 [4194304,4194304] 0 2024-04-23T10:21:47.617 INFO:tasks.workunit.client.0.smithi029.stdout:2/831: getdents d1/dd/d47/d63/d64/d78 0 2024-04-23T10:21:47.619 INFO:tasks.workunit.client.0.smithi029.stdout:8/951: symlink d3/d44/db1/l133 0 2024-04-23T10:21:47.620 INFO:tasks.workunit.client.0.smithi029.stdout:4/970: truncate d0/d3c/d52/f14 7526061 0 2024-04-23T10:21:47.623 INFO:tasks.workunit.client.0.smithi029.stdout:4/971: write d0/d12/da9/f14e [3351409,81340] 0 2024-04-23T10:21:47.627 INFO:tasks.workunit.client.0.smithi029.stdout:2/832: dwrite d1/dd/d60/dd7/f113 [0,4194304] 0 2024-04-23T10:21:47.633 INFO:tasks.workunit.client.0.smithi029.stdout:2/833: unlink d1/d31/d50/d9b/d9e/cbb 0 2024-04-23T10:21:47.633 INFO:tasks.workunit.client.0.smithi029.stdout:2/834: stat d1/cc7 0 2024-04-23T10:21:47.635 INFO:tasks.workunit.client.0.smithi029.stdout:8/952: write d3/d50/dac/de1/d120/d95/d36/d68/f87 [380896,29941] 0 2024-04-23T10:21:47.636 INFO:tasks.workunit.client.0.smithi029.stdout:2/835: mkdir d1/d31/d50/d9b/d117 0 2024-04-23T10:21:47.638 INFO:tasks.workunit.client.0.smithi029.stdout:4/972: write d0/d3c/d52/d1b/d5b/d65/d6a/f6f [3067360,5909] 0 2024-04-23T10:21:47.642 INFO:tasks.workunit.client.0.smithi029.stdout:8/953: mkdir d3/d50/dac/de1/d134 0 2024-04-23T10:21:47.644 INFO:tasks.workunit.client.0.smithi029.stdout:2/836: unlink d1/dd/d22/cc0 0 2024-04-23T10:21:47.646 INFO:tasks.workunit.client.0.smithi029.stdout:4/973: creat d0/d3c/d52/d74/f159 x:0 0 0 2024-04-23T10:21:47.652 INFO:tasks.workunit.client.0.smithi029.stdout:4/974: dread d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d/f129 [0,4194304] 0 2024-04-23T10:21:47.654 INFO:tasks.workunit.client.0.smithi029.stdout:4/975: creat d0/d12/d10b/d134/f15a x:0 0 0 2024-04-23T10:21:47.654 INFO:tasks.workunit.client.0.smithi029.stdout:8/954: dwrite d3/d50/dac/de1/d120/d95/d36/d94/fb7 [0,4194304] 0 2024-04-23T10:21:47.663 INFO:tasks.workunit.client.0.smithi029.stdout:4/976: dwrite d0/d3c/d52/d1b/d36/d45/d4f/d7b/df7/f105 [0,4194304] 0 2024-04-23T10:21:47.666 INFO:tasks.workunit.client.0.smithi029.stdout:8/955: mknod d3/d50/dac/de1/d120/d95/d11e/c135 0 2024-04-23T10:21:47.671 INFO:tasks.workunit.client.0.smithi029.stdout:4/977: dread d0/d3c/d52/d1b/d36/d45/d68/f8f [0,4194304] 0 2024-04-23T10:21:47.676 INFO:tasks.workunit.client.0.smithi029.stdout:8/956: symlink d3/d50/dac/de1/de3/l136 0 2024-04-23T10:21:47.683 INFO:tasks.workunit.client.0.smithi029.stdout:8/957: mkdir d3/d50/dac/de1/d120/dd9/d137 0 2024-04-23T10:21:47.685 INFO:tasks.workunit.client.0.smithi029.stdout:4/978: truncate d0/d3c/d52/d1b/f152 1052526 0 2024-04-23T10:21:47.687 INFO:tasks.workunit.client.0.smithi029.stdout:8/958: mknod d3/d50/dac/de6/c138 0 2024-04-23T10:21:47.689 INFO:tasks.workunit.client.0.smithi029.stdout:8/959: chown d3/d50/dac/de1/d120/d95/d36/dbf/fd0 5 1 2024-04-23T10:21:47.689 INFO:tasks.workunit.client.0.smithi029.stdout:8/960: chown d3/d50/dac/de1/d120/d95/d36/d68/f110 2504 1 2024-04-23T10:21:47.691 INFO:tasks.workunit.client.0.smithi029.stdout:4/979: mknod d0/d3c/d52/d1b/d5b/d65/d6a/d11b/c15b 0 2024-04-23T10:21:47.694 INFO:tasks.workunit.client.0.smithi029.stdout:8/961: read - d3/d50/fdb zero size 2024-04-23T10:21:47.700 INFO:tasks.workunit.client.0.smithi029.stdout:4/980: link d0/d3c/d52/d1b/d9f/d92/dd8/da1/c128 d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d/c15c 0 2024-04-23T10:21:47.703 INFO:tasks.workunit.client.0.smithi029.stdout:8/962: mkdir d3/d50/dac/de1/d120/d95/d36/d3e/dce/da4/d139 0 2024-04-23T10:21:47.714 INFO:tasks.workunit.client.0.smithi029.stdout:8/963: mknod d3/d50/dac/de1/c13a 0 2024-04-23T10:21:47.718 INFO:tasks.workunit.client.0.smithi029.stdout:4/981: dwrite d0/d3c/d52/d1b/d36/d45/f58 [0,4194304] 0 2024-04-23T10:21:47.719 INFO:tasks.workunit.client.0.smithi029.stdout:4/982: chown d0/d3c/d52/d1b/f2e 404060210 1 2024-04-23T10:21:47.733 INFO:tasks.workunit.client.0.smithi029.stdout:4/983: dread d0/d3c/d52/d1b/f152 [0,4194304] 0 2024-04-23T10:21:47.737 INFO:tasks.workunit.client.0.smithi029.stdout:8/964: creat d3/d44/db1/f13b x:0 0 0 2024-04-23T10:21:47.745 INFO:tasks.workunit.client.0.smithi029.stdout:4/984: mknod d0/d3c/d52/d1b/d5b/d65/d6a/d145/c15d 0 2024-04-23T10:21:47.746 INFO:tasks.workunit.client.0.smithi029.stdout:8/965: dwrite d3/d50/dac/de1/d120/f101 [0,4194304] 0 2024-04-23T10:21:47.748 INFO:tasks.workunit.client.0.smithi029.stdout:8/966: write d3/d50/dac/de1/d120/d95/d36/d94/dcd/f106 [546968,30786] 0 2024-04-23T10:21:47.749 INFO:tasks.workunit.client.0.smithi029.stdout:8/967: write d3/f9c [588418,86253] 0 2024-04-23T10:21:47.751 INFO:tasks.workunit.client.0.smithi029.stdout:4/985: truncate d0/d3c/d52/d1b/d36/d45/f78 766748 0 2024-04-23T10:21:47.761 INFO:tasks.workunit.client.0.smithi029.stdout:8/968: fdatasync d3/d50/dac/de1/d120/fe0 0 2024-04-23T10:21:47.762 INFO:tasks.workunit.client.0.smithi029.stdout:4/986: dwrite d0/d3c/d52/d1b/d9f/f13c [0,4194304] 0 2024-04-23T10:21:47.766 INFO:tasks.workunit.client.0.smithi029.stdout:8/969: fdatasync d3/d50/dac/de1/d120/d95/d36/d3e/dce/fc4 0 2024-04-23T10:21:47.767 INFO:tasks.workunit.client.0.smithi029.stdout:8/970: write d3/d50/dac/de1/d120/d95/f11d [131304,7674] 0 2024-04-23T10:21:47.776 INFO:tasks.workunit.client.0.smithi029.stdout:4/987: unlink d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d/f146 0 2024-04-23T10:21:47.782 INFO:tasks.workunit.client.0.smithi029.stdout:4/988: rmdir d0/d3c/d52/d1b/d36/d45/d4f/d7b/d108/d11d 39 2024-04-23T10:21:47.783 INFO:tasks.workunit.client.0.smithi029.stdout:4/989: write d0/d3c/d52/d74/f13d [320874,41295] 0 2024-04-23T10:21:47.784 INFO:tasks.workunit.client.0.smithi029.stdout:4/990: readlink d0/d3c/d52/d1b/d36/d45/l76 0 2024-04-23T10:21:47.789 INFO:tasks.workunit.client.0.smithi029.stdout:8/971: dwrite d3/d50/dac/de1/de3/f4d [0,4194304] 0 2024-04-23T10:21:47.799 INFO:tasks.workunit.client.0.smithi029.stdout:4/991: dwrite d0/d3c/d52/f1d [0,4194304] 0 2024-04-23T10:21:47.802 INFO:tasks.workunit.client.0.smithi029.stdout:0/746: sync 2024-04-23T10:21:47.802 INFO:tasks.workunit.client.0.smithi029.stdout:3/797: sync 2024-04-23T10:21:47.806 INFO:tasks.workunit.client.0.smithi029.stdout:8/972: write d3/d50/f64 [8752861,21883] 0 2024-04-23T10:21:47.807 INFO:tasks.workunit.client.0.smithi029.stdout:4/992: creat d0/d3c/d52/d1b/d36/f15e x:0 0 0 2024-04-23T10:21:47.809 INFO:tasks.workunit.client.0.smithi029.stdout:0/747: rename d0/dc/f57 to d0/da9/d4c/da7/dc7/dd7/ffd 0 2024-04-23T10:21:47.810 INFO:tasks.workunit.client.0.smithi029.stdout:3/798: creat d3/d15/d4b/d52/f10b x:0 0 0 2024-04-23T10:21:47.816 INFO:tasks.workunit.client.0.smithi029.stdout:4/993: dwrite d0/d3c/d52/d1b/d36/d45/d68/f73 [0,4194304] 0 2024-04-23T10:21:47.818 INFO:tasks.workunit.client.0.smithi029.stdout:0/748: mkdir d0/dc/dd9/dfe 0 2024-04-23T10:21:47.821 INFO:tasks.workunit.client.0.smithi029.stdout:3/799: dwrite d3/d10/d48/ffc [0,4194304] 0 2024-04-23T10:21:47.829 INFO:tasks.workunit.client.0.smithi029.stdout:8/973: dwrite d3/d50/dac/de1/d120/d95/d36/d3e/f41 [4194304,4194304] 0 2024-04-23T10:21:47.831 INFO:tasks.workunit.client.0.smithi029.stdout:3/800: read d3/d10/de/d2e/d36/d40/d46/f9f [229230,32423] 0 2024-04-23T10:21:47.840 INFO:tasks.workunit.client.0.smithi029.stdout:4/994: dread d0/fd [0,4194304] 0 2024-04-23T10:21:47.844 INFO:tasks.workunit.client.0.smithi029.stdout:8/974: creat d3/d50/dac/de1/d120/d95/d36/d68/d8c/f13c x:0 0 0 2024-04-23T10:21:47.844 INFO:tasks.workunit.client.0.smithi029.stdout:0/749: dwrite d0/d1b/d67/f98 [0,4194304] 0 2024-04-23T10:21:47.845 INFO:tasks.workunit.client.0.smithi029.stdout:0/750: chown d0/d3e/d4e/d7c/fa3 395 1 2024-04-23T10:21:47.849 INFO:tasks.workunit.client.0.smithi029.stdout:3/801: creat d3/d10/de/d2e/d36/d40/d46/d72/d75/f10c x:0 0 0 2024-04-23T10:21:47.849 INFO:tasks.workunit.client.0.smithi029.stdout:8/975: dread d3/d50/dac/de1/d120/d95/f11d [0,4194304] 0 2024-04-23T10:21:47.856 INFO:tasks.workunit.client.0.smithi029.stdout:4/995: dwrite d0/d12/f43 [0,4194304] 0 2024-04-23T10:21:47.858 INFO:tasks.workunit.client.0.smithi029.stdout:3/802: truncate d3/d10/de/d2e/f42 1501770 0 2024-04-23T10:21:47.859 INFO:tasks.workunit.client.0.smithi029.stdout:0/751: getdents d0/d3e 0 2024-04-23T10:21:47.864 INFO:tasks.workunit.client.0.smithi029.stdout:8/976: dwrite d3/d50/dac/de1/d120/d95/f88 [0,4194304] 0 2024-04-23T10:21:47.876 INFO:tasks.workunit.client.0.smithi029.stdout:3/803: dwrite d3/d10/de/d2e/d36/d40/d46/d72/fc4 [0,4194304] 0 2024-04-23T10:21:47.877 INFO:tasks.workunit.client.0.smithi029.stdout:8/977: write d3/d50/dac/de1/d120/d95/d36/d68/d8c/f8d [791234,52360] 0 2024-04-23T10:21:47.877 INFO:tasks.workunit.client.0.smithi029.stdout:0/752: truncate d0/da9/d4c/da7/dc7/dd7/d71/f8e 3474323 0 2024-04-23T10:21:47.879 INFO:tasks.workunit.client.0.smithi029.stdout:4/996: dwrite d0/d3c/d52/f42 [0,4194304] 0 2024-04-23T10:21:47.912 INFO:tasks.workunit.client.0.smithi029.stdout:8/978: dread d3/d50/dac/de1/de3/f8a [0,4194304] 0 2024-04-23T10:21:47.917 INFO:tasks.workunit.client.0.smithi029.stdout:3/804: dread d3/d10/de/d2e/d36/d40/d46/d72/d5e/f9e [4194304,4194304] 0 2024-04-23T10:21:47.923 INFO:tasks.workunit.client.0.smithi029.stdout:0/753: mknod d0/d1b/cff 0 2024-04-23T10:21:47.923 INFO:tasks.workunit.client.0.smithi029.stdout:4/997: symlink d0/d3c/d52/d74/d8a/l15f 0 2024-04-23T10:21:48.090 INFO:tasks.workunit.client.0.smithi029.stdout:8/979: truncate d3/d50/dac/de1/d120/d95/d36/f4a 1585199 0 2024-04-23T10:21:48.125 INFO:tasks.workunit.client.0.smithi029.stdout:1/804: sync 2024-04-23T10:21:48.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/805: write d3/d10/f20 [5988005,96719] 0 2024-04-23T10:21:48.183 INFO:tasks.workunit.client.0.smithi029.stdout:4/998: dwrite d0/d3c/d52/f90 [4194304,4194304] 0 2024-04-23T10:21:48.186 INFO:tasks.workunit.client.0.smithi029.stdout:8/980: rename d3/f30 to d3/df0/f13d 0 2024-04-23T10:21:48.254 INFO:tasks.workunit.client.0.smithi029.stdout:7/930: sync 2024-04-23T10:21:48.255 INFO:tasks.workunit.client.0.smithi029.stdout:7/931: stat d5/d71/d114 0 2024-04-23T10:21:48.258 INFO:tasks.workunit.client.0.smithi029.stdout:4/999: rmdir d0/d3c/d52/d1b/d9f/d92 39 2024-04-23T10:21:48.321 INFO:tasks.workunit.client.0.smithi029.stdout:0/754: sync 2024-04-23T10:21:48.321 INFO:tasks.workunit.client.0.smithi029.stdout:5/945: sync 2024-04-23T10:21:48.321 INFO:tasks.workunit.client.0.smithi029.stdout:2/837: sync 2024-04-23T10:21:48.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/806: creat d3/d15/f10d x:0 0 0 2024-04-23T10:21:48.344 INFO:tasks.workunit.client.0.smithi029.stdout:2/838: mknod d1/dd/d47/d63/c118 0 2024-04-23T10:21:48.352 INFO:tasks.workunit.client.0.smithi029.stdout:5/946: mknod d0/d35/d38/db3/c134 0 2024-04-23T10:21:48.358 INFO:tasks.workunit.client.0.smithi029.stdout:0/755: rename d0/da9/d4c/d6d/f82 to d0/da9/d4c/d6d/f100 0 2024-04-23T10:21:48.360 INFO:tasks.workunit.client.0.smithi029.stdout:3/807: dwrite d3/d15/d4b/ff0 [0,4194304] 0 2024-04-23T10:21:48.363 INFO:tasks.workunit.client.0.smithi029.stdout:3/808: write d3/d45/d4f/fe8 [674648,99762] 0 2024-04-23T10:21:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:7/932: symlink d5/d29/ded/d8a/d8b/l129 0 2024-04-23T10:21:48.369 INFO:tasks.workunit.client.0.smithi029.stdout:2/839: mknod d1/d110/c119 0 2024-04-23T10:21:48.379 INFO:tasks.workunit.client.0.smithi029.stdout:7/933: dread d5/f41 [0,4194304] 0 2024-04-23T10:21:48.380 INFO:tasks.workunit.client.0.smithi029.stdout:8/981: write d3/f26 [2070826,113819] 0 2024-04-23T10:21:48.385 INFO:tasks.workunit.client.0.smithi029.stdout:8/982: truncate d3/d7d/f118 989850 0 2024-04-23T10:21:48.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/983: write d3/d50/f64 [3505833,74306] 0 2024-04-23T10:21:48.396 INFO:tasks.workunit.client.0.smithi029.stdout:2/840: mknod d1/d3e/d107/c11a 0 2024-04-23T10:21:48.402 INFO:tasks.workunit.client.0.smithi029.stdout:8/984: mknod d3/d50/dac/de1/d120/d95/d11e/c13e 0 2024-04-23T10:21:48.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/809: mkdir d3/d10/de/d2e/d36/d8a/d10e 0 2024-04-23T10:21:48.409 INFO:tasks.workunit.client.0.smithi029.stdout:5/947: creat d0/d35/f135 x:0 0 0 2024-04-23T10:21:48.414 INFO:tasks.workunit.client.0.smithi029.stdout:0/756: dread d0/da9/f61 [0,4194304] 0 2024-04-23T10:21:48.422 INFO:tasks.workunit.client.0.smithi029.stdout:5/948: readlink d0/d35/d38/d3e/d66/d5a/dcc/le9 0 2024-04-23T10:21:48.430 INFO:tasks.workunit.client.0.smithi029.stdout:8/985: write d3/d50/dac/de1/de3/f79 [2118544,87909] 0 2024-04-23T10:21:48.435 INFO:tasks.workunit.client.0.smithi029.stdout:7/934: dwrite d5/d29/ded/d8a/f10d [0,4194304] 0 2024-04-23T10:21:48.435 INFO:tasks.workunit.client.0.smithi029.stdout:5/949: dread - d0/d35/d38/db3/dcf/f128 zero size 2024-04-23T10:21:48.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/841: write d1/d3e/f89 [1151759,124835] 0 2024-04-23T10:21:48.438 INFO:tasks.workunit.client.0.smithi029.stdout:7/935: chown d5/d8/d51/f5c 1427689602 1 2024-04-23T10:21:48.440 INFO:tasks.workunit.client.0.smithi029.stdout:3/810: rename d3/d15/d4b/d52/f87 to d3/d10/de/d2e/f10f 0 2024-04-23T10:21:48.444 INFO:tasks.workunit.client.0.smithi029.stdout:8/986: chown d3/d7d/l86 0 1 2024-04-23T10:21:48.449 INFO:tasks.workunit.client.0.smithi029.stdout:5/950: symlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/l136 0 2024-04-23T10:21:48.454 INFO:tasks.workunit.client.0.smithi029.stdout:2/842: link d1/d3e/d107/f112 d1/d3e/d3b/d75/f11b 0 2024-04-23T10:21:48.456 INFO:tasks.workunit.client.0.smithi029.stdout:8/987: mknod d3/d7d/c13f 0 2024-04-23T10:21:48.457 INFO:tasks.workunit.client.0.smithi029.stdout:2/843: readlink d1/d31/d50/l69 0 2024-04-23T10:21:48.462 INFO:tasks.workunit.client.0.smithi029.stdout:5/951: truncate d0/d35/d38/d3e/f4e 182628 0 2024-04-23T10:21:48.468 INFO:tasks.workunit.client.0.smithi029.stdout:2/844: creat d1/d4/db7/f11c x:0 0 0 2024-04-23T10:21:48.470 INFO:tasks.workunit.client.0.smithi029.stdout:7/936: dread d5/d8/d51/f57 [0,4194304] 0 2024-04-23T10:21:48.471 INFO:tasks.workunit.client.0.smithi029.stdout:8/988: link d3/d44/c7b d3/d71/d96/c140 0 2024-04-23T10:21:48.472 INFO:tasks.workunit.client.0.smithi029.stdout:8/989: chown d3/d44/f81 386 1 2024-04-23T10:21:48.472 INFO:tasks.workunit.client.0.smithi029.stdout:1/805: dread d5/d6/f19 [0,4194304] 0 2024-04-23T10:21:48.474 INFO:tasks.workunit.client.0.smithi029.stdout:5/952: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d114/f137 x:0 0 0 2024-04-23T10:21:48.478 INFO:tasks.workunit.client.0.smithi029.stdout:8/990: symlink d3/d50/dac/de1/d120/dd9/d129/l141 0 2024-04-23T10:21:48.483 INFO:tasks.workunit.client.0.smithi029.stdout:7/937: rename d5/d71/d92/dda/cfa to d5/d29/dc9/c12a 0 2024-04-23T10:21:48.484 INFO:tasks.workunit.client.0.smithi029.stdout:2/845: link d1/dd/d47/l73 d1/l11d 0 2024-04-23T10:21:48.486 INFO:tasks.workunit.client.0.smithi029.stdout:5/953: creat d0/d35/d38/d3e/d66/d5a/dcc/f138 x:0 0 0 2024-04-23T10:21:48.488 INFO:tasks.workunit.client.0.smithi029.stdout:1/806: getdents d5/d6/de/d27/da9/dad 0 2024-04-23T10:21:48.492 INFO:tasks.workunit.client.0.smithi029.stdout:7/938: chown d5/d29/d4a/f8f 5 1 2024-04-23T10:21:48.497 INFO:tasks.workunit.client.0.smithi029.stdout:7/939: fsync d5/d8/d51/f57 0 2024-04-23T10:21:48.499 INFO:tasks.workunit.client.0.smithi029.stdout:5/954: symlink d0/d35/d38/d3e/d66/l139 0 2024-04-23T10:21:48.500 INFO:tasks.workunit.client.0.smithi029.stdout:2/846: creat d1/dd/d47/d63/f11e x:0 0 0 2024-04-23T10:21:48.501 INFO:tasks.workunit.client.0.smithi029.stdout:8/991: dwrite d3/f2d [0,4194304] 0 2024-04-23T10:21:48.503 INFO:tasks.workunit.client.0.smithi029.stdout:8/992: write d3/d50/dac/de1/de3/f5c [395811,42227] 0 2024-04-23T10:21:48.504 INFO:tasks.workunit.client.0.smithi029.stdout:8/993: chown d3/d7d/l86 1702415594 1 2024-04-23T10:21:48.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/847: stat d1/d3e/d3b/d75/f7a 0 2024-04-23T10:21:48.511 INFO:tasks.workunit.client.0.smithi029.stdout:5/955: unlink d0/d35/d38/d3e/f4e 0 2024-04-23T10:21:48.515 INFO:tasks.workunit.client.0.smithi029.stdout:7/940: write d5/d71/d114/d59/fb5 [55804,70547] 0 2024-04-23T10:21:48.516 INFO:tasks.workunit.client.0.smithi029.stdout:8/994: mkdir d3/d71/d142 0 2024-04-23T10:21:48.517 INFO:tasks.workunit.client.0.smithi029.stdout:1/807: dwrite d5/d6/de/d27/f35 [0,4194304] 0 2024-04-23T10:21:48.518 INFO:tasks.workunit.client.0.smithi029.stdout:7/941: chown d5/d8/fb0 39043203 1 2024-04-23T10:21:48.520 INFO:tasks.workunit.client.0.smithi029.stdout:2/848: mkdir d1/dd/ddf/d11f 0 2024-04-23T10:21:48.520 INFO:tasks.workunit.client.0.smithi029.stdout:5/956: rmdir d0/d35/d83 39 2024-04-23T10:21:48.521 INFO:tasks.workunit.client.0.smithi029.stdout:8/995: fdatasync d3/d50/dac/de1/d120/d95/d36/d3e/dce/fc4 0 2024-04-23T10:21:48.522 INFO:tasks.workunit.client.0.smithi029.stdout:1/808: rmdir d5/d3e/da7 39 2024-04-23T10:21:48.526 INFO:tasks.workunit.client.0.smithi029.stdout:7/942: mknod d5/d29/ded/d9c/dd3/c12b 0 2024-04-23T10:21:48.527 INFO:tasks.workunit.client.0.smithi029.stdout:1/809: write d5/d6/de/d15/f1a [388026,82303] 0 2024-04-23T10:21:48.529 INFO:tasks.workunit.client.0.smithi029.stdout:2/849: mknod d1/dd/d47/d63/d64/ded/d10d/c120 0 2024-04-23T10:21:48.530 INFO:tasks.workunit.client.0.smithi029.stdout:5/957: mknod d0/d35/d10/c13a 0 2024-04-23T10:21:48.531 INFO:tasks.workunit.client.0.smithi029.stdout:7/943: chown d5/d71/d114/da5 55 1 2024-04-23T10:21:48.535 INFO:tasks.workunit.client.0.smithi029.stdout:8/996: dwrite d3/d50/dac/de1/de3/f4d [4194304,4194304] 0 2024-04-23T10:21:48.537 INFO:tasks.workunit.client.0.smithi029.stdout:2/850: stat d1/d31/d3d/l57 0 2024-04-23T10:21:48.539 INFO:tasks.workunit.client.0.smithi029.stdout:1/810: unlink d5/d6/de/l97 0 2024-04-23T10:21:48.542 INFO:tasks.workunit.client.0.smithi029.stdout:5/958: dwrite d0/d35/f135 [0,4194304] 0 2024-04-23T10:21:48.545 INFO:tasks.workunit.client.0.smithi029.stdout:2/851: mkdir d1/dd/d60/dd7/d121 0 2024-04-23T10:21:48.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/944: chown d5/d71/d92/dda/ca8 79086214 1 2024-04-23T10:21:48.547 INFO:tasks.workunit.client.0.smithi029.stdout:2/852: read d1/dd/d47/d63/d64/fcc [4305861,28047] 0 2024-04-23T10:21:48.548 INFO:tasks.workunit.client.0.smithi029.stdout:1/811: truncate d5/d6/f19 2888139 0 2024-04-23T10:21:48.551 INFO:tasks.workunit.client.0.smithi029.stdout:7/945: mkdir d5/d71/d92/db7/d12c 0 2024-04-23T10:21:48.555 INFO:tasks.workunit.client.0.smithi029.stdout:5/959: dwrite d0/d35/d38/db3/dcf/f128 [0,4194304] 0 2024-04-23T10:21:48.557 INFO:tasks.workunit.client.0.smithi029.stdout:0/757: sync 2024-04-23T10:21:48.558 INFO:tasks.workunit.client.0.smithi029.stdout:2/853: mknod d1/dd/d47/d63/c122 0 2024-04-23T10:21:48.558 INFO:tasks.workunit.client.0.smithi029.stdout:5/960: truncate d0/d9a/f11d 514387 0 2024-04-23T10:21:48.561 INFO:tasks.workunit.client.0.smithi029.stdout:1/812: creat d5/d6/d34/fff x:0 0 0 2024-04-23T10:21:48.562 INFO:tasks.workunit.client.0.smithi029.stdout:7/946: rename d5/d29/ded/d8e/la6 to d5/d29/ded/d4d/ddb/l12d 0 2024-04-23T10:21:48.564 INFO:tasks.workunit.client.0.smithi029.stdout:2/854: rmdir d1/d4/db7/deb 39 2024-04-23T10:21:48.567 INFO:tasks.workunit.client.0.smithi029.stdout:1/813: fsync d5/f37 0 2024-04-23T10:21:48.570 INFO:tasks.workunit.client.0.smithi029.stdout:7/947: chown d5/c22 59 1 2024-04-23T10:21:48.572 INFO:tasks.workunit.client.0.smithi029.stdout:8/997: write d3/f29 [1260313,9033] 0 2024-04-23T10:21:48.575 INFO:tasks.workunit.client.0.smithi029.stdout:5/961: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/c13b 0 2024-04-23T10:21:48.577 INFO:tasks.workunit.client.0.smithi029.stdout:0/758: link d0/da9/d4c/f6b d0/d3e/ddd/f101 0 2024-04-23T10:21:48.579 INFO:tasks.workunit.client.0.smithi029.stdout:2/855: mkdir d1/dd/d47/d63/d64/d123 0 2024-04-23T10:21:48.585 INFO:tasks.workunit.client.0.smithi029.stdout:1/814: rename d5/d6/d34/d63/dfc/dc4/d47/fa6 to d5/d6/d34/d63/dfc/f100 0 2024-04-23T10:21:48.586 INFO:tasks.workunit.client.0.smithi029.stdout:7/948: creat d5/d8/d51/f12e x:0 0 0 2024-04-23T10:21:48.588 INFO:tasks.workunit.client.0.smithi029.stdout:0/759: rename d0/da9/fe6 to d0/d3e/ddd/de4/f102 0 2024-04-23T10:21:48.588 INFO:tasks.workunit.client.0.smithi029.stdout:1/815: mknod d5/d6/de/d27/da9/dad/c101 0 2024-04-23T10:21:48.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/962: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/f73 [0,4194304] 0 2024-04-23T10:21:48.590 INFO:tasks.workunit.client.0.smithi029.stdout:7/949: mknod d5/d29/dc9/c12f 0 2024-04-23T10:21:48.591 INFO:tasks.workunit.client.0.smithi029.stdout:0/760: chown d0/da9/d4c/da7/cfc 6265217 1 2024-04-23T10:21:48.591 INFO:tasks.workunit.client.0.smithi029.stdout:5/963: dread - d0/d6a/dd7/f123 zero size 2024-04-23T10:21:48.593 INFO:tasks.workunit.client.0.smithi029.stdout:5/964: stat d0/f40 0 2024-04-23T10:21:48.594 INFO:tasks.workunit.client.0.smithi029.stdout:1/816: creat d5/d6/d34/d8a/de2/f102 x:0 0 0 2024-04-23T10:21:48.594 INFO:tasks.workunit.client.0.smithi029.stdout:0/761: chown d0/d21/d7f/d3a/lc9 121934404 1 2024-04-23T10:21:48.594 INFO:tasks.workunit.client.0.smithi029.stdout:0/762: stat d0/d21/f38 0 2024-04-23T10:21:48.596 INFO:tasks.workunit.client.0.smithi029.stdout:7/950: rename d5/d29/ded/d4d/c10b to d5/d29/ded/d9c/dd3/c130 0 2024-04-23T10:21:48.598 INFO:tasks.workunit.client.0.smithi029.stdout:0/763: rmdir d0/d1b/d67/dae/d92/da0/dd3 39 2024-04-23T10:21:48.599 INFO:tasks.workunit.client.0.smithi029.stdout:5/965: write d0/d35/d38/d3e/d66/d5a/dcc/f138 [699957,31300] 0 2024-04-23T10:21:48.600 INFO:tasks.workunit.client.0.smithi029.stdout:8/998: dread d3/d50/dac/de1/d120/faf [0,4194304] 0 2024-04-23T10:21:48.601 INFO:tasks.workunit.client.0.smithi029.stdout:3/811: dread d3/d45/d4f/fe8 [0,4194304] 0 2024-04-23T10:21:48.604 INFO:tasks.workunit.client.0.smithi029.stdout:7/951: mknod d5/d29/ded/d4d/ddb/d11c/c131 0 2024-04-23T10:21:48.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/999: chown d3/d50/dac/de1/d120/d95/d36/d3e 2 1 2024-04-23T10:21:48.605 INFO:tasks.workunit.client.0.smithi029.stdout:2/856: dread d1/d3e/d5a/d6d/faf [0,4194304] 0 2024-04-23T10:21:48.605 INFO:tasks.workunit.client.0.smithi029.stdout:1/817: dread d5/d6/de/d22/fe4 [0,4194304] 0 2024-04-23T10:21:48.606 INFO:tasks.workunit.client.0.smithi029.stdout:7/952: rmdir d5/d29 39 2024-04-23T10:21:48.608 INFO:tasks.workunit.client.0.smithi029.stdout:5/966: rename d0/l1 to d0/d35/d38/d3e/d66/d5a/d78/d3d/l13c 0 2024-04-23T10:21:48.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/967: mkdir d0/d35/d38/d3e/d66/d8c/dda/d13d 0 2024-04-23T10:21:48.613 INFO:tasks.workunit.client.0.smithi029.stdout:2/857: mknod d1/dd/d47/d63/d64/d78/da6/c124 0 2024-04-23T10:21:48.616 INFO:tasks.workunit.client.0.smithi029.stdout:0/764: write d0/d3e/d4e/d7c/f9a [1644798,117355] 0 2024-04-23T10:21:48.617 INFO:tasks.workunit.client.0.smithi029.stdout:1/818: link d5/d6/d34/d63/dfc/dc4/f44 d5/d6/d34/d63/dcf/f103 0 2024-04-23T10:21:48.617 INFO:tasks.workunit.client.0.smithi029.stdout:0/765: write d0/d3e/feb [234997,13054] 0 2024-04-23T10:21:48.622 INFO:tasks.workunit.client.0.smithi029.stdout:1/819: creat d5/d6/de/d27/da9/dad/f104 x:0 0 0 2024-04-23T10:21:48.623 INFO:tasks.workunit.client.0.smithi029.stdout:0/766: rename d0/d1b/d67/dae/l63 to d0/d21/dcb/de9/l103 0 2024-04-23T10:21:48.624 INFO:tasks.workunit.client.0.smithi029.stdout:1/820: fdatasync d5/d6/de/d22/f5b 0 2024-04-23T10:21:48.626 INFO:tasks.workunit.client.0.smithi029.stdout:5/968: getdents d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/ddd 0 2024-04-23T10:21:48.627 INFO:tasks.workunit.client.0.smithi029.stdout:0/767: unlink d0/d21/d7f/d55/f68 0 2024-04-23T10:21:48.628 INFO:tasks.workunit.client.0.smithi029.stdout:7/953: dwrite d5/f2c [8388608,4194304] 0 2024-04-23T10:21:48.634 INFO:tasks.workunit.client.0.smithi029.stdout:5/969: creat d0/d35/d49/f13e x:0 0 0 2024-04-23T10:21:48.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/858: dwrite d1/dd/f62 [0,4194304] 0 2024-04-23T10:21:48.639 INFO:tasks.workunit.client.0.smithi029.stdout:0/768: creat d0/da9/d4c/da7/dc7/dd7/f104 x:0 0 0 2024-04-23T10:21:48.642 INFO:tasks.workunit.client.0.smithi029.stdout:1/821: dwrite d5/d6/de/d27/da9/dad/f104 [0,4194304] 0 2024-04-23T10:21:48.642 INFO:tasks.workunit.client.0.smithi029.stdout:7/954: write d5/f1f [343431,16306] 0 2024-04-23T10:21:48.644 INFO:tasks.workunit.client.0.smithi029.stdout:2/859: creat d1/dd/d47/d63/f125 x:0 0 0 2024-04-23T10:21:48.646 INFO:tasks.workunit.client.0.smithi029.stdout:1/822: mkdir d5/d6/da5/d105 0 2024-04-23T10:21:48.647 INFO:tasks.workunit.client.0.smithi029.stdout:2/860: creat d1/d4/db7/db8/dde/f126 x:0 0 0 2024-04-23T10:21:48.648 INFO:tasks.workunit.client.0.smithi029.stdout:0/769: readlink d0/da9/d4c/da7/dc7/dd7/d73/d7e/lbc 0 2024-04-23T10:21:48.649 INFO:tasks.workunit.client.0.smithi029.stdout:7/955: mkdir d5/d8/d116/d127/d132 0 2024-04-23T10:21:48.654 INFO:tasks.workunit.client.0.smithi029.stdout:0/770: dread d0/f1 [0,4194304] 0 2024-04-23T10:21:48.660 INFO:tasks.workunit.client.0.smithi029.stdout:0/771: creat d0/d1b/d67/dae/d92/da0/dbe/f105 x:0 0 0 2024-04-23T10:21:48.662 INFO:tasks.workunit.client.0.smithi029.stdout:1/823: write d5/d6/de/d15/d7b/fb4 [785476,98612] 0 2024-04-23T10:21:48.662 INFO:tasks.workunit.client.0.smithi029.stdout:7/956: dwrite d5/d29/ded/d8a/f10d [0,4194304] 0 2024-04-23T10:21:48.664 INFO:tasks.workunit.client.0.smithi029.stdout:1/824: chown d5/d6/de/d27/da9/dad/cb5 3 1 2024-04-23T10:21:48.664 INFO:tasks.workunit.client.0.smithi029.stdout:0/772: symlink d0/d1b/d67/dae/d6a/df4/l106 0 2024-04-23T10:21:48.669 INFO:tasks.workunit.client.0.smithi029.stdout:1/825: mkdir d5/d6/de/d15/dfe/d106 0 2024-04-23T10:21:48.674 INFO:tasks.workunit.client.0.smithi029.stdout:1/826: creat d5/d6/d34/d63/dfc/dc4/d6a/f107 x:0 0 0 2024-04-23T10:21:48.674 INFO:tasks.workunit.client.0.smithi029.stdout:2/861: dread d1/dd/d22/f88 [0,4194304] 0 2024-04-23T10:21:48.677 INFO:tasks.workunit.client.0.smithi029.stdout:2/862: write d1/dd/f1d [1039242,118546] 0 2024-04-23T10:21:48.679 INFO:tasks.workunit.client.0.smithi029.stdout:7/957: dwrite d5/d29/dc9/f100 [0,4194304] 0 2024-04-23T10:21:48.682 INFO:tasks.workunit.client.0.smithi029.stdout:2/863: mkdir d1/dd/d22/d127 0 2024-04-23T10:21:48.685 INFO:tasks.workunit.client.0.smithi029.stdout:2/864: rmdir d1/d3e 39 2024-04-23T10:21:48.686 INFO:tasks.workunit.client.0.smithi029.stdout:7/958: creat d5/d8/d51/d9e/f133 x:0 0 0 2024-04-23T10:21:48.687 INFO:tasks.workunit.client.0.smithi029.stdout:2/865: mknod d1/dd5/c128 0 2024-04-23T10:21:48.691 INFO:tasks.workunit.client.0.smithi029.stdout:1/827: dwrite d5/d6/de/f62 [4194304,4194304] 0 2024-04-23T10:21:48.692 INFO:tasks.workunit.client.0.smithi029.stdout:7/959: unlink d5/d71/df5/c10e 0 2024-04-23T10:21:48.694 INFO:tasks.workunit.client.0.smithi029.stdout:7/960: truncate d5/d8/fb0 2443544 0 2024-04-23T10:21:48.695 INFO:tasks.workunit.client.0.smithi029.stdout:7/961: chown d5/d29/ded/d9c/fab 77466438 1 2024-04-23T10:21:48.696 INFO:tasks.workunit.client.0.smithi029.stdout:1/828: symlink d5/d6/de/d27/da9/dad/l108 0 2024-04-23T10:21:48.698 INFO:tasks.workunit.client.0.smithi029.stdout:1/829: chown d5/d6/de/d27/da9/dad/cb5 1 1 2024-04-23T10:21:48.699 INFO:tasks.workunit.client.0.smithi029.stdout:3/812: dread d3/d45/f4a [0,4194304] 0 2024-04-23T10:21:48.700 INFO:tasks.workunit.client.0.smithi029.stdout:1/830: chown d5/d6/d34/d63/dfc/dc4/d47/db0/fe3 232218093 1 2024-04-23T10:21:48.701 INFO:tasks.workunit.client.0.smithi029.stdout:3/813: truncate d3/d45/d4f/f105 84370 0 2024-04-23T10:21:48.704 INFO:tasks.workunit.client.0.smithi029.stdout:2/866: creat d1/d3e/f129 x:0 0 0 2024-04-23T10:21:48.704 INFO:tasks.workunit.client.0.smithi029.stdout:7/962: symlink d5/d71/df5/l134 0 2024-04-23T10:21:48.708 INFO:tasks.workunit.client.0.smithi029.stdout:3/814: unlink d3/d10/de/d2e/d36/d40/d46/d72/d75/cae 0 2024-04-23T10:21:48.710 INFO:tasks.workunit.client.0.smithi029.stdout:1/831: dwrite d5/d6/d34/d63/dcf/fd1 [0,4194304] 0 2024-04-23T10:21:48.710 INFO:tasks.workunit.client.0.smithi029.stdout:2/867: rmdir d1/d31/d3d/de4 0 2024-04-23T10:21:48.711 INFO:tasks.workunit.client.0.smithi029.stdout:1/832: readlink d5/d6/lba 0 2024-04-23T10:21:48.715 INFO:tasks.workunit.client.0.smithi029.stdout:1/833: unlink d5/d6/d34/d8a/fbe 0 2024-04-23T10:21:48.716 INFO:tasks.workunit.client.0.smithi029.stdout:1/834: chown d5/d6/de/d27/da9/dad/cb5 1322997879 1 2024-04-23T10:21:48.718 INFO:tasks.workunit.client.0.smithi029.stdout:3/815: symlink d3/d10/de/d2e/d36/d40/d46/d72/d28/l110 0 2024-04-23T10:21:48.720 INFO:tasks.workunit.client.0.smithi029.stdout:7/963: rename d5/d71/d92/db7 to d5/d71/d114/d59/daf/d135 0 2024-04-23T10:21:48.721 INFO:tasks.workunit.client.0.smithi029.stdout:1/835: chown d5/d6/de/d22/d77/ccc 7744 1 2024-04-23T10:21:48.725 INFO:tasks.workunit.client.0.smithi029.stdout:3/816: creat d3/d10/de/d2e/d36/d107/f111 x:0 0 0 2024-04-23T10:21:48.727 INFO:tasks.workunit.client.0.smithi029.stdout:1/836: mknod d5/d6/de/d22/c109 0 2024-04-23T10:21:48.732 INFO:tasks.workunit.client.0.smithi029.stdout:1/837: rmdir d5/d6/da5/d105 0 2024-04-23T10:21:48.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/838: symlink d5/d6/de/d22/l10a 0 2024-04-23T10:21:48.735 INFO:tasks.workunit.client.0.smithi029.stdout:3/817: write d3/d10/de/d2e/d36/f38 [1109494,88533] 0 2024-04-23T10:21:48.735 INFO:tasks.workunit.client.0.smithi029.stdout:2/868: dread d1/dd/d47/f5d [0,4194304] 0 2024-04-23T10:21:48.738 INFO:tasks.workunit.client.0.smithi029.stdout:1/839: dread - d5/d6/de/d22/d77/fe1 zero size 2024-04-23T10:21:48.740 INFO:tasks.workunit.client.0.smithi029.stdout:7/964: dwrite d5/f30 [0,4194304] 0 2024-04-23T10:21:48.740 INFO:tasks.workunit.client.0.smithi029.stdout:2/869: creat d1/dd/d60/dd7/f12a x:0 0 0 2024-04-23T10:21:48.743 INFO:tasks.workunit.client.0.smithi029.stdout:2/870: write d1/d31/d3d/fe9 [954372,70722] 0 2024-04-23T10:21:48.743 INFO:tasks.workunit.client.0.smithi029.stdout:7/965: fdatasync d5/dc8/fea 0 2024-04-23T10:21:48.743 INFO:tasks.workunit.client.0.smithi029.stdout:1/840: mknod d5/d6/de/d22/c10b 0 2024-04-23T10:21:48.746 INFO:tasks.workunit.client.0.smithi029.stdout:2/871: truncate d1/dd/d47/d63/d64/d78/fce 5236014 0 2024-04-23T10:21:48.747 INFO:tasks.workunit.client.0.smithi029.stdout:2/872: dread - d1/d3e/d3b/fca zero size 2024-04-23T10:21:48.752 INFO:tasks.workunit.client.0.smithi029.stdout:1/841: mknod d5/d6/d34/d63/dfc/dc4/d6a/c10c 0 2024-04-23T10:21:48.754 INFO:tasks.workunit.client.0.smithi029.stdout:7/966: mkdir d5/d8/d136 0 2024-04-23T10:21:48.758 INFO:tasks.workunit.client.0.smithi029.stdout:7/967: creat d5/d29/d4a/f137 x:0 0 0 2024-04-23T10:21:48.761 INFO:tasks.workunit.client.0.smithi029.stdout:3/818: dread d3/d10/de/d2e/d36/d40/d46/f83 [0,4194304] 0 2024-04-23T10:21:48.763 INFO:tasks.workunit.client.0.smithi029.stdout:1/842: write d5/d6/de/d15/f1a [2045693,122266] 0 2024-04-23T10:21:48.766 INFO:tasks.workunit.client.0.smithi029.stdout:1/843: creat d5/d3e/da7/f10d x:0 0 0 2024-04-23T10:21:48.766 INFO:tasks.workunit.client.0.smithi029.stdout:1/844: fdatasync d5/fa3 0 2024-04-23T10:21:48.767 INFO:tasks.workunit.client.0.smithi029.stdout:7/968: write d5/d71/d114/d59/daf/fd5 [685543,76839] 0 2024-04-23T10:21:48.771 INFO:tasks.workunit.client.0.smithi029.stdout:1/845: truncate d5/d6/de/d22/f56 1028180 0 2024-04-23T10:21:48.773 INFO:tasks.workunit.client.0.smithi029.stdout:3/819: dwrite d3/f2a [0,4194304] 0 2024-04-23T10:21:48.773 INFO:tasks.workunit.client.0.smithi029.stdout:1/846: fdatasync d5/d6/d34/d63/dfc/dc4/fcd 0 2024-04-23T10:21:48.773 INFO:tasks.workunit.client.0.smithi029.stdout:7/969: creat d5/d71/d114/f138 x:0 0 0 2024-04-23T10:21:48.776 INFO:tasks.workunit.client.0.smithi029.stdout:7/970: fdatasync d5/d9/f7b 0 2024-04-23T10:21:48.777 INFO:tasks.workunit.client.0.smithi029.stdout:1/847: truncate d5/d6/de/d22/d6c/fc5 633958 0 2024-04-23T10:21:48.780 INFO:tasks.workunit.client.0.smithi029.stdout:3/820: creat d3/d10/de/d2e/d36/d40/d46/f112 x:0 0 0 2024-04-23T10:21:48.781 INFO:tasks.workunit.client.0.smithi029.stdout:1/848: symlink d5/d6/d34/d63/dfc/dc4/l10e 0 2024-04-23T10:21:48.785 INFO:tasks.workunit.client.0.smithi029.stdout:1/849: mknod d5/d6/d34/d8a/de2/c10f 0 2024-04-23T10:21:48.788 INFO:tasks.workunit.client.0.smithi029.stdout:7/971: dwrite d5/d9/fc5 [0,4194304] 0 2024-04-23T10:21:48.789 INFO:tasks.workunit.client.0.smithi029.stdout:1/850: mknod d5/d6/d34/d8a/c110 0 2024-04-23T10:21:48.791 INFO:tasks.workunit.client.0.smithi029.stdout:7/972: mknod d5/d29/ded/d9c/dd3/c139 0 2024-04-23T10:21:48.793 INFO:tasks.workunit.client.0.smithi029.stdout:7/973: write d5/d29/d4a/fd1 [4058013,5619] 0 2024-04-23T10:21:48.799 INFO:tasks.workunit.client.0.smithi029.stdout:7/974: write d5/dc8/fea [5052873,67753] 0 2024-04-23T10:21:48.804 INFO:tasks.workunit.client.0.smithi029.stdout:7/975: fdatasync d5/d29/ded/d8a/d8b/d8d/fbe 0 2024-04-23T10:21:48.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/976: chown d5/d29/ded/lad 3403056 1 2024-04-23T10:21:48.811 INFO:tasks.workunit.client.0.smithi029.stdout:7/977: rename d5/d8/d51/f7f to d5/d29/ded/d8a/d8b/d8d/d96/f13a 0 2024-04-23T10:21:48.812 INFO:tasks.workunit.client.0.smithi029.stdout:7/978: write d5/dc8/fea [3219356,94308] 0 2024-04-23T10:21:48.814 INFO:tasks.workunit.client.0.smithi029.stdout:7/979: fsync d5/d29/ded/d9c/faa 0 2024-04-23T10:21:48.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/980: truncate d5/f63 1685507 0 2024-04-23T10:21:48.820 INFO:tasks.workunit.client.0.smithi029.stdout:7/981: rename d5/d29/ded/d4d/ce4 to d5/d29/ded/d9c/c13b 0 2024-04-23T10:21:48.820 INFO:tasks.workunit.client.0.smithi029.stdout:7/982: readlink d5/d71/df5/l134 0 2024-04-23T10:21:48.822 INFO:tasks.workunit.client.0.smithi029.stdout:7/983: truncate d5/d29/d4a/f93 286880 0 2024-04-23T10:21:48.823 INFO:tasks.workunit.client.0.smithi029.stdout:7/984: write d5/d29/d4a/f137 [352471,43842] 0 2024-04-23T10:21:48.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/985: write d5/d29/ded/d9c/f108 [2466558,14871] 0 2024-04-23T10:21:48.827 INFO:tasks.workunit.client.0.smithi029.stdout:7/986: mkdir d5/d8/d51/d9e/d13c 0 2024-04-23T10:21:48.829 INFO:tasks.workunit.client.0.smithi029.stdout:7/987: fdatasync d5/d9/f2b 0 2024-04-23T10:21:48.837 INFO:tasks.workunit.client.0.smithi029.stdout:0/773: dread d0/d21/f89 [0,4194304] 0 2024-04-23T10:21:48.837 INFO:tasks.workunit.client.0.smithi029.stdout:7/988: write d5/d29/ded/d9c/fab [594877,80297] 0 2024-04-23T10:21:48.840 INFO:tasks.workunit.client.0.smithi029.stdout:0/774: dread - d0/da9/d4c/da7/dc7/dd7/f104 zero size 2024-04-23T10:21:48.844 INFO:tasks.workunit.client.0.smithi029.stdout:7/989: link d5/d71/d114/d59/l109 d5/d8/d80/l13d 0 2024-04-23T10:21:48.845 INFO:tasks.workunit.client.0.smithi029.stdout:0/775: write d0/d21/d7f/f31 [493532,11585] 0 2024-04-23T10:21:48.847 INFO:tasks.workunit.client.0.smithi029.stdout:7/990: creat d5/d29/ded/d4d/ddb/d11c/f13e x:0 0 0 2024-04-23T10:21:48.852 INFO:tasks.workunit.client.0.smithi029.stdout:0/776: truncate d0/d1b/d67/dae/d92/fca 1323005 0 2024-04-23T10:21:48.853 INFO:tasks.workunit.client.0.smithi029.stdout:7/991: write d5/d29/ded/d9c/fc0 [903611,61832] 0 2024-04-23T10:21:48.853 INFO:tasks.workunit.client.0.smithi029.stdout:0/777: chown d0/d3e/ddd/de4/f102 285020 1 2024-04-23T10:21:48.861 INFO:tasks.workunit.client.0.smithi029.stdout:0/778: write d0/d21/d7f/d55/f8a [607142,105215] 0 2024-04-23T10:21:48.862 INFO:tasks.workunit.client.0.smithi029.stdout:7/992: dwrite d5/d29/ded/d8a/f10d [4194304,4194304] 0 2024-04-23T10:21:48.869 INFO:tasks.workunit.client.0.smithi029.stdout:7/993: dread d5/f30 [0,4194304] 0 2024-04-23T10:21:48.879 INFO:tasks.workunit.client.0.smithi029.stdout:0/779: read d0/dc/f15 [1248036,23308] 0 2024-04-23T10:21:48.881 INFO:tasks.workunit.client.0.smithi029.stdout:0/780: mkdir d0/da9/d4c/da7/dc7/dd7/d71/da4/d107 0 2024-04-23T10:21:48.885 INFO:tasks.workunit.client.0.smithi029.stdout:0/781: rename d0/l9 to d0/da9/d4c/da7/dc7/dd7/d71/da4/d107/l108 0 2024-04-23T10:21:48.886 INFO:tasks.workunit.client.0.smithi029.stdout:0/782: write d0/da9/d4c/da7/dc7/dd7/d73/fea [431998,28030] 0 2024-04-23T10:21:48.889 INFO:tasks.workunit.client.0.smithi029.stdout:0/783: truncate d0/dc/f96 712913 0 2024-04-23T10:21:48.890 INFO:tasks.workunit.client.0.smithi029.stdout:0/784: fdatasync d0/d1b/d67/dae/f78 0 2024-04-23T10:21:48.892 INFO:tasks.workunit.client.0.smithi029.stdout:0/785: creat d0/d21/dcb/f109 x:0 0 0 2024-04-23T10:21:48.902 INFO:tasks.workunit.client.0.smithi029.stdout:0/786: write d0/d1b/f37 [3553393,99866] 0 2024-04-23T10:21:48.950 INFO:tasks.workunit.client.0.smithi029.stdout:0/787: write d0/da9/d4c/da7/dc7/dd7/d73/fb2 [538222,93149] 0 2024-04-23T10:21:48.957 INFO:tasks.workunit.client.0.smithi029.stdout:0/788: rename d0/da9/d4c/daf/dde/lf6 to d0/d1b/l10a 0 2024-04-23T10:21:48.964 INFO:tasks.workunit.client.0.smithi029.stdout:0/789: write d0/da9/d4c/d6d/fc2 [2344441,90986] 0 2024-04-23T10:21:49.074 INFO:tasks.workunit.client.0.smithi029.stdout:5/970: sync 2024-04-23T10:21:49.084 INFO:tasks.workunit.client.0.smithi029.stdout:5/971: rename d0/f31 to d0/d35/d38/d3e/d66/d5a/d78/d3d/d11b/f13f 0 2024-04-23T10:21:49.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/790: symlink d0/d1b/d67/dae/d92/l10b 0 2024-04-23T10:21:49.090 INFO:tasks.workunit.client.0.smithi029.stdout:5/972: fsync d0/f81 0 2024-04-23T10:21:49.099 INFO:tasks.workunit.client.0.smithi029.stdout:0/791: dwrite d0/da9/d4c/d6d/fc2 [0,4194304] 0 2024-04-23T10:21:49.112 INFO:tasks.workunit.client.0.smithi029.stdout:0/792: creat d0/d3e/f10c x:0 0 0 2024-04-23T10:21:49.124 INFO:tasks.workunit.client.0.smithi029.stdout:5/973: dwrite d0/d35/d38/d3e/d66/d5a/d78/de4/f10c [0,4194304] 0 2024-04-23T10:21:49.127 INFO:tasks.workunit.client.0.smithi029.stdout:0/793: read d0/d21/f38 [376601,101531] 0 2024-04-23T10:21:49.131 INFO:tasks.workunit.client.0.smithi029.stdout:5/974: fdatasync d0/d35/d38/d3e/d66/d5a/f92 0 2024-04-23T10:21:49.147 INFO:tasks.workunit.client.0.smithi029.stdout:0/794: write d0/d3e/ddd/f101 [2409372,538] 0 2024-04-23T10:21:49.148 INFO:tasks.workunit.client.0.smithi029.stdout:2/873: sync 2024-04-23T10:21:49.148 INFO:tasks.workunit.client.0.smithi029.stdout:7/994: sync 2024-04-23T10:21:49.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/851: sync 2024-04-23T10:21:49.151 INFO:tasks.workunit.client.0.smithi029.stdout:5/975: dwrite d0/d35/d38/f4b [4194304,4194304] 0 2024-04-23T10:21:49.157 INFO:tasks.workunit.client.0.smithi029.stdout:1/852: mkdir d5/d6/de/d27/d111 0 2024-04-23T10:21:49.160 INFO:tasks.workunit.client.0.smithi029.stdout:1/853: write d5/d6/f16 [781190,98093] 0 2024-04-23T10:21:49.171 INFO:tasks.workunit.client.0.smithi029.stdout:5/976: rename d0/d35/d38/d3e/d66/d8c/dda to d0/d35/d38/d3e/d66/d5a/d78/d140 0 2024-04-23T10:21:49.174 INFO:tasks.workunit.client.0.smithi029.stdout:5/977: chown d0/d35/d10/d26 964295150 1 2024-04-23T10:21:49.175 INFO:tasks.workunit.client.0.smithi029.stdout:0/795: dwrite d0/da9/d4c/da7/dc7/dd7/d73/d7e/fee [0,4194304] 0 2024-04-23T10:21:49.177 INFO:tasks.workunit.client.0.smithi029.stdout:2/874: dread d1/fb3 [0,4194304] 0 2024-04-23T10:21:49.180 INFO:tasks.workunit.client.0.smithi029.stdout:5/978: readlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/dca/l5e 0 2024-04-23T10:21:49.182 INFO:tasks.workunit.client.0.smithi029.stdout:1/854: dwrite d5/d6/de/d27/da9/fb9 [0,4194304] 0 2024-04-23T10:21:49.185 INFO:tasks.workunit.client.0.smithi029.stdout:5/979: chown d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/dc6/dca 379 1 2024-04-23T10:21:49.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/875: fsync d1/dd/d47/d63/d64/f72 0 2024-04-23T10:21:49.191 INFO:tasks.workunit.client.0.smithi029.stdout:1/855: symlink d5/d6/d34/l112 0 2024-04-23T10:21:49.199 INFO:tasks.workunit.client.0.smithi029.stdout:1/856: unlink d5/d6/c9e 0 2024-04-23T10:21:49.199 INFO:tasks.workunit.client.0.smithi029.stdout:0/796: write d0/d3e/d4e/d7c/f9b [4600449,60730] 0 2024-04-23T10:21:49.202 INFO:tasks.workunit.client.0.smithi029.stdout:5/980: symlink d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/l141 0 2024-04-23T10:21:49.204 INFO:tasks.workunit.client.0.smithi029.stdout:1/857: chown d5/d6/de/d22/d77/cca 80604 1 2024-04-23T10:21:49.206 INFO:tasks.workunit.client.0.smithi029.stdout:0/797: creat d0/da9/d4c/da7/f10d x:0 0 0 2024-04-23T10:21:49.209 INFO:tasks.workunit.client.0.smithi029.stdout:1/858: mknod d5/d6/d34/d63/dfc/dc4/d6a/c113 0 2024-04-23T10:21:49.215 INFO:tasks.workunit.client.0.smithi029.stdout:0/798: link d0/d3e/d4e/fcf d0/da9/d4c/da7/dc7/dd7/d71/da4/f10e 0 2024-04-23T10:21:49.218 INFO:tasks.workunit.client.0.smithi029.stdout:2/876: dread d1/d31/d3d/f41 [0,4194304] 0 2024-04-23T10:21:49.219 INFO:tasks.workunit.client.0.smithi029.stdout:0/799: creat d0/d1b/d67/d6c/f10f x:0 0 0 2024-04-23T10:21:49.220 INFO:tasks.workunit.client.0.smithi029.stdout:2/877: stat d1/d4/l42 0 2024-04-23T10:21:49.223 INFO:tasks.workunit.client.0.smithi029.stdout:0/800: symlink d0/da9/d4c/da7/dc7/dd7/d71/da4/l110 0 2024-04-23T10:21:49.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/981: dwrite d0/d35/d10/d26/f45 [0,4194304] 0 2024-04-23T10:21:49.231 INFO:tasks.workunit.client.0.smithi029.stdout:0/801: dread d0/da9/d4c/d6d/fc2 [0,4194304] 0 2024-04-23T10:21:49.245 INFO:tasks.workunit.client.0.smithi029.stdout:5/982: dwrite d0/d35/d83/fb9 [0,4194304] 0 2024-04-23T10:21:49.248 INFO:tasks.workunit.client.0.smithi029.stdout:2/878: dread d1/dd/d47/d63/d64/f115 [0,4194304] 0 2024-04-23T10:21:49.250 INFO:tasks.workunit.client.0.smithi029.stdout:2/879: chown d1/cc7 2598 1 2024-04-23T10:21:49.250 INFO:tasks.workunit.client.0.smithi029.stdout:0/802: dwrite d0/d21/f38 [0,4194304] 0 2024-04-23T10:21:49.251 INFO:tasks.workunit.client.0.smithi029.stdout:5/983: write d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/f94 [546290,101760] 0 2024-04-23T10:21:49.259 INFO:tasks.workunit.client.0.smithi029.stdout:2/880: rename d1/d4/db7/db8/dde/cf7 to d1/dd/d47/d63/d64/ded/d10d/c12b 0 2024-04-23T10:21:49.266 INFO:tasks.workunit.client.0.smithi029.stdout:0/803: rename d0/d3e/c5a to d0/da9/d4c/da7/dc7/dd7/d71/da4/c111 0 2024-04-23T10:21:49.269 INFO:tasks.workunit.client.0.smithi029.stdout:5/984: creat d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/dcb/f142 x:0 0 0 2024-04-23T10:21:49.274 INFO:tasks.workunit.client.0.smithi029.stdout:5/985: creat d0/d35/f143 x:0 0 0 2024-04-23T10:21:49.276 INFO:tasks.workunit.client.0.smithi029.stdout:0/804: getdents d0/d1b/d67/dae/d92/da0/dd3 0 2024-04-23T10:21:49.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/986: write d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/d3f/fc0 [837117,113301] 0 2024-04-23T10:21:49.284 INFO:tasks.workunit.client.0.smithi029.stdout:0/805: write d0/d21/f39 [2109163,37478] 0 2024-04-23T10:21:49.288 INFO:tasks.workunit.client.0.smithi029.stdout:5/987: dread d0/d6a/dd7/f107 [0,4194304] 0 2024-04-23T10:21:49.289 INFO:tasks.workunit.client.0.smithi029.stdout:0/806: creat d0/d1b/d67/dae/f112 x:0 0 0 2024-04-23T10:21:49.291 INFO:tasks.workunit.client.0.smithi029.stdout:0/807: write d0/d21/d7f/d55/f8a [895185,17834] 0 2024-04-23T10:21:49.292 INFO:tasks.workunit.client.0.smithi029.stdout:2/881: dread d1/dd/d47/d63/d64/f72 [0,4194304] 0 2024-04-23T10:21:49.294 INFO:tasks.workunit.client.0.smithi029.stdout:0/808: write d0/d21/dcb/f109 [293142,89021] 0 2024-04-23T10:21:49.294 INFO:tasks.workunit.client.0.smithi029.stdout:5/988: mkdir d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d144 0 2024-04-23T10:21:49.296 INFO:tasks.workunit.client.0.smithi029.stdout:0/809: rmdir d0/da9/d4c/daf/ddc 39 2024-04-23T10:21:49.296 INFO:tasks.workunit.client.0.smithi029.stdout:2/882: read d1/dd/d47/d63/fa7 [917384,72200] 0 2024-04-23T10:21:49.299 INFO:tasks.workunit.client.0.smithi029.stdout:0/810: creat d0/d1b/d67/f113 x:0 0 0 2024-04-23T10:21:49.303 INFO:tasks.workunit.client.0.smithi029.stdout:2/883: unlink d1/dd/d47/d63/d64/d78/da6/dcf/fd0 0 2024-04-23T10:21:49.304 INFO:tasks.workunit.client.0.smithi029.stdout:0/811: fdatasync d0/d3e/d4e/d7c/f95 0 2024-04-23T10:21:49.306 INFO:tasks.workunit.client.0.smithi029.stdout:2/884: creat d1/d3e/d107/f12c x:0 0 0 2024-04-23T10:21:49.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/989: truncate d0/d35/d38/d3e/d66/d5a/f92 7283767 0 2024-04-23T10:21:49.310 INFO:tasks.workunit.client.0.smithi029.stdout:0/812: getdents d0/da9/d4c/da7/dc7/dd7/d73 0 2024-04-23T10:21:49.311 INFO:tasks.workunit.client.0.smithi029.stdout:5/990: dread - d0/d35/d38/d3e/d66/d8c/fc7 zero size 2024-04-23T10:21:49.315 INFO:tasks.workunit.client.0.smithi029.stdout:0/813: symlink d0/d1b/d67/dae/d92/da0/l114 0 2024-04-23T10:21:49.322 INFO:tasks.workunit.client.0.smithi029.stdout:0/814: write d0/d21/d7f/d55/f91 [188525,29572] 0 2024-04-23T10:21:49.326 INFO:tasks.workunit.client.0.smithi029.stdout:0/815: creat d0/da9/d4c/f115 x:0 0 0 2024-04-23T10:21:49.329 INFO:tasks.workunit.client.0.smithi029.stdout:0/816: rmdir d0/d1b/d67/dae/d92 39 2024-04-23T10:21:49.329 INFO:tasks.workunit.client.0.smithi029.stdout:2/885: dread d1/dd/d22/f90 [0,4194304] 0 2024-04-23T10:21:49.330 INFO:tasks.workunit.client.0.smithi029.stdout:0/817: dread - d0/da9/d4c/d6d/ff9 zero size 2024-04-23T10:21:49.330 INFO:tasks.workunit.client.0.smithi029.stdout:2/886: chown d1/d31/d3d/l40 1181 1 2024-04-23T10:21:49.334 INFO:tasks.workunit.client.0.smithi029.stdout:2/887: symlink d1/d3e/d3b/d75/dd1/l12d 0 2024-04-23T10:21:49.336 INFO:tasks.workunit.client.0.smithi029.stdout:2/888: symlink d1/dda/l12e 0 2024-04-23T10:21:49.341 INFO:tasks.workunit.client.0.smithi029.stdout:0/818: dwrite d0/da9/f45 [4194304,4194304] 0 2024-04-23T10:21:49.345 INFO:tasks.workunit.client.0.smithi029.stdout:0/819: rmdir d0/d3e/d4e/d7c 39 2024-04-23T10:21:49.345 INFO:tasks.workunit.client.0.smithi029.stdout:2/889: dwrite d1/dd/d22/f2c [0,4194304] 0 2024-04-23T10:21:49.347 INFO:tasks.workunit.client.0.smithi029.stdout:2/890: symlink d1/dd/ddf/d11f/l12f 0 2024-04-23T10:21:49.348 INFO:tasks.workunit.client.0.smithi029.stdout:0/820: creat d0/da9/d4c/daf/f116 x:0 0 0 2024-04-23T10:21:49.349 INFO:tasks.workunit.client.0.smithi029.stdout:2/891: mknod d1/c130 0 2024-04-23T10:21:49.351 INFO:tasks.workunit.client.0.smithi029.stdout:2/892: readlink d1/d31/d3d/l40 0 2024-04-23T10:21:49.355 INFO:tasks.workunit.client.0.smithi029.stdout:2/893: creat d1/dd/d60/dd7/d121/f131 x:0 0 0 2024-04-23T10:21:49.362 INFO:tasks.workunit.client.0.smithi029.stdout:0/821: dwrite d0/da9/d4c/d6d/f100 [0,4194304] 0 2024-04-23T10:21:49.364 INFO:tasks.workunit.client.0.smithi029.stdout:0/822: readlink d0/dc/le 0 2024-04-23T10:21:49.368 INFO:tasks.workunit.client.0.smithi029.stdout:0/823: fdatasync d0/d3e/fb1 0 2024-04-23T10:21:49.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/821: dread d3/d15/d4b/f50 [0,4194304] 0 2024-04-23T10:21:49.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/824: mknod d0/d1b/d67/d6c/c117 0 2024-04-23T10:21:49.375 INFO:tasks.workunit.client.0.smithi029.stdout:3/822: stat d3/d45/d4f/f6e 0 2024-04-23T10:21:49.377 INFO:tasks.workunit.client.0.smithi029.stdout:0/825: creat d0/d1b/d67/d6c/f118 x:0 0 0 2024-04-23T10:21:49.381 INFO:tasks.workunit.client.0.smithi029.stdout:3/823: fdatasync d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/fda 0 2024-04-23T10:21:49.388 INFO:tasks.workunit.client.0.smithi029.stdout:7/995: sync 2024-04-23T10:21:49.388 INFO:tasks.workunit.client.0.smithi029.stdout:3/824: write d3/d45/d4f/d6b/f93 [4903209,62567] 0 2024-04-23T10:21:49.390 INFO:tasks.workunit.client.0.smithi029.stdout:3/825: fdatasync d3/d10/de/d2e/d36/f38 0 2024-04-23T10:21:49.393 INFO:tasks.workunit.client.0.smithi029.stdout:3/826: fsync d3/d10/de/d2e/d36/d8a/f95 0 2024-04-23T10:21:49.395 INFO:tasks.workunit.client.0.smithi029.stdout:7/996: link d5/f2c d5/d29/d4a/dc1/f13f 0 2024-04-23T10:21:49.396 INFO:tasks.workunit.client.0.smithi029.stdout:3/827: chown d3/d10/d48/cbb 1126597 1 2024-04-23T10:21:49.396 INFO:tasks.workunit.client.0.smithi029.stdout:7/997: readlink d5/l16 0 2024-04-23T10:21:49.399 INFO:tasks.workunit.client.0.smithi029.stdout:7/998: mknod d5/d8/d116/d127/c140 0 2024-04-23T10:21:49.399 INFO:tasks.workunit.client.0.smithi029.stdout:3/828: getdents d3/d10/de 0 2024-04-23T10:21:49.401 INFO:tasks.workunit.client.0.smithi029.stdout:7/999: creat d5/d71/df5/f141 x:0 0 0 2024-04-23T10:21:49.407 INFO:tasks.workunit.client.0.smithi029.stdout:3/829: dread d3/d10/de/d2e/d36/d40/d46/d72/f68 [0,4194304] 0 2024-04-23T10:21:49.409 INFO:tasks.workunit.client.0.smithi029.stdout:3/830: mkdir d3/d113 0 2024-04-23T10:21:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:3/831: rename d3/d102/cf2 to d3/d45/d4f/df5/c114 0 2024-04-23T10:21:49.415 INFO:tasks.workunit.client.0.smithi029.stdout:3/832: fsync d3/d10/de/d2e/d36/fa5 0 2024-04-23T10:21:49.426 INFO:tasks.workunit.client.0.smithi029.stdout:3/833: dwrite d3/d45/d4f/d6b/ddf/fd7 [0,4194304] 0 2024-04-23T10:21:49.430 INFO:tasks.workunit.client.0.smithi029.stdout:3/834: unlink d3/d10/d48/ca6 0 2024-04-23T10:21:49.431 INFO:tasks.workunit.client.0.smithi029.stdout:3/835: chown d3/d10/f2b 1 1 2024-04-23T10:21:49.440 INFO:tasks.workunit.client.0.smithi029.stdout:3/836: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d28/f64 [0,4194304] 0 2024-04-23T10:21:49.443 INFO:tasks.workunit.client.0.smithi029.stdout:3/837: chown d3/d10/de/d2e/d36/d40/d46/leb 12 1 2024-04-23T10:21:49.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/838: dread d3/d10/de/d2e/d36/d40/d46/d72/d31/f1a [0,4194304] 0 2024-04-23T10:21:49.466 INFO:tasks.workunit.client.0.smithi029.stdout:3/839: mknod d3/d10/de/d2e/d36/d40/d46/d65/c115 0 2024-04-23T10:21:49.475 INFO:tasks.workunit.client.0.smithi029.stdout:3/840: dread d3/d10/d48/fb5 [0,4194304] 0 2024-04-23T10:21:49.477 INFO:tasks.workunit.client.0.smithi029.stdout:3/841: truncate d3/d10/de/d2e/d36/d8a/f95 1097359 0 2024-04-23T10:21:49.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/842: chown d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89 1 1 2024-04-23T10:21:49.479 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:21:49.479 INFO:tasks.workunit.client.0.smithi029.stdout:3/843: chown d3/d45/f4a 7351967 1 2024-04-23T10:21:49.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:21:49.487 INFO:tasks.workunit.client.0.smithi029.stdout:3/844: dwrite d3/d10/de/d2e/d36/d107/f111 [0,4194304] 0 2024-04-23T10:21:49.494 INFO:tasks.workunit.client.0.smithi029.stdout:3/845: write d3/f5c [1922844,8609] 0 2024-04-23T10:21:49.496 INFO:tasks.workunit.client.0.smithi029.stdout:3/846: stat d3/d45/d4f/d6b/ddf/fd7 0 2024-04-23T10:21:49.500 INFO:tasks.workunit.client.0.smithi029.stdout:3/847: read d3/d45/d4f/f6e [977883,118705] 0 2024-04-23T10:21:49.516 INFO:tasks.workunit.client.0.smithi029.stdout:2/894: dread d1/d3e/d5a/d6d/fbe [0,4194304] 0 2024-04-23T10:21:49.518 INFO:tasks.workunit.client.0.smithi029.stdout:2/895: write d1/dd/d47/d63/d64/d78/ff6 [446398,128971] 0 2024-04-23T10:21:49.519 INFO:tasks.workunit.client.0.smithi029.stdout:2/896: dread - d1/d3e/d107/f12c zero size 2024-04-23T10:21:49.527 INFO:tasks.workunit.client.0.smithi029.stdout:2/897: dwrite d1/dd/d60/dd7/f12a [0,4194304] 0 2024-04-23T10:21:49.528 INFO:tasks.workunit.client.0.smithi029.stdout:2/898: fsync d1/d4/db7/ff8 0 2024-04-23T10:21:49.534 INFO:tasks.workunit.client.0.smithi029.stdout:2/899: rename d1/d31/l36 to d1/dd/d22/l132 0 2024-04-23T10:21:49.534 INFO:tasks.workunit.client.0.smithi029.stdout:2/900: fdatasync d1/d3e/f89 0 2024-04-23T10:21:49.536 INFO:tasks.workunit.client.0.smithi029.stdout:2/901: stat d1/d3e/d3b/d75/f85 0 2024-04-23T10:21:49.537 INFO:tasks.workunit.client.0.smithi029.stdout:2/902: truncate d1/fe6 744771 0 2024-04-23T10:21:49.541 INFO:tasks.workunit.client.0.smithi029.stdout:2/903: creat d1/dd/d22/f133 x:0 0 0 2024-04-23T10:21:49.674 INFO:tasks.workunit.client.0.smithi029.stdout:1/859: sync 2024-04-23T10:21:49.680 INFO:tasks.workunit.client.0.smithi029.stdout:1/860: symlink d5/d6/de/d22/l114 0 2024-04-23T10:21:49.731 INFO:tasks.workunit.client.0.smithi029.stdout:2/904: dread d1/d3e/d3b/d75/f7a [0,4194304] 0 2024-04-23T10:21:49.734 INFO:tasks.workunit.client.0.smithi029.stdout:2/905: write d1/dd/d60/dd7/f113 [472558,50900] 0 2024-04-23T10:21:49.739 INFO:tasks.workunit.client.0.smithi029.stdout:2/906: rmdir d1/dd/d47 39 2024-04-23T10:21:49.836 INFO:tasks.workunit.client.0.smithi029.stdout:5/991: sync 2024-04-23T10:21:49.842 INFO:tasks.workunit.client.0.smithi029.stdout:5/992: unlink d0/d35/d38/d3e/d66/d5a/d78/l60 0 2024-04-23T10:21:49.848 INFO:tasks.workunit.client.0.smithi029.stdout:5/993: mknod d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d114/c145 0 2024-04-23T10:21:49.852 INFO:tasks.workunit.client.0.smithi029.stdout:5/994: chown d0/d35/d38/d3e/d66/d5a/f92 1 1 2024-04-23T10:21:49.855 INFO:tasks.workunit.client.0.smithi029.stdout:5/995: chown d0/d35/d38/d3e/d66/c62 938754 1 2024-04-23T10:21:49.877 INFO:tasks.workunit.client.0.smithi029.stdout:5/996: dread d0/d35/d38/d3e/d66/d5a/d78/d6d/d72/d85/d9b/d11f/f86 [0,4194304] 0 2024-04-23T10:21:50.043 INFO:tasks.workunit.client.0.smithi029.stdout:0/826: sync 2024-04-23T10:21:50.063 INFO:tasks.workunit.client.0.smithi029.stdout:0/827: dwrite d0/da9/d4c/da7/fd4 [0,4194304] 0 2024-04-23T10:21:50.067 INFO:tasks.workunit.client.0.smithi029.stdout:0/828: chown d0/c1f 424289352 1 2024-04-23T10:21:50.069 INFO:tasks.workunit.client.0.smithi029.stdout:0/829: chown d0/d21/le0 1 1 2024-04-23T10:21:50.078 INFO:tasks.workunit.client.0.smithi029.stdout:0/830: write d0/dc/fcc [729157,119694] 0 2024-04-23T10:21:50.081 INFO:tasks.workunit.client.0.smithi029.stdout:0/831: chown d0/d3e/d4e/cc1 10884800 1 2024-04-23T10:21:50.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/832: chown d0/da9/d4c/da7/dc7/dd7/d73/fea 6992577 1 2024-04-23T10:21:50.092 INFO:tasks.workunit.client.0.smithi029.stdout:0/833: creat d0/da9/d4c/daf/dde/f119 x:0 0 0 2024-04-23T10:21:50.097 INFO:tasks.workunit.client.0.smithi029.stdout:1/861: dread d5/f17 [0,4194304] 0 2024-04-23T10:21:50.099 INFO:tasks.workunit.client.0.smithi029.stdout:0/834: mknod d0/d1b/d67/c11a 0 2024-04-23T10:21:50.105 INFO:tasks.workunit.client.0.smithi029.stdout:0/835: mknod d0/da9/d4c/c11b 0 2024-04-23T10:21:50.107 INFO:tasks.workunit.client.0.smithi029.stdout:0/836: chown d0/d21/d7f/lb7 0 1 2024-04-23T10:21:50.126 INFO:tasks.workunit.client.0.smithi029.stdout:0/837: dwrite d0/da9/d4c/da7/f10d [0,4194304] 0 2024-04-23T10:21:50.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/838: dwrite d0/d21/d7f/d3a/f86 [0,4194304] 0 2024-04-23T10:21:50.213 INFO:tasks.workunit.client.0.smithi029.stdout:2/907: dread d1/d31/d50/d9b/d9e/fa3 [0,4194304] 0 2024-04-23T10:21:50.218 INFO:tasks.workunit.client.0.smithi029.stdout:0/839: mkdir d0/dc/dd9/d11c 0 2024-04-23T10:21:50.222 INFO:tasks.workunit.client.0.smithi029.stdout:2/908: creat d1/dd/d60/dd7/f134 x:0 0 0 2024-04-23T10:21:50.230 INFO:tasks.workunit.client.0.smithi029.stdout:0/840: mkdir d0/d21/d7f/d11d 0 2024-04-23T10:21:50.232 INFO:tasks.workunit.client.0.smithi029.stdout:0/841: readlink d0/d1b/d67/dae/d6a/lc5 0 2024-04-23T10:21:50.248 INFO:tasks.workunit.client.0.smithi029.stdout:0/842: truncate d0/da9/d4c/f6b 1089804 0 2024-04-23T10:21:50.250 INFO:tasks.workunit.client.0.smithi029.stdout:0/843: chown d0/dc/d26/f2e 2718267 1 2024-04-23T10:21:50.256 INFO:tasks.workunit.client.0.smithi029.stdout:2/909: rename d1/dd/d47/f5d to d1/dd/f135 0 2024-04-23T10:21:50.267 INFO:tasks.workunit.client.0.smithi029.stdout:2/910: dread d1/dd/d22/f90 [0,4194304] 0 2024-04-23T10:21:50.274 INFO:tasks.workunit.client.0.smithi029.stdout:3/848: sync 2024-04-23T10:21:50.283 INFO:tasks.workunit.client.0.smithi029.stdout:0/844: mkdir d0/da9/d4c/daf/ddc/d11e 0 2024-04-23T10:21:50.287 INFO:tasks.workunit.client.0.smithi029.stdout:2/911: dwrite d1/d3e/d107/f12c [0,4194304] 0 2024-04-23T10:21:50.291 INFO:tasks.workunit.client.0.smithi029.stdout:3/849: creat d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/f116 x:0 0 0 2024-04-23T10:21:50.294 INFO:tasks.workunit.client.0.smithi029.stdout:0/845: dread - d0/d1b/d67/fd2 zero size 2024-04-23T10:21:50.318 INFO:tasks.workunit.client.0.smithi029.stdout:3/850: creat d3/d10/de/d2e/d36/d40/d46/d72/d28/f117 x:0 0 0 2024-04-23T10:21:50.323 INFO:tasks.workunit.client.0.smithi029.stdout:2/912: rename d1/d110 to d1/d3e/d5a/d6d/d136 0 2024-04-23T10:21:50.331 INFO:tasks.workunit.client.0.smithi029.stdout:2/913: rename d1/dda/l105 to d1/dda/l137 0 2024-04-23T10:21:50.338 INFO:tasks.workunit.client.0.smithi029.stdout:0/846: dread d0/da9/d4c/da7/dc7/dd7/ffd [0,4194304] 0 2024-04-23T10:21:50.339 INFO:tasks.workunit.client.0.smithi029.stdout:0/847: stat d0/d21/le0 0 2024-04-23T10:21:50.346 INFO:tasks.workunit.client.0.smithi029.stdout:3/851: write d3/d15/f1d [2904648,125578] 0 2024-04-23T10:21:50.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/914: mkdir d1/dd/d47/d63/d64/d78/d138 0 2024-04-23T10:21:50.353 INFO:tasks.workunit.client.0.smithi029.stdout:0/848: symlink d0/da9/d4c/daf/l11f 0 2024-04-23T10:21:50.359 INFO:tasks.workunit.client.0.smithi029.stdout:0/849: fsync d0/f4 0 2024-04-23T10:21:50.362 INFO:tasks.workunit.client.0.smithi029.stdout:3/852: symlink d3/d10/de/d2e/d36/d40/d46/d72/d5e/l118 0 2024-04-23T10:21:50.430 INFO:tasks.workunit.client.0.smithi029.stdout:5/997: sync 2024-04-23T10:21:50.437 INFO:tasks.workunit.client.0.smithi029.stdout:5/998: mknod d0/c146 0 2024-04-23T10:21:50.441 INFO:tasks.workunit.client.0.smithi029.stdout:3/853: creat d3/d15/d4b/f119 x:0 0 0 2024-04-23T10:21:50.443 INFO:tasks.workunit.client.0.smithi029.stdout:3/854: write d3/f5c [4777818,67722] 0 2024-04-23T10:21:50.464 INFO:tasks.workunit.client.0.smithi029.stdout:5/999: dread d0/d35/d10/d26/db2/fd4 [0,4194304] 0 2024-04-23T10:21:50.532 INFO:tasks.workunit.client.0.smithi029.stdout:1/862: sync 2024-04-23T10:21:50.545 INFO:tasks.workunit.client.0.smithi029.stdout:1/863: creat d5/d3e/f115 x:0 0 0 2024-04-23T10:21:50.547 INFO:tasks.workunit.client.0.smithi029.stdout:1/864: chown d5/d6/d34/d63/f7d 134 1 2024-04-23T10:21:50.557 INFO:tasks.workunit.client.0.smithi029.stdout:3/855: link d3/d10/de/d2e/d36/d40/d46/d72/d5e/cc5 d3/d10/de/d2e/d59/c11a 0 2024-04-23T10:21:50.575 INFO:tasks.workunit.client.0.smithi029.stdout:1/865: write d5/d6/de/d27/fe9 [695815,91877] 0 2024-04-23T10:21:50.587 INFO:tasks.workunit.client.0.smithi029.stdout:3/856: dread d3/d10/f20 [4194304,4194304] 0 2024-04-23T10:21:50.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/866: dread d5/d6/de/f33 [0,4194304] 0 2024-04-23T10:21:50.605 INFO:tasks.workunit.client.0.smithi029.stdout:2/915: sync 2024-04-23T10:21:50.606 INFO:tasks.workunit.client.0.smithi029.stdout:0/850: sync 2024-04-23T10:21:50.610 INFO:tasks.workunit.client.0.smithi029.stdout:3/857: dread d3/d15/d4b/d52/dee/f57 [0,4194304] 0 2024-04-23T10:21:50.612 INFO:tasks.workunit.client.0.smithi029.stdout:0/851: chown d0/d1b/d67/dae/d92/fb5 550122 1 2024-04-23T10:21:50.614 INFO:tasks.workunit.client.0.smithi029.stdout:1/867: symlink d5/d6/d34/d8a/l116 0 2024-04-23T10:21:50.618 INFO:tasks.workunit.client.0.smithi029.stdout:0/852: mknod d0/da9/d4c/daf/ddc/c120 0 2024-04-23T10:21:50.630 INFO:tasks.workunit.client.0.smithi029.stdout:1/868: dwrite d5/d6/f21 [0,4194304] 0 2024-04-23T10:21:50.630 INFO:tasks.workunit.client.0.smithi029.stdout:2/916: dread d1/d3e/d5a/f6f [0,4194304] 0 2024-04-23T10:21:50.631 INFO:tasks.workunit.client.0.smithi029.stdout:1/869: stat d5/d6/de/d15/fee 0 2024-04-23T10:21:50.633 INFO:tasks.workunit.client.0.smithi029.stdout:1/870: stat d5/d6/d34/d63/fa2 0 2024-04-23T10:21:50.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/917: dread d1/d3e/f4c [0,4194304] 0 2024-04-23T10:21:50.647 INFO:tasks.workunit.client.0.smithi029.stdout:0/853: creat d0/d21/d7f/d3a/f121 x:0 0 0 2024-04-23T10:21:50.647 INFO:tasks.workunit.client.0.smithi029.stdout:1/871: write d5/d6/de/d22/d77/f98 [424079,7979] 0 2024-04-23T10:21:50.648 INFO:tasks.workunit.client.0.smithi029.stdout:3/858: dwrite d3/d15/f21 [0,4194304] 0 2024-04-23T10:21:50.649 INFO:tasks.workunit.client.0.smithi029.stdout:1/872: readlink d5/d6/d34/laa 0 2024-04-23T10:21:50.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/854: symlink d0/d1b/d67/dae/d92/da0/dbe/l122 0 2024-04-23T10:21:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:3/859: symlink d3/d10/de/d2e/d36/d40/d46/d65/dfd/l11b 0 2024-04-23T10:21:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:2/918: write d1/d3e/d3b/d75/fdd [163438,100970] 0 2024-04-23T10:21:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:0/855: dwrite d0/da9/d4c/daf/dde/f119 [0,4194304] 0 2024-04-23T10:21:50.681 INFO:tasks.workunit.client.0.smithi029.stdout:3/860: dread - d3/d102/fff zero size 2024-04-23T10:21:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:1/873: dread d5/d6/d34/d63/dfc/dc4/f67 [0,4194304] 0 2024-04-23T10:21:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:0/856: mknod d0/d21/dcb/c123 0 2024-04-23T10:21:50.695 INFO:tasks.workunit.client.0.smithi029.stdout:1/874: write d5/d6/de/d22/ff4 [864693,93024] 0 2024-04-23T10:21:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:3/861: mknod d3/d10/de/d2e/d36/d8a/c11c 0 2024-04-23T10:21:50.704 INFO:tasks.workunit.client.0.smithi029.stdout:2/919: truncate d1/d3e/d3b/d75/fdd 3561548 0 2024-04-23T10:21:50.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/920: dread d1/fe6 [0,4194304] 0 2024-04-23T10:21:50.709 INFO:tasks.workunit.client.0.smithi029.stdout:1/875: dwrite d5/d6/de/d27/da9/fb9 [0,4194304] 0 2024-04-23T10:21:50.711 INFO:tasks.workunit.client.0.smithi029.stdout:3/862: unlink d3/d10/de/d2e/d36/d40/d46/d65/f81 0 2024-04-23T10:21:50.713 INFO:tasks.workunit.client.0.smithi029.stdout:2/921: fdatasync d1/d31/d50/f82 0 2024-04-23T10:21:50.714 INFO:tasks.workunit.client.0.smithi029.stdout:1/876: symlink d5/d6/da5/l117 0 2024-04-23T10:21:50.718 INFO:tasks.workunit.client.0.smithi029.stdout:2/922: mkdir d1/d3e/d3b/d75/dd1/d139 0 2024-04-23T10:21:50.724 INFO:tasks.workunit.client.0.smithi029.stdout:1/877: read d5/d6/f7f [138331,94507] 0 2024-04-23T10:21:50.728 INFO:tasks.workunit.client.0.smithi029.stdout:3/863: dwrite d3/d10/d48/ffc [0,4194304] 0 2024-04-23T10:21:50.730 INFO:tasks.workunit.client.0.smithi029.stdout:0/857: dread d0/d21/d7f/f8f [0,4194304] 0 2024-04-23T10:21:50.735 INFO:tasks.workunit.client.0.smithi029.stdout:2/923: truncate d1/dd/d47/d63/d64/f72 1396208 0 2024-04-23T10:21:50.742 INFO:tasks.workunit.client.0.smithi029.stdout:0/858: fdatasync d0/d1b/d67/dae/d92/fca 0 2024-04-23T10:21:50.744 INFO:tasks.workunit.client.0.smithi029.stdout:1/878: dread d5/d6/fdb [0,4194304] 0 2024-04-23T10:21:50.745 INFO:tasks.workunit.client.0.smithi029.stdout:1/879: chown d5/d6/de/d27/da9/dad/f104 48 1 2024-04-23T10:21:50.748 INFO:tasks.workunit.client.0.smithi029.stdout:3/864: write d3/d10/fa1 [91378,130520] 0 2024-04-23T10:21:50.751 INFO:tasks.workunit.client.0.smithi029.stdout:2/924: fdatasync d1/dd/d47/d63/d64/f6b 0 2024-04-23T10:21:50.752 INFO:tasks.workunit.client.0.smithi029.stdout:2/925: chown d1/d3e/d5a/d6d/faf 34 1 2024-04-23T10:21:50.755 INFO:tasks.workunit.client.0.smithi029.stdout:3/865: rmdir d3/d10/de/d2e/d36/d40/d46 39 2024-04-23T10:21:50.760 INFO:tasks.workunit.client.0.smithi029.stdout:0/859: link d0/da9/d4c/da7/dc7/dd7/d73/laa d0/da9/d4c/da7/dc7/l124 0 2024-04-23T10:21:50.761 INFO:tasks.workunit.client.0.smithi029.stdout:1/880: rename d5/d3e/da7/ld2 to d5/d6/d34/d63/dfc/l118 0 2024-04-23T10:21:50.762 INFO:tasks.workunit.client.0.smithi029.stdout:2/926: dwrite d1/d31/d3d/fe9 [0,4194304] 0 2024-04-23T10:21:50.762 INFO:tasks.workunit.client.0.smithi029.stdout:3/866: symlink d3/d45/d4f/l11d 0 2024-04-23T10:21:50.765 INFO:tasks.workunit.client.0.smithi029.stdout:1/881: readlink d5/d6/d34/lb1 0 2024-04-23T10:21:50.765 INFO:tasks.workunit.client.0.smithi029.stdout:2/927: dread d1/dd/d22/f90 [4194304,4194304] 0 2024-04-23T10:21:50.765 INFO:tasks.workunit.client.0.smithi029.stdout:0/860: write d0/d3e/d4e/d7c/f9a [2200036,105486] 0 2024-04-23T10:21:50.765 INFO:tasks.workunit.client.0.smithi029.stdout:3/867: readlink d3/d10/de/d2e/d36/d40/d46/lf7 0 2024-04-23T10:21:50.767 INFO:tasks.workunit.client.0.smithi029.stdout:2/928: readlink d1/dd/d47/d63/d64/l114 0 2024-04-23T10:21:50.767 INFO:tasks.workunit.client.0.smithi029.stdout:1/882: chown d5/d6/de/d15/d7b/l86 54626 1 2024-04-23T10:21:50.769 INFO:tasks.workunit.client.0.smithi029.stdout:2/929: truncate d1/dd/d60/ff5 510089 0 2024-04-23T10:21:50.770 INFO:tasks.workunit.client.0.smithi029.stdout:1/883: readlink d5/d6/de/d22/d77/lbd 0 2024-04-23T10:21:50.773 INFO:tasks.workunit.client.0.smithi029.stdout:0/861: mkdir d0/da9/d4c/da7/dc7/dd7/d71/d125 0 2024-04-23T10:21:50.777 INFO:tasks.workunit.client.0.smithi029.stdout:2/930: symlink d1/dd/d47/d63/d64/ded/d10d/l13a 0 2024-04-23T10:21:50.779 INFO:tasks.workunit.client.0.smithi029.stdout:3/868: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d28/f117 [0,4194304] 0 2024-04-23T10:21:50.794 INFO:tasks.workunit.client.0.smithi029.stdout:2/931: dwrite d1/d3e/fa9 [0,4194304] 0 2024-04-23T10:21:50.796 INFO:tasks.workunit.client.0.smithi029.stdout:2/932: stat d1/dd/d60/dd7/d121 0 2024-04-23T10:21:50.796 INFO:tasks.workunit.client.0.smithi029.stdout:2/933: stat d1/dd/d60/cfc 0 2024-04-23T10:21:50.799 INFO:tasks.workunit.client.0.smithi029.stdout:2/934: mkdir d1/d31/d50/d13b 0 2024-04-23T10:21:50.799 INFO:tasks.workunit.client.0.smithi029.stdout:1/884: dread d5/d6/de/d15/d7b/f9b [0,4194304] 0 2024-04-23T10:21:50.803 INFO:tasks.workunit.client.0.smithi029.stdout:3/869: rename d3/d15/f21 to d3/d10/de/d2e/d36/d40/d46/d72/d31/f11e 0 2024-04-23T10:21:50.809 INFO:tasks.workunit.client.0.smithi029.stdout:0/862: dread d0/d21/f39 [0,4194304] 0 2024-04-23T10:21:50.810 INFO:tasks.workunit.client.0.smithi029.stdout:1/885: dwrite d5/f66 [0,4194304] 0 2024-04-23T10:21:50.814 INFO:tasks.workunit.client.0.smithi029.stdout:3/870: unlink d3/d15/d4b/d52/d5f/c10a 0 2024-04-23T10:21:50.815 INFO:tasks.workunit.client.0.smithi029.stdout:1/886: dread d5/d6/de/d22/f56 [0,4194304] 0 2024-04-23T10:21:50.816 INFO:tasks.workunit.client.0.smithi029.stdout:2/935: write d1/d3e/d3b/d75/fe2 [129189,62872] 0 2024-04-23T10:21:50.820 INFO:tasks.workunit.client.0.smithi029.stdout:1/887: creat d5/d6/d34/d63/dfc/dc4/d6a/f119 x:0 0 0 2024-04-23T10:21:50.822 INFO:tasks.workunit.client.0.smithi029.stdout:3/871: mkdir d3/d10/de/d2e/d36/d8a/d10e/d11f 0 2024-04-23T10:21:50.823 INFO:tasks.workunit.client.0.smithi029.stdout:2/936: creat d1/dd/d22/d127/f13c x:0 0 0 2024-04-23T10:21:50.826 INFO:tasks.workunit.client.0.smithi029.stdout:2/937: unlink d1/d3e/d5a/f6e 0 2024-04-23T10:21:50.829 INFO:tasks.workunit.client.0.smithi029.stdout:3/872: link d3/f63 d3/d102/f120 0 2024-04-23T10:21:50.830 INFO:tasks.workunit.client.0.smithi029.stdout:2/938: mkdir d1/dd/d22/d13d 0 2024-04-23T10:21:50.831 INFO:tasks.workunit.client.0.smithi029.stdout:1/888: dwrite d5/d6/fdb [0,4194304] 0 2024-04-23T10:21:50.833 INFO:tasks.workunit.client.0.smithi029.stdout:2/939: stat d1/d3e/c2f 0 2024-04-23T10:21:50.833 INFO:tasks.workunit.client.0.smithi029.stdout:2/940: fdatasync d1/dd/f51 0 2024-04-23T10:21:50.834 INFO:tasks.workunit.client.0.smithi029.stdout:3/873: symlink d3/d45/d4f/d6b/ddf/l121 0 2024-04-23T10:21:50.839 INFO:tasks.workunit.client.0.smithi029.stdout:2/941: unlink d1/d3e/d3b/fca 0 2024-04-23T10:21:50.842 INFO:tasks.workunit.client.0.smithi029.stdout:1/889: mkdir d5/d6/de/d27/d111/d11a 0 2024-04-23T10:21:50.846 INFO:tasks.workunit.client.0.smithi029.stdout:2/942: rename d1/d31/d3d/f41 to d1/d4/db7/db8/dd8/f13e 0 2024-04-23T10:21:50.849 INFO:tasks.workunit.client.0.smithi029.stdout:3/874: dwrite d3/d15/d4b/f50 [4194304,4194304] 0 2024-04-23T10:21:50.850 INFO:tasks.workunit.client.0.smithi029.stdout:3/875: chown d3/d45/d4f/cc8 0 1 2024-04-23T10:21:50.858 INFO:tasks.workunit.client.0.smithi029.stdout:2/943: write d1/dd/d47/d63/d64/d78/fce [860074,61175] 0 2024-04-23T10:21:50.861 INFO:tasks.workunit.client.0.smithi029.stdout:1/890: dwrite d5/fa0 [0,4194304] 0 2024-04-23T10:21:50.862 INFO:tasks.workunit.client.0.smithi029.stdout:3/876: getdents d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89 0 2024-04-23T10:21:50.864 INFO:tasks.workunit.client.0.smithi029.stdout:1/891: write d5/d6/d34/d63/dfc/dc4/ff9 [11255,67161] 0 2024-04-23T10:21:50.868 INFO:tasks.workunit.client.0.smithi029.stdout:1/892: write d5/d6/d34/d63/dfc/dc4/fc7 [2719910,65151] 0 2024-04-23T10:21:50.868 INFO:tasks.workunit.client.0.smithi029.stdout:3/877: fdatasync d3/d102/fff 0 2024-04-23T10:21:50.870 INFO:tasks.workunit.client.0.smithi029.stdout:2/944: rename d1/d3e/d3b/l9a to d1/d31/d50/d9b/d117/l13f 0 2024-04-23T10:21:50.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/893: write d5/d6/de/d22/d77/fe1 [886392,47744] 0 2024-04-23T10:21:50.878 INFO:tasks.workunit.client.0.smithi029.stdout:3/878: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d75/d122 0 2024-04-23T10:21:50.878 INFO:tasks.workunit.client.0.smithi029.stdout:1/894: mknod d5/d6/d34/d63/dfc/c11b 0 2024-04-23T10:21:50.880 INFO:tasks.workunit.client.0.smithi029.stdout:2/945: creat d1/d4/db7/db8/f140 x:0 0 0 2024-04-23T10:21:50.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/895: rename d5/d6/d34/d63/dfc/dc4/l4d to d5/d6/d34/d8a/de2/l11c 0 2024-04-23T10:21:50.888 INFO:tasks.workunit.client.0.smithi029.stdout:2/946: dwrite d1/dd/d60/fc9 [0,4194304] 0 2024-04-23T10:21:50.892 INFO:tasks.workunit.client.0.smithi029.stdout:1/896: write d5/d6/de/d22/fe4 [1164676,94218] 0 2024-04-23T10:21:50.893 INFO:tasks.workunit.client.0.smithi029.stdout:3/879: dwrite d3/d15/d4b/d52/dee/f57 [0,4194304] 0 2024-04-23T10:21:50.896 INFO:tasks.workunit.client.0.smithi029.stdout:1/897: unlink d5/d6/d34/d63/dfc/dc4/f65 0 2024-04-23T10:21:50.897 INFO:tasks.workunit.client.0.smithi029.stdout:2/947: link d1/d31/d50/d9b/d9e/f10f d1/dd5/f141 0 2024-04-23T10:21:50.899 INFO:tasks.workunit.client.0.smithi029.stdout:1/898: write d5/d6/d34/d63/dfc/dc4/d6a/f119 [371237,37321] 0 2024-04-23T10:21:50.909 INFO:tasks.workunit.client.0.smithi029.stdout:3/880: rename d3/d10/de/d2e/d36/d40/d46/d72/d28/l110 to d3/d15/d4b/d52/dee/l123 0 2024-04-23T10:21:50.914 INFO:tasks.workunit.client.0.smithi029.stdout:1/899: getdents d5/d6/de/d27/d111/d11a 0 2024-04-23T10:21:50.916 INFO:tasks.workunit.client.0.smithi029.stdout:2/948: dwrite d1/dd5/f141 [0,4194304] 0 2024-04-23T10:21:50.916 INFO:tasks.workunit.client.0.smithi029.stdout:1/900: truncate d5/d6/de/d22/ff4 1323133 0 2024-04-23T10:21:50.939 INFO:tasks.workunit.client.0.smithi029.stdout:3/881: unlink d3/d10/de/d2e/d36/d40/d46/d72/d5e/cc5 0 2024-04-23T10:21:50.940 INFO:tasks.workunit.client.0.smithi029.stdout:1/901: mknod d5/d6/de/d15/dfe/d106/c11d 0 2024-04-23T10:21:50.942 INFO:tasks.workunit.client.0.smithi029.stdout:1/902: dread d5/d6/de/d22/f56 [0,4194304] 0 2024-04-23T10:21:50.952 INFO:tasks.workunit.client.0.smithi029.stdout:3/882: fdatasync d3/d45/d4f/f6e 0 2024-04-23T10:21:50.953 INFO:tasks.workunit.client.0.smithi029.stdout:2/949: dwrite d1/dd/d60/fe0 [0,4194304] 0 2024-04-23T10:21:50.954 INFO:tasks.workunit.client.0.smithi029.stdout:2/950: readlink d1/d3e/d5a/d6d/lbc 0 2024-04-23T10:21:50.955 INFO:tasks.workunit.client.0.smithi029.stdout:2/951: chown d1/d31/d50/f82 134 1 2024-04-23T10:21:50.957 INFO:tasks.workunit.client.0.smithi029.stdout:3/883: read - d3/d45/fbd zero size 2024-04-23T10:21:50.961 INFO:tasks.workunit.client.0.smithi029.stdout:3/884: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/d124 0 2024-04-23T10:21:50.964 INFO:tasks.workunit.client.0.smithi029.stdout:2/952: mkdir d1/d4/db7/db8/dde/d142 0 2024-04-23T10:21:50.975 INFO:tasks.workunit.client.0.smithi029.stdout:3/885: dread d3/d10/de/d2e/d36/d8a/f95 [0,4194304] 0 2024-04-23T10:21:50.978 INFO:tasks.workunit.client.0.smithi029.stdout:2/953: unlink d1/dd/d47/d63/d64/fcc 0 2024-04-23T10:21:50.980 INFO:tasks.workunit.client.0.smithi029.stdout:3/886: readlink d3/d10/de/d2e/d59/l84 0 2024-04-23T10:21:50.982 INFO:tasks.workunit.client.0.smithi029.stdout:3/887: dread d3/d10/de/d2e/d36/d8a/f95 [0,4194304] 0 2024-04-23T10:21:50.986 INFO:tasks.workunit.client.0.smithi029.stdout:2/954: link d1/d3e/fa9 d1/dd/ddf/d11f/f143 0 2024-04-23T10:21:50.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/955: mkdir d1/d4/db7/deb/d144 0 2024-04-23T10:21:50.989 INFO:tasks.workunit.client.0.smithi029.stdout:3/888: creat d3/d10/de/d2e/d36/d8a/f125 x:0 0 0 2024-04-23T10:21:50.991 INFO:tasks.workunit.client.0.smithi029.stdout:2/956: chown d1/d3e/d3b/cb2 495 1 2024-04-23T10:21:50.993 INFO:tasks.workunit.client.0.smithi029.stdout:3/889: rename d3/d45/d4f/cc8 to d3/d15/d4b/d52/dee/dde/c126 0 2024-04-23T10:21:50.997 INFO:tasks.workunit.client.0.smithi029.stdout:2/957: truncate d1/dd/d47/f53 2580284 0 2024-04-23T10:21:50.999 INFO:tasks.workunit.client.0.smithi029.stdout:3/890: creat d3/d10/d48/def/f127 x:0 0 0 2024-04-23T10:21:51.001 INFO:tasks.workunit.client.0.smithi029.stdout:2/958: fdatasync d1/f8c 0 2024-04-23T10:21:51.003 INFO:tasks.workunit.client.0.smithi029.stdout:3/891: creat d3/d10/de/f128 x:0 0 0 2024-04-23T10:21:51.003 INFO:tasks.workunit.client.0.smithi029.stdout:2/959: read d1/dd/d60/dd7/f113 [1942248,21315] 0 2024-04-23T10:21:51.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/960: dwrite d1/d3e/f89 [0,4194304] 0 2024-04-23T10:21:51.017 INFO:tasks.workunit.client.0.smithi029.stdout:2/961: mknod d1/dd/ddf/c145 0 2024-04-23T10:21:51.018 INFO:tasks.workunit.client.0.smithi029.stdout:3/892: write d3/d10/de/d2e/d36/d40/d46/d72/d5e/f9e [9281938,50120] 0 2024-04-23T10:21:51.019 INFO:tasks.workunit.client.0.smithi029.stdout:3/893: chown d3/d10/de/d2e/de2 14 1 2024-04-23T10:21:51.026 INFO:tasks.workunit.client.0.smithi029.stdout:2/962: write d1/d3e/f77 [11741659,107988] 0 2024-04-23T10:21:51.026 INFO:tasks.workunit.client.0.smithi029.stdout:3/894: write d3/d15/d4b/d52/fa4 [1464564,13397] 0 2024-04-23T10:21:51.033 INFO:tasks.workunit.client.0.smithi029.stdout:2/963: rename d1/d31/d3d/c4f to d1/d3e/d3b/d75/dd1/c146 0 2024-04-23T10:21:51.036 INFO:tasks.workunit.client.0.smithi029.stdout:2/964: mknod d1/d3e/d3b/d75/dd1/c147 0 2024-04-23T10:21:51.040 INFO:tasks.workunit.client.0.smithi029.stdout:2/965: mknod d1/dd/d47/d63/d64/d78/da6/dcf/c148 0 2024-04-23T10:21:51.042 INFO:tasks.workunit.client.0.smithi029.stdout:2/966: rmdir d1/d4/db7/db8/dde 39 2024-04-23T10:21:51.043 INFO:tasks.workunit.client.0.smithi029.stdout:2/967: write d1/d4/db7/db8/f140 [734991,10899] 0 2024-04-23T10:21:51.057 INFO:tasks.workunit.client.0.smithi029.stdout:3/895: dread d3/d45/d4f/d6b/fdc [0,4194304] 0 2024-04-23T10:21:51.063 INFO:tasks.workunit.client.0.smithi029.stdout:2/968: dread d1/d3e/d3b/f7d [0,4194304] 0 2024-04-23T10:21:51.067 INFO:tasks.workunit.client.0.smithi029.stdout:2/969: rename d1/d3e/d5a to d1/d4/d149 0 2024-04-23T10:21:51.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/970: rmdir d1/d31/d50/d9b/d117 39 2024-04-23T10:21:51.071 INFO:tasks.workunit.client.0.smithi029.stdout:2/971: write d1/dd/d47/d63/d64/d78/ff6 [215437,37392] 0 2024-04-23T10:21:51.073 INFO:tasks.workunit.client.0.smithi029.stdout:2/972: mknod d1/dd/d22/c14a 0 2024-04-23T10:21:51.082 INFO:tasks.workunit.client.0.smithi029.stdout:2/973: dwrite d1/dd/d47/d63/f11e [0,4194304] 0 2024-04-23T10:21:51.082 INFO:tasks.workunit.client.0.smithi029.stdout:2/974: chown d1/d3e/d3b/d75/dd1/dea 1 1 2024-04-23T10:21:51.085 INFO:tasks.workunit.client.0.smithi029.stdout:2/975: symlink d1/d31/d50/d9b/l14b 0 2024-04-23T10:21:51.088 INFO:tasks.workunit.client.0.smithi029.stdout:2/976: truncate d1/d31/d50/d9b/fb5 781374 0 2024-04-23T10:21:51.090 INFO:tasks.workunit.client.0.smithi029.stdout:2/977: chown d1/d31/d50/d9b/d117 13279943 1 2024-04-23T10:21:51.090 INFO:tasks.workunit.client.0.smithi029.stdout:2/978: fsync d1/d3e/d3b/d75/dd1/f116 0 2024-04-23T10:21:51.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/979: creat d1/d4/db7/db8/dde/f14c x:0 0 0 2024-04-23T10:21:51.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/980: read d1/dd/d60/dd7/f12a [407475,2139] 0 2024-04-23T10:21:51.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/981: rename d1/dd/ffd to d1/dd/ddf/d11f/f14d 0 2024-04-23T10:21:51.109 INFO:tasks.workunit.client.0.smithi029.stdout:2/982: dwrite d1/fb3 [0,4194304] 0 2024-04-23T10:21:51.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/983: write d1/d4/db7/db8/f140 [63877,62027] 0 2024-04-23T10:21:51.120 INFO:tasks.workunit.client.0.smithi029.stdout:2/984: dwrite d1/d3e/f129 [0,4194304] 0 2024-04-23T10:21:51.129 INFO:tasks.workunit.client.0.smithi029.stdout:2/985: dwrite d1/d3e/f77 [4194304,4194304] 0 2024-04-23T10:21:51.131 INFO:tasks.workunit.client.0.smithi029.stdout:2/986: write d1/dd/f62 [4650529,90597] 0 2024-04-23T10:21:51.135 INFO:tasks.workunit.client.0.smithi029.stdout:2/987: symlink d1/d3e/d3b/l14e 0 2024-04-23T10:21:51.143 INFO:tasks.workunit.client.0.smithi029.stdout:2/988: fsync d1/dd/d47/d63/d64/f72 0 2024-04-23T10:21:51.146 INFO:tasks.workunit.client.0.smithi029.stdout:2/989: mkdir d1/dd/d47/d63/d64/d78/da6/d14f 0 2024-04-23T10:21:51.149 INFO:tasks.workunit.client.0.smithi029.stdout:2/990: truncate d1/dd/ddf/d11f/f143 3516114 0 2024-04-23T10:21:51.150 INFO:tasks.workunit.client.0.smithi029.stdout:2/991: chown d1/d31/ce5 86830 1 2024-04-23T10:21:51.152 INFO:tasks.workunit.client.0.smithi029.stdout:2/992: dread d1/dd/d47/d63/d64/f72 [0,4194304] 0 2024-04-23T10:21:51.160 INFO:tasks.workunit.client.0.smithi029.stdout:2/993: dread d1/dd/ddf/d11f/f143 [0,4194304] 0 2024-04-23T10:21:51.164 INFO:tasks.workunit.client.0.smithi029.stdout:2/994: write d1/dd/d60/dd7/f12a [1104751,99197] 0 2024-04-23T10:21:51.165 INFO:tasks.workunit.client.0.smithi029.stdout:2/995: rmdir d1/d4/d149/dcd 39 2024-04-23T10:21:51.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/996: fsync d1/dd/d47/d63/d64/d78/fce 0 2024-04-23T10:21:51.169 INFO:tasks.workunit.client.0.smithi029.stdout:2/997: dread - d1/d31/fbf zero size 2024-04-23T10:21:51.171 INFO:tasks.workunit.client.0.smithi029.stdout:2/998: truncate d1/d4/d149/dcd/fd2 467953 0 2024-04-23T10:21:51.174 INFO:tasks.workunit.client.0.smithi029.stdout:2/999: creat d1/dd/d22/d13d/f150 x:0 0 0 2024-04-23T10:21:51.243 INFO:tasks.workunit.client.0.smithi029.stdout:0/863: sync 2024-04-23T10:21:51.244 INFO:tasks.workunit.client.0.smithi029.stdout:0/864: stat d0/da9/f70 0 2024-04-23T10:21:51.250 INFO:tasks.workunit.client.0.smithi029.stdout:0/865: mknod d0/da9/d4c/da7/dc7/dd7/d73/c126 0 2024-04-23T10:21:51.258 INFO:tasks.workunit.client.0.smithi029.stdout:0/866: getdents d0/d21/d7f/d55 0 2024-04-23T10:21:51.264 INFO:tasks.workunit.client.0.smithi029.stdout:0/867: mknod d0/d21/d7f/d3a/c127 0 2024-04-23T10:21:51.267 INFO:tasks.workunit.client.0.smithi029.stdout:0/868: creat d0/da9/f128 x:0 0 0 2024-04-23T10:21:51.288 INFO:tasks.workunit.client.0.smithi029.stdout:0/869: dwrite d0/d21/d7f/f8f [0,4194304] 0 2024-04-23T10:21:51.293 INFO:tasks.workunit.client.0.smithi029.stdout:0/870: truncate d0/da9/d4c/d6d/fbd 2129508 0 2024-04-23T10:21:51.315 INFO:tasks.workunit.client.0.smithi029.stdout:0/871: dread d0/d3e/ddd/f101 [0,4194304] 0 2024-04-23T10:21:51.333 INFO:tasks.workunit.client.0.smithi029.stdout:0/872: dwrite d0/d21/f77 [0,4194304] 0 2024-04-23T10:21:51.340 INFO:tasks.workunit.client.0.smithi029.stdout:0/873: rename d0/c1f to d0/d3e/d4e/d7c/c129 0 2024-04-23T10:21:51.361 INFO:tasks.workunit.client.0.smithi029.stdout:0/874: dwrite d0/d1b/d67/dae/d6a/fdb [0,4194304] 0 2024-04-23T10:21:51.371 INFO:tasks.workunit.client.0.smithi029.stdout:0/875: rename d0/da9/d4c/da7/dc7/dd7/d73 to d0/d1b/d67/dae/d92/da0/dbe/d12a 0 2024-04-23T10:21:51.383 INFO:tasks.workunit.client.0.smithi029.stdout:0/876: dwrite d0/d3e/f10c [0,4194304] 0 2024-04-23T10:21:51.388 INFO:tasks.workunit.client.0.smithi029.stdout:0/877: fdatasync d0/d3e/d4e/fcf 0 2024-04-23T10:21:51.388 INFO:tasks.workunit.client.0.smithi029.stdout:0/878: stat d0/d3e/d4e 0 2024-04-23T10:21:51.395 INFO:tasks.workunit.client.0.smithi029.stdout:0/879: fdatasync d0/d3e/f72 0 2024-04-23T10:21:51.405 INFO:tasks.workunit.client.0.smithi029.stdout:0/880: creat d0/da9/d4c/da7/dc7/dd7/d71/d125/f12b x:0 0 0 2024-04-23T10:21:51.410 INFO:tasks.workunit.client.0.smithi029.stdout:0/881: unlink d0/d1b/d67/dae/d92/fb5 0 2024-04-23T10:21:51.413 INFO:tasks.workunit.client.0.smithi029.stdout:0/882: mkdir d0/da9/d4c/daf/ddc/d12c 0 2024-04-23T10:21:51.414 INFO:tasks.workunit.client.0.smithi029.stdout:0/883: dread - d0/da9/d4c/da7/dc7/dd7/f104 zero size 2024-04-23T10:21:51.425 INFO:tasks.workunit.client.0.smithi029.stdout:0/884: write d0/da9/d4c/da7/dc7/fef [969,17347] 0 2024-04-23T10:21:51.429 INFO:tasks.workunit.client.0.smithi029.stdout:0/885: read d0/da9/d4c/d6d/f100 [576535,87921] 0 2024-04-23T10:21:51.433 INFO:tasks.workunit.client.0.smithi029.stdout:1/903: sync 2024-04-23T10:21:51.434 INFO:tasks.workunit.client.0.smithi029.stdout:1/904: chown d5/d6/da5/l117 0 1 2024-04-23T10:21:51.516 INFO:tasks.workunit.client.0.smithi029.stdout:3/896: sync 2024-04-23T10:21:51.639 INFO:tasks.workunit.client.0.smithi029.stdout:0/886: write d0/fe3 [675839,112465] 0 2024-04-23T10:21:51.642 INFO:tasks.workunit.client.0.smithi029.stdout:3/897: mknod d3/d113/c129 0 2024-04-23T10:21:51.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/887: truncate d0/d3e/ddd/de4/f102 238181 0 2024-04-23T10:21:51.647 INFO:tasks.workunit.client.0.smithi029.stdout:1/905: creat d5/d6/d34/d63/dfc/f11e x:0 0 0 2024-04-23T10:21:51.650 INFO:tasks.workunit.client.0.smithi029.stdout:1/906: chown d5/d3e/da7 16 1 2024-04-23T10:21:51.653 INFO:tasks.workunit.client.0.smithi029.stdout:0/888: mkdir d0/da9/d4c/daf/ddc/d12d 0 2024-04-23T10:21:51.653 INFO:tasks.workunit.client.0.smithi029.stdout:1/907: dread - d5/d6/d34/d63/fa2 zero size 2024-04-23T10:21:51.656 INFO:tasks.workunit.client.0.smithi029.stdout:0/889: write d0/d21/f53 [292952,96032] 0 2024-04-23T10:21:51.659 INFO:tasks.workunit.client.0.smithi029.stdout:1/908: unlink d5/d6/d34/fb7 0 2024-04-23T10:21:51.663 INFO:tasks.workunit.client.0.smithi029.stdout:0/890: fdatasync d0/d21/dcb/de9/fed 0 2024-04-23T10:21:51.671 INFO:tasks.workunit.client.0.smithi029.stdout:0/891: symlink d0/d3e/ddd/de4/l12e 0 2024-04-23T10:21:51.673 INFO:tasks.workunit.client.0.smithi029.stdout:1/909: truncate d5/d6/d34/d63/dfc/dc4/d47/fa8 126600 0 2024-04-23T10:21:51.675 INFO:tasks.workunit.client.0.smithi029.stdout:1/910: fdatasync d5/d6/d34/d8a/fc0 0 2024-04-23T10:21:51.685 INFO:tasks.workunit.client.0.smithi029.stdout:0/892: link d0/d21/d7f/f29 d0/dc/f12f 0 2024-04-23T10:21:51.686 INFO:tasks.workunit.client.0.smithi029.stdout:3/898: dread d3/d10/f20 [0,4194304] 0 2024-04-23T10:21:51.687 INFO:tasks.workunit.client.0.smithi029.stdout:0/893: readlink d0/d1b/d67/dae/d6a/lc5 0 2024-04-23T10:21:51.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/911: dread d5/d6/d34/d63/dfc/dc4/d47/fa8 [0,4194304] 0 2024-04-23T10:21:51.694 INFO:tasks.workunit.client.0.smithi029.stdout:3/899: dread f0 [4194304,4194304] 0 2024-04-23T10:21:51.703 INFO:tasks.workunit.client.0.smithi029.stdout:3/900: write d3/d45/f4a [2728322,102987] 0 2024-04-23T10:21:51.734 INFO:tasks.workunit.client.0.smithi029.stdout:1/912: dread d5/f70 [0,4194304] 0 2024-04-23T10:21:51.735 INFO:tasks.workunit.client.0.smithi029.stdout:0/894: dread d0/da9/f61 [4194304,4194304] 0 2024-04-23T10:21:51.735 INFO:tasks.workunit.client.0.smithi029.stdout:3/901: dwrite d3/d10/de/d2e/d36/d40/f41 [0,4194304] 0 2024-04-23T10:21:51.742 INFO:tasks.workunit.client.0.smithi029.stdout:0/895: stat d0/dc/d90/cf3 0 2024-04-23T10:21:51.747 INFO:tasks.workunit.client.0.smithi029.stdout:0/896: chown d0/d21/d7f/d3a/f4b 1617347 1 2024-04-23T10:21:51.757 INFO:tasks.workunit.client.0.smithi029.stdout:0/897: rmdir d0/d21/d7f/d11d 0 2024-04-23T10:21:51.761 INFO:tasks.workunit.client.0.smithi029.stdout:0/898: fdatasync d0/da9/f9e 0 2024-04-23T10:21:51.778 INFO:tasks.workunit.client.0.smithi029.stdout:0/899: dwrite d0/da9/d4c/da7/fd4 [4194304,4194304] 0 2024-04-23T10:21:51.781 INFO:tasks.workunit.client.0.smithi029.stdout:3/902: dread d3/d10/de/f54 [0,4194304] 0 2024-04-23T10:21:51.786 INFO:tasks.workunit.client.0.smithi029.stdout:3/903: readlink d3/d15/d4b/d52/dee/l123 0 2024-04-23T10:21:51.824 INFO:tasks.workunit.client.0.smithi029.stdout:3/904: dread d3/d10/de/d2e/d36/d40/f7e [0,4194304] 0 2024-04-23T10:21:51.829 INFO:tasks.workunit.client.0.smithi029.stdout:0/900: rename d0/d1b/c42 to d0/dc/d90/c130 0 2024-04-23T10:21:51.838 INFO:tasks.workunit.client.0.smithi029.stdout:3/905: symlink d3/d10/de/d2e/d59/l12a 0 2024-04-23T10:21:51.841 INFO:tasks.workunit.client.0.smithi029.stdout:3/906: truncate d3/d10/de/f128 591915 0 2024-04-23T10:21:51.848 INFO:tasks.workunit.client.0.smithi029.stdout:0/901: creat d0/dc/dd9/dfe/f131 x:0 0 0 2024-04-23T10:21:51.854 INFO:tasks.workunit.client.0.smithi029.stdout:3/907: rmdir d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89 39 2024-04-23T10:21:51.880 INFO:tasks.workunit.client.0.smithi029.stdout:0/902: rename d0/d1b/d67/dae/d92/da0/dbe/ff1 to d0/da9/d4c/f132 0 2024-04-23T10:21:51.894 INFO:tasks.workunit.client.0.smithi029.stdout:3/908: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/fb1 [0,4194304] 0 2024-04-23T10:21:51.908 INFO:tasks.workunit.client.0.smithi029.stdout:0/903: write d0/d1b/d67/dae/d92/da0/dbe/d12a/d7e/fa8 [3872236,85391] 0 2024-04-23T10:21:51.908 INFO:tasks.workunit.client.0.smithi029.stdout:3/909: write d3/d45/d4f/d6b/fea [70695,80537] 0 2024-04-23T10:21:51.927 INFO:tasks.workunit.client.0.smithi029.stdout:1/913: sync 2024-04-23T10:21:51.974 INFO:tasks.workunit.client.0.smithi029.stdout:1/914: symlink d5/d6/de/d22/d77/l11f 0 2024-04-23T10:21:51.979 INFO:tasks.workunit.client.0.smithi029.stdout:0/904: getdents d0/dc/d26 0 2024-04-23T10:21:51.988 INFO:tasks.workunit.client.0.smithi029.stdout:1/915: mknod d5/d6/d34/d63/dfc/dc4/d47/db0/c120 0 2024-04-23T10:21:51.998 INFO:tasks.workunit.client.0.smithi029.stdout:1/916: rename d5/d6/de/d27/l42 to d5/d6/de/d27/da9/dad/l121 0 2024-04-23T10:21:52.004 INFO:tasks.workunit.client.0.smithi029.stdout:0/905: link d0/d1b/d67/dae/d92/da0/dbe/d12a/d7e/fee d0/da9/d4c/daf/ddc/d11e/f133 0 2024-04-23T10:21:52.013 INFO:tasks.workunit.client.0.smithi029.stdout:3/910: write d3/d10/f7a [337303,102999] 0 2024-04-23T10:21:52.016 INFO:tasks.workunit.client.0.smithi029.stdout:0/906: dread d0/d21/f77 [0,4194304] 0 2024-04-23T10:21:52.035 INFO:tasks.workunit.client.0.smithi029.stdout:1/917: dwrite d5/d6/d34/d63/dfc/dc4/fe0 [0,4194304] 0 2024-04-23T10:21:52.042 INFO:tasks.workunit.client.0.smithi029.stdout:1/918: symlink d5/d3e/dda/l122 0 2024-04-23T10:21:52.048 INFO:tasks.workunit.client.0.smithi029.stdout:0/907: getdents d0/d1b/d67/d6c 0 2024-04-23T10:21:52.061 INFO:tasks.workunit.client.0.smithi029.stdout:1/919: write d5/d6/de/d22/d6c/fc5 [907359,70590] 0 2024-04-23T10:21:52.074 INFO:tasks.workunit.client.0.smithi029.stdout:1/920: dwrite d5/fa3 [0,4194304] 0 2024-04-23T10:21:52.075 INFO:tasks.workunit.client.0.smithi029.stdout:1/921: chown d5/fa3 0 1 2024-04-23T10:21:52.082 INFO:tasks.workunit.client.0.smithi029.stdout:0/908: link d0/d1b/d67/dae/d92/da0/lc4 d0/d3e/ddd/de4/l134 0 2024-04-23T10:21:52.086 INFO:tasks.workunit.client.0.smithi029.stdout:1/922: mkdir d5/d6/de/d123 0 2024-04-23T10:21:52.212 INFO:tasks.workunit.client.0.smithi029.stdout:3/911: sync 2024-04-23T10:21:52.235 INFO:tasks.workunit.client.0.smithi029.stdout:0/909: dwrite d0/d1b/fa1 [0,4194304] 0 2024-04-23T10:21:52.248 INFO:tasks.workunit.client.0.smithi029.stdout:3/912: dwrite d3/d10/de/f14 [4194304,4194304] 0 2024-04-23T10:21:52.257 INFO:tasks.workunit.client.0.smithi029.stdout:0/910: rename d0/f6 to d0/dc/dd9/f135 0 2024-04-23T10:21:52.259 INFO:tasks.workunit.client.0.smithi029.stdout:0/911: chown d0/d1b/d67/dae/d92/l10b 50 1 2024-04-23T10:21:52.261 INFO:tasks.workunit.client.0.smithi029.stdout:0/912: readlink d0/d21/d7f/lb7 0 2024-04-23T10:21:52.265 INFO:tasks.workunit.client.0.smithi029.stdout:3/913: chown d3/d10/de/d2e/d36/d8a/c92 31 1 2024-04-23T10:21:52.270 INFO:tasks.workunit.client.0.smithi029.stdout:1/923: sync 2024-04-23T10:21:52.276 INFO:tasks.workunit.client.0.smithi029.stdout:1/924: dread - d5/d6/de/d22/f7a zero size 2024-04-23T10:21:52.277 INFO:tasks.workunit.client.0.smithi029.stdout:0/913: write d0/f4f [838489,67217] 0 2024-04-23T10:21:52.281 INFO:tasks.workunit.client.0.smithi029.stdout:3/914: creat d3/d10/de/d2e/f12b x:0 0 0 2024-04-23T10:21:52.284 INFO:tasks.workunit.client.0.smithi029.stdout:1/925: stat d5/d6/de/d15/c8b 0 2024-04-23T10:21:52.292 INFO:tasks.workunit.client.0.smithi029.stdout:1/926: write d5/d6/d34/d63/dfc/dc4/d47/db0/fed [4812116,94890] 0 2024-04-23T10:21:52.296 INFO:tasks.workunit.client.0.smithi029.stdout:0/914: write d0/d21/d7f/d3a/fbb [438817,126731] 0 2024-04-23T10:21:52.297 INFO:tasks.workunit.client.0.smithi029.stdout:3/915: write d3/d10/de/d2e/d36/fb2 [135927,86379] 0 2024-04-23T10:21:52.300 INFO:tasks.workunit.client.0.smithi029.stdout:0/915: stat d0/da9/d4c/da7/dc7/dd7/d71/fd6 0 2024-04-23T10:21:52.313 INFO:tasks.workunit.client.0.smithi029.stdout:1/927: write d5/d3e/da7/fb2 [3646258,97374] 0 2024-04-23T10:21:52.313 INFO:tasks.workunit.client.0.smithi029.stdout:0/916: write d0/d1b/d67/dae/d92/da0/fd1 [928147,89764] 0 2024-04-23T10:21:52.315 INFO:tasks.workunit.client.0.smithi029.stdout:1/928: readlink d5/d6/lba 0 2024-04-23T10:21:52.322 INFO:tasks.workunit.client.0.smithi029.stdout:1/929: creat d5/d6/de/d27/da9/dad/f124 x:0 0 0 2024-04-23T10:21:52.329 INFO:tasks.workunit.client.0.smithi029.stdout:0/917: truncate d0/d21/f38 3790155 0 2024-04-23T10:21:52.333 INFO:tasks.workunit.client.0.smithi029.stdout:0/918: rmdir d0/d3e/ddd/de4 39 2024-04-23T10:21:52.344 INFO:tasks.workunit.client.0.smithi029.stdout:1/930: write d5/d6/d34/d63/dfc/f100 [1498670,8500] 0 2024-04-23T10:21:52.353 INFO:tasks.workunit.client.0.smithi029.stdout:0/919: dwrite d0/dc/f36 [0,4194304] 0 2024-04-23T10:21:52.353 INFO:tasks.workunit.client.0.smithi029.stdout:1/931: unlink d5/d6/d34/d63/dcf/fd1 0 2024-04-23T10:21:52.361 INFO:tasks.workunit.client.0.smithi029.stdout:1/932: mknod d5/d6/d34/d8a/de2/c125 0 2024-04-23T10:21:52.373 INFO:tasks.workunit.client.0.smithi029.stdout:0/920: truncate d0/da9/d4c/d6d/f100 1111039 0 2024-04-23T10:21:52.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/921: read - d0/d3e/d4e/fcf zero size 2024-04-23T10:21:52.377 INFO:tasks.workunit.client.0.smithi029.stdout:1/933: truncate d5/d6/d34/d63/dfc/dc4/d47/fac 131778 0 2024-04-23T10:21:52.380 INFO:tasks.workunit.client.0.smithi029.stdout:1/934: fdatasync d5/d6/de/f33 0 2024-04-23T10:21:52.384 INFO:tasks.workunit.client.0.smithi029.stdout:0/922: mkdir d0/d1b/d67/dae/d136 0 2024-04-23T10:21:52.393 INFO:tasks.workunit.client.0.smithi029.stdout:0/923: symlink d0/da9/d4c/da7/dc7/l137 0 2024-04-23T10:21:52.396 INFO:tasks.workunit.client.0.smithi029.stdout:1/935: fdatasync d5/d6/de/d22/d77/f89 0 2024-04-23T10:21:52.397 INFO:tasks.workunit.client.0.smithi029.stdout:1/936: chown d5/d6/de 282 1 2024-04-23T10:21:52.404 INFO:tasks.workunit.client.0.smithi029.stdout:0/924: dwrite d0/d21/d7f/d3a/f86 [0,4194304] 0 2024-04-23T10:21:52.408 INFO:tasks.workunit.client.0.smithi029.stdout:1/937: symlink d5/d6/de/d15/dfe/d106/l126 0 2024-04-23T10:21:52.414 INFO:tasks.workunit.client.0.smithi029.stdout:1/938: mknod d5/d6/d34/d63/dfc/dc4/d6a/c127 0 2024-04-23T10:21:52.418 INFO:tasks.workunit.client.0.smithi029.stdout:0/925: write d0/d1b/f5d [919622,106756] 0 2024-04-23T10:21:52.422 INFO:tasks.workunit.client.0.smithi029.stdout:1/939: truncate d5/d6/de/d27/f99 1079002 0 2024-04-23T10:21:52.430 INFO:tasks.workunit.client.0.smithi029.stdout:3/916: sync 2024-04-23T10:21:52.431 INFO:tasks.workunit.client.0.smithi029.stdout:1/940: mkdir d5/d6/d34/d63/dcf/d128 0 2024-04-23T10:21:52.434 INFO:tasks.workunit.client.0.smithi029.stdout:0/926: write d0/d21/d7f/d3a/f87 [26143,5840] 0 2024-04-23T10:21:52.438 INFO:tasks.workunit.client.0.smithi029.stdout:1/941: read d5/d6/de/d15/f1a [3491706,97924] 0 2024-04-23T10:21:52.444 INFO:tasks.workunit.client.0.smithi029.stdout:0/927: mknod d0/d1b/d67/dae/d92/da0/dbe/d12a/c138 0 2024-04-23T10:21:52.447 INFO:tasks.workunit.client.0.smithi029.stdout:0/928: creat d0/d1b/d67/dae/d6a/df4/f139 x:0 0 0 2024-04-23T10:21:52.450 INFO:tasks.workunit.client.0.smithi029.stdout:1/942: creat d5/d8c/f129 x:0 0 0 2024-04-23T10:21:52.453 INFO:tasks.workunit.client.0.smithi029.stdout:1/943: readlink d5/d6/d34/d63/dfc/dc4/l4a 0 2024-04-23T10:21:52.456 INFO:tasks.workunit.client.0.smithi029.stdout:1/944: mkdir d5/d6/de/d27/da9/dad/dc9/d12a 0 2024-04-23T10:21:52.457 INFO:tasks.workunit.client.0.smithi029.stdout:0/929: link d0/d1b/d67/fd2 d0/d1b/d67/dae/f13a 0 2024-04-23T10:21:52.460 INFO:tasks.workunit.client.0.smithi029.stdout:1/945: rename d5/d6/de/d15/f26 to d5/d6/de/d27/f12b 0 2024-04-23T10:21:52.463 INFO:tasks.workunit.client.0.smithi029.stdout:0/930: getdents d0/d1b/d67 0 2024-04-23T10:21:52.464 INFO:tasks.workunit.client.0.smithi029.stdout:1/946: symlink d5/d6/d34/d63/dcf/d128/l12c 0 2024-04-23T10:21:52.465 INFO:tasks.workunit.client.0.smithi029.stdout:0/931: stat d0/d3e/d4e/l54 0 2024-04-23T10:21:52.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/932: read d0/d1b/fab [213032,85154] 0 2024-04-23T10:21:52.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/933: stat d0/d21/le0 0 2024-04-23T10:21:52.476 INFO:tasks.workunit.client.0.smithi029.stdout:0/934: dwrite d0/d1b/f5d [0,4194304] 0 2024-04-23T10:21:52.480 INFO:tasks.workunit.client.0.smithi029.stdout:0/935: mknod d0/d1b/d67/dae/d92/c13b 0 2024-04-23T10:21:52.486 INFO:tasks.workunit.client.0.smithi029.stdout:3/917: truncate d3/d10/de/d2e/d36/d40/d46/d72/d5e/f9e 8768510 0 2024-04-23T10:21:52.492 INFO:tasks.workunit.client.0.smithi029.stdout:3/918: unlink d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/cf4 0 2024-04-23T10:21:52.501 INFO:tasks.workunit.client.0.smithi029.stdout:3/919: dwrite d3/d10/de/d2e/d36/d40/f41 [4194304,4194304] 0 2024-04-23T10:21:52.504 INFO:tasks.workunit.client.0.smithi029.stdout:1/947: write d5/d6/de/d22/f59 [1204335,115178] 0 2024-04-23T10:21:52.507 INFO:tasks.workunit.client.0.smithi029.stdout:1/948: truncate d5/d6/fbc 474140 0 2024-04-23T10:21:52.509 INFO:tasks.workunit.client.0.smithi029.stdout:0/936: write d0/dc/d26/f28 [2332284,81873] 0 2024-04-23T10:21:52.521 INFO:tasks.workunit.client.0.smithi029.stdout:1/949: truncate d5/d6/de/d22/f5b 2964397 0 2024-04-23T10:21:52.522 INFO:tasks.workunit.client.0.smithi029.stdout:1/950: chown d5/d6/de/d22/f83 197364 1 2024-04-23T10:21:52.525 INFO:tasks.workunit.client.0.smithi029.stdout:0/937: creat d0/dc/d90/f13c x:0 0 0 2024-04-23T10:21:52.529 INFO:tasks.workunit.client.0.smithi029.stdout:0/938: creat d0/d1b/d67/dae/d6a/df4/f13d x:0 0 0 2024-04-23T10:21:52.530 INFO:tasks.workunit.client.0.smithi029.stdout:0/939: stat d0/dc/d90/lce 0 2024-04-23T10:21:52.530 INFO:tasks.workunit.client.0.smithi029.stdout:1/951: creat d5/d6/de/d27/da9/dad/dc9/d12a/f12d x:0 0 0 2024-04-23T10:21:52.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/920: write f0 [4762291,105621] 0 2024-04-23T10:21:52.532 INFO:tasks.workunit.client.0.smithi029.stdout:1/952: chown d5/d6/f21 504 1 2024-04-23T10:21:52.535 INFO:tasks.workunit.client.0.smithi029.stdout:0/940: mknod d0/da9/d4c/da7/dc7/dd7/d71/d125/c13e 0 2024-04-23T10:21:52.537 INFO:tasks.workunit.client.0.smithi029.stdout:1/953: symlink d5/d6/de/d15/l12e 0 2024-04-23T10:21:52.537 INFO:tasks.workunit.client.0.smithi029.stdout:0/941: rmdir d0/d1b/d67/dae/d6a/df4 39 2024-04-23T10:21:52.551 INFO:tasks.workunit.client.0.smithi029.stdout:1/954: dwrite d5/d6/f16 [0,4194304] 0 2024-04-23T10:21:52.552 INFO:tasks.workunit.client.0.smithi029.stdout:0/942: dwrite d0/fe3 [0,4194304] 0 2024-04-23T10:21:52.558 INFO:tasks.workunit.client.0.smithi029.stdout:1/955: truncate d5/d6/de/d22/f2f 104749 0 2024-04-23T10:21:52.559 INFO:tasks.workunit.client.0.smithi029.stdout:3/921: dread f0 [0,4194304] 0 2024-04-23T10:21:52.564 INFO:tasks.workunit.client.0.smithi029.stdout:3/922: chown d3/f69 31567 1 2024-04-23T10:21:52.565 INFO:tasks.workunit.client.0.smithi029.stdout:3/923: stat d3/d10/de/d2e/d36/fb2 0 2024-04-23T10:21:52.566 INFO:tasks.workunit.client.0.smithi029.stdout:1/956: getdents d5/d6/d34/d63/dfc/dc4/d6a 0 2024-04-23T10:21:52.569 INFO:tasks.workunit.client.0.smithi029.stdout:3/924: stat d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/ce4 0 2024-04-23T10:21:52.570 INFO:tasks.workunit.client.0.smithi029.stdout:1/957: read d5/d6/de/d15/d7b/f82 [443646,129422] 0 2024-04-23T10:21:52.571 INFO:tasks.workunit.client.0.smithi029.stdout:1/958: write d5/fa3 [2986442,75941] 0 2024-04-23T10:21:52.575 INFO:tasks.workunit.client.0.smithi029.stdout:3/925: getdents d3/d10/de/d2e/d36/d8a 0 2024-04-23T10:21:52.581 INFO:tasks.workunit.client.0.smithi029.stdout:3/926: rename d3/d10/de/d2e/d36/d40/d46/d72/d28/f64 to d3/d113/f12c 0 2024-04-23T10:21:52.583 INFO:tasks.workunit.client.0.smithi029.stdout:3/927: write d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/fda [797927,66108] 0 2024-04-23T10:21:52.585 INFO:tasks.workunit.client.0.smithi029.stdout:3/928: read d3/d10/de/f14 [4299303,108378] 0 2024-04-23T10:21:52.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/943: dwrite d0/d3e/fc3 [0,4194304] 0 2024-04-23T10:21:52.608 INFO:tasks.workunit.client.0.smithi029.stdout:1/959: dwrite d5/d6/d34/d63/dfc/dc4/d47/db0/fe3 [0,4194304] 0 2024-04-23T10:21:52.611 INFO:tasks.workunit.client.0.smithi029.stdout:3/929: write d3/f63 [4825857,72783] 0 2024-04-23T10:21:52.613 INFO:tasks.workunit.client.0.smithi029.stdout:1/960: unlink d5/d3e/da7/f10d 0 2024-04-23T10:21:52.615 INFO:tasks.workunit.client.0.smithi029.stdout:0/944: creat d0/d1b/d67/dae/d92/da0/dbe/d12a/d7e/f13f x:0 0 0 2024-04-23T10:21:52.618 INFO:tasks.workunit.client.0.smithi029.stdout:1/961: mkdir d5/d6/de/d15/d7b/d12f 0 2024-04-23T10:21:52.619 INFO:tasks.workunit.client.0.smithi029.stdout:3/930: creat d3/d45/f12d x:0 0 0 2024-04-23T10:21:52.619 INFO:tasks.workunit.client.0.smithi029.stdout:1/962: readlink d5/d6/de/d22/d6c/l9a 0 2024-04-23T10:21:52.622 INFO:tasks.workunit.client.0.smithi029.stdout:0/945: creat d0/d3e/ddd/de4/f140 x:0 0 0 2024-04-23T10:21:52.623 INFO:tasks.workunit.client.0.smithi029.stdout:1/963: mknod d5/d6/d34/d63/dcf/c130 0 2024-04-23T10:21:52.625 INFO:tasks.workunit.client.0.smithi029.stdout:1/964: fsync d5/d6/d34/d63/dfc/dc4/d47/db0/fe3 0 2024-04-23T10:21:52.625 INFO:tasks.workunit.client.0.smithi029.stdout:0/946: symlink d0/d1b/d67/l141 0 2024-04-23T10:21:52.626 INFO:tasks.workunit.client.0.smithi029.stdout:3/931: mknod d3/d10/de/d2e/d36/d40/d46/d72/d75/c12e 0 2024-04-23T10:21:52.629 INFO:tasks.workunit.client.0.smithi029.stdout:1/965: rename d5/d6/de/d27/da9/dad/ddd to d5/d6/de/d22/d6c/d131 0 2024-04-23T10:21:52.632 INFO:tasks.workunit.client.0.smithi029.stdout:3/932: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/d124/d12f 0 2024-04-23T10:21:52.636 INFO:tasks.workunit.client.0.smithi029.stdout:1/966: dwrite d5/d6/f16 [0,4194304] 0 2024-04-23T10:21:52.638 INFO:tasks.workunit.client.0.smithi029.stdout:1/967: write d5/d6/de/d27/f35 [1935809,61924] 0 2024-04-23T10:21:52.644 INFO:tasks.workunit.client.0.smithi029.stdout:1/968: creat d5/d6/de/d27/d111/d11a/f132 x:0 0 0 2024-04-23T10:21:52.646 INFO:tasks.workunit.client.0.smithi029.stdout:3/933: rename d3/d15/fb0 to d3/d15/d4b/f130 0 2024-04-23T10:21:52.933 INFO:tasks.workunit.client.0.smithi029.stdout:3/934: creat d3/d15/d4b/f131 x:0 0 0 2024-04-23T10:21:53.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/969: write d5/d6/de/d22/f5b [378666,106520] 0 2024-04-23T10:21:53.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/935: symlink d3/d10/de/d2e/d36/d107/l132 0 2024-04-23T10:21:53.050 INFO:tasks.workunit.client.0.smithi029.stdout:3/936: read d3/d45/d4f/d6b/fdc [1844468,10429] 0 2024-04-23T10:21:53.052 INFO:tasks.workunit.client.0.smithi029.stdout:3/937: chown d3/d45/d4f/df5 143908 1 2024-04-23T10:21:53.052 INFO:tasks.workunit.client.0.smithi029.stdout:1/970: dread d5/d6/de/d22/d77/f98 [0,4194304] 0 2024-04-23T10:21:53.057 INFO:tasks.workunit.client.0.smithi029.stdout:0/947: rename d0/d1b/d67/dae/d92/fca to d0/da9/d4c/daf/ddc/d12d/f142 0 2024-04-23T10:21:53.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/971: fdatasync d5/d6/de/d27/f12b 0 2024-04-23T10:21:53.066 INFO:tasks.workunit.client.0.smithi029.stdout:1/972: write d5/d6/fdb [4271255,99110] 0 2024-04-23T10:21:53.072 INFO:tasks.workunit.client.0.smithi029.stdout:0/948: creat d0/d1b/d67/dae/d92/da0/dbe/d12a/d7e/f143 x:0 0 0 2024-04-23T10:21:53.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/973: write d5/d6/d34/d63/dfc/dc4/fcd [730056,57528] 0 2024-04-23T10:21:53.076 INFO:tasks.workunit.client.0.smithi029.stdout:0/949: stat d0/da9/d4c/d6d 0 2024-04-23T10:21:53.079 INFO:tasks.workunit.client.0.smithi029.stdout:0/950: chown d0/d1b/l1d 4753 1 2024-04-23T10:21:53.082 INFO:tasks.workunit.client.0.smithi029.stdout:0/951: chown d0/d21/d7f/d3a/f86 22 1 2024-04-23T10:21:53.088 INFO:tasks.workunit.client.0.smithi029.stdout:0/952: mknod d0/d1b/d67/dae/d92/da0/dd3/c144 0 2024-04-23T10:21:53.090 INFO:tasks.workunit.client.0.smithi029.stdout:0/953: chown d0/da9/c75 1782556 1 2024-04-23T10:21:53.100 INFO:tasks.workunit.client.0.smithi029.stdout:0/954: rename d0/da9/d4c/d6d/fbd to d0/dc/dd9/f145 0 2024-04-23T10:21:53.106 INFO:tasks.workunit.client.0.smithi029.stdout:1/974: getdents d5/d6/d34 0 2024-04-23T10:21:53.115 INFO:tasks.workunit.client.0.smithi029.stdout:3/938: dwrite d3/d45/d4f/d6b/ddf/f104 [0,4194304] 0 2024-04-23T10:21:53.153 INFO:tasks.workunit.client.0.smithi029.stdout:3/939: dread d3/f69 [0,4194304] 0 2024-04-23T10:21:53.191 INFO:tasks.workunit.client.0.smithi029.stdout:3/940: dwrite d3/d10/f20 [8388608,4194304] 0 2024-04-23T10:21:53.214 INFO:tasks.workunit.client.0.smithi029.stdout:0/955: link d0/da9/f128 d0/d21/d7f/f146 0 2024-04-23T10:21:53.303 INFO:tasks.workunit.client.0.smithi029.stdout:3/941: write d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/fe6 [403749,14271] 0 2024-04-23T10:21:53.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/956: dread - d0/d1b/d67/dae/d92/da0/dd3/ff8 zero size 2024-04-23T10:21:53.312 INFO:tasks.workunit.client.0.smithi029.stdout:3/942: unlink d3/d10/de/d2e/d36/d8a/c92 0 2024-04-23T10:21:53.332 INFO:tasks.workunit.client.0.smithi029.stdout:3/943: dwrite d3/d15/f10d [0,4194304] 0 2024-04-23T10:21:53.355 INFO:tasks.workunit.client.0.smithi029.stdout:0/957: dread d0/f2b [0,4194304] 0 2024-04-23T10:21:53.358 INFO:tasks.workunit.client.0.smithi029.stdout:3/944: mkdir d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/d133 0 2024-04-23T10:21:53.363 INFO:tasks.workunit.client.0.smithi029.stdout:3/945: truncate d3/d10/de/d2e/d36/d40/d46/f112 369806 0 2024-04-23T10:21:53.380 INFO:tasks.workunit.client.0.smithi029.stdout:0/958: write d0/d1b/d67/d6c/f118 [186631,129358] 0 2024-04-23T10:21:53.383 INFO:tasks.workunit.client.0.smithi029.stdout:3/946: dwrite d3/d45/f12d [0,4194304] 0 2024-04-23T10:21:53.391 INFO:tasks.workunit.client.0.smithi029.stdout:0/959: mknod d0/da9/c147 0 2024-04-23T10:21:53.397 INFO:tasks.workunit.client.0.smithi029.stdout:0/960: creat d0/dc/dd9/f148 x:0 0 0 2024-04-23T10:21:53.403 INFO:tasks.workunit.client.0.smithi029.stdout:0/961: read d0/d21/d7f/d3a/f4b [381989,102581] 0 2024-04-23T10:21:53.405 INFO:tasks.workunit.client.0.smithi029.stdout:0/962: fsync d0/d21/dcb/f109 0 2024-04-23T10:21:53.408 INFO:tasks.workunit.client.0.smithi029.stdout:3/947: symlink d3/d10/de/d2e/d36/d40/d46/d72/d28/l134 0 2024-04-23T10:21:53.537 INFO:tasks.workunit.client.0.smithi029.stdout:1/975: sync 2024-04-23T10:21:53.539 INFO:tasks.workunit.client.0.smithi029.stdout:1/976: fsync d5/d6/de/d27/f35 0 2024-04-23T10:21:53.553 INFO:tasks.workunit.client.0.smithi029.stdout:1/977: dread d5/d6/de/d15/d7b/fb4 [0,4194304] 0 2024-04-23T10:21:53.555 INFO:tasks.workunit.client.0.smithi029.stdout:0/963: rename d0/da9/d4c/da7/dc7/dd7/d71/da4/f10e to d0/da9/d4c/f149 0 2024-04-23T10:21:53.570 INFO:tasks.workunit.client.0.smithi029.stdout:0/964: creat d0/da9/d4c/da7/dc7/dd7/d71/f14a x:0 0 0 2024-04-23T10:21:53.577 INFO:tasks.workunit.client.0.smithi029.stdout:1/978: creat d5/d8c/f133 x:0 0 0 2024-04-23T10:21:53.579 INFO:tasks.workunit.client.0.smithi029.stdout:1/979: chown d5/d3e/l50 3 1 2024-04-23T10:21:53.589 INFO:tasks.workunit.client.0.smithi029.stdout:0/965: dwrite d0/d21/d7f/d3a/f87 [0,4194304] 0 2024-04-23T10:21:53.591 INFO:tasks.workunit.client.0.smithi029.stdout:0/966: chown d0/d1b/d67/dae/d92 20846 1 2024-04-23T10:21:53.593 INFO:tasks.workunit.client.0.smithi029.stdout:0/967: chown d0/da9/d4c/d6d/ff9 73 1 2024-04-23T10:21:53.599 INFO:tasks.workunit.client.0.smithi029.stdout:1/980: dread d5/d6/de/d22/ff4 [0,4194304] 0 2024-04-23T10:21:53.611 INFO:tasks.workunit.client.0.smithi029.stdout:3/948: sync 2024-04-23T10:21:53.612 INFO:tasks.workunit.client.0.smithi029.stdout:3/949: stat d3/d113/f12c 0 2024-04-23T10:21:53.614 INFO:tasks.workunit.client.0.smithi029.stdout:3/950: read d3/d10/de/d2e/d36/d40/f41 [839389,112993] 0 2024-04-23T10:21:53.635 INFO:tasks.workunit.client.0.smithi029.stdout:0/968: write d0/d1b/d67/dae/d92/da0/dd3/ff8 [941372,4729] 0 2024-04-23T10:21:53.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/969: stat d0/da9/d4c/daf/ddc 0 2024-04-23T10:21:53.766 INFO:tasks.workunit.client.0.smithi029.stdout:1/981: sync 2024-04-23T10:21:53.840 INFO:tasks.workunit.client.0.smithi029.stdout:3/951: sync 2024-04-23T10:21:53.854 INFO:tasks.workunit.client.0.smithi029.stdout:3/952: mkdir d3/d15/d4b/d52/dee/d135 0 2024-04-23T10:21:53.860 INFO:tasks.workunit.client.0.smithi029.stdout:0/970: creat d0/f14b x:0 0 0 2024-04-23T10:21:53.866 INFO:tasks.workunit.client.0.smithi029.stdout:1/982: creat d5/d6/d34/d63/dfc/dc4/f134 x:0 0 0 2024-04-23T10:21:53.873 INFO:tasks.workunit.client.0.smithi029.stdout:0/971: mknod d0/dc/dd9/c14c 0 2024-04-23T10:21:53.874 INFO:tasks.workunit.client.0.smithi029.stdout:0/972: dread - d0/f14b zero size 2024-04-23T10:21:53.878 INFO:tasks.workunit.client.0.smithi029.stdout:0/973: dread - d0/da9/d4c/da7/dc7/dd7/d71/d125/f12b zero size 2024-04-23T10:21:53.887 INFO:tasks.workunit.client.0.smithi029.stdout:0/974: creat d0/d1b/d67/dae/d92/da0/dd3/f14d x:0 0 0 2024-04-23T10:21:53.891 INFO:tasks.workunit.client.0.smithi029.stdout:1/983: fdatasync d5/d6/de/d22/f5f 0 2024-04-23T10:21:53.896 INFO:tasks.workunit.client.0.smithi029.stdout:1/984: write d5/d6/d34/d63/dfc/dc4/ff9 [331223,55047] 0 2024-04-23T10:21:53.897 INFO:tasks.workunit.client.0.smithi029.stdout:0/975: mknod d0/d21/d7f/c14e 0 2024-04-23T10:21:53.904 INFO:tasks.workunit.client.0.smithi029.stdout:3/953: dread d3/d45/d4f/d6b/f74 [0,4194304] 0 2024-04-23T10:21:53.911 INFO:tasks.workunit.client.0.smithi029.stdout:1/985: unlink d5/d6/d34/d63/dfc/dc4/f134 0 2024-04-23T10:21:53.917 INFO:tasks.workunit.client.0.smithi029.stdout:0/976: mkdir d0/da9/d4c/da7/dc7/dd7/d71/d14f 0 2024-04-23T10:21:53.926 INFO:tasks.workunit.client.0.smithi029.stdout:3/954: write d3/d45/d4f/f91 [864216,102372] 0 2024-04-23T10:21:53.957 INFO:tasks.workunit.client.0.smithi029.stdout:1/986: dwrite d5/d6/d34/d63/dfc/dc4/f44 [0,4194304] 0 2024-04-23T10:21:53.959 INFO:tasks.workunit.client.0.smithi029.stdout:0/977: dwrite d0/da9/d4c/d6d/fe7 [0,4194304] 0 2024-04-23T10:21:54.012 INFO:tasks.workunit.client.0.smithi029.stdout:1/987: chown d5/d6/de/d22/f2f 1352812452 1 2024-04-23T10:21:54.016 INFO:tasks.workunit.client.0.smithi029.stdout:0/978: mkdir d0/da9/d4c/da7/dc7/dd7/d71/da4/d107/d150 0 2024-04-23T10:21:54.053 INFO:tasks.workunit.client.0.smithi029.stdout:3/955: dwrite d3/d10/de/d2e/d36/d40/d46/f9f [0,4194304] 0 2024-04-23T10:21:54.057 INFO:tasks.workunit.client.0.smithi029.stdout:3/956: write d3/d15/d4b/f50 [6094889,26180] 0 2024-04-23T10:21:54.057 INFO:tasks.workunit.client.0.smithi029.stdout:1/988: rmdir d5/d6/de 39 2024-04-23T10:21:54.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/989: write d5/d6/d34/d63/dfc/f11e [1031071,52927] 0 2024-04-23T10:21:54.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/990: chown d5/l2d 722924 1 2024-04-23T10:21:54.094 INFO:tasks.workunit.client.0.smithi029.stdout:1/991: dread d5/fbf [0,4194304] 0 2024-04-23T10:21:54.120 INFO:tasks.workunit.client.0.smithi029.stdout:0/979: rename d0/d3e/ddd/de4/l134 to d0/dc/d26/l151 0 2024-04-23T10:21:54.120 INFO:tasks.workunit.client.0.smithi029.stdout:3/957: symlink d3/d10/de/d2e/d36/d40/d46/d72/l136 0 2024-04-23T10:21:54.120 INFO:tasks.workunit.client.0.smithi029.stdout:0/980: read - d0/da9/d4c/f149 zero size 2024-04-23T10:21:54.120 INFO:tasks.workunit.client.0.smithi029.stdout:1/992: write d5/d6/d34/d63/f75 [1601733,44699] 0 2024-04-23T10:21:54.149 INFO:tasks.workunit.client.0.smithi029.stdout:1/993: dread d5/d6/de/d27/f12b [0,4194304] 0 2024-04-23T10:21:54.215 INFO:tasks.workunit.client.0.smithi029.stdout:0/981: dread - d0/dc/d26/fb0 zero size 2024-04-23T10:21:54.219 INFO:tasks.workunit.client.0.smithi029.stdout:3/958: creat d3/f137 x:0 0 0 2024-04-23T10:21:54.226 INFO:tasks.workunit.client.0.smithi029.stdout:0/982: dread d0/dc/f36 [0,4194304] 0 2024-04-23T10:21:54.228 INFO:tasks.workunit.client.0.smithi029.stdout:0/983: readlink d0/d3e/ddd/de4/l12e 0 2024-04-23T10:21:54.231 INFO:tasks.workunit.client.0.smithi029.stdout:3/959: mkdir d3/d10/de/d2e/d36/d40/d138 0 2024-04-23T10:21:54.240 INFO:tasks.workunit.client.0.smithi029.stdout:0/984: write d0/dc/f15 [30381,122312] 0 2024-04-23T10:21:54.249 INFO:tasks.workunit.client.0.smithi029.stdout:0/985: rename d0/f4a to d0/dc/dd9/f152 0 2024-04-23T10:21:54.256 INFO:tasks.workunit.client.0.smithi029.stdout:0/986: unlink d0/d1b/d67/f8c 0 2024-04-23T10:21:54.261 INFO:tasks.workunit.client.0.smithi029.stdout:0/987: mkdir d0/da9/d4c/daf/dde/d153 0 2024-04-23T10:21:54.272 INFO:tasks.workunit.client.0.smithi029.stdout:0/988: creat d0/d1b/d67/dae/d92/da0/dbe/d12a/f154 x:0 0 0 2024-04-23T10:21:54.278 INFO:tasks.workunit.client.0.smithi029.stdout:0/989: mknod d0/da9/d4c/da7/dc7/dd7/d71/da4/d107/c155 0 2024-04-23T10:21:54.284 INFO:tasks.workunit.client.0.smithi029.stdout:0/990: truncate d0/d1b/f79 752434 0 2024-04-23T10:21:54.289 INFO:tasks.workunit.client.0.smithi029.stdout:0/991: mknod d0/da9/d4c/da7/c156 0 2024-04-23T10:21:54.295 INFO:tasks.workunit.client.0.smithi029.stdout:0/992: creat d0/da9/d4c/daf/ddc/d12c/f157 x:0 0 0 2024-04-23T10:21:54.311 INFO:tasks.workunit.client.0.smithi029.stdout:1/994: sync 2024-04-23T10:21:54.313 INFO:tasks.workunit.client.0.smithi029.stdout:1/995: readlink d5/d6/lba 0 2024-04-23T10:21:54.316 INFO:tasks.workunit.client.0.smithi029.stdout:0/993: write d0/da9/f9e [5092338,121289] 0 2024-04-23T10:21:54.319 INFO:tasks.workunit.client.0.smithi029.stdout:1/996: creat d5/d6/d34/f135 x:0 0 0 2024-04-23T10:21:54.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/994: rename d0/da9/d4c/daf/dde to d0/da9/d158 0 2024-04-23T10:21:54.333 INFO:tasks.workunit.client.0.smithi029.stdout:1/997: mknod d5/d6/de/d22/c136 0 2024-04-23T10:21:54.338 INFO:tasks.workunit.client.0.smithi029.stdout:0/995: dread d0/d3e/fc3 [0,4194304] 0 2024-04-23T10:21:54.341 INFO:tasks.workunit.client.0.smithi029.stdout:0/996: dread - d0/d21/d7f/d3a/f121 zero size 2024-04-23T10:21:54.345 INFO:tasks.workunit.client.0.smithi029.stdout:1/998: write d5/d6/de/f62 [3504856,110817] 0 2024-04-23T10:21:54.356 INFO:tasks.workunit.client.0.smithi029.stdout:1/999: creat d5/d6/d34/f137 x:0 0 0 2024-04-23T10:21:54.358 INFO:tasks.workunit.client.0.smithi029.stdout:3/960: sync 2024-04-23T10:21:54.364 INFO:tasks.workunit.client.0.smithi029.stdout:0/997: dwrite d0/d1b/fa1 [0,4194304] 0 2024-04-23T10:21:54.369 INFO:tasks.workunit.client.0.smithi029.stdout:3/961: creat d3/d10/de/d2e/d36/d8a/d10e/f139 x:0 0 0 2024-04-23T10:21:54.369 INFO:tasks.workunit.client.0.smithi029.stdout:0/998: rmdir d0/da9/d4c/daf/ddc/d12c 39 2024-04-23T10:21:54.370 INFO:tasks.workunit.client.0.smithi029.stdout:0/999: stat d0/d1b/d67 0 2024-04-23T10:21:54.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/962: dwrite d3/d10/de/d2e/d36/d8a/f125 [0,4194304] 0 2024-04-23T10:21:54.417 INFO:tasks.workunit.client.0.smithi029.stdout:3/963: dread d3/d15/fc6 [0,4194304] 0 2024-04-23T10:21:54.437 INFO:tasks.workunit.client.0.smithi029.stdout:3/964: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d75/f10c [0,4194304] 0 2024-04-23T10:21:54.439 INFO:tasks.workunit.client.0.smithi029.stdout:3/965: write d3/d15/d4b/f131 [287352,80338] 0 2024-04-23T10:21:54.464 INFO:tasks.workunit.client.0.smithi029.stdout:3/966: rename d3/d10/de/d2e/d36/d40/d46/fcd to d3/d10/de/d2e/d36/d40/d46/f13a 0 2024-04-23T10:21:54.472 INFO:tasks.workunit.client.0.smithi029.stdout:3/967: mkdir d3/d15/d4b/d52/d5f/d13b 0 2024-04-23T10:21:54.474 INFO:tasks.workunit.client.0.smithi029.stdout:3/968: dread - d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/f116 zero size 2024-04-23T10:21:54.479 INFO:tasks.workunit.client.0.smithi029.stdout:3/969: truncate d3/d45/d4f/fb4 5125444 0 2024-04-23T10:21:54.481 INFO:tasks.workunit.client.0.smithi029.stdout:3/970: stat d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/fda 0 2024-04-23T10:21:54.635 INFO:tasks.workunit.client.0.smithi029.stdout:3/971: sync 2024-04-23T10:21:54.636 INFO:tasks.workunit.client.0.smithi029.stdout:3/972: chown d3/d45/d4f/d6b/fdc 16628 1 2024-04-23T10:21:54.643 INFO:tasks.workunit.client.0.smithi029.stdout:3/973: creat d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/f13c x:0 0 0 2024-04-23T10:21:54.654 INFO:tasks.workunit.client.0.smithi029.stdout:3/974: rmdir d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/d124/d12f 0 2024-04-23T10:21:54.660 INFO:tasks.workunit.client.0.smithi029.stdout:3/975: symlink d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/l13d 0 2024-04-23T10:21:54.663 INFO:tasks.workunit.client.0.smithi029.stdout:3/976: rmdir d3/d45 39 2024-04-23T10:21:54.671 INFO:tasks.workunit.client.0.smithi029.stdout:3/977: creat d3/d10/de/d2e/f13e x:0 0 0 2024-04-23T10:21:54.674 INFO:tasks.workunit.client.0.smithi029.stdout:3/978: readlink d3/d10/de/d2e/d36/d40/d46/d65/dfd/l11b 0 2024-04-23T10:21:54.683 INFO:tasks.workunit.client.0.smithi029.stdout:3/979: getdents d3/d15/d4b/d52/dee 0 2024-04-23T10:21:54.716 INFO:tasks.workunit.client.0.smithi029.stdout:3/980: dwrite d3/d10/de/d2e/d36/d40/d46/d72/d31/d96/fb9 [0,4194304] 0 2024-04-23T10:21:54.725 INFO:tasks.workunit.client.0.smithi029.stdout:3/981: symlink d3/d10/de/d2e/d36/d40/d138/l13f 0 2024-04-23T10:21:54.756 INFO:tasks.workunit.client.0.smithi029.stdout:3/982: dread d3/d10/de/d2e/d36/f38 [0,4194304] 0 2024-04-23T10:21:54.769 INFO:tasks.workunit.client.0.smithi029.stdout:3/983: creat d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/f140 x:0 0 0 2024-04-23T10:21:54.769 INFO:tasks.workunit.client.0.smithi029.stdout:3/984: chown d3/d10/de/d2e/d36/d40/d46/d72/d75/c12e 189 1 2024-04-23T10:21:54.780 INFO:tasks.workunit.client.0.smithi029.stdout:3/985: getdents d3/d10/de/d2e/d36/d40/d46/d72/d28 0 2024-04-23T10:21:54.788 INFO:tasks.workunit.client.0.smithi029.stdout:3/986: creat d3/d10/de/d2e/d36/d40/d46/d72/d5e/dad/dc3/dd2/d124/f141 x:0 0 0 2024-04-23T10:21:54.802 INFO:tasks.workunit.client.0.smithi029.stdout:3/987: dwrite d3/d10/d48/ffc [4194304,4194304] 0 2024-04-23T10:21:54.805 INFO:tasks.workunit.client.0.smithi029.stdout:3/988: fsync d3/d10/de/d2e/d36/d40/d46/f9f 0 2024-04-23T10:21:54.812 INFO:tasks.workunit.client.0.smithi029.stdout:3/989: unlink d3/d102/f120 0 2024-04-23T10:21:54.819 INFO:tasks.workunit.client.0.smithi029.stdout:3/990: fdatasync d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/fcc 0 2024-04-23T10:21:54.821 INFO:tasks.workunit.client.0.smithi029.stdout:3/991: read d3/d10/de/f128 [16664,11553] 0 2024-04-23T10:21:54.826 INFO:tasks.workunit.client.0.smithi029.stdout:3/992: dread - d3/d10/de/d2e/d36/ffb zero size 2024-04-23T10:21:54.833 INFO:tasks.workunit.client.0.smithi029.stdout:3/993: symlink d3/d10/de/d2e/d36/d40/d46/l142 0 2024-04-23T10:21:54.837 INFO:tasks.workunit.client.0.smithi029.stdout:3/994: readlink d3/d10/de/d2e/d36/d40/d46/d72/d28/d76/d89/lf8 0 2024-04-23T10:21:54.845 INFO:tasks.workunit.client.0.smithi029.stdout:3/995: link d3/d45/f4a d3/d10/de/d2e/d36/d107/f143 0 2024-04-23T10:21:54.858 INFO:tasks.workunit.client.0.smithi029.stdout:3/996: write d3/d15/fc6 [694964,115186] 0 2024-04-23T10:21:54.869 INFO:tasks.workunit.client.0.smithi029.stdout:3/997: rmdir d3/d10/de/d2e/d36/d40/d46/d72/d75/d122 0 2024-04-23T10:21:54.874 INFO:tasks.workunit.client.0.smithi029.stdout:3/998: unlink d3/d45/d4f/d6b/ddf/l121 0 2024-04-23T10:21:54.881 INFO:tasks.workunit.client.0.smithi029.stdout:3/999: unlink d3/d10/d48/def/ld8 0 2024-04-23T10:21:54.989 INFO:tasks.workunit.client.0.smithi029.stderr:+ rm -rf -- ./tmp.vPgxgTD9ov 2024-04-23T10:22:10.662 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T10:22:10.663 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.5 2024-04-23T10:22:10.663 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:22:10.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.790+0000 7fa853ce8640 1 Processor -- start 2024-04-23T10:22:10.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.790+0000 7fa853ce8640 1 -- start start 2024-04-23T10:22:10.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa853ce8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa84c0c99f0 0x7fa84c0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:10.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa853ce8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84c157db0 con 0x7fa84c152030 2024-04-23T10:22:10.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa853ce8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84c158070 con 0x7fa84c15b550 2024-04-23T10:22:10.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa853ce8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa84c158350 con 0x7fa84c0c99f0 2024-04-23T10:22:10.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa851a84640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa84c152030 0x7fa84c0cd5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60458/0 (socket says 172.21.15.29:60458) 2024-04-23T10:22:10.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa851a84640 1 -- 172.21.15.29:0/2885995325 learned_addr learned my addr 172.21.15.29:0/2885995325 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:22:10.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa851283640 1 --2- 172.21.15.29:0/2885995325 >> v2:172.21.15.29:3300/0 conn(0x7fa84c0c99f0 0x7fa84c0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:10.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa850a82640 1 -- 172.21.15.29:0/2885995325 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174984721 0 0) 0x7fa84c157db0 con 0x7fa84c152030 2024-04-23T10:22:10.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa850a82640 1 -- 172.21.15.29:0/2885995325 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa838003530 con 0x7fa84c152030 2024-04-23T10:22:10.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa851283640 1 -- 172.21.15.29:0/2885995325 >> v1:172.21.15.72:6789/0 conn(0x7fa84c15b550 legacy=0x7fa84c15b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:10.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa851283640 1 -- 172.21.15.29:0/2885995325 >> v1:172.21.15.29:6789/0 conn(0x7fa84c152030 legacy=0x7fa84c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:10.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa850a82640 1 -- 172.21.15.29:0/2885995325 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165222206 0 0) 0x7fa84c158070 con 0x7fa84c15b550 2024-04-23T10:22:10.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa851283640 1 -- 172.21.15.29:0/2885995325 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c158630 con 0x7fa84c0c99f0 2024-04-23T10:22:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa851283640 1 --2- 172.21.15.29:0/2885995325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c0c99f0 0x7fa84c0c8660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa8400097c0 tx=0x7fa84001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3319440cb320c8d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa850a82640 1 -- 172.21.15.29:0/2885995325 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8400b0070 con 0x7fa84c0c99f0 2024-04-23T10:22:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa850a82640 1 -- 172.21.15.29:0/2885995325 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8400ab600 con 0x7fa84c0c99f0 2024-04-23T10:22:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.794+0000 7fa850a82640 1 -- 172.21.15.29:0/2885995325 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8400ab9d0 con 0x7fa84c0c99f0 2024-04-23T10:22:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- 172.21.15.29:0/2885995325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c0c99f0 msgr2=0x7fa84c0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 --2- 172.21.15.29:0/2885995325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c0c99f0 0x7fa84c0c8660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa8400097c0 tx=0x7fa84001c4a0 comp rx=0 tx=0).stop 2024-04-23T10:22:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- 172.21.15.29:0/2885995325 shutdown_connections 2024-04-23T10:22:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 --2- 172.21.15.29:0/2885995325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c0c99f0 0x7fa84c0c8660 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- 172.21.15.29:0/2885995325 >> 172.21.15.29:0/2885995325 conn(0x7fa84c06b9e0 msgr2=0x7fa84c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- 172.21.15.29:0/2885995325 shutdown_connections 2024-04-23T10:22:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- 172.21.15.29:0/2885995325 wait complete. 2024-04-23T10:22:10.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 Processor -- start 2024-04-23T10:22:10.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- start start 2024-04-23T10:22:10.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa84c0c99f0 0x7fa84c158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:10.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa84c152030 0x7fa84c0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:10.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c15b550 0x7fa84c1417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:10.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1660e0 con 0x7fa84c15b550 2024-04-23T10:22:10.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c165f60 con 0x7fa84c0c99f0 2024-04-23T10:22:10.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa84c166260 con 0x7fa84c152030 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c15b550 0x7fa84c1417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c15b550 0x7fa84c1417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36940/0 (socket says 172.21.15.29:36940) 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 -- 172.21.15.29:0/2289013128 learned_addr learned my addr 172.21.15.29:0/2289013128 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa851283640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa84c152030 0x7fa84c0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa851a84640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa84c0c99f0 0x7fa84c158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 -- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa84c152030 msgr2=0x7fa84c0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa84c152030 0x7fa84c0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 -- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa84c0c99f0 msgr2=0x7fa84c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa84c0c99f0 0x7fa84c158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 -- 172.21.15.29:0/2289013128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c15c1f0 con 0x7fa84c15b550 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa851a84640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa84c0c99f0 0x7fa84c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa852285640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c15b550 0x7fa84c1417e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c7b0 tx=0x7fa84400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa83e7fc640 1 -- 172.21.15.29:0/2289013128 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844003db0 con 0x7fa84c15b550 2024-04-23T10:22:10.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa83e7fc640 1 -- 172.21.15.29:0/2289013128 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa844005070 con 0x7fa84c15b550 2024-04-23T10:22:10.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84c13ae70 con 0x7fa84c15b550 2024-04-23T10:22:10.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa83e7fc640 1 -- 172.21.15.29:0/2289013128 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844005460 con 0x7fa84c15b550 2024-04-23T10:22:10.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.798+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84c13b3f0 con 0x7fa84c15b550 2024-04-23T10:22:10.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.802+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa84c0693c0 con 0x7fa84c15b550 2024-04-23T10:22:10.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.802+0000 7fa83e7fc640 1 -- 172.21.15.29:0/2289013128 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa844005600 con 0x7fa84c15b550 2024-04-23T10:22:10.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.802+0000 7fa83e7fc640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa8300683b0 0x7fa83006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:10.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.802+0000 7fa83e7fc640 1 -- 172.21.15.29:0/2289013128 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa844086ba0 con 0x7fa84c15b550 2024-04-23T10:22:10.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.802+0000 7fa851a84640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa8300683b0 0x7fa83006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:10.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.802+0000 7fa851a84640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa8300683b0 0x7fa83006a870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa848005890 tx=0x7fa848009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:10.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:10.806+0000 7fa83e7fc640 1 -- 172.21.15.29:0/2289013128 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa844056dd0 con 0x7fa84c15b550 2024-04-23T10:22:11.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.010+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa84c0c91c0 con 0x7fa84c15b550 2024-04-23T10:22:11.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.010+0000 7fa83e7fc640 1 -- 172.21.15.29:0/2289013128 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7fa8440566d0 con 0x7fa84c15b550 2024-04-23T10:22:11.011 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:22:11.011 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:22:11.011 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa8300683b0 msgr2=0x7fa83006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa8300683b0 0x7fa83006a870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa848005890 tx=0x7fa848009040 comp rx=0 tx=0).stop 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c15b550 msgr2=0x7fa84c1417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c15b550 0x7fa84c1417e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c7b0 tx=0x7fa84400cc70 comp rx=0 tx=0).stop 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 shutdown_connections 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa8300683b0 0x7fa83006a870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa84c15b550 0x7fa84c1417e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa84c152030 0x7fa84c0cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 --2- 172.21.15.29:0/2289013128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa84c0c99f0 0x7fa84c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 >> 172.21.15.29:0/2289013128 conn(0x7fa84c06b9e0 msgr2=0x7fa84c0730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 shutdown_connections 2024-04-23T10:22:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.014+0000 7fa853ce8640 1 -- 172.21.15.29:0/2289013128 wait complete. 2024-04-23T10:22:11.029 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 78.5 --await-for 42.0' 2024-04-23T10:22:11.029 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 78.5 --await-for 42.0 2024-04-23T10:22:11.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984f975640 1 Processor -- start 2024-04-23T10:22:11.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984f975640 1 -- start start 2024-04-23T10:22:11.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984f975640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98480cc900 0x7f98480d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984f975640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f984815ba90 0x7f98480d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984f975640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98480ce3d0 con 0x7f98480b5270 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984f975640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f98480cb8b0 con 0x7f98480cc900 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984f975640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f98480cbb50 con 0x7f984815ba90 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984cf10640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98480cc900 0x7f98480d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984cf10640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98480cc900 0x7f98480d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36952/0 (socket says 172.21.15.29:36952) 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984cf10640 1 -- 172.21.15.29:0/1688578029 learned_addr learned my addr 172.21.15.29:0/1688578029 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984df12640 1 --2- 172.21.15.29:0/1688578029 >> v2:172.21.15.72:3300/0 conn(0x7f984815ba90 0x7f98480d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984cf10640 1 -- 172.21.15.29:0/1688578029 >> v2:172.21.15.72:3300/0 conn(0x7f984815ba90 msgr2=0x7f98480d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984cf10640 1 --2- 172.21.15.29:0/1688578029 >> v2:172.21.15.72:3300/0 conn(0x7f984815ba90 0x7f98480d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984cf10640 1 -- 172.21.15.29:0/1688578029 >> v1:172.21.15.72:6789/0 conn(0x7f98480b5270 legacy=0x7f98480cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.154+0000 7f984cf10640 1 -- 172.21.15.29:0/1688578029 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98480cd1e0 con 0x7f98480cc900 2024-04-23T10:22:11.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984cf10640 1 --2- 172.21.15.29:0/1688578029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f98480d0ab0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f98480cb650 tx=0x7f983801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a176e2ec829ac11 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:11.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f983ffff640 1 -- 172.21.15.29:0/1688578029 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380ab430 con 0x7f98480cc900 2024-04-23T10:22:11.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f983ffff640 1 -- 172.21.15.29:0/1688578029 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380b0070 con 0x7f98480cc900 2024-04-23T10:22:11.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f983ffff640 1 -- 172.21.15.29:0/1688578029 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380ab7f0 con 0x7f98480cc900 2024-04-23T10:22:11.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 -- 172.21.15.29:0/1688578029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 msgr2=0x7f98480d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 --2- 172.21.15.29:0/1688578029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f98480d0ab0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f98480cb650 tx=0x7f983801c520 comp rx=0 tx=0).stop 2024-04-23T10:22:11.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 -- 172.21.15.29:0/1688578029 shutdown_connections 2024-04-23T10:22:11.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 --2- 172.21.15.29:0/1688578029 >> v2:172.21.15.72:3300/0 conn(0x7f984815ba90 0x7f98480d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 --2- 172.21.15.29:0/1688578029 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f98480d0ab0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 -- 172.21.15.29:0/1688578029 >> 172.21.15.29:0/1688578029 conn(0x7f984806d450 msgr2=0x7f9848074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:11.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 -- 172.21.15.29:0/1688578029 shutdown_connections 2024-04-23T10:22:11.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 -- 172.21.15.29:0/1688578029 wait complete. 2024-04-23T10:22:11.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 Processor -- start 2024-04-23T10:22:11.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.158+0000 7f984f975640 1 -- start start 2024-04-23T10:22:11.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984f975640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98480b5270 0x7f984815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984f975640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f9848156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984f975640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f984815ba90 0x7f98480c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984f975640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f98480cc500 con 0x7f98480cc900 2024-04-23T10:22:11.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984f975640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f98480b3a40 con 0x7f984815ba90 2024-04-23T10:22:11.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984f975640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f98480cc680 con 0x7f98480b5270 2024-04-23T10:22:11.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f9848156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f9848156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36958/0 (socket says 172.21.15.29:36958) 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 -- 172.21.15.29:0/2454119656 learned_addr learned my addr 172.21.15.29:0/2454119656 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984df12640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f984815ba90 0x7f98480c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984d711640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98480b5270 0x7f984815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 -- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98480b5270 msgr2=0x7f984815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98480b5270 0x7f984815a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 -- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f984815ba90 msgr2=0x7f98480c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f984815ba90 0x7f98480c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 -- 172.21.15.29:0/2454119656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9848159980 con 0x7f98480cc900 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984df12640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f984815ba90 0x7f98480c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984cf10640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f9848156780 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9838019130 tx=0x7f983801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f983dffb640 1 -- 172.21.15.29:0/2454119656 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380be5f0 con 0x7f98480cc900 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f983dffb640 1 -- 172.21.15.29:0/2454119656 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380be790 con 0x7f98480cc900 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984f975640 1 -- 172.21.15.29:0/2454119656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98480c5af0 con 0x7f98480cc900 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f983dffb640 1 -- 172.21.15.29:0/2454119656 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380beb80 con 0x7f98480cc900 2024-04-23T10:22:11.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984f975640 1 -- 172.21.15.29:0/2454119656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9848159bf0 con 0x7f98480cc900 2024-04-23T10:22:11.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f983dffb640 1 -- 172.21.15.29:0/2454119656 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98380b43f0 con 0x7f98480cc900 2024-04-23T10:22:11.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f983dffb640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f982c068380 0x7f982c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f983dffb640 1 -- 172.21.15.29:0/2454119656 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f98380a8070 con 0x7f98480cc900 2024-04-23T10:22:11.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.162+0000 7f984d711640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f982c068380 0x7f982c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 Processor -- start 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- start start 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984d711640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f982c068380 0x7f982c06a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9840000f70 tx=0x7f9840009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedf99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedfeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeedff3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558eeeca52a0 con 0x558eeedfe6c0 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558eeec0b5f0 con 0x558eeedfefe0 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558eeeba6820 con 0x558eeedf9600 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedfeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedfeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36970/0 (socket says 172.21.15.29:36970) 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 -- 172.21.15.29:0/1484660326 learned_addr learned my addr 172.21.15.29:0/1484660326 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984d711640 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedf99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984df12640 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeedff3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 -- 172.21.15.29:0/1484660326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 msgr2=0x558eeedf99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedf99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 -- 172.21.15.29:0/1484660326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 msgr2=0x558eeedff3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeedff3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 -- 172.21.15.29:0/1484660326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eeec51c00 con 0x558eeedfe6c0 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f984cf10640 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedfeaa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f98380f0ff0 tx=0x7f98380abf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ea5722b4562e6e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9832ffd640 1 -- 172.21.15.29:0/1484660326 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380f9cd0 con 0x558eeedfe6c0 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9832ffd640 1 -- 172.21.15.29:0/1484660326 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380b0040 con 0x558eeedfe6c0 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9832ffd640 1 -- 172.21.15.29:0/1484660326 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380ed6d0 con 0x558eeedfe6c0 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- 172.21.15.29:0/1484660326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 msgr2=0x558eeedfeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedfeaa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f98380f0ff0 tx=0x7f98380abf90 comp rx=0 tx=0).stop 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- 172.21.15.29:0/1484660326 shutdown_connections 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeedff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedfeaa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 --2- 172.21.15.29:0/1484660326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedf99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- 172.21.15.29:0/1484660326 >> 172.21.15.29:0/1484660326 conn(0x558eeedfa470 msgr2=0x558eeedfc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- 172.21.15.29:0/1484660326 shutdown_connections 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- 172.21.15.29:0/1484660326 wait complete. 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 -- start start 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.166+0000 7f9852af7000 1 Processor -- start 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedf9600 0x558eeedf89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 0x558eeedf8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeee04620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558eeeca52a0 con 0x558eeedf9600 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558eeec8dbf0 con 0x558eeedfefe0 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558eeecc8560 con 0x558eeedfe6c0 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 10 client.0 _ll_register_callbacks cb 0x558eeebe2570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedf9600 0x558eeedf89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedf9600 0x558eeedf89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36974/0 (socket says 172.21.15.29:36974) 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 -- 172.21.15.29:0/1525995661 learned_addr learned my addr 172.21.15.29:0/1525995661 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984df12640 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeee04620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984cf10640 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 0x558eeedf8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 -- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 msgr2=0x558eeedf8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 0x558eeedf8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 -- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 msgr2=0x558eeee04620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeee04620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 -- 172.21.15.29:0/1525995661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eeec46630 con 0x558eeedf9600 2024-04-23T10:22:11.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984d711640 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedf9600 0x558eeedf89e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f98400038d0 tx=0x7f9840001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f313ae81d600c30d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9827fff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9827fff640 1 -- 172.21.15.29:0/1525995661 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984000ddb0 con 0x558eeedf9600 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9827fff640 1 -- 172.21.15.29:0/1525995661 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f98400067e0 con 0x558eeedf9600 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 -- 172.21.15.29:0/1525995661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98380b0040 con 0x558eeedf9600 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9827fff640 1 -- 172.21.15.29:0/1525995661 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9840029070 con 0x558eeedf9600 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 10 client.5415 fetch_fsmap learned FSMap version 18 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 -- 172.21.15.29:0/1525995661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558eeebab490 con 0x558eeedf9600 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9827fff640 1 -- 172.21.15.29:0/1525995661 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380b0040 con 0x558eeedf9600 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9827fff640 1 -- 172.21.15.29:0/1525995661 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f9840020020 con 0x558eeedf9600 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 10 client.5415 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 10 client.5415 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 20 client.5415 populate_metadata read hostname 'smithi029' 2024-04-23T10:22:11.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558eeee05390 0x558eeee057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 4 client.5415 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:22:11.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9852af7000 1 -- 172.21.15.29:0/1525995661 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eeeba57f0 con 0x558eeee05390 2024-04-23T10:22:11.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984cf10640 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558eeee05390 0x558eeee057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f984cf10640 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558eeee05390 0x558eeee057a0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0e312215403f79 server_cookie=df2f79f2cf240eaa in_seq=0 out_seq=0 2024-04-23T10:22:11.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.170+0000 7f9827fff640 10 client.5415 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9827fff640 1 -- 172.21.15.29:0/1525995661 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558eeeba57f0 con 0x558eeee05390 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9827fff640 10 client.5415 handle_command_reply: tid=0 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 client.5415 shutdown 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 -- 172.21.15.29:0/1525995661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedf9600 msgr2=0x558eeedf89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedf9600 0x558eeedf89e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f98400038d0 tx=0x7f9840001090 comp rx=0 tx=0).stop 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 -- 172.21.15.29:0/1525995661 shutdown_connections 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558eeee05390 0x558eeee057a0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeee04620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 0x558eeedf8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 --2- 172.21.15.29:0/1525995661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedf9600 0x558eeedf89e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 -- 172.21.15.29:0/1525995661 >> 172.21.15.29:0/1525995661 conn(0x558eeedfa470 msgr2=0x558eeedfd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:11.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9827fff640 0 client.5415 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:11.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 -- 172.21.15.29:0/1525995661 shutdown_connections 2024-04-23T10:22:11.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 1 -- 172.21.15.29:0/1525995661 wait complete. 2024-04-23T10:22:11.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.174+0000 7f9852af7000 20 client.5415 trim_cache size 0 max 16384 2024-04-23T10:22:11.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.190+0000 7f9852af7000 1 Processor -- start 2024-04-23T10:22:11.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.190+0000 7f9852af7000 1 -- start start 2024-04-23T10:22:11.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.190+0000 7f9852af7000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedf9600 0x558eeee19010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 0x558eeee19550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfefe0 0x558eeee19a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f98482016b0 con 0x558eeedfefe0 2024-04-23T10:22:11.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9848201d80 con 0x558eeedf9600 2024-04-23T10:22:11.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f98481f7fe0 con 0x558eeedfe6c0 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfefe0 0x558eeee19a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfefe0 0x558eeee19a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36982/0 (socket says 172.21.15.29:36982) 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 -- 172.21.15.29:0/1758836278 learned_addr learned my addr 172.21.15.29:0/1758836278 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 0x558eeee19550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 -- 172.21.15.29:0/1758836278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 msgr2=0x558eeee19550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 0x558eeee19550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 -- 172.21.15.29:0/1758836278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedf9600 msgr2=0x558eeee19010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984d711640 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedf9600 0x558eeee19010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedf9600 0x558eeee19010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 -- 172.21.15.29:0/1758836278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eeeba6a70 con 0x558eeedfefe0 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfefe0 0x558eeee19a90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9844009d60 tx=0x7f9844007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893d2406f51e5757 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f98327fc640 1 -- 172.21.15.29:0/1758836278 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984401a020 con 0x558eeedfefe0 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f98327fc640 1 -- 172.21.15.29:0/1758836278 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844007e10 con 0x558eeedfefe0 2024-04-23T10:22:11.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f98327fc640 1 -- 172.21.15.29:0/1758836278 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844016640 con 0x558eeedfefe0 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- 172.21.15.29:0/1758836278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfefe0 msgr2=0x558eeee19a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfefe0 0x558eeee19a90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9844009d60 tx=0x7f9844007700 comp rx=0 tx=0).stop 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- 172.21.15.29:0/1758836278 shutdown_connections 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfefe0 0x558eeee19a90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedfe6c0 0x558eeee19550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- 172.21.15.29:0/1758836278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedf9600 0x558eeee19010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- 172.21.15.29:0/1758836278 >> 172.21.15.29:0/1758836278 conn(0x558eeedfa470 msgr2=0x558eeee0fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- 172.21.15.29:0/1758836278 shutdown_connections 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- 172.21.15.29:0/1758836278 wait complete. 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- start start 2024-04-23T10:22:11.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 Processor -- start 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedc2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedc3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeedc0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558eeec0a900 con 0x558eeedfe6c0 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558eeebd5e60 con 0x558eeedfefe0 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558eeec0fc20 con 0x558eeedf9600 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 10 client.0 _ll_register_callbacks cb 0x7f9840001330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedc3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedc3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36998/0 (socket says 172.21.15.29:36998) 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 -- 172.21.15.29:0/2657008027 learned_addr learned my addr 172.21.15.29:0/2657008027 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984d711640 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedc2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984df12640 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeedc0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 -- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 msgr2=0x558eeedc2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedc2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 -- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 msgr2=0x558eeedc0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:11.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeedc0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 -- 172.21.15.29:0/2657008027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eeec8e080 con 0x558eeedfe6c0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984d711640 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedc2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f984cf10640 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedc3050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9838009280 tx=0x7f98380c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ba7489498bd656 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9827fff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9827fff640 1 -- 172.21.15.29:0/2657008027 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380f50e0 con 0x558eeedfe6c0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9852af7000 1 -- 172.21.15.29:0/2657008027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9844007e10 con 0x558eeedfe6c0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.194+0000 7f9827fff640 1 -- 172.21.15.29:0/2657008027 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f98380ed6d0 con 0x558eeedfe6c0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9827fff640 1 -- 172.21.15.29:0/2657008027 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9838100050 con 0x558eeedfe6c0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9852af7000 10 client.5421 fetch_fsmap learned FSMap version 18 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9852af7000 1 -- 172.21.15.29:0/2657008027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558eeebb13e0 con 0x558eeedfe6c0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9827fff640 1 -- 172.21.15.29:0/2657008027 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844007e10 con 0x558eeedfe6c0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9827fff640 1 -- 172.21.15.29:0/2657008027 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f9838103020 con 0x558eeedfe6c0 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9852af7000 10 client.5421 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9852af7000 10 client.5421 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:22:11.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9852af7000 20 client.5421 populate_metadata read hostname 'smithi029' 2024-04-23T10:22:11.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9852af7000 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558eeedc0d70 0x558eeedc1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:11.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9852af7000 4 client.5421 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.5, "await_for": 42.0}] 2024-04-23T10:22:11.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9852af7000 1 -- 172.21.15.29:0/2657008027 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.5, "await_for": 42.0}) -- 0x558eeebb4940 con 0x558eeedc0d70 2024-04-23T10:22:11.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f984d711640 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558eeedc0d70 0x558eeedc1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:11.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f984d711640 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558eeedc0d70 0x558eeedc1180 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a0c23ed7e3fef server_cookie=ee1ce1ee9bfa20d2 in_seq=0 out_seq=0 2024-04-23T10:22:11.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:11.198+0000 7f9827fff640 10 client.5421 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:14.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9827fff640 1 -- 172.21.15.29:0/2657008027 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x558eeebb4940 con 0x558eeedc0d70 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9827fff640 10 client.5421 handle_command_reply: tid=0 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 client.5421 shutdown 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 -- 172.21.15.29:0/2657008027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 msgr2=0x558eeedc3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedc3050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9838009280 tx=0x7f98380c1000 comp rx=0 tx=0).stop 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 -- 172.21.15.29:0/2657008027 shutdown_connections 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558eeedc0d70 0x558eeedc1180 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558eeedfefe0 0x558eeedc0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9827fff640 0 client.5421 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558eeedfe6c0 0x558eeedc3050 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 --2- 172.21.15.29:0/2657008027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558eeedf9600 0x558eeedc2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 -- 172.21.15.29:0/2657008027 >> 172.21.15.29:0/2657008027 conn(0x558eeedfa470 msgr2=0x558eeee033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 -- 172.21.15.29:0/2657008027 shutdown_connections 2024-04-23T10:22:14.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 1 -- 172.21.15.29:0/2657008027 wait complete. 2024-04-23T10:22:14.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.594+0000 7f9852af7000 20 client.5421 trim_cache size 0 max 16384 2024-04-23T10:22:14.597 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:22:14.597 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:22:14.597 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:22:14.597 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 22, 2024-04-23T10:22:14.597 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:22:14.597 INFO:teuthology.orchestra.run.smithi029.stdout: "e96b608": { 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 22, 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 78.5, 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:22:14.598 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:22:14.599 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:22:14.599 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:14.599 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:14.599 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:14.599 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:14.599 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:14.599 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 -- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f982c068380 msgr2=0x7f982c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f982c068380 0x7f982c06a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9840000f70 tx=0x7f9840009040 comp rx=0 tx=0).stop 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 -- 172.21.15.29:0/2454119656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 msgr2=0x7f9848156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f9848156780 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9838019130 tx=0x7f983801ad60 comp rx=0 tx=0).stop 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 -- 172.21.15.29:0/2454119656 shutdown_connections 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f982c068380 0x7f982c06a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f984815ba90 0x7f98480c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98480cc900 0x7f9848156780 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:14.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 --2- 172.21.15.29:0/2454119656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98480b5270 0x7f984815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:14.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 -- 172.21.15.29:0/2454119656 >> 172.21.15.29:0/2454119656 conn(0x7f984806d450 msgr2=0x7f98480c8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:14.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 -- 172.21.15.29:0/2454119656 shutdown_connections 2024-04-23T10:22:14.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:14.598+0000 7f984f975640 1 -- 172.21.15.29:0/2454119656 wait complete. 2024-04-23T10:22:14.627 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e96b608', quiesce took 4.0 seconds. Will release after: 18.5 2024-04-23T10:22:19.837 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:22:19.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:22:33.128 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:22:33.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0699ca8640 1 Processor -- start 2024-04-23T10:22:33.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0699ca8640 1 -- start start 2024-04-23T10:22:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0699ca8640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06940c8960 0x7f069415f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0699ca8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069415f8d0 con 0x7f0694073930 2024-04-23T10:22:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0699ca8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069415b7a0 con 0x7f06940cf450 2024-04-23T10:22:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0699ca8640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f069415ba80 con 0x7f06940c8960 2024-04-23T10:22:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0693fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0694073930 0x7f0694073d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43788/0 (socket says 172.21.15.29:43788) 2024-04-23T10:22:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0693fff640 1 -- 172.21.15.29:0/3938855570 learned_addr learned my addr 172.21.15.29:0/3938855570 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:22:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06937fe640 1 --2- 172.21.15.29:0/3938855570 >> v2:172.21.15.72:3300/0 conn(0x7f06940c8960 0x7f069415f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872423961 0 0) 0x7f069415f8d0 con 0x7f0694073930 2024-04-23T10:22:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0680003530 con 0x7f0694073930 2024-04-23T10:22:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 782270026 0 0) 0x7f0680003530 con 0x7f0694073930 2024-04-23T10:22:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 >> v2:172.21.15.72:3300/0 conn(0x7f06940c8960 msgr2=0x7f069415f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 --2- 172.21.15.29:0/3938855570 >> v2:172.21.15.72:3300/0 conn(0x7f06940c8960 0x7f069415f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 >> v1:172.21.15.72:6789/0 conn(0x7f06940cf450 legacy=0x7f06940ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069415bd60 con 0x7f0694073930 2024-04-23T10:22:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f068c001a00 con 0x7f0694073930 2024-04-23T10:22:33.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 >> v1:172.21.15.29:6789/0 conn(0x7f0694073930 legacy=0x7f0694073d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06800039c0 0x7f0680003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0680004810 0x7f0680004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06800051d0 0x7f068000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f069415ba80 con 0x7f06800051d0 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f068000c070 con 0x7f06800039c0 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f068000c270 con 0x7f0680004810 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0693fff640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06800051d0 0x7f068000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06937fe640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06800039c0 0x7f0680003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0692ffd640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0680004810 0x7f0680004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0693fff640 1 -- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0680004810 msgr2=0x7f0680004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0693fff640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0680004810 0x7f0680004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0693fff640 1 -- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06800039c0 msgr2=0x7f0680003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0693fff640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06800039c0 0x7f0680003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f0693fff640 1 -- 172.21.15.29:0/3938855570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0680003530 con 0x7f06800051d0 2024-04-23T10:22:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.266+0000 7f06937fe640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06800039c0 0x7f0680003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0693fff640 1 -- 172.21.15.29:0/3938855570 reap_dead start 2024-04-23T10:22:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0693fff640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06800051d0 0x7f068000b9d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f068c00a880 tx=0x7f068c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143bd6c5f833bda4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c00a4a0 con 0x7f06800051d0 2024-04-23T10:22:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068c0ad650 con 0x7f06800051d0 2024-04-23T10:22:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f06927fc640 1 -- 172.21.15.29:0/3938855570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c0ada40 con 0x7f06800051d0 2024-04-23T10:22:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 -- 172.21.15.29:0/3938855570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06800051d0 msgr2=0x7f068000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06800051d0 0x7f068000b9d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f068c00a880 tx=0x7f068c01d3a0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 -- 172.21.15.29:0/3938855570 shutdown_connections 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 --2- 172.21.15.29:0/3938855570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06800051d0 0x7f068000b9d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 -- 172.21.15.29:0/3938855570 >> 172.21.15.29:0/3938855570 conn(0x7f0694074d60 msgr2=0x7f0694075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 -- 172.21.15.29:0/3938855570 shutdown_connections 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 -- 172.21.15.29:0/3938855570 wait complete. 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 Processor -- start 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.270+0000 7f0699ca8640 1 -- start start 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06800051d0 0x7f06941f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069415c5c0 0x7f06941f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0694157020 0x7f069415f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f06940c8d40 con 0x7f0694157020 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0694073410 con 0x7f069415c5c0 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f06940c9860 con 0x7f06800051d0 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0694157020 0x7f069415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0694157020 0x7f069415f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55968/0 (socket says 172.21.15.29:55968) 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 -- 172.21.15.29:0/1632761880 learned_addr learned my addr 172.21.15.29:0/1632761880 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f06937fe640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06800051d0 0x7f06941f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0692ffd640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069415c5c0 0x7f06941f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 -- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06800051d0 msgr2=0x7f06941f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06800051d0 0x7f06941f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 -- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069415c5c0 msgr2=0x7f06941f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069415c5c0 0x7f06941f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 -- 172.21.15.29:0/1632761880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06941f1ec0 con 0x7f0694157020 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0692ffd640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069415c5c0 0x7f06941f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f06937fe640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06800051d0 0x7f06941f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0693fff640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0694157020 0x7f069415f070 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f068c01dc40 tx=0x7f0680005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f068bfff640 1 -- 172.21.15.29:0/1632761880 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c00a4a0 con 0x7f0694157020 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f068bfff640 1 -- 172.21.15.29:0/1632761880 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068c0b4070 con 0x7f0694157020 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f068bfff640 1 -- 172.21.15.29:0/1632761880 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c004b70 con 0x7f0694157020 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06941f4b90 con 0x7f0694157020 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06941f5150 con 0x7f0694157020 2024-04-23T10:22:33.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06941f5390 con 0x7f0694157020 2024-04-23T10:22:33.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f068bfff640 1 -- 172.21.15.29:0/1632761880 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f068c0b6020 con 0x7f0694157020 2024-04-23T10:22:33.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f068bfff640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f06740683b0 0x7f067406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f068bfff640 1 -- 172.21.15.29:0/1632761880 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f068c121030 con 0x7f0694157020 2024-04-23T10:22:33.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.274+0000 7f06937fe640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f06740683b0 0x7f067406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.278+0000 7f06937fe640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f06740683b0 0x7f067406a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0684009ac0 tx=0x7f0684008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.278+0000 7f068bfff640 1 -- 172.21.15.29:0/1632761880 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06941f5390 con 0x7f0694157020 2024-04-23T10:22:33.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.482+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06940693c0 con 0x7f0694157020 2024-04-23T10:22:33.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.482+0000 7f068bfff640 1 -- 172.21.15.29:0/1632761880 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f068c0170b0 con 0x7f0694157020 2024-04-23T10:22:33.483 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:22:33.483 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:22:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:22:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f06740683b0 msgr2=0x7f067406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f06740683b0 0x7f067406a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0684009ac0 tx=0x7f0684008040 comp rx=0 tx=0).stop 2024-04-23T10:22:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0694157020 msgr2=0x7f069415f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0694157020 0x7f069415f070 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f068c01dc40 tx=0x7f0680005840 comp rx=0 tx=0).stop 2024-04-23T10:22:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 shutdown_connections 2024-04-23T10:22:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f06740683b0 0x7f067406a870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0694157020 0x7f069415f070 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069415c5c0 0x7f06941f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 --2- 172.21.15.29:0/1632761880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06800051d0 0x7f06941f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 >> 172.21.15.29:0/1632761880 conn(0x7f0694074d60 msgr2=0x7f0694155340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 shutdown_connections 2024-04-23T10:22:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.486+0000 7f0699ca8640 1 -- 172.21.15.29:0/1632761880 wait complete. 2024-04-23T10:22:33.501 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id e96b608 --release --await' 2024-04-23T10:22:33.501 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id e96b608 --release --await 2024-04-23T10:22:33.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.630+0000 7f1da9933640 1 Processor -- start 2024-04-23T10:22:33.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da9933640 1 -- start start 2024-04-23T10:22:33.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da9933640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da40ccf30 0x7f1da40c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da9933640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da40cb9d0 con 0x7f1da40c5a40 2024-04-23T10:22:33.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da9933640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da4155840 con 0x7f1da4155460 2024-04-23T10:22:33.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da9933640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1da40cc380 con 0x7f1da40ccf30 2024-04-23T10:22:33.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1da40c5a40 0x7f1da40d0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43804/0 (socket says 172.21.15.29:43804) 2024-04-23T10:22:33.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da37fe640 1 -- 172.21.15.29:0/1261243477 learned_addr learned my addr 172.21.15.29:0/1261243477 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:22:33.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da27fc640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da40ccf30 0x7f1da40c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466955841 0 0) 0x7f1da40cb9d0 con 0x7f1da40c5a40 2024-04-23T10:22:33.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d8c003530 con 0x7f1da40c5a40 2024-04-23T10:22:33.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1585590746 0 0) 0x7f1d8c003530 con 0x7f1da40c5a40 2024-04-23T10:22:33.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da40ccf30 msgr2=0x7f1da40c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da40ccf30 0x7f1da40c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 >> v1:172.21.15.72:6789/0 conn(0x7f1da4155460 legacy=0x7f1da415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40cbc70 con 0x7f1da40c5a40 2024-04-23T10:22:33.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f1d9c001a00 con 0x7f1da40c5a40 2024-04-23T10:22:33.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 >> v1:172.21.15.29:6789/0 conn(0x7f1da40c5a40 legacy=0x7f1da40d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8c0039f0 0x7f1d8c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8c004810 0x7f1d8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da40ccf30 0x7f1d8c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40cc380 con 0x7f1d8c0039f0 2024-04-23T10:22:33.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c00bab0 con 0x7f1d8c004810 2024-04-23T10:22:33.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1d8c00bcb0 con 0x7f1da40ccf30 2024-04-23T10:22:33.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8c0039f0 0x7f1d8c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da27fc640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8c004810 0x7f1d8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da37fe640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da40ccf30 0x7f1d8c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da2ffd640 1 -- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da40ccf30 msgr2=0x7f1d8c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da40ccf30 0x7f1d8c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da2ffd640 1 -- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8c004810 msgr2=0x7f1d8c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8c004810 0x7f1d8c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da2ffd640 1 -- 172.21.15.29:0/1261243477 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c003530 con 0x7f1d8c0039f0 2024-04-23T10:22:33.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.634+0000 7f1da27fc640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8c004810 0x7f1d8c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:33.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8c0039f0 0x7f1d8c003e10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1d94001750 tx=0x7f1d9401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d889a3ad08d3e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d940013a0 con 0x7f1d8c0039f0 2024-04-23T10:22:33.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d940052f0 con 0x7f1d8c0039f0 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da1ffb640 1 -- 172.21.15.29:0/1261243477 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94003840 con 0x7f1d8c0039f0 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- 172.21.15.29:0/1261243477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8c0039f0 msgr2=0x7f1d8c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 --2- 172.21.15.29:0/1261243477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8c0039f0 0x7f1d8c003e10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1d94001750 tx=0x7f1d9401c3c0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da37fe640 1 -- 172.21.15.29:0/1261243477 reap_dead start 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- 172.21.15.29:0/1261243477 shutdown_connections 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- 172.21.15.29:0/1261243477 >> 172.21.15.29:0/1261243477 conn(0x7f1da4074d60 msgr2=0x7f1da4075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- 172.21.15.29:0/1261243477 shutdown_connections 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- 172.21.15.29:0/1261243477 wait complete. 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 Processor -- start 2024-04-23T10:22:33.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- start start 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da415dcf0 0x7f1da41f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da415e0d0 0x7f1da41f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da4161510 0x7f1da40cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40d1050 con 0x7f1da415e0d0 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1da415bf80 con 0x7f1da415dcf0 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da9933640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1da40d11d0 con 0x7f1da4161510 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da415e0d0 0x7f1da41f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da415e0d0 0x7f1da41f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55976/0 (socket says 172.21.15.29:55976) 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da27fc640 1 -- 172.21.15.29:0/486393170 learned_addr learned my addr 172.21.15.29:0/486393170 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:33.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da415dcf0 0x7f1da41f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.638+0000 7f1da37fe640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da4161510 0x7f1da40cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da27fc640 1 -- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da4161510 msgr2=0x7f1da40cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da27fc640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da4161510 0x7f1da40cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da27fc640 1 -- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da415dcf0 msgr2=0x7f1da41f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da27fc640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da415dcf0 0x7f1da41f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da27fc640 1 -- 172.21.15.29:0/486393170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40b5ce0 con 0x7f1da415e0d0 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da37fe640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da4161510 0x7f1da40cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da27fc640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da415e0d0 0x7f1da41f5170 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d98010890 tx=0x7f1d98010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1d8bfff640 1 -- 172.21.15.29:0/486393170 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800f040 con 0x7f1da415e0d0 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1d8bfff640 1 -- 172.21.15.29:0/486393170 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d98004220 con 0x7f1da415e0d0 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da9933640 1 -- 172.21.15.29:0/486393170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da40b5fc0 con 0x7f1da415e0d0 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1d8bfff640 1 -- 172.21.15.29:0/486393170 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800e960 con 0x7f1da415e0d0 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da9933640 1 -- 172.21.15.29:0/486393170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da40b6580 con 0x7f1da415e0d0 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1d8bfff640 1 -- 172.21.15.29:0/486393170 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d9800eb00 con 0x7f1da415e0d0 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1d8bfff640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1d900683b0 0x7f1d9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1d8bfff640 1 -- 172.21.15.29:0/486393170 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1d98086f80 con 0x7f1da415e0d0 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1d900683b0 0x7f1d9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1dacab5000 1 Processor -- start 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.642+0000 7f1dacab5000 1 -- start start 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1d900683b0 0x7f1d9006a870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0057f0 tx=0x7f1d940011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50ef69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50f32500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558b50d3e660 con 0x558b50ef6f00 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558b50ce35d0 con 0x558b50f32120 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558b50d3a620 con 0x558b50f2d8a0 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55986/0 (socket says 172.21.15.29:55986) 2024-04-23T10:22:33.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 -- 172.21.15.29:0/1494315752 learned_addr learned my addr 172.21.15.29:0/1494315752 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1494315752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50ef69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 -- 172.21.15.29:0/1494315752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 msgr2=0x558b50ef69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 --2- 172.21.15.29:0/1494315752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50ef69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 -- 172.21.15.29:0/1494315752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 msgr2=0x558b50f32500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 --2- 172.21.15.29:0/1494315752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50f32500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 -- 172.21.15.29:0/1494315752 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b50d17bd0 con 0x558b50ef6f00 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da27fc640 1 --2- 172.21.15.29:0/1494315752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef72e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d9805f160 tx=0x7f1d980571b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab6132da474e202 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1d897fa640 1 -- 172.21.15.29:0/1494315752 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9806f020 con 0x558b50ef6f00 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1d897fa640 1 -- 172.21.15.29:0/1494315752 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9805f690 con 0x558b50ef6f00 2024-04-23T10:22:33.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1d897fa640 1 -- 172.21.15.29:0/1494315752 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98021040 con 0x558b50ef6f00 2024-04-23T10:22:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- 172.21.15.29:0/1494315752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 msgr2=0x558b50ef72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1494315752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef72e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d9805f160 tx=0x7f1d980571b0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- 172.21.15.29:0/1494315752 shutdown_connections 2024-04-23T10:22:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1494315752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50f32500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1494315752 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef72e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1494315752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50ef69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- 172.21.15.29:0/1494315752 >> 172.21.15.29:0/1494315752 conn(0x558b50dd8b00 msgr2=0x558b50f2fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:33.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- 172.21.15.29:0/1494315752 shutdown_connections 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- 172.21.15.29:0/1494315752 wait complete. 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- start start 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 Processor -- start 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50f2c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50f2cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50ef1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558b50dfbd40 con 0x558b50ef6f00 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558b50cf8eb0 con 0x558b50f32120 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558b50d392a0 con 0x558b50f2d8a0 2024-04-23T10:22:33.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1dacab5000 10 client.0 _ll_register_callbacks cb 0x558b50edca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50f2c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50f2c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55992/0 (socket says 172.21.15.29:55992) 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.646+0000 7f1da2ffd640 1 -- 172.21.15.29:0/4185432124 learned_addr learned my addr 172.21.15.29:0/4185432124 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da37fe640 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50ef1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da2ffd640 1 -- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 msgr2=0x558b50f2cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50f2cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da2ffd640 1 -- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 msgr2=0x558b50ef1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50ef1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da2ffd640 1 -- 172.21.15.29:0/4185432124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b50d84b30 con 0x558b50ef6f00 2024-04-23T10:22:33.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50f2c650 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d94001750 tx=0x7f1d9401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa6ed80ffcafd76 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1d827fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1d827fc640 1 -- 172.21.15.29:0/4185432124 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d940067e0 con 0x558b50ef6f00 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1d827fc640 1 -- 172.21.15.29:0/4185432124 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1d94006980 con 0x558b50ef6f00 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 1 -- 172.21.15.29:0/4185432124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558b50cd8060 con 0x558b50ef6f00 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1d827fc640 1 -- 172.21.15.29:0/4185432124 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1d94006b80 con 0x558b50ef6f00 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 10 client.5439 fetch_fsmap learned FSMap version 18 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 1 -- 172.21.15.29:0/4185432124 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558b50cddb70 con 0x558b50ef6f00 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1d827fc640 1 -- 172.21.15.29:0/4185432124 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558b50cd8060 con 0x558b50ef6f00 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1d827fc640 1 -- 172.21.15.29:0/4185432124 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f1d94003600 con 0x558b50ef6f00 2024-04-23T10:22:33.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 10 client.5439 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 10 client.5439 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 20 client.5439 populate_metadata read hostname 'smithi029' 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558b50ef25e0 0x558b50ef29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 4 client.5439 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1dacab5000 1 -- 172.21.15.29:0/4185432124 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b50d16e30 con 0x558b50ef25e0 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da27fc640 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558b50ef25e0 0x558b50ef29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1d827fc640 10 client.5439 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.650+0000 7f1da27fc640 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558b50ef25e0 0x558b50ef29f0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f0e5838514acb57 server_cookie=9ebffe5b22aac755 in_seq=0 out_seq=0 2024-04-23T10:22:33.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1d827fc640 1 -- 172.21.15.29:0/4185432124 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558b50d16e30 con 0x558b50ef25e0 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1d827fc640 10 client.5439 handle_command_reply: tid=0 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 client.5439 shutdown 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 -- 172.21.15.29:0/4185432124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 msgr2=0x558b50f2c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50f2c650 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d94001750 tx=0x7f1d9401ac00 comp rx=0 tx=0).stop 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 -- 172.21.15.29:0/4185432124 shutdown_connections 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558b50ef25e0 0x558b50ef29f0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50ef1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50f2cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 --2- 172.21.15.29:0/4185432124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50f2c650 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1d827fc640 0 client.5439 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 -- 172.21.15.29:0/4185432124 >> 172.21.15.29:0/4185432124 conn(0x558b50dd8b00 msgr2=0x558b50f319a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 -- 172.21.15.29:0/4185432124 shutdown_connections 2024-04-23T10:22:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 1 -- 172.21.15.29:0/4185432124 wait complete. 2024-04-23T10:22:33.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.654+0000 7f1dacab5000 20 client.5439 trim_cache size 0 max 16384 2024-04-23T10:22:33.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1dacab5000 1 Processor -- start 2024-04-23T10:22:33.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1dacab5000 1 -- start start 2024-04-23T10:22:33.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50ef57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50f48b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1dacab5000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4202d30 con 0x558b50ef6f00 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1dacab5000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4203400 con 0x558b50f32120 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1dacab5000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1da4201490 con 0x558b50f2d8a0 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56004/0 (socket says 172.21.15.29:56004) 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 -- 172.21.15.29:0/1150234528 learned_addr learned my addr 172.21.15.29:0/1150234528 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 -- 172.21.15.29:0/1150234528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 msgr2=0x558b50ef57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1150234528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50ef57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 -- 172.21.15.29:0/1150234528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 msgr2=0x558b50f48b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1150234528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50f48b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 -- 172.21.15.29:0/1150234528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b50dc05e0 con 0x558b50ef6f00 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1150234528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef5260 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1d94007fd0 tx=0x7f1d940b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae159fb362fbc425 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1d88ff9640 1 -- 172.21.15.29:0/1150234528 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94006d20 con 0x558b50ef6f00 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1d88ff9640 1 -- 172.21.15.29:0/1150234528 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d940c7070 con 0x558b50ef6f00 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.670+0000 7f1d88ff9640 1 -- 172.21.15.29:0/1150234528 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d940067e0 con 0x558b50ef6f00 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- 172.21.15.29:0/1150234528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 msgr2=0x558b50ef5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1150234528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef5260 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1d94007fd0 tx=0x7f1d940b5000 comp rx=0 tx=0).stop 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- 172.21.15.29:0/1150234528 shutdown_connections 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1150234528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50f32120 0x558b50f48b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1150234528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50ef57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1150234528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50ef6f00 0x558b50ef5260 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- 172.21.15.29:0/1150234528 >> 172.21.15.29:0/1150234528 conn(0x558b50dd8b00 msgr2=0x558b50f2d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- 172.21.15.29:0/1150234528 shutdown_connections 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- 172.21.15.29:0/1150234528 wait complete. 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- start start 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 Processor -- start 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50ef6f00 0x558b50f9fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50fa0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50f32120 0x558b50f4ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558b50d3d970 con 0x558b50f32120 2024-04-23T10:22:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558b50cf38f0 con 0x558b50ef6f00 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x558b50d42c90 con 0x558b50f2d8a0 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 10 client.0 _ll_register_callbacks cb 0x7f1d8c003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50f32120 0x558b50f4ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50f32120 0x558b50f4ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56014/0 (socket says 172.21.15.29:56014) 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 -- 172.21.15.29:0/1182871492 learned_addr learned my addr 172.21.15.29:0/1182871492 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da27fc640 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50fa0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50ef6f00 0x558b50f9fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 -- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 msgr2=0x558b50fa0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50fa0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 -- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50ef6f00 msgr2=0x558b50f9fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50ef6f00 0x558b50f9fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 -- 172.21.15.29:0/1182871492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b50cd0ae0 con 0x558b50f32120 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da37fe640 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50f32120 0x558b50f4ae30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c001fa0 tx=0x7f1d9c007980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff27a007085bf088 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1d827fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1d827fc640 1 -- 172.21.15.29:0/1182871492 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c010920 con 0x558b50f32120 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1d827fc640 1 -- 172.21.15.29:0/1182871492 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1d9c010ac0 con 0x558b50f32120 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- 172.21.15.29:0/1182871492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d940c7070 con 0x558b50f32120 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1d827fc640 1 -- 172.21.15.29:0/1182871492 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c021050 con 0x558b50f32120 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 10 client.5445 fetch_fsmap learned FSMap version 18 2024-04-23T10:22:33.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- 172.21.15.29:0/1182871492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558b50cd3d80 con 0x558b50f32120 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1d827fc640 1 -- 172.21.15.29:0/1182871492 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d940c7070 con 0x558b50f32120 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1d827fc640 1 -- 172.21.15.29:0/1182871492 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f1d9c024020 con 0x558b50f32120 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 10 client.5445 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 10 client.5445 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 20 client.5445 populate_metadata read hostname 'smithi029' 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558b50f4b370 0x558b50f4b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 4 client.5445 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e96b608", "release": true, "await": true}] 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1dacab5000 1 -- 172.21.15.29:0/1182871492 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e96b608", "release": true, "await": true}) -- 0x558b50cdc0d0 con 0x558b50f4b370 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.674+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558b50f4b370 0x558b50f4b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.678+0000 7f1d827fc640 10 client.5445 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:33.678+0000 7f1da2ffd640 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558b50f4b370 0x558b50f4b780 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=975a324fe7d3e1eb server_cookie=bd833e2670c07a36 in_seq=0 out_seq=0 2024-04-23T10:22:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1d827fc640 1 -- 172.21.15.29:0/1182871492 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x558b50cdc0d0 con 0x558b50f4b370 2024-04-23T10:22:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1d827fc640 10 client.5445 handle_command_reply: tid=0 2024-04-23T10:22:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 client.5445 shutdown 2024-04-23T10:22:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 -- 172.21.15.29:0/1182871492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50f32120 msgr2=0x558b50f4ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50f32120 0x558b50f4ae30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c001fa0 tx=0x7f1d9c007980 comp rx=0 tx=0).stop 2024-04-23T10:22:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 -- 172.21.15.29:0/1182871492 shutdown_connections 2024-04-23T10:22:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x558b50f4b370 0x558b50f4b780 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558b50f32120 0x558b50f4ae30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b50f2d8a0 0x558b50fa0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 --2- 172.21.15.29:0/1182871492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b50ef6f00 0x558b50f9fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 -- 172.21.15.29:0/1182871492 >> 172.21.15.29:0/1182871492 conn(0x558b50dd8b00 msgr2=0x558b50f4dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1d827fc640 0 client.5445 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 -- 172.21.15.29:0/1182871492 shutdown_connections 2024-04-23T10:22:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 1 -- 172.21.15.29:0/1182871492 wait complete. 2024-04-23T10:22:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1dacab5000 20 client.5445 trim_cache size 0 max 16384 2024-04-23T10:22:34.288 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:22:34.288 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:22:34.288 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:22:34.288 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 24, 2024-04-23T10:22:34.288 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:22:34.288 INFO:teuthology.orchestra.run.smithi029.stdout: "e96b608": { 2024-04-23T10:22:34.288 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 24, 2024-04-23T10:22:34.288 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 78.5, 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:22:34.289 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:22:34.290 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:22:34.290 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:22:34.290 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:34.290 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:34.290 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:34.290 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:34.290 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:34.290 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:22:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 -- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1d900683b0 msgr2=0x7f1d9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1d900683b0 0x7f1d9006a870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0057f0 tx=0x7f1d940011a0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 -- 172.21.15.29:0/486393170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da415e0d0 msgr2=0x7f1da41f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da415e0d0 0x7f1da41f5170 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d98010890 tx=0x7f1d98010d50 comp rx=0 tx=0).stop 2024-04-23T10:22:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 -- 172.21.15.29:0/486393170 shutdown_connections 2024-04-23T10:22:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1d900683b0 0x7f1d9006a870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1da4161510 0x7f1da40cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da415e0d0 0x7f1da41f5170 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 --2- 172.21.15.29:0/486393170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da415dcf0 0x7f1da41f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 -- 172.21.15.29:0/486393170 >> 172.21.15.29:0/486393170 conn(0x7f1da4074d60 msgr2=0x7f1da4165c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 -- 172.21.15.29:0/486393170 shutdown_connections 2024-04-23T10:22:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.286+0000 7f1da9933640 1 -- 172.21.15.29:0/486393170 wait complete. 2024-04-23T10:22:34.312 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e96b608', seconds elapsed: 23.6 2024-04-23T10:22:34.312 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.5 2024-04-23T10:22:34.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:22:34.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.442+0000 7f4f6ac1d640 1 Processor -- start 2024-04-23T10:22:34.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.442+0000 7f4f6ac1d640 1 -- start start 2024-04-23T10:22:34.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f6ac1d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f641552c0 0x7f4f6406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f6ac1d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f64073350 con 0x7f4f64067f70 2024-04-23T10:22:34.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f6ac1d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f640735f0 con 0x7f4f64072bd0 2024-04-23T10:22:34.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f6ac1d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6406d990 con 0x7f4f641552c0 2024-04-23T10:22:34.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4f64067f70 0x7f4f640cd010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:40694/0 (socket says 172.21.15.29:40694) 2024-04-23T10:22:34.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5bfff640 1 -- 172.21.15.29:0/2434344351 learned_addr learned my addr 172.21.15.29:0/2434344351 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f689b9640 1 --2- 172.21.15.29:0/2434344351 >> v2:172.21.15.72:3300/0 conn(0x7f4f641552c0 0x7f4f6406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707992732 0 0) 0x7f4f64073350 con 0x7f4f64067f70 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f4c003530 con 0x7f4f64067f70 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2684525657 0 0) 0x7f4f4c003530 con 0x7f4f64067f70 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 >> v2:172.21.15.72:3300/0 conn(0x7f4f641552c0 msgr2=0x7f4f6406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 --2- 172.21.15.29:0/2434344351 >> v2:172.21.15.72:3300/0 conn(0x7f4f641552c0 0x7f4f6406d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 >> v1:172.21.15.72:6789/0 conn(0x7f4f64072bd0 legacy=0x7f4f64165a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6415b320 con 0x7f4f64067f70 2024-04-23T10:22:34.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f4f54001680 con 0x7f4f64067f70 2024-04-23T10:22:34.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 >> v1:172.21.15.29:6789/0 conn(0x7f4f64067f70 legacy=0x7f4f640cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f4c0039c0 0x7f4f4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c004810 0x7f4f4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f4c0051d0 0x7f4f4c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c00c050 con 0x7f4f4c0051d0 2024-04-23T10:22:34.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c00c200 con 0x7f4f4c004810 2024-04-23T10:22:34.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4c00c400 con 0x7f4f4c0039c0 2024-04-23T10:22:34.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f691ba640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f4c0051d0 0x7f4f4c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5bfff640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c004810 0x7f4f4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f689b9640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f4c0039c0 0x7f4f4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f691ba640 1 -- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f4c0039c0 msgr2=0x7f4f4c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f691ba640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f4c0039c0 0x7f4f4c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f691ba640 1 -- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c004810 msgr2=0x7f4f4c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f691ba640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c004810 0x7f4f4c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f691ba640 1 -- 172.21.15.29:0/2434344351 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c003530 con 0x7f4f4c0051d0 2024-04-23T10:22:34.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.446+0000 7f4f5bfff640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c004810 0x7f4f4c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:22:34.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f691ba640 1 -- 172.21.15.29:0/2434344351 reap_dead start 2024-04-23T10:22:34.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f691ba640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f4c0051d0 0x7f4f4c00b9d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c001e70 tx=0x7f4f5c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d338d7c524f01b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c001a90 con 0x7f4f4c0051d0 2024-04-23T10:22:34.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5c003bc0 con 0x7f4f4c0051d0 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5b7fe640 1 -- 172.21.15.29:0/2434344351 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c005020 con 0x7f4f4c0051d0 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/2434344351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f4c0051d0 msgr2=0x7f4f4c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f4c0051d0 0x7f4f4c00b9d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c001e70 tx=0x7f4f5c01c780 comp rx=0 tx=0).stop 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/2434344351 shutdown_connections 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 --2- 172.21.15.29:0/2434344351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f4c0051d0 0x7f4f4c00b9d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/2434344351 >> 172.21.15.29:0/2434344351 conn(0x7f4f6406f830 msgr2=0x7f4f6406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/2434344351 shutdown_connections 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/2434344351 wait complete. 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 Processor -- start 2024-04-23T10:22:34.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- start start 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c0051d0 0x7f4f6415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64158440 0x7f4f641f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6415c2d0 0x7f4f641477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6406ef30 con 0x7f4f64158440 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6415b8e0 con 0x7f4f4c0051d0 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f6ac1d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6406f0b0 con 0x7f4f6415c2d0 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64158440 0x7f4f641f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64158440 0x7f4f641f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51354/0 (socket says 172.21.15.29:51354) 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5bfff640 1 -- 172.21.15.29:0/819859440 learned_addr learned my addr 172.21.15.29:0/819859440 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:34.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f689b9640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c0051d0 0x7f4f6415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f691ba640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6415c2d0 0x7f4f641477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5bfff640 1 -- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6415c2d0 msgr2=0x7f4f641477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5bfff640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6415c2d0 0x7f4f641477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5bfff640 1 -- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c0051d0 msgr2=0x7f4f6415a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5bfff640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c0051d0 0x7f4f6415a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f5bfff640 1 -- 172.21.15.29:0/819859440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6415c8a0 con 0x7f4f64158440 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.450+0000 7f4f691ba640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6415c2d0 0x7f4f641477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f5bfff640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64158440 0x7f4f641f0760 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4f54000fc0 tx=0x7f4f5400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f597fa640 1 -- 172.21.15.29:0/819859440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5400c8a0 con 0x7f4f64158440 2024-04-23T10:22:34.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f597fa640 1 -- 172.21.15.29:0/819859440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54018070 con 0x7f4f64158440 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f597fa640 1 -- 172.21.15.29:0/819859440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5400cc40 con 0x7f4f64158440 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6415cb80 con 0x7f4f64158440 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6415e840 con 0x7f4f64158440 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f640693c0 con 0x7f4f64158440 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f597fa640 1 -- 172.21.15.29:0/819859440 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f54013420 con 0x7f4f64158440 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f597fa640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4f500683b0 0x7f4f5006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f597fa640 1 -- 172.21.15.29:0/819859440 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4f540868f0 con 0x7f4f64158440 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f689b9640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4f500683b0 0x7f4f5006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.454+0000 7f4f689b9640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4f500683b0 0x7f4f5006a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009aa0 tx=0x7f4f60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.458+0000 7f4f597fa640 1 -- 172.21.15.29:0/819859440 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4f54056a90 con 0x7f4f64158440 2024-04-23T10:22:34.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.658+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f64158b30 con 0x7f4f64158440 2024-04-23T10:22:34.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.658+0000 7f4f597fa640 1 -- 172.21.15.29:0/819859440 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f4f54084e20 con 0x7f4f64158440 2024-04-23T10:22:34.661 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:22:34.661 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:22:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:22:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4f500683b0 msgr2=0x7f4f5006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4f500683b0 0x7f4f5006a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009aa0 tx=0x7f4f60008040 comp rx=0 tx=0).stop 2024-04-23T10:22:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64158440 msgr2=0x7f4f641f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64158440 0x7f4f641f0760 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4f54000fc0 tx=0x7f4f5400ec80 comp rx=0 tx=0).stop 2024-04-23T10:22:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 shutdown_connections 2024-04-23T10:22:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4f500683b0 0x7f4f5006a870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6415c2d0 0x7f4f641477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f64158440 0x7f4f641f0760 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 --2- 172.21.15.29:0/819859440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f4c0051d0 0x7f4f6415a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 >> 172.21.15.29:0/819859440 conn(0x7f4f6406f830 msgr2=0x7f4f6406e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 shutdown_connections 2024-04-23T10:22:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.662+0000 7f4f6ac1d640 1 -- 172.21.15.29:0/819859440 wait complete. 2024-04-23T10:22:34.680 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 78.5 --await-for 42.0' 2024-04-23T10:22:34.681 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 78.5 --await-for 42.0 2024-04-23T10:22:34.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.810+0000 7fba6a221640 1 Processor -- start 2024-04-23T10:22:34.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.810+0000 7fba6a221640 1 -- start start 2024-04-23T10:22:34.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba6a221640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba640c7150 0x7fba64074160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba6a221640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba64071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba6a221640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba641597f0 con 0x7fba640c5e00 2024-04-23T10:22:34.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba6a221640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fba64159ad0 con 0x7fba640c7150 2024-04-23T10:22:34.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba6a221640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fba64159db0 con 0x7fba640c61e0 2024-04-23T10:22:34.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba62ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba640c7150 0x7fba64074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba63fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba64071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba62ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba640c7150 0x7fba64074160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:37912/0 (socket says 172.21.15.29:37912) 2024-04-23T10:22:34.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba63fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba64071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:43846/0 (socket says 172.21.15.29:43846) 2024-04-23T10:22:34.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba62ffd640 1 -- 172.21.15.29:0/3426427136 learned_addr learned my addr 172.21.15.29:0/3426427136 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:34.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba637fe640 1 --1- 172.21.15.29:0/3426427136 >> v1:172.21.15.72:6789/0 conn(0x7fba640c5e00 0x7fba64158ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:44986/0 (socket says 172.21.15.29:44986) 2024-04-23T10:22:34.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba63fff640 1 -- 172.21.15.29:0/3426427136 >> v2:172.21.15.72:3300/0 conn(0x7fba640c7150 msgr2=0x7fba64074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba63fff640 1 --2- 172.21.15.29:0/3426427136 >> v2:172.21.15.72:3300/0 conn(0x7fba640c7150 0x7fba64074160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba63fff640 1 -- 172.21.15.29:0/3426427136 >> v1:172.21.15.72:6789/0 conn(0x7fba640c5e00 legacy=0x7fba64158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba63fff640 1 -- 172.21.15.29:0/3426427136 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba640712a0 con 0x7fba640c61e0 2024-04-23T10:22:34.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba62ffd640 1 --2- 172.21.15.29:0/3426427136 >> v2:172.21.15.72:3300/0 conn(0x7fba640c7150 0x7fba64074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:22:34.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba63fff640 1 --2- 172.21.15.29:0/3426427136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba64071aa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009d90 tx=0x7fba5c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=652c0b5ac88dd1a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.814+0000 7fba627fc640 1 -- 172.21.15.29:0/3426427136 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0b2070 con 0x7fba640c61e0 2024-04-23T10:22:34.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba627fc640 1 -- 172.21.15.29:0/3426427136 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5c0a5920 con 0x7fba640c61e0 2024-04-23T10:22:34.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba627fc640 1 -- 172.21.15.29:0/3426427136 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0a5cf0 con 0x7fba640c61e0 2024-04-23T10:22:34.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- 172.21.15.29:0/3426427136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 msgr2=0x7fba64071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 --2- 172.21.15.29:0/3426427136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba64071aa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009d90 tx=0x7fba5c01c940 comp rx=0 tx=0).stop 2024-04-23T10:22:34.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- 172.21.15.29:0/3426427136 shutdown_connections 2024-04-23T10:22:34.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 --2- 172.21.15.29:0/3426427136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba64071aa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 --2- 172.21.15.29:0/3426427136 >> v2:172.21.15.72:3300/0 conn(0x7fba640c7150 0x7fba64074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- 172.21.15.29:0/3426427136 >> 172.21.15.29:0/3426427136 conn(0x7fba640cc490 msgr2=0x7fba640cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:34.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- 172.21.15.29:0/3426427136 shutdown_connections 2024-04-23T10:22:34.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- 172.21.15.29:0/3426427136 wait complete. 2024-04-23T10:22:34.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 Processor -- start 2024-04-23T10:22:34.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- start start 2024-04-23T10:22:34.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba640c5e00 0x7fba64133200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba640c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba640c7150 0x7fba640c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fba64165980 con 0x7fba640c5e00 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fba640721f0 con 0x7fba640c7150 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba6a221640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fba64165b00 con 0x7fba640c61e0 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba640c5e00 0x7fba64133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba640c5e00 0x7fba64133200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51360/0 (socket says 172.21.15.29:51360) 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba637fe640 1 -- 172.21.15.29:0/4263613562 learned_addr learned my addr 172.21.15.29:0/4263613562 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba62ffd640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba640c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba63fff640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba640c7150 0x7fba640c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.818+0000 7fba637fe640 1 -- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 msgr2=0x7fba640c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba637fe640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba640c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba637fe640 1 -- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba640c7150 msgr2=0x7fba640c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba637fe640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba640c7150 0x7fba640c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba637fe640 1 -- 172.21.15.29:0/4263613562 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba640c6830 con 0x7fba640c5e00 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba63fff640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba640c7150 0x7fba640c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba62ffd640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba640c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba637fe640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba640c5e00 0x7fba64133200 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fba5400c450 tx=0x7fba5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba4bfff640 1 -- 172.21.15.29:0/4263613562 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54018070 con 0x7fba640c5e00 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba4bfff640 1 -- 172.21.15.29:0/4263613562 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba54007480 con 0x7fba640c5e00 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba6a221640 1 -- 172.21.15.29:0/4263613562 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba640c8970 con 0x7fba640c5e00 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba4bfff640 1 -- 172.21.15.29:0/4263613562 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540047f0 con 0x7fba640c5e00 2024-04-23T10:22:34.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba6a221640 1 -- 172.21.15.29:0/4263613562 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba641328a0 con 0x7fba640c5e00 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba4bfff640 1 -- 172.21.15.29:0/4263613562 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba5401b070 con 0x7fba640c5e00 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba4bfff640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fba50068380 0x7fba5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba4bfff640 1 -- 172.21.15.29:0/4263613562 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fba54085f80 con 0x7fba640c5e00 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba62ffd640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fba50068380 0x7fba5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba6d3a3000 1 Processor -- start 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba6d3a3000 1 -- start start 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.822+0000 7fba62ffd640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fba50068380 0x7fba5006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba64136540 tx=0x7fba58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 0x55907d72a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 0x55907d72faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72ffe0 0x55907d7303c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55907d5d62a0 con 0x55907d72ffe0 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55907d53c5f0 con 0x55907d72f6c0 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55907d4d7820 con 0x55907d72a600 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72ffe0 0x55907d7303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72ffe0 0x55907d7303c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51362/0 (socket says 172.21.15.29:51362) 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 -- 172.21.15.29:0/1660978416 learned_addr learned my addr 172.21.15.29:0/1660978416 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba62ffd640 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 0x55907d72faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 0x55907d72a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 -- 172.21.15.29:0/1660978416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 msgr2=0x55907d72a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 0x55907d72a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 -- 172.21.15.29:0/1660978416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 msgr2=0x55907d72faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 0x55907d72faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 -- 172.21.15.29:0/1660978416 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907d582c00 con 0x55907d72ffe0 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72ffe0 0x55907d7303c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0b0040 tx=0x7fba5c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9667fb02af837db1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba497fa640 1 -- 172.21.15.29:0/1660978416 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0b2040 con 0x55907d72ffe0 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba497fa640 1 -- 172.21.15.29:0/1660978416 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5c0a5aa0 con 0x55907d72ffe0 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba497fa640 1 -- 172.21.15.29:0/1660978416 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0b8440 con 0x55907d72ffe0 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- 172.21.15.29:0/1660978416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72ffe0 msgr2=0x55907d7303c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72ffe0 0x55907d7303c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0b0040 tx=0x7fba5c004ac0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- 172.21.15.29:0/1660978416 shutdown_connections 2024-04-23T10:22:34.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72ffe0 0x55907d7303c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 0x55907d72faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/1660978416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 0x55907d72a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- 172.21.15.29:0/1660978416 >> 172.21.15.29:0/1660978416 conn(0x55907d72b470 msgr2=0x55907d72d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- 172.21.15.29:0/1660978416 shutdown_connections 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- 172.21.15.29:0/1660978416 wait complete. 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- start start 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 Processor -- start 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7299e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 0x55907d729f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72ffe0 0x55907d735620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55907d4e7c60 con 0x55907d72a600 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55907d5bebf0 con 0x55907d72f6c0 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55907d5f9560 con 0x55907d72ffe0 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba6d3a3000 10 client.0 _ll_register_callbacks cb 0x55907d513570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7299e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7299e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51370/0 (socket says 172.21.15.29:51370) 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 -- 172.21.15.29:0/3488850710 learned_addr learned my addr 172.21.15.29:0/3488850710 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba62ffd640 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 0x55907d729f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba63fff640 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72ffe0 0x55907d735620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 -- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72ffe0 msgr2=0x55907d735620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72ffe0 0x55907d735620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 -- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 msgr2=0x55907d729f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 0x55907d729f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.826+0000 7fba637fe640 1 -- 172.21.15.29:0/3488850710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907d577630 con 0x55907d72a600 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba637fe640 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7299e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fba54051f10 tx=0x7fba54059e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b951c30c68749265 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 1 -- 172.21.15.29:0/3488850710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5405e400 con 0x55907d72a600 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 1 -- 172.21.15.29:0/3488850710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fba54054f00 con 0x55907d72a600 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 -- 172.21.15.29:0/3488850710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba5c0a5aa0 con 0x55907d72a600 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 1 -- 172.21.15.29:0/3488850710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fba54055100 con 0x55907d72a600 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 10 client.5460 fetch_fsmap learned FSMap version 18 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 -- 172.21.15.29:0/3488850710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55907d4dc490 con 0x55907d72a600 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 1 -- 172.21.15.29:0/3488850710 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5c0a5aa0 con 0x55907d72a600 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 1 -- 172.21.15.29:0/3488850710 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fba540743f0 con 0x55907d72a600 2024-04-23T10:22:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 10 client.5460 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:22:34.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 10 client.5460 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:22:34.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 20 client.5460 populate_metadata read hostname 'smithi029' 2024-04-23T10:22:34.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55907d7363c0 0x55907d7367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 4 client.5460 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:22:34.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 -- 172.21.15.29:0/3488850710 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55907d4d67f0 con 0x55907d7363c0 2024-04-23T10:22:34.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba62ffd640 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55907d7363c0 0x55907d7367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 10 client.5460 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:34.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba62ffd640 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55907d7363c0 0x55907d7367d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd293d834895809 server_cookie=8198202fce73ecb4 in_seq=0 out_seq=0 2024-04-23T10:22:34.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 1 -- 172.21.15.29:0/3488850710 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55907d4d67f0 con 0x55907d7363c0 2024-04-23T10:22:34.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 10 client.5460 handle_command_reply: tid=0 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 client.5460 shutdown 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 -- 172.21.15.29:0/3488850710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 msgr2=0x55907d7299e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7299e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fba54051f10 tx=0x7fba54059e60 comp rx=0 tx=0).stop 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 -- 172.21.15.29:0/3488850710 shutdown_connections 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55907d7363c0 0x55907d7367d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72ffe0 0x55907d735620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72f6c0 0x55907d729f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/3488850710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7299e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba427fc640 0 client.5460 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 -- 172.21.15.29:0/3488850710 >> 172.21.15.29:0/3488850710 conn(0x55907d72b470 msgr2=0x55907d72e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:34.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 -- 172.21.15.29:0/3488850710 shutdown_connections 2024-04-23T10:22:34.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 1 -- 172.21.15.29:0/3488850710 wait complete. 2024-04-23T10:22:34.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.830+0000 7fba6d3a3000 20 client.5460 trim_cache size 0 max 16384 2024-04-23T10:22:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 Processor -- start 2024-04-23T10:22:34.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- start start 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72f6c0 0x55907d7379f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 0x55907d737f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fba64201bc0 con 0x55907d72a600 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fba64202290 con 0x55907d72ffe0 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fba641f8600 con 0x55907d72f6c0 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7414f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51386/0 (socket says 172.21.15.29:51386) 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 -- 172.21.15.29:0/2820895286 learned_addr learned my addr 172.21.15.29:0/2820895286 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba63fff640 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 0x55907d737f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba62ffd640 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72f6c0 0x55907d7379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 -- 172.21.15.29:0/2820895286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72f6c0 msgr2=0x55907d7379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72f6c0 0x55907d7379f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 -- 172.21.15.29:0/2820895286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 msgr2=0x55907d737f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 0x55907d737f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 -- 172.21.15.29:0/2820895286 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907d4d7a70 con 0x55907d72a600 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba637fe640 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7414f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba5400ce10 tx=0x7fba54006070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f3411ea0a7379b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba48ff9640 1 -- 172.21.15.29:0/2820895286 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54053b50 con 0x55907d72a600 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba48ff9640 1 -- 172.21.15.29:0/2820895286 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5405e200 con 0x55907d72a600 2024-04-23T10:22:34.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba48ff9640 1 -- 172.21.15.29:0/2820895286 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5405c300 con 0x55907d72a600 2024-04-23T10:22:34.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2820895286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 msgr2=0x55907d7414f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:34.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7414f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba5400ce10 tx=0x7fba54006070 comp rx=0 tx=0).stop 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2820895286 shutdown_connections 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 0x55907d737f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72f6c0 0x55907d7379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2820895286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72a600 0x55907d7414f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2820895286 >> 172.21.15.29:0/2820895286 conn(0x55907d72b470 msgr2=0x55907d74b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2820895286 shutdown_connections 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2820895286 wait complete. 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 -- start start 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.850+0000 7fba6d3a3000 1 Processor -- start 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 0x55907d6f3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72f6c0 0x55907d737aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 0x55907d737fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55907d53b900 con 0x55907d72f6c0 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55907d506e60 con 0x55907d72ffe0 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55907d540c20 con 0x55907d72a600 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 10 client.0 _ll_register_callbacks cb 0x7fba540555f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72f6c0 0x55907d737aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72f6c0 0x55907d737aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51394/0 (socket says 172.21.15.29:51394) 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 -- 172.21.15.29:0/2935170455 learned_addr learned my addr 172.21.15.29:0/2935170455 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba637fe640 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 0x55907d6f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 -- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 msgr2=0x55907d6f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 0x55907d6f3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 -- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 msgr2=0x55907d737fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:34.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 0x55907d737fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 -- 172.21.15.29:0/2935170455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907d5bf080 con 0x55907d72f6c0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba62ffd640 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72f6c0 0x55907d737aa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fba58011d80 tx=0x7fba58004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b37d071cde6caa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba427fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba427fc640 1 -- 172.21.15.29:0/2935170455 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5802e060 con 0x55907d72f6c0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba427fc640 1 -- 172.21.15.29:0/2935170455 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fba58029b50 con 0x55907d72f6c0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2935170455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba5405e200 con 0x55907d72f6c0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba427fc640 1 -- 172.21.15.29:0/2935170455 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fba58034050 con 0x55907d72f6c0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 10 client.5466 fetch_fsmap learned FSMap version 18 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2935170455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55907d4e23e0 con 0x55907d72f6c0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba427fc640 1 -- 172.21.15.29:0/2935170455 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5405e200 con 0x55907d72f6c0 2024-04-23T10:22:34.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba427fc640 1 -- 172.21.15.29:0/2935170455 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fba58037020 con 0x55907d72f6c0 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 10 client.5466 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 10 client.5466 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 20 client.5466 populate_metadata read hostname 'smithi029' 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55907d6f1730 0x55907d7aca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 4 client.5466 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.5, "await_for": 42.0}] 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2935170455 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.5, "await_for": 42.0}) -- 0x55907d4e5940 con 0x55907d6f1730 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba637fe640 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55907d6f1730 0x55907d7aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba427fc640 10 client.5466 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:34.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:34.854+0000 7fba637fe640 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55907d6f1730 0x55907d7aca90 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34c2998554d06a82 server_cookie=95f69ddb8c135951 in_seq=0 out_seq=0 2024-04-23T10:22:38.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.662+0000 7fba427fc640 1 -- 172.21.15.29:0/2935170455 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55907d4e5940 con 0x55907d6f1730 2024-04-23T10:22:38.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.662+0000 7fba427fc640 10 client.5466 handle_command_reply: tid=0 2024-04-23T10:22:38.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.662+0000 7fba6d3a3000 1 client.5466 shutdown 2024-04-23T10:22:38.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2935170455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72f6c0 msgr2=0x55907d737aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72f6c0 0x55907d737aa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fba58011d80 tx=0x7fba58004740 comp rx=0 tx=0).stop 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2935170455 shutdown_connections 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55907d6f1730 0x55907d7aca90 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55907d72ffe0 0x55907d737fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55907d72f6c0 0x55907d737aa0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba427fc640 0 client.5466 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 --2- 172.21.15.29:0/2935170455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55907d72a600 0x55907d6f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2935170455 >> 172.21.15.29:0/2935170455 conn(0x55907d72b470 msgr2=0x55907d74a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2935170455 shutdown_connections 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 1 -- 172.21.15.29:0/2935170455 wait complete. 2024-04-23T10:22:38.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6d3a3000 20 client.5466 trim_cache size 0 max 16384 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 26, 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "d575fd93": { 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 26, 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:22:38.667 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 78.5, 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:38.668 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:38.669 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:22:38.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 -- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fba50068380 msgr2=0x7fba5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:38.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fba50068380 0x7fba5006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba64136540 tx=0x7fba58008040 comp rx=0 tx=0).stop 2024-04-23T10:22:38.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 -- 172.21.15.29:0/4263613562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba640c5e00 msgr2=0x7fba64133200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba640c5e00 0x7fba64133200 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fba5400c450 tx=0x7fba5400c910 comp rx=0 tx=0).stop 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 -- 172.21.15.29:0/4263613562 shutdown_connections 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fba50068380 0x7fba5006a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba640c7150 0x7fba640c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba640c61e0 0x7fba640c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 --2- 172.21.15.29:0/4263613562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba640c5e00 0x7fba64133200 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 -- 172.21.15.29:0/4263613562 >> 172.21.15.29:0/4263613562 conn(0x7fba640cc490 msgr2=0x7fba640cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 -- 172.21.15.29:0/4263613562 shutdown_connections 2024-04-23T10:22:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:38.666+0000 7fba6a221640 1 -- 172.21.15.29:0/4263613562 wait complete. 2024-04-23T10:22:38.697 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd575fd93', quiesce took 4.4 seconds. Will release after: 18.5 2024-04-23T10:22:50.322 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:22:50.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:22:57.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:22:57.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.329+0000 7f792b99f640 1 Processor -- start 2024-04-23T10:22:57.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f792b99f640 1 -- start start 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f792b99f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7924155460 0x7f79240c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f792b99f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f79240ccf30 0x7f792415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f792b99f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79240cb9d0 con 0x7f79240c5a40 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f792b99f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f79240cc380 con 0x7f79240ccf30 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f792b99f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f79240cbf50 con 0x7f7924155460 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f7928f3a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f79240ccf30 0x7f792415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f7929f3c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f79240c5a40 0x7f792415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39528/0 (socket says 172.21.15.29:39528) 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f7929f3c640 1 -- 172.21.15.29:0/3470915470 learned_addr learned my addr 172.21.15.29:0/3470915470 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f792973b640 1 --2- 172.21.15.29:0/3470915470 >> v2:172.21.15.72:3300/0 conn(0x7f7924155460 0x7f79240c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f7928f3a640 1 -- 172.21.15.29:0/3470915470 >> v2:172.21.15.72:3300/0 conn(0x7f7924155460 msgr2=0x7f79240c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f7928f3a640 1 --2- 172.21.15.29:0/3470915470 >> v2:172.21.15.72:3300/0 conn(0x7f7924155460 0x7f79240c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f7928f3a640 1 -- 172.21.15.29:0/3470915470 >> v1:172.21.15.29:6789/0 conn(0x7f79240c5a40 legacy=0x7f792415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f7928f3a640 1 -- 172.21.15.29:0/3470915470 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7924155840 con 0x7f79240ccf30 2024-04-23T10:22:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f7928f3a640 1 --2- 172.21.15.29:0/3470915470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79240ccf30 0x7f792415bb70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f792408e5e0 tx=0x7f791401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9e05eeacb7c697 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.333+0000 7f791bfff640 1 -- 172.21.15.29:0/3470915470 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79140b0070 con 0x7f79240ccf30 2024-04-23T10:22:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f791bfff640 1 -- 172.21.15.29:0/3470915470 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79140ab600 con 0x7f79240ccf30 2024-04-23T10:22:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f791bfff640 1 -- 172.21.15.29:0/3470915470 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79140ab9d0 con 0x7f79240ccf30 2024-04-23T10:22:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- 172.21.15.29:0/3470915470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79240ccf30 msgr2=0x7f792415bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 --2- 172.21.15.29:0/3470915470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79240ccf30 0x7f792415bb70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f792408e5e0 tx=0x7f791401c310 comp rx=0 tx=0).stop 2024-04-23T10:22:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- 172.21.15.29:0/3470915470 shutdown_connections 2024-04-23T10:22:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 --2- 172.21.15.29:0/3470915470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79240ccf30 0x7f792415bb70 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 --2- 172.21.15.29:0/3470915470 >> v2:172.21.15.72:3300/0 conn(0x7f7924155460 0x7f79240c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- 172.21.15.29:0/3470915470 >> 172.21.15.29:0/3470915470 conn(0x7f7924074d60 msgr2=0x7f7924075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- 172.21.15.29:0/3470915470 shutdown_connections 2024-04-23T10:22:57.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- 172.21.15.29:0/3470915470 wait complete. 2024-04-23T10:22:57.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 Processor -- start 2024-04-23T10:22:57.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- start start 2024-04-23T10:22:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79240c5a40 0x7f79241e5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79240ccf30 0x7f79241f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7924155460 0x7f79241f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f792415ead0 con 0x7f7924155460 2024-04-23T10:22:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f792415e7f0 con 0x7f79240c5a40 2024-04-23T10:22:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792b99f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f79240d0940 con 0x7f79240ccf30 2024-04-23T10:22:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7924155460 0x7f79241f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f792973b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79240c5a40 0x7f79241e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7924155460 0x7f79241f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35372/0 (socket says 172.21.15.29:35372) 2024-04-23T10:22:57.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 -- 172.21.15.29:0/3719093646 learned_addr learned my addr 172.21.15.29:0/3719093646 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:57.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7928f3a640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79240ccf30 0x7f79241f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 -- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79240ccf30 msgr2=0x7f79241f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79240ccf30 0x7f79241f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 -- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79240c5a40 msgr2=0x7f79241e5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79240c5a40 0x7f79241e5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 -- 172.21.15.29:0/3719093646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79240d00f0 con 0x7f7924155460 2024-04-23T10:22:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7929f3c640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7924155460 0x7f79241f1ac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f791c009eb0 tx=0x7f791c00c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7919ffb640 1 -- 172.21.15.29:0/3719093646 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c019070 con 0x7f7924155460 2024-04-23T10:22:57.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.337+0000 7f7919ffb640 1 -- 172.21.15.29:0/3719093646 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c0078f0 con 0x7f7924155460 2024-04-23T10:22:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f7919ffb640 1 -- 172.21.15.29:0/3719093646 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c007cc0 con 0x7f7924155460 2024-04-23T10:22:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79241599c0 con 0x7f7924155460 2024-04-23T10:22:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79240d0670 con 0x7f7924155460 2024-04-23T10:22:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79240693c0 con 0x7f7924155460 2024-04-23T10:22:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f7919ffb640 1 -- 172.21.15.29:0/3719093646 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f791c01c070 con 0x7f7924155460 2024-04-23T10:22:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f7919ffb640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7908068380 0x7f790806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f7919ffb640 1 -- 172.21.15.29:0/3719093646 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f791c088a70 con 0x7f7924155460 2024-04-23T10:22:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f792973b640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7908068380 0x7f790806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.341+0000 7f792973b640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7908068380 0x7f790806a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7920003ab0 tx=0x7f7920009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.345+0000 7f7919ffb640 1 -- 172.21.15.29:0/3719093646 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f791c058650 con 0x7f7924155460 2024-04-23T10:22:57.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.549+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f792414be20 con 0x7f7924155460 2024-04-23T10:22:57.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f7919ffb640 1 -- 172.21.15.29:0/3719093646 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f791c05c950 con 0x7f7924155460 2024-04-23T10:22:57.553 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:22:57.553 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:22:57.553 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:22:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7908068380 msgr2=0x7f790806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7908068380 0x7f790806a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7920003ab0 tx=0x7f7920009830 comp rx=0 tx=0).stop 2024-04-23T10:22:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7924155460 msgr2=0x7f79241f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7924155460 0x7f79241f1ac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f791c009eb0 tx=0x7f791c00c430 comp rx=0 tx=0).stop 2024-04-23T10:22:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 shutdown_connections 2024-04-23T10:22:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7908068380 0x7f790806a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7924155460 0x7f79241f1ac0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79240ccf30 0x7f79241f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 --2- 172.21.15.29:0/3719093646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79240c5a40 0x7f79241e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 >> 172.21.15.29:0/3719093646 conn(0x7f7924074d60 msgr2=0x7f792415b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 shutdown_connections 2024-04-23T10:22:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.553+0000 7f792b99f640 1 -- 172.21.15.29:0/3719093646 wait complete. 2024-04-23T10:22:57.572 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id d575fd93 --release --await' 2024-04-23T10:22:57.572 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id d575fd93 --release --await 2024-04-23T10:22:57.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56c4b3d640 1 Processor -- start 2024-04-23T10:22:57.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56c4b3d640 1 -- start start 2024-04-23T10:22:57.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56c4b3d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c0153190 0x7f56c0159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56c4b3d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56c006f150 0x7f56c006f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56c4b3d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56c00c3fe0 con 0x7f56c00ccc50 2024-04-23T10:22:57.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56c4b3d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f56c0159380 con 0x7f56c006f150 2024-04-23T10:22:57.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56c4b3d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f56c00c42c0 con 0x7f56c0153190 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56bdd9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56c006f150 0x7f56c006f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56bdd9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56c006f150 0x7f56c006f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:45462/0 (socket says 172.21.15.29:45462) 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56bed9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f56c00ccc50 0x7f56c00cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:56454/0 (socket says 172.21.15.29:56454) 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56be59c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c0153190 0x7f56c0159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56bdd9b640 1 -- 172.21.15.29:0/1688509761 learned_addr learned my addr 172.21.15.29:0/1688509761 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56be59c640 1 -- 172.21.15.29:0/1688509761 >> v2:172.21.15.72:3300/0 conn(0x7f56c006f150 msgr2=0x7f56c006f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56be59c640 1 --2- 172.21.15.29:0/1688509761 >> v2:172.21.15.72:3300/0 conn(0x7f56c006f150 0x7f56c006f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56be59c640 1 -- 172.21.15.29:0/1688509761 >> v1:172.21.15.72:6789/0 conn(0x7f56c00ccc50 legacy=0x7f56c00cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56bd59a640 1 -- 172.21.15.29:0/1688509761 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313638345 0 0) 0x7f56c00c3fe0 con 0x7f56c00ccc50 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56be59c640 1 -- 172.21.15.29:0/1688509761 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c00c45a0 con 0x7f56c0153190 2024-04-23T10:22:57.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.709+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/1688509761 >> v2:172.21.15.72:3300/0 conn(0x7f56c006f150 0x7f56c006f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:22:57.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56be59c640 1 --2- 172.21.15.29:0/1688509761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c0153190 0x7f56c0159810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56b00097c0 tx=0x7f56b001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2b5efa0c26d391 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56bd59a640 1 -- 172.21.15.29:0/1688509761 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b00b5070 con 0x7f56c0153190 2024-04-23T10:22:57.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56bd59a640 1 -- 172.21.15.29:0/1688509761 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b00a8990 con 0x7f56c0153190 2024-04-23T10:22:57.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56bd59a640 1 -- 172.21.15.29:0/1688509761 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b00a8d60 con 0x7f56c0153190 2024-04-23T10:22:57.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 -- 172.21.15.29:0/1688509761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c0153190 msgr2=0x7f56c0159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/1688509761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c0153190 0x7f56c0159810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56b00097c0 tx=0x7f56b001ec90 comp rx=0 tx=0).stop 2024-04-23T10:22:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 -- 172.21.15.29:0/1688509761 shutdown_connections 2024-04-23T10:22:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/1688509761 >> v2:172.21.15.72:3300/0 conn(0x7f56c006f150 0x7f56c006f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/1688509761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c0153190 0x7f56c0159810 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 -- 172.21.15.29:0/1688509761 >> 172.21.15.29:0/1688509761 conn(0x7f56c006cfb0 msgr2=0x7f56c006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 -- 172.21.15.29:0/1688509761 shutdown_connections 2024-04-23T10:22:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 -- 172.21.15.29:0/1688509761 wait complete. 2024-04-23T10:22:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 Processor -- start 2024-04-23T10:22:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.713+0000 7f56c4b3d640 1 -- start start 2024-04-23T10:22:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56c4b3d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c006f150 0x7f56c01ec860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56c4b3d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56c00ccc50 0x7f56c014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56c4b3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56c0153190 0x7f56c0151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56c4b3d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f56c00c4880 con 0x7f56c0153190 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56c4b3d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f56c0153570 con 0x7f56c00ccc50 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56c4b3d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f56c00c9070 con 0x7f56c006f150 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56c0153190 0x7f56c0151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56c0153190 0x7f56c0151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35386/0 (socket says 172.21.15.29:35386) 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 -- 172.21.15.29:0/2390472281 learned_addr learned my addr 172.21.15.29:0/2390472281 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56c00ccc50 0x7f56c014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56be59c640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c006f150 0x7f56c01ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 -- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c006f150 msgr2=0x7f56c01ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c006f150 0x7f56c01ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 -- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56c00ccc50 msgr2=0x7f56c014e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56c00ccc50 0x7f56c014e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 -- 172.21.15.29:0/2390472281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c014ce50 con 0x7f56c0153190 2024-04-23T10:22:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56bed9d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56c0153190 0x7f56c0151070 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f56b800c7a0 tx=0x7f56b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56aeffd640 1 -- 172.21.15.29:0/2390472281 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b8018070 con 0x7f56c0153190 2024-04-23T10:22:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56aeffd640 1 -- 172.21.15.29:0/2390472281 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b800ce50 con 0x7f56c0153190 2024-04-23T10:22:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56c4b3d640 1 -- 172.21.15.29:0/2390472281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c014d0c0 con 0x7f56c0153190 2024-04-23T10:22:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56aeffd640 1 -- 172.21.15.29:0/2390472281 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b800a820 con 0x7f56c0153190 2024-04-23T10:22:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56c4b3d640 1 -- 172.21.15.29:0/2390472281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c014d680 con 0x7f56c0153190 2024-04-23T10:22:57.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56aeffd640 1 -- 172.21.15.29:0/2390472281 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56b801b070 con 0x7f56c0153190 2024-04-23T10:22:57.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56aeffd640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f56a0068380 0x7f56a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56aeffd640 1 -- 172.21.15.29:0/2390472281 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f56b8086320 con 0x7f56c0153190 2024-04-23T10:22:57.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.717+0000 7f56be59c640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f56a0068380 0x7f56a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 Processor -- start 2024-04-23T10:22:57.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- start start 2024-04-23T10:22:57.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f56a0068380 0x7f56a006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56b00b2000 tx=0x7f56b00aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d28198a0 0x5627d27e29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d27e2f00 0x5627d27e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d281e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5627d262a660 con 0x5627d28198a0 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5627d25cf5d0 con 0x5627d27e2f00 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5627d2626620 con 0x5627d281e120 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d28198a0 0x5627d27e29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d28198a0 0x5627d27e29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35396/0 (socket says 172.21.15.29:35396) 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 -- 172.21.15.29:0/574082684 learned_addr learned my addr 172.21.15.29:0/574082684 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56bed9d640 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d281e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 -- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 msgr2=0x5627d281e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d281e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d27e2f00 0x5627d27e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 -- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d27e2f00 msgr2=0x5627d27e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d27e2f00 0x5627d27e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 -- 172.21.15.29:0/574082684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627d2603bd0 con 0x5627d28198a0 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56bed9d640 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d281e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:57.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d27e2f00 0x5627d27e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:57.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56be59c640 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d28198a0 0x5627d27e29c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009580 tx=0x7f56b0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6be969d5a2df143 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f569ffff640 1 -- 172.21.15.29:0/574082684 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b00ca070 con 0x5627d28198a0 2024-04-23T10:22:57.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f569ffff640 1 -- 172.21.15.29:0/574082684 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b00ba520 con 0x5627d28198a0 2024-04-23T10:22:57.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f569ffff640 1 -- 172.21.15.29:0/574082684 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b00b5040 con 0x5627d28198a0 2024-04-23T10:22:57.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- 172.21.15.29:0/574082684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d28198a0 msgr2=0x5627d27e29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d28198a0 0x5627d27e29c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009580 tx=0x7f56b0004740 comp rx=0 tx=0).stop 2024-04-23T10:22:57.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- 172.21.15.29:0/574082684 shutdown_connections 2024-04-23T10:22:57.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d281e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d27e2f00 0x5627d27e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/574082684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d28198a0 0x5627d27e29c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- 172.21.15.29:0/574082684 >> 172.21.15.29:0/574082684 conn(0x5627d26c4b00 msgr2=0x5627d281bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- 172.21.15.29:0/574082684 shutdown_connections 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- 172.21.15.29:0/574082684 wait complete. 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 -- start start 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.721+0000 7f56c7cbf000 1 Processor -- start 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d27e2f00 0x5627d2818650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d2818b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d281e120 0x5627d27dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5627d26e7d40 con 0x5627d281e120 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5627d25e4eb0 con 0x5627d28198a0 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5627d26252a0 con 0x5627d27e2f00 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 10 client.0 _ll_register_callbacks cb 0x5627d27c8a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:22:57.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d281e120 0x5627d27dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d281e120 0x5627d27dd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35408/0 (socket says 172.21.15.29:35408) 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 -- 172.21.15.29:0/2359549597 learned_addr learned my addr 172.21.15.29:0/2359549597 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56be59c640 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d27e2f00 0x5627d2818650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d2818b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 -- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d27e2f00 msgr2=0x5627d2818650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d27e2f00 0x5627d2818650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 -- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 msgr2=0x5627d2818b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d2818b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 -- 172.21.15.29:0/2359549597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627d2670b30 con 0x5627d281e120 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56bed9d640 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d281e120 0x5627d27dd8a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f56b8055ac0 tx=0x7f56b8055f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294aaea026f307e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f569d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f569d7fa640 1 -- 172.21.15.29:0/2359549597 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b806e170 con 0x5627d281e120 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 -- 172.21.15.29:0/2359549597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5627d25c4060 con 0x5627d281e120 2024-04-23T10:22:57.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f569d7fa640 1 -- 172.21.15.29:0/2359549597 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f56b806e310 con 0x5627d281e120 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f569d7fa640 1 -- 172.21.15.29:0/2359549597 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f56b8084050 con 0x5627d281e120 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 10 client.5484 fetch_fsmap learned FSMap version 18 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 -- 172.21.15.29:0/2359549597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5627d25c9b70 con 0x5627d281e120 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f569d7fa640 1 -- 172.21.15.29:0/2359549597 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5627d25c4060 con 0x5627d281e120 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f569d7fa640 1 -- 172.21.15.29:0/2359549597 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f56b8055210 con 0x5627d281e120 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 10 client.5484 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 10 client.5484 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 20 client.5484 populate_metadata read hostname 'smithi029' 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5627d27de640 0x5627d27dea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 4 client.5484 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56c7cbf000 1 -- 172.21.15.29:0/2359549597 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627d2602e30 con 0x5627d27de640 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56be59c640 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5627d27de640 0x5627d27dea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f569d7fa640 10 client.5484 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:57.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.725+0000 7f56be59c640 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5627d27de640 0x5627d27dea20 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f1f1a81098e5fec server_cookie=3bd6cd84b7433820 in_seq=0 out_seq=0 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f569d7fa640 1 -- 172.21.15.29:0/2359549597 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5627d2602e30 con 0x5627d27de640 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f569d7fa640 10 client.5484 handle_command_reply: tid=0 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 client.5484 shutdown 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 -- 172.21.15.29:0/2359549597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d281e120 msgr2=0x5627d27dd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d281e120 0x5627d27dd8a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f56b8055ac0 tx=0x7f56b8055f00 comp rx=0 tx=0).stop 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 -- 172.21.15.29:0/2359549597 shutdown_connections 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5627d27de640 0x5627d27dea20 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d281e120 0x5627d27dd8a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d2818b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f569d7fa640 0 client.5484 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/2359549597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d27e2f00 0x5627d2818650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 -- 172.21.15.29:0/2359549597 >> 172.21.15.29:0/2359549597 conn(0x5627d26c4b00 msgr2=0x5627d281d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:57.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 -- 172.21.15.29:0/2359549597 shutdown_connections 2024-04-23T10:22:57.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 1 -- 172.21.15.29:0/2359549597 wait complete. 2024-04-23T10:22:57.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.729+0000 7f56c7cbf000 20 client.5484 trim_cache size 0 max 16384 2024-04-23T10:22:57.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56c7cbf000 1 Processor -- start 2024-04-23T10:22:57.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56c7cbf000 1 -- start start 2024-04-23T10:22:57.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d27e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d27e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d2834b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f56c01fa2f0 con 0x5627d27e2f00 2024-04-23T10:22:57.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f56c01fa9c0 con 0x5627d28198a0 2024-04-23T10:22:57.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f56c014c2f0 con 0x5627d281e120 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56be59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d27e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56be59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d27e12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35414/0 (socket says 172.21.15.29:35414) 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.745+0000 7f56be59c640 1 -- 172.21.15.29:0/4220095640 learned_addr learned my addr 172.21.15.29:0/4220095640 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d27e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 -- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 msgr2=0x5627d2834b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56bed9d640 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d2834b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d2834b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 -- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 msgr2=0x5627d27e1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d27e1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 -- 172.21.15.29:0/4220095640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627d26ac5e0 con 0x5627d27e2f00 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d27e1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d27e12c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f56b00a9fd0 tx=0x7f56b00b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e184d2ce2851900 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f569f7fe640 1 -- 172.21.15.29:0/4220095640 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b00ca040 con 0x5627d27e2f00 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f569f7fe640 1 -- 172.21.15.29:0/4220095640 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b00ba920 con 0x5627d27e2f00 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f569f7fe640 1 -- 172.21.15.29:0/4220095640 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b00b5040 con 0x5627d27e2f00 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- 172.21.15.29:0/4220095640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 msgr2=0x5627d27e12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d27e12c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f56b00a9fd0 tx=0x7f56b00b8000 comp rx=0 tx=0).stop 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- 172.21.15.29:0/4220095640 shutdown_connections 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d2834b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d27e1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/4220095640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d27e12c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- 172.21.15.29:0/4220095640 >> 172.21.15.29:0/4220095640 conn(0x5627d26c4b00 msgr2=0x5627d2819080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- 172.21.15.29:0/4220095640 shutdown_connections 2024-04-23T10:22:57.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- 172.21.15.29:0/4220095640 wait complete. 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- start start 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 Processor -- start 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d288bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d288c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d2836e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5627d2629970 con 0x5627d27e2f00 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5627d25df8f0 con 0x5627d28198a0 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5627d262ec90 con 0x5627d281e120 2024-04-23T10:22:57.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 10 client.0 _ll_register_callbacks cb 0x7f56b80520e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d288bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d288bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35430/0 (socket says 172.21.15.29:35430) 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 -- 172.21.15.29:0/906184677 learned_addr learned my addr 172.21.15.29:0/906184677 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56bed9d640 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d2836e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d288c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 -- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 msgr2=0x5627d2836e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d2836e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 -- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 msgr2=0x5627d288c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d288c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 -- 172.21.15.29:0/906184677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627d25bcae0 con 0x5627d27e2f00 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d288c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56be59c640 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d288bd10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f56b001d340 tx=0x7f56b001d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19621c178abc80fb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f569d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:22:57.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f569d7fa640 1 -- 172.21.15.29:0/906184677 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b00ca070 con 0x5627d27e2f00 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f569d7fa640 1 -- 172.21.15.29:0/906184677 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f56b00baad0 con 0x5627d27e2f00 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- 172.21.15.29:0/906184677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56b00ba920 con 0x5627d27e2f00 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f569d7fa640 1 -- 172.21.15.29:0/906184677 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f56b00e1050 con 0x5627d27e2f00 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 10 client.5490 fetch_fsmap learned FSMap version 18 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f56c7cbf000 1 -- 172.21.15.29:0/906184677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5627d25bfd80 con 0x5627d27e2f00 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.749+0000 7f569d7fa640 1 -- 172.21.15.29:0/906184677 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b00ba920 con 0x5627d27e2f00 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f569d7fa640 1 -- 172.21.15.29:0/906184677 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f56b00e4020 con 0x5627d27e2f00 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f56c7cbf000 10 client.5490 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f56c7cbf000 10 client.5490 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f56c7cbf000 20 client.5490 populate_metadata read hostname 'smithi029' 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5627d2837820 0x5627d2837c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f56c7cbf000 4 client.5490 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d575fd93", "release": true, "await": true}] 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f56c7cbf000 1 -- 172.21.15.29:0/906184677 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d575fd93", "release": true, "await": true}) -- 0x5627d25c80d0 con 0x5627d2837820 2024-04-23T10:22:57.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5627d2837820 0x5627d2837c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:57.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f56bdd9b640 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5627d2837820 0x5627d2837c30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f4f53e9a50ed26 server_cookie=fe868338680baf0c in_seq=0 out_seq=0 2024-04-23T10:22:57.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:57.753+0000 7f569d7fa640 10 client.5490 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f569d7fa640 1 -- 172.21.15.29:0/906184677 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5627d25c80d0 con 0x5627d2837820 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f569d7fa640 10 client.5490 handle_command_reply: tid=0 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 client.5490 shutdown 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 -- 172.21.15.29:0/906184677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 msgr2=0x5627d288bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d288bd10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f56b001d340 tx=0x7f56b001d4d0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 -- 172.21.15.29:0/906184677 shutdown_connections 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5627d2837820 0x5627d2837c30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5627d281e120 0x5627d2836e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5627d28198a0 0x5627d288c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 --2- 172.21.15.29:0/906184677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5627d27e2f00 0x5627d288bd10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 -- 172.21.15.29:0/906184677 >> 172.21.15.29:0/906184677 conn(0x5627d26c4b00 msgr2=0x5627d27dcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f569d7fa640 0 client.5490 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:22:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 -- 172.21.15.29:0/906184677 shutdown_connections 2024-04-23T10:22:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 1 -- 172.21.15.29:0/906184677 wait complete. 2024-04-23T10:22:58.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.337+0000 7f56c7cbf000 20 client.5490 trim_cache size 0 max 16384 2024-04-23T10:22:58.340 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 28, 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "d575fd93": { 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 28, 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:22:58.341 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 78.5, 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:22:58.342 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:22:58.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 -- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f56a0068380 msgr2=0x7f56a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f56a0068380 0x7f56a006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56b00b2000 tx=0x7f56b00aa070 comp rx=0 tx=0).stop 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 -- 172.21.15.29:0/2390472281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56c0153190 msgr2=0x7f56c0151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56c0153190 0x7f56c0151070 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f56b800c7a0 tx=0x7f56b800cc60 comp rx=0 tx=0).stop 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 -- 172.21.15.29:0/2390472281 shutdown_connections 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f56a0068380 0x7f56a006a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56c0153190 0x7f56c0151070 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56c00ccc50 0x7f56c014e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 --2- 172.21.15.29:0/2390472281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56c006f150 0x7f56c01ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 -- 172.21.15.29:0/2390472281 >> 172.21.15.29:0/2390472281 conn(0x7f56c006cfb0 msgr2=0x7f56c0074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 -- 172.21.15.29:0/2390472281 shutdown_connections 2024-04-23T10:22:58.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:22:58.341+0000 7f56c4b3d640 1 -- 172.21.15.29:0/2390472281 wait complete. 2024-04-23T10:22:58.369 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd575fd93', seconds elapsed: 24.1 2024-04-23T10:23:20.371 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:23:20.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:23:30.755 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T10:23:30.755 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T10:23:50.414 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:23:50.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:07.085 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.3 2024-04-23T10:24:07.085 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:07.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.217+0000 7f2fc1adb640 1 Processor -- start 2024-04-23T10:24:07.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.217+0000 7f2fc1adb640 1 -- start start 2024-04-23T10:24:07.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fc1adb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2fbc0c7730 0x7f2fbc15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fc1adb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2fbc1518f0 0x7f2fbc06f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fc1adb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc0c6320 0x7f2fbc0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fc1adb640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2fbc0c4280 con 0x7f2fbc0c7730 2024-04-23T10:24:07.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fc1adb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2fbc15b350 con 0x7f2fbc1518f0 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fc1adb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc15b630 con 0x7f2fbc0c6320 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2fbc0c7730 0x7f2fbc15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2fbc0c7730 0x7f2fbc15ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51332/0 (socket says 172.21.15.29:51332) 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 -- 172.21.15.29:0/2975235369 learned_addr learned my addr 172.21.15.29:0/2975235369 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbbfff640 1 --2- 172.21.15.29:0/2975235369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc0c6320 0x7f2fbc0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fb3fff640 1 --2- 172.21.15.29:0/2975235369 >> v2:172.21.15.72:3300/0 conn(0x7f2fbc1518f0 0x7f2fbc06f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 -- 172.21.15.29:0/2975235369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc0c6320 msgr2=0x7f2fbc0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 --2- 172.21.15.29:0/2975235369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc0c6320 0x7f2fbc0c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 -- 172.21.15.29:0/2975235369 >> v2:172.21.15.72:3300/0 conn(0x7f2fbc1518f0 msgr2=0x7f2fbc06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 --2- 172.21.15.29:0/2975235369 >> v2:172.21.15.72:3300/0 conn(0x7f2fbc1518f0 0x7f2fbc06f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 -- 172.21.15.29:0/2975235369 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc15b910 con 0x7f2fbc0c7730 2024-04-23T10:24:07.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbb7fe640 1 --2- 172.21.15.29:0/2975235369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc15ac10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc06fa60 tx=0x7f2fac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2392f6db7cce55bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbaffd640 1 -- 172.21.15.29:0/2975235369 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0ab5f0 con 0x7f2fbc0c7730 2024-04-23T10:24:07.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbaffd640 1 -- 172.21.15.29:0/2975235369 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fac0b0070 con 0x7f2fbc0c7730 2024-04-23T10:24:07.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.221+0000 7f2fbaffd640 1 -- 172.21.15.29:0/2975235369 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0ab9b0 con 0x7f2fbc0c7730 2024-04-23T10:24:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- 172.21.15.29:0/2975235369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 msgr2=0x7f2fbc15ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/2975235369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc15ac10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc06fa60 tx=0x7f2fac01c520 comp rx=0 tx=0).stop 2024-04-23T10:24:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- 172.21.15.29:0/2975235369 shutdown_connections 2024-04-23T10:24:07.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/2975235369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc0c6320 0x7f2fbc0c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/2975235369 >> v2:172.21.15.72:3300/0 conn(0x7f2fbc1518f0 0x7f2fbc06f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/2975235369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc15ac10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- 172.21.15.29:0/2975235369 >> 172.21.15.29:0/2975235369 conn(0x7f2fbc06cfb0 msgr2=0x7f2fbc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- 172.21.15.29:0/2975235369 shutdown_connections 2024-04-23T10:24:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- 172.21.15.29:0/2975235369 wait complete. 2024-04-23T10:24:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 Processor -- start 2024-04-23T10:24:07.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- start start 2024-04-23T10:24:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc0c6320 0x7f2fbc146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc1518f0 0x7f2fbc14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc06f810 con 0x7f2fbc0c7730 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc06f690 con 0x7f2fbc0c6320 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc0c7f60 con 0x7f2fbc1518f0 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51340/0 (socket says 172.21.15.29:51340) 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 -- 172.21.15.29:0/569563652 learned_addr learned my addr 172.21.15.29:0/569563652 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fbbfff640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc1518f0 0x7f2fbc14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fbb7fe640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc0c6320 0x7f2fbc146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 -- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc1518f0 msgr2=0x7f2fbc14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc1518f0 0x7f2fbc14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 -- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc0c6320 msgr2=0x7f2fbc146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc0c6320 0x7f2fbc146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 -- 172.21.15.29:0/569563652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc145210 con 0x7f2fbc0c7730 2024-04-23T10:24:07.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fbbfff640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc1518f0 0x7f2fbc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:07.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb3fff640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc159f50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c820 tx=0x7f2fa400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb8ff9640 1 -- 172.21.15.29:0/569563652 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4015070 con 0x7f2fbc0c7730 2024-04-23T10:24:07.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb8ff9640 1 -- 172.21.15.29:0/569563652 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa4007a30 con 0x7f2fbc0c7730 2024-04-23T10:24:07.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fb8ff9640 1 -- 172.21.15.29:0/569563652 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4007e20 con 0x7f2fbc0c7730 2024-04-23T10:24:07.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc1f3500 con 0x7f2fbc0c7730 2024-04-23T10:24:07.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.225+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc1f37a0 con 0x7f2fbc0c7730 2024-04-23T10:24:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.229+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc068d70 con 0x7f2fbc0c7730 2024-04-23T10:24:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.229+0000 7f2fb8ff9640 1 -- 172.21.15.29:0/569563652 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2fa4018070 con 0x7f2fbc0c7730 2024-04-23T10:24:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.229+0000 7f2fb8ff9640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2f9c068380 0x7f2f9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.229+0000 7f2fb8ff9640 1 -- 172.21.15.29:0/569563652 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2fa4086c10 con 0x7f2fbc0c7730 2024-04-23T10:24:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.229+0000 7f2fbb7fe640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2f9c068380 0x7f2f9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.229+0000 7f2fbb7fe640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2f9c068380 0x7f2f9c06a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0af000 tx=0x7f2fac0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.233+0000 7f2fb8ff9640 1 -- 172.21.15.29:0/569563652 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2fa4056db0 con 0x7f2fbc0c7730 2024-04-23T10:24:07.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.433+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fbc0c8dc0 con 0x7f2fbc0c7730 2024-04-23T10:24:07.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fb8ff9640 1 -- 172.21.15.29:0/569563652 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f2fa40566b0 con 0x7f2fbc0c7730 2024-04-23T10:24:07.436 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:24:07.436 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:24:07.436 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:24:07.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2f9c068380 msgr2=0x7f2f9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2f9c068380 0x7f2f9c06a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0af000 tx=0x7f2fac0a7000 comp rx=0 tx=0).stop 2024-04-23T10:24:07.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 msgr2=0x7f2fbc159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc159f50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c820 tx=0x7f2fa400cce0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 shutdown_connections 2024-04-23T10:24:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2f9c068380 0x7f2f9c06a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fbc1518f0 0x7f2fbc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fbc0c7730 0x7f2fbc159f50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 --2- 172.21.15.29:0/569563652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc0c6320 0x7f2fbc146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 >> 172.21.15.29:0/569563652 conn(0x7f2fbc06cfb0 msgr2=0x7f2fbc0c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 shutdown_connections 2024-04-23T10:24:07.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.437+0000 7f2fc1adb640 1 -- 172.21.15.29:0/569563652 wait complete. 2024-04-23T10:24:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 76.3 --await-for 42.0' 2024-04-23T10:24:07.455 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 76.3 --await-for 42.0 2024-04-23T10:24:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.593+0000 7fcb9fd38640 1 Processor -- start 2024-04-23T10:24:07.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.593+0000 7fcb9fd38640 1 -- start start 2024-04-23T10:24:07.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9fd38640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb98073f30 0x7fcb980cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9fd38640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb98074310 0x7fcb9815c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9fd38640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb98071c10 con 0x7fcb980cb280 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9fd38640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcb98158db0 con 0x7fcb98074310 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9fd38640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcb98072790 con 0x7fcb98073f30 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9d2d3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcb980cb280 0x7fcb98159500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49806/0 (socket says 172.21.15.29:49806) 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/1738100141 learned_addr learned my addr 172.21.15.29:0/1738100141 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb98073f30 0x7fcb980cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/1738100141 >> v2:172.21.15.72:3300/0 conn(0x7fcb98074310 0x7fcb9815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655949074 0 0) 0x7fcb98071c10 con 0x7fcb980cb280 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb84003530 con 0x7fcb980cb280 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2185124601 0 0) 0x7fcb84003530 con 0x7fcb980cb280 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb98073f30 msgr2=0x7fcb980cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb98073f30 0x7fcb980cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 >> v2:172.21.15.72:3300/0 conn(0x7fcb98074310 msgr2=0x7fcb9815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 --2- 172.21.15.29:0/1738100141 >> v2:172.21.15.72:3300/0 conn(0x7fcb98074310 0x7fcb9815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb98071ef0 con 0x7fcb980cb280 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fcb88001680 con 0x7fcb980cb280 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 >> v1:172.21.15.29:6789/0 conn(0x7fcb980cb280 legacy=0x7fcb98159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb98073f30 0x7fcb840039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb84003fc0 0x7fcb84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb84004d50 0x7fcb840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcb98072790 con 0x7fcb84004d50 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8400ba00 con 0x7fcb84003fc0 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8400bc00 con 0x7fcb98073f30 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb84004d50 0x7fcb840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb98073f30 0x7fcb840039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb84003fc0 0x7fcb84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb98073f30 msgr2=0x7fcb840039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb98073f30 0x7fcb840039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb84003fc0 msgr2=0x7fcb84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb84003fc0 0x7fcb84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/1738100141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb84003530 con 0x7fcb84004d50 2024-04-23T10:24:07.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.597+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb84003fc0 0x7fcb84004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb84004d50 0x7fcb840051d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009fc0 tx=0x7fcb9001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75096dd9a81ad57 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb900b2070 con 0x7fcb84004d50 2024-04-23T10:24:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb900a5cd0 con 0x7fcb84004d50 2024-04-23T10:24:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9cad2640 1 -- 172.21.15.29:0/1738100141 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90009c10 con 0x7fcb84004d50 2024-04-23T10:24:07.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- 172.21.15.29:0/1738100141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb84004d50 msgr2=0x7fcb840051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 --2- 172.21.15.29:0/1738100141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb84004d50 0x7fcb840051d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009fc0 tx=0x7fcb9001ccc0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/1738100141 reap_dead start 2024-04-23T10:24:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- 172.21.15.29:0/1738100141 shutdown_connections 2024-04-23T10:24:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- 172.21.15.29:0/1738100141 >> 172.21.15.29:0/1738100141 conn(0x7fcb98074d60 msgr2=0x7fcb9806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- 172.21.15.29:0/1738100141 shutdown_connections 2024-04-23T10:24:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- 172.21.15.29:0/1738100141 wait complete. 2024-04-23T10:24:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 Processor -- start 2024-04-23T10:24:07.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- start start 2024-04-23T10:24:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb84004d50 0x7fcb980c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb981564b0 0x7fcb981eeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6e30 0x7fcb981ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcb98158fe0 con 0x7fcb981564b0 2024-04-23T10:24:07.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb980724b0 con 0x7fcb980c6e30 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9fd38640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcb98159c10 con 0x7fcb84004d50 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9d2d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb981564b0 0x7fcb981eeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9d2d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb981564b0 0x7fcb981eeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51360/0 (socket says 172.21.15.29:51360) 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/3824070779 learned_addr learned my addr 172.21.15.29:0/3824070779 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb84004d50 0x7fcb980c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6e30 0x7fcb981ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb84004d50 msgr2=0x7fcb980c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb84004d50 0x7fcb980c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6e30 msgr2=0x7fcb981ef080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6e30 0x7fcb981ef080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/3824070779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb981f28e0 con 0x7fcb981564b0 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.601+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6e30 0x7fcb981ef080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb981564b0 0x7fcb981eeb40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800d860 tx=0x7fcb8800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb8e7fc640 1 -- 172.21.15.29:0/3824070779 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88019070 con 0x7fcb981564b0 2024-04-23T10:24:07.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb8e7fc640 1 -- 172.21.15.29:0/3824070779 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb880074e0 con 0x7fcb981564b0 2024-04-23T10:24:07.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb9fd38640 1 -- 172.21.15.29:0/3824070779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb981f1dc0 con 0x7fcb981564b0 2024-04-23T10:24:07.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb8e7fc640 1 -- 172.21.15.29:0/3824070779 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb880049f0 con 0x7fcb981564b0 2024-04-23T10:24:07.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb9fd38640 1 -- 172.21.15.29:0/3824070779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb981f2320 con 0x7fcb981564b0 2024-04-23T10:24:07.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb8e7fc640 1 -- 172.21.15.29:0/3824070779 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb8801c070 con 0x7fcb981564b0 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb8e7fc640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcb7c0683b0 0x7fcb7c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb8e7fc640 1 -- 172.21.15.29:0/3824070779 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcb880868b0 con 0x7fcb981564b0 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcb7c0683b0 0x7fcb7c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcba2eba000 1 Processor -- start 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcba2eba000 1 -- start start 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.605+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcb7c0683b0 0x7fcb7c06a870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009a30 tx=0x7fcb94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f3246c0 0x56489f324aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 0x56489f3253c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56489f1cb2a0 con 0x56489f3246c0 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56489f1315f0 con 0x56489f324fe0 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x56489f0cc820 con 0x56489f31f600 2024-04-23T10:24:07.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f3246c0 0x56489f324aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f3246c0 0x56489f324aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51370/0 (socket says 172.21.15.29:51370) 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/228471432 learned_addr learned my addr 172.21.15.29:0/228471432 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 0x56489f3253c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 msgr2=0x56489f31f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 msgr2=0x56489f3253c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 0x56489f3253c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 -- 172.21.15.29:0/228471432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489f177c00 con 0x56489f3246c0 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f3246c0 0x56489f324aa0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcb88056050 tx=0x7fcb88056250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4900131c256773 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb7b7fe640 1 -- 172.21.15.29:0/228471432 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8805ef30 con 0x56489f3246c0 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb7b7fe640 1 -- 172.21.15.29:0/228471432 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb88054650 con 0x56489f3246c0 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb7b7fe640 1 -- 172.21.15.29:0/228471432 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88004b90 con 0x56489f3246c0 2024-04-23T10:24:07.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- 172.21.15.29:0/228471432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f3246c0 msgr2=0x56489f324aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f3246c0 0x56489f324aa0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcb88056050 tx=0x7fcb88056250 comp rx=0 tx=0).stop 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- 172.21.15.29:0/228471432 shutdown_connections 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 0x56489f3253c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f3246c0 0x56489f324aa0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- 172.21.15.29:0/228471432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- 172.21.15.29:0/228471432 >> 172.21.15.29:0/228471432 conn(0x56489f320470 msgr2=0x56489f322890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- 172.21.15.29:0/228471432 shutdown_connections 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- 172.21.15.29:0/228471432 wait complete. 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- start start 2024-04-23T10:24:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 Processor -- start 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f31ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f32a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56489f0dcc60 con 0x56489f324fe0 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56489f1b3bf0 con 0x56489f3246c0 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x56489f1ee560 con 0x56489f31f600 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcba2eba000 10 client.0 _ll_register_callbacks cb 0x56489f108570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f32a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f32a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51376/0 (socket says 172.21.15.29:51376) 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/2599945606 learned_addr learned my addr 172.21.15.29:0/2599945606 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f31ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 msgr2=0x56489f31e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 msgr2=0x56489f31ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f31ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/2599945606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56489f16c630 con 0x56489f324fe0 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.609+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f31ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f32a830 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcb9001caf0 tx=0x7fcb84005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5d7de80877e4ba server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2599945606 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb900bd060 con 0x56489f324fe0 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2599945606 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcb900039a0 con 0x56489f324fe0 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 1 -- 172.21.15.29:0/2599945606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb88054650 con 0x56489f324fe0 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2599945606 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fcb900c3050 con 0x56489f324fe0 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 10 client.5508 fetch_fsmap learned FSMap version 18 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 1 -- 172.21.15.29:0/2599945606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56489f0d1490 con 0x56489f324fe0 2024-04-23T10:24:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2599945606 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb88054650 con 0x56489f324fe0 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2599945606 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fcb900c6020 con 0x56489f324fe0 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 10 client.5508 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 10 client.5508 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 20 client.5508 populate_metadata read hostname 'smithi029' 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x56489f32b5d0 0x56489f32b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 4 client.5508 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcba2eba000 1 -- 172.21.15.29:0/2599945606 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56489f0cb7f0 con 0x56489f32b5d0 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x56489f32b5d0 0x56489f32b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x56489f32b5d0 0x56489f32b9b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa35209e6328a85 server_cookie=71d705fe703ab415 in_seq=0 out_seq=0 2024-04-23T10:24:07.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.613+0000 7fcb78ff9640 10 client.5508 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:07.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2599945606 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56489f0cb7f0 con 0x56489f32b5d0 2024-04-23T10:24:07.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcb78ff9640 10 client.5508 handle_command_reply: tid=0 2024-04-23T10:24:07.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 client.5508 shutdown 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 -- 172.21.15.29:0/2599945606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 msgr2=0x56489f32a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f32a830 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcb9001caf0 tx=0x7fcb84005840 comp rx=0 tx=0).stop 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 -- 172.21.15.29:0/2599945606 shutdown_connections 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x56489f32b5d0 0x56489f32b9b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f32a830 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f31ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcb78ff9640 0 client.5508 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2599945606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f31e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 -- 172.21.15.29:0/2599945606 >> 172.21.15.29:0/2599945606 conn(0x56489f320470 msgr2=0x56489f3236b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 -- 172.21.15.29:0/2599945606 shutdown_connections 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 1 -- 172.21.15.29:0/2599945606 wait complete. 2024-04-23T10:24:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.617+0000 7fcba2eba000 20 client.5508 trim_cache size 0 max 16384 2024-04-23T10:24:07.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 Processor -- start 2024-04-23T10:24:07.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- start start 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f31f600 0x56489f33f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f3246c0 0x56489f32a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 0x56489f32a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcb981fc890 con 0x56489f31f600 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb981fcf60 con 0x56489f324fe0 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcb981fb1b0 con 0x56489f3246c0 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f31f600 0x56489f33f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f31f600 0x56489f33f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51388/0 (socket says 172.21.15.29:51388) 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 -- 172.21.15.29:0/1621645856 learned_addr learned my addr 172.21.15.29:0/1621645856 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 -- 172.21.15.29:0/1621645856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f3246c0 msgr2=0x56489f32a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/1621645856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f3246c0 0x56489f32a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 -- 172.21.15.29:0/1621645856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 msgr2=0x56489f32a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/1621645856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 0x56489f32a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 -- 172.21.15.29:0/1621645856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489f0cca70 con 0x56489f31f600 2024-04-23T10:24:07.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/1621645856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f31f600 0x56489f33f930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcb94006ef0 tx=0x7fcb94015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851b2e9f62b92b09 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb7affd640 1 -- 172.21.15.29:0/1621645856 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400f040 con 0x56489f31f600 2024-04-23T10:24:07.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb7affd640 1 -- 172.21.15.29:0/1621645856 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb94030070 con 0x56489f31f600 2024-04-23T10:24:07.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcb7affd640 1 -- 172.21.15.29:0/1621645856 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94024dc0 con 0x56489f31f600 2024-04-23T10:24:07.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- 172.21.15.29:0/1621645856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f31f600 msgr2=0x56489f33f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:07.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 --2- 172.21.15.29:0/1621645856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f31f600 0x56489f33f930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcb94006ef0 tx=0x7fcb94015000 comp rx=0 tx=0).stop 2024-04-23T10:24:07.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- 172.21.15.29:0/1621645856 shutdown_connections 2024-04-23T10:24:07.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 --2- 172.21.15.29:0/1621645856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f324fe0 0x56489f32a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 --2- 172.21.15.29:0/1621645856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f3246c0 0x56489f32a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 --2- 172.21.15.29:0/1621645856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f31f600 0x56489f33f930 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- 172.21.15.29:0/1621645856 >> 172.21.15.29:0/1621645856 conn(0x56489f320470 msgr2=0x56489f33f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- 172.21.15.29:0/1621645856 shutdown_connections 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.633+0000 7fcba2eba000 1 -- 172.21.15.29:0/1621645856 wait complete. 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 -- start start 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 Processor -- start 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f392ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f393530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f2e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56489f130900 con 0x56489f324fe0 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56489f0fbe60 con 0x56489f3246c0 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x56489f135c20 con 0x56489f31f600 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 10 client.0 _ll_register_callbacks cb 0x7fcb900b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:24:07.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f2e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f2e71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51396/0 (socket says 172.21.15.29:51396) 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/2571529886 learned_addr learned my addr 172.21.15.29:0/2571529886 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 msgr2=0x56489f392ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f392ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f392ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9d2d3640 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f393530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 msgr2=0x56489f393530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f393530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 -- 172.21.15.29:0/2571529886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56489f1b4080 con 0x56489f324fe0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9e2d5640 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f2e71c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcb90003e10 tx=0x7fcb90009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4040e5994840f1bb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2571529886 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb900b2070 con 0x56489f324fe0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2571529886 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcb900039a0 con 0x56489f324fe0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 -- 172.21.15.29:0/2571529886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb94030070 con 0x56489f324fe0 2024-04-23T10:24:07.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2571529886 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fcb900d6050 con 0x56489f324fe0 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 10 client.5514 fetch_fsmap learned FSMap version 18 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 -- 172.21.15.29:0/2571529886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56489f0d73e0 con 0x56489f324fe0 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2571529886 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb94030070 con 0x56489f324fe0 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2571529886 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fcb900d9020 con 0x56489f324fe0 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 10 client.5514 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 10 client.5514 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 20 client.5514 populate_metadata read hostname 'smithi029' 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x56489f2e8070 0x56489f2e8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 4 client.5514 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 76.3, "await_for": 42.0}] 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcba2eba000 1 -- 172.21.15.29:0/2571529886 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 76.3, "await_for": 42.0}) -- 0x56489f0da940 con 0x56489f2e8070 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x56489f2e8070 0x56489f2e8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:07.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb9dad4640 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x56489f2e8070 0x56489f2e8480 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c21c994dbeba5080 server_cookie=3808627d7cd36d8d in_seq=0 out_seq=0 2024-04-23T10:24:07.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:07.637+0000 7fcb78ff9640 10 client.5514 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:09.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcb78ff9640 1 -- 172.21.15.29:0/2571529886 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56489f0da940 con 0x56489f2e8070 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcb78ff9640 10 client.5514 handle_command_reply: tid=0 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 client.5514 shutdown 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 -- 172.21.15.29:0/2571529886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 msgr2=0x56489f2e71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f2e71c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcb90003e10 tx=0x7fcb90009750 comp rx=0 tx=0).stop 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 -- 172.21.15.29:0/2571529886 shutdown_connections 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x56489f2e8070 0x56489f2e8480 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56489f324fe0 0x56489f2e71c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56489f3246c0 0x56489f393530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcb78ff9640 0 client.5514 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 --2- 172.21.15.29:0/2571529886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56489f31f600 0x56489f392ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 -- 172.21.15.29:0/2571529886 >> 172.21.15.29:0/2571529886 conn(0x56489f320470 msgr2=0x56489f33f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 -- 172.21.15.29:0/2571529886 shutdown_connections 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 1 -- 172.21.15.29:0/2571529886 wait complete. 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcba2eba000 20 client.5514 trim_cache size 0 max 16384 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 30, 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:24:09.852 INFO:teuthology.orchestra.run.smithi029.stdout: "af326a7b": { 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 30, 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 76.3, 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:24:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:24:09.854 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:09.854 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:09.854 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:09.854 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:09.854 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:09.854 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:24:09.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcb9fd38640 1 -- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcb7c0683b0 msgr2=0x7fcb7c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:09.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.849+0000 7fcb9fd38640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcb7c0683b0 0x7fcb7c06a870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009a30 tx=0x7fcb94008040 comp rx=0 tx=0).stop 2024-04-23T10:24:09.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 -- 172.21.15.29:0/3824070779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb981564b0 msgr2=0x7fcb981eeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:09.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb981564b0 0x7fcb981eeb40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800d860 tx=0x7fcb8800dd20 comp rx=0 tx=0).stop 2024-04-23T10:24:09.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 -- 172.21.15.29:0/3824070779 shutdown_connections 2024-04-23T10:24:09.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcb7c0683b0 0x7fcb7c06a870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6e30 0x7fcb981ef080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb981564b0 0x7fcb981eeb40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 --2- 172.21.15.29:0/3824070779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb84004d50 0x7fcb980c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 -- 172.21.15.29:0/3824070779 >> 172.21.15.29:0/3824070779 conn(0x7fcb98074d60 msgr2=0x7fcb98157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 -- 172.21.15.29:0/3824070779 shutdown_connections 2024-04-23T10:24:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:09.853+0000 7fcb9fd38640 1 -- 172.21.15.29:0/3824070779 wait complete. 2024-04-23T10:24:09.878 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'af326a7b', quiesce took 2.8 seconds. Will release after: 16.3 2024-04-23T10:24:20.478 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:20.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:26.179 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:26.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa3d94640 1 Processor -- start 2024-04-23T10:24:26.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa3d94640 1 -- start start 2024-04-23T10:24:26.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa3d94640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f9c0ca430 0x7f0f9c0755d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa3d94640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f9c0ca810 0x7f0f9c15eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa3d94640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9c15b340 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa3d94640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0f9c0c9010 con 0x7f0f9c0ca430 2024-04-23T10:24:26.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa3d94640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0f9c15b5e0 con 0x7f0f9c0ca810 2024-04-23T10:24:26.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa1b30640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f9c0ca430 0x7f0f9c0755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa1b30640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f9c0ca430 0x7f0f9c0755d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48458/0 (socket says 172.21.15.29:48458) 2024-04-23T10:24:26.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa1b30640 1 -- 172.21.15.29:0/4270711337 learned_addr learned my addr 172.21.15.29:0/4270711337 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:26.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa132f640 1 --2- 172.21.15.29:0/4270711337 >> v2:172.21.15.72:3300/0 conn(0x7f0f9c0ca810 0x7f0f9c15eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa1b30640 1 -- 172.21.15.29:0/4270711337 >> v2:172.21.15.72:3300/0 conn(0x7f0f9c0ca810 msgr2=0x7f0f9c15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa1b30640 1 --2- 172.21.15.29:0/4270711337 >> v2:172.21.15.72:3300/0 conn(0x7f0f9c0ca810 0x7f0f9c15eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa1b30640 1 -- 172.21.15.29:0/4270711337 >> v1:172.21.15.72:6789/0 conn(0x7f0f9c0c83d0 legacy=0x7f0f9c154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.313+0000 7f0fa1b30640 1 -- 172.21.15.29:0/4270711337 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c15b8c0 con 0x7f0f9c0ca430 2024-04-23T10:24:26.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa1b30640 1 --2- 172.21.15.29:0/4270711337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0ca430 0x7f0f9c0755d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009870 tx=0x7f0f8c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2118e2514d0183a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa0b2e640 1 -- 172.21.15.29:0/4270711337 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0b5070 con 0x7f0f9c0ca430 2024-04-23T10:24:26.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa0b2e640 1 -- 172.21.15.29:0/4270711337 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0a89d0 con 0x7f0f9c0ca430 2024-04-23T10:24:26.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa0b2e640 1 -- 172.21.15.29:0/4270711337 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0a8da0 con 0x7f0f9c0ca430 2024-04-23T10:24:26.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- 172.21.15.29:0/4270711337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0ca430 msgr2=0x7f0f9c0755d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/4270711337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0ca430 0x7f0f9c0755d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009870 tx=0x7f0f8c01ecd0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- 172.21.15.29:0/4270711337 shutdown_connections 2024-04-23T10:24:26.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/4270711337 >> v2:172.21.15.72:3300/0 conn(0x7f0f9c0ca810 0x7f0f9c15eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/4270711337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0ca430 0x7f0f9c0755d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- 172.21.15.29:0/4270711337 >> 172.21.15.29:0/4270711337 conn(0x7f0f9c06fe00 msgr2=0x7f0f9c070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:26.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- 172.21.15.29:0/4270711337 shutdown_connections 2024-04-23T10:24:26.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- 172.21.15.29:0/4270711337 wait complete. 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 Processor -- start 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- start start 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0c83d0 0x7f0f9c06bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f9c0ca810 0x7f0f9c1f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f9c0cd2e0 0x7f0f9c1e51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c075b10 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c15be80 con 0x7f0f9c0ca810 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa3d94640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0f9c075c90 con 0x7f0f9c0cd2e0 2024-04-23T10:24:26.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa1b30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0c83d0 0x7f0f9c06bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa1b30640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0c83d0 0x7f0f9c06bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48472/0 (socket says 172.21.15.29:48472) 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.317+0000 7f0fa1b30640 1 -- 172.21.15.29:0/1612810808 learned_addr learned my addr 172.21.15.29:0/1612810808 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa132f640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f9c0ca810 0x7f0f9c1f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa1b30640 1 -- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f9c0cd2e0 msgr2=0x7f0f9c1e51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa1b30640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f9c0cd2e0 0x7f0f9c1e51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa1b30640 1 -- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f9c0ca810 msgr2=0x7f0f9c1f0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa1b30640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f9c0ca810 0x7f0f9c1f0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa1b30640 1 -- 172.21.15.29:0/1612810808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c15dfc0 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa132f640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f9c0ca810 0x7f0f9c1f0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa1b30640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0c83d0 0x7f0f9c06bc40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c000c10 tx=0x7f0f8c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0f927fc640 1 -- 172.21.15.29:0/1612810808 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0bf070 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0f927fc640 1 -- 172.21.15.29:0/1612810808 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0b0840 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c15e2a0 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0f927fc640 1 -- 172.21.15.29:0/1612810808 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0b5040 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9c1f3fb0 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9c068900 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0f927fc640 1 -- 172.21.15.29:0/1612810808 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f8c0c2070 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0f927fc640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0f80068380 0x7f0f8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0f927fc640 1 -- 172.21.15.29:0/1612810808 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0f8c123950 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa132f640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0f80068380 0x7f0f8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.321+0000 7f0fa132f640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0f80068380 0x7f0f8006a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0f98006fd0 tx=0x7f0f98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.325+0000 7f0f927fc640 1 -- 172.21.15.29:0/1612810808 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0f8c018830 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.525+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f9c1f3a80 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.525+0000 7f0f927fc640 1 -- 172.21.15.29:0/1612810808 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f0f8c0f3a60 con 0x7f0f9c0c83d0 2024-04-23T10:24:26.527 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:24:26.528 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:24:26.528 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0f80068380 msgr2=0x7f0f8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0f80068380 0x7f0f8006a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0f98006fd0 tx=0x7f0f98008040 comp rx=0 tx=0).stop 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0c83d0 msgr2=0x7f0f9c06bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0c83d0 0x7f0f9c06bc40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c000c10 tx=0x7f0f8c01ba70 comp rx=0 tx=0).stop 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 shutdown_connections 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f0f80068380 0x7f0f8006a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f9c0cd2e0 0x7f0f9c1e51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f9c0ca810 0x7f0f9c1f0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 --2- 172.21.15.29:0/1612810808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f9c0c83d0 0x7f0f9c06bc40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 >> 172.21.15.29:0/1612810808 conn(0x7f0f9c06fe00 msgr2=0x7f0f9c151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 shutdown_connections 2024-04-23T10:24:26.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.529+0000 7f0fa3d94640 1 -- 172.21.15.29:0/1612810808 wait complete. 2024-04-23T10:24:26.547 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id af326a7b --release --await' 2024-04-23T10:24:26.547 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id af326a7b --release --await 2024-04-23T10:24:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.673+0000 7f219aa48640 1 Processor -- start 2024-04-23T10:24:26.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f219aa48640 1 -- start start 2024-04-23T10:24:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f219aa48640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f219406f3b0 0x7f21940c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f219aa48640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f790 0x7f2194073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f219aa48640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2194071160 0x7f2194157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f219aa48640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2194072fe0 con 0x7f219406f3b0 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f219aa48640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2194158df0 con 0x7f2194071160 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f219aa48640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2194072590 con 0x7f219406f790 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f219406f3b0 0x7f21940c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f219406f3b0 0x7f21940c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48488/0 (socket says 172.21.15.29:48488) 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 -- 172.21.15.29:0/1281637744 learned_addr learned my addr 172.21.15.29:0/1281637744 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 -- 172.21.15.29:0/1281637744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f790 msgr2=0x7f2194073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2198fe5640 1 --2- 172.21.15.29:0/1281637744 >> v2:172.21.15.72:3300/0 conn(0x7f2194071160 0x7f2194157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 --2- 172.21.15.29:0/1281637744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f790 0x7f2194073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 -- 172.21.15.29:0/1281637744 >> v2:172.21.15.72:3300/0 conn(0x7f2194071160 msgr2=0x7f2194157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 --2- 172.21.15.29:0/1281637744 >> v2:172.21.15.72:3300/0 conn(0x7f2194071160 0x7f2194157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 -- 172.21.15.29:0/1281637744 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2194158830 con 0x7f219406f3b0 2024-04-23T10:24:26.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.677+0000 7f2193fff640 1 --2- 172.21.15.29:0/1281637744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219406f3b0 0x7f21940c4d70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f219406dd50 tx=0x7f218401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752e13def37e9be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f21937fe640 1 -- 172.21.15.29:0/1281637744 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840aa610 con 0x7f219406f3b0 2024-04-23T10:24:26.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f21937fe640 1 -- 172.21.15.29:0/1281637744 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21840af070 con 0x7f219406f3b0 2024-04-23T10:24:26.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f21937fe640 1 -- 172.21.15.29:0/1281637744 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840aa9d0 con 0x7f219406f3b0 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- 172.21.15.29:0/1281637744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219406f3b0 msgr2=0x7f21940c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 --2- 172.21.15.29:0/1281637744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219406f3b0 0x7f21940c4d70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f219406dd50 tx=0x7f218401c4f0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- 172.21.15.29:0/1281637744 shutdown_connections 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 --2- 172.21.15.29:0/1281637744 >> v2:172.21.15.72:3300/0 conn(0x7f2194071160 0x7f2194157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 --2- 172.21.15.29:0/1281637744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f790 0x7f2194073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 --2- 172.21.15.29:0/1281637744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219406f3b0 0x7f21940c4d70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- 172.21.15.29:0/1281637744 >> 172.21.15.29:0/1281637744 conn(0x7f219406cfb0 msgr2=0x7f219406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- 172.21.15.29:0/1281637744 shutdown_connections 2024-04-23T10:24:26.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- 172.21.15.29:0/1281637744 wait complete. 2024-04-23T10:24:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 Processor -- start 2024-04-23T10:24:26.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- start start 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f3b0 0x7f219413f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219406f790 0x7f2194143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2194071160 0x7f21940ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f21941524b0 con 0x7f2194071160 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2194152330 con 0x7f219406f790 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.681+0000 7f219aa48640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f219415b3e0 con 0x7f219406f3b0 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2194071160 0x7f21940ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2194071160 0x7f21940ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48502/0 (socket says 172.21.15.29:48502) 2024-04-23T10:24:26.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 -- 172.21.15.29:0/2535699248 learned_addr learned my addr 172.21.15.29:0/2535699248 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f218bfff640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219406f790 0x7f2194143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2193fff640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f3b0 0x7f219413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 -- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f3b0 msgr2=0x7f219413f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f3b0 0x7f219413f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 -- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219406f790 msgr2=0x7f2194143720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219406f790 0x7f2194143720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 -- 172.21.15.29:0/2535699248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2194157e90 con 0x7f2194071160 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f218bfff640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219406f790 0x7f2194143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2198fe5640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2194071160 0x7f21940ca5c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f218c00cc30 tx=0x7f218c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f21917fa640 1 -- 172.21.15.29:0/2535699248 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c00ce40 con 0x7f2194071160 2024-04-23T10:24:26.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f21917fa640 1 -- 172.21.15.29:0/2535699248 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218c0039a0 con 0x7f2194071160 2024-04-23T10:24:26.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f21917fa640 1 -- 172.21.15.29:0/2535699248 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c003d50 con 0x7f2194071160 2024-04-23T10:24:26.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f219aa48640 1 -- 172.21.15.29:0/2535699248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21941576d0 con 0x7f2194071160 2024-04-23T10:24:26.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f219aa48640 1 -- 172.21.15.29:0/2535699248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219413fa40 con 0x7f2194071160 2024-04-23T10:24:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f21917fa640 1 -- 172.21.15.29:0/2535699248 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f218c003f70 con 0x7f2194071160 2024-04-23T10:24:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f21917fa640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2174068380 0x7f217406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f21917fa640 1 -- 172.21.15.29:0/2535699248 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f218c0872e0 con 0x7f2194071160 2024-04-23T10:24:26.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.685+0000 7f2193fff640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2174068380 0x7f217406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 Processor -- start 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- start start 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2174068380 0x7f217406a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f21840ae000 tx=0x7f21840a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560c8e5fd660 con 0x560c8e7a7920 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560c8e5a25d0 con 0x560c8e7f1660 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x560c8e5f9620 con 0x560c8e7ec7b0 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ec270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48512/0 (socket says 172.21.15.29:48512) 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 -- 172.21.15.29:0/2106513795 learned_addr learned my addr 172.21.15.29:0/2106513795 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:26.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f218bfff640 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2198fe5640 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 -- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 msgr2=0x560c8e7f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 -- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 msgr2=0x560c8e7f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 -- 172.21.15.29:0/2106513795 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8e5d6bd0 con 0x560c8e7a7920 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f218bfff640 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2198fe5640 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ec270 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f218401aba0 tx=0x7f2184004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dee9f3b0298db2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2189ffb640 1 -- 172.21.15.29:0/2106513795 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840b9070 con 0x560c8e7a7920 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2189ffb640 1 -- 172.21.15.29:0/2106513795 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21840af040 con 0x560c8e7a7920 2024-04-23T10:24:26.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2189ffb640 1 -- 172.21.15.29:0/2106513795 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840be8d0 con 0x560c8e7a7920 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- 172.21.15.29:0/2106513795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 msgr2=0x560c8e7ec270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ec270 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f218401aba0 tx=0x7f2184004740 comp rx=0 tx=0).stop 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- 172.21.15.29:0/2106513795 shutdown_connections 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- 172.21.15.29:0/2106513795 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ec270 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- 172.21.15.29:0/2106513795 >> 172.21.15.29:0/2106513795 conn(0x560c8e697b00 msgr2=0x560c8e7eeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- 172.21.15.29:0/2106513795 shutdown_connections 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- 172.21.15.29:0/2106513795 wait complete. 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- start start 2024-04-23T10:24:26.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 Processor -- start 2024-04-23T10:24:26.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7b5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560c8e6bad40 con 0x560c8e7a7920 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560c8e5b7eb0 con 0x560c8e7f1660 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x560c8e5f82a0 con 0x560c8e7ec7b0 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f219dbca000 10 client.0 _ll_register_callbacks cb 0x560c8e79ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48526/0 (socket says 172.21.15.29:48526) 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.689+0000 7f2193fff640 1 -- 172.21.15.29:0/956011073 learned_addr learned my addr 172.21.15.29:0/956011073 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f218bfff640 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2198fe5640 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2193fff640 1 -- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 msgr2=0x560c8e7f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2193fff640 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2193fff640 1 -- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 msgr2=0x560c8e7f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2193fff640 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2193fff640 1 -- 172.21.15.29:0/956011073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8e643b30 con 0x560c8e7a7920 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2193fff640 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7b5600 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f218401aba0 tx=0x7f218401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbc0ee8ca005923 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 1 -- 172.21.15.29:0/956011073 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840b9040 con 0x560c8e7a7920 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 1 -- 172.21.15.29:0/956011073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c8e597060 con 0x560c8e7a7920 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 1 -- 172.21.15.29:0/956011073 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f21840bedc0 con 0x560c8e7a7920 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 1 -- 172.21.15.29:0/956011073 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f21840db050 con 0x560c8e7a7920 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 10 client.5532 fetch_fsmap learned FSMap version 18 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 1 -- 172.21.15.29:0/956011073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x560c8e59cb70 con 0x560c8e7a7920 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 1 -- 172.21.15.29:0/956011073 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560c8e597060 con 0x560c8e7a7920 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 1 -- 172.21.15.29:0/956011073 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f21840de020 con 0x560c8e7a7920 2024-04-23T10:24:26.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 10 client.5532 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 10 client.5532 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 20 client.5532 populate_metadata read hostname 'smithi029' 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x560c8e7eaf60 0x560c8e7eb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 4 client.5532 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 1 -- 172.21.15.29:0/956011073 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c8e5d5e30 con 0x560c8e7eaf60 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f218bfff640 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x560c8e7eaf60 0x560c8e7eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f218bfff640 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x560c8e7eaf60 0x560c8e7eb340 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f42e4f804bd18b server_cookie=e40cacb9e810962d in_seq=0 out_seq=0 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 10 client.5532 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 1 -- 172.21.15.29:0/956011073 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560c8e5d5e30 con 0x560c8e7eaf60 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f2172ffd640 10 client.5532 handle_command_reply: tid=0 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.693+0000 7f219dbca000 1 client.5532 shutdown 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 -- 172.21.15.29:0/956011073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 msgr2=0x560c8e7b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7b5600 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f218401aba0 tx=0x7f218401ad30 comp rx=0 tx=0).stop 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 -- 172.21.15.29:0/956011073 shutdown_connections 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x560c8e7eaf60 0x560c8e7eb340 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e7f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e7f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f2172ffd640 0 client.5532 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 --2- 172.21.15.29:0/956011073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7b5600 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 -- 172.21.15.29:0/956011073 >> 172.21.15.29:0/956011073 conn(0x560c8e697b00 msgr2=0x560c8e7eeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 -- 172.21.15.29:0/956011073 shutdown_connections 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 1 -- 172.21.15.29:0/956011073 wait complete. 2024-04-23T10:24:26.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.697+0000 7f219dbca000 20 client.5532 trim_cache size 0 max 16384 2024-04-23T10:24:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 Processor -- start 2024-04-23T10:24:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- start start 2024-04-23T10:24:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ea500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e8110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e811620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f21941fd440 con 0x560c8e7a7920 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f21941fdb10 con 0x560c8e7f1660 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f219415af70 con 0x560c8e7ec7b0 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ea500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48538/0 (socket says 172.21.15.29:48538) 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 -- 172.21.15.29:0/2700911493 learned_addr learned my addr 172.21.15.29:0/2700911493 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f218bfff640 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e8110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2198fe5640 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e811620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 -- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 msgr2=0x560c8e8110e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e8110e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 -- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 msgr2=0x560c8e811620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e811620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 -- 172.21.15.29:0/2700911493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8e67f5e0 con 0x560c8e7a7920 2024-04-23T10:24:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2198fe5640 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e811620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f2193fff640 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ea500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f21840aa3e0 tx=0x7f21840cb070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73e35560d49da22 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f21897fa640 1 -- 172.21.15.29:0/2700911493 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840e4070 con 0x560c8e7a7920 2024-04-23T10:24:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f21897fa640 1 -- 172.21.15.29:0/2700911493 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21840cd070 con 0x560c8e7a7920 2024-04-23T10:24:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f21897fa640 1 -- 172.21.15.29:0/2700911493 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840b9040 con 0x560c8e7a7920 2024-04-23T10:24:26.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- 172.21.15.29:0/2700911493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 msgr2=0x560c8e7ea500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:26.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ea500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f21840aa3e0 tx=0x7f21840cb070 comp rx=0 tx=0).stop 2024-04-23T10:24:26.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- 172.21.15.29:0/2700911493 shutdown_connections 2024-04-23T10:24:26.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7f1660 0x560c8e811620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7ec7b0 0x560c8e8110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 --2- 172.21.15.29:0/2700911493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e7ea500 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- 172.21.15.29:0/2700911493 >> 172.21.15.29:0/2700911493 conn(0x560c8e697b00 msgr2=0x560c8e7b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- 172.21.15.29:0/2700911493 shutdown_connections 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.713+0000 7f219dbca000 1 -- 172.21.15.29:0/2700911493 wait complete. 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 -- start start 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 Processor -- start 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e8113b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7ec7b0 0x560c8e810110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7f1660 0x560c8e810650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560c8e5fc970 con 0x560c8e7a7920 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x560c8e5b28f0 con 0x560c8e7ec7b0 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x560c8e601c90 con 0x560c8e7f1660 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 10 client.0 _ll_register_callbacks cb 0x7f21840aa890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e8113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e8113b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48554/0 (socket says 172.21.15.29:48554) 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 -- 172.21.15.29:0/3434461961 learned_addr learned my addr 172.21.15.29:0/3434461961 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f218bfff640 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7ec7b0 0x560c8e810110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2198fe5640 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7f1660 0x560c8e810650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 -- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7f1660 msgr2=0x560c8e810650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7f1660 0x560c8e810650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 -- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7ec7b0 msgr2=0x560c8e810110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7ec7b0 0x560c8e810110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:26.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 -- 172.21.15.29:0/3434461961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8e58fae0 con 0x560c8e7a7920 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2198fe5640 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7f1660 0x560c8e810650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2193fff640 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e8113b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f218401c530 tx=0x7f2184009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854c4f9094c8458b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2172ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2172ffd640 1 -- 172.21.15.29:0/3434461961 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840e4050 con 0x560c8e7a7920 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2172ffd640 1 -- 172.21.15.29:0/3434461961 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2184005db0 con 0x560c8e7a7920 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 -- 172.21.15.29:0/3434461961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21840cd070 con 0x560c8e7a7920 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2172ffd640 1 -- 172.21.15.29:0/3434461961 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f21840ee050 con 0x560c8e7a7920 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 10 client.5538 fetch_fsmap learned FSMap version 18 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 -- 172.21.15.29:0/3434461961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x560c8e592d80 con 0x560c8e7a7920 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2172ffd640 1 -- 172.21.15.29:0/3434461961 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21840cd070 con 0x560c8e7a7920 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2172ffd640 1 -- 172.21.15.29:0/3434461961 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f21840f1020 con 0x560c8e7a7920 2024-04-23T10:24:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 10 client.5538 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:24:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 10 client.5538 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:24:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 20 client.5538 populate_metadata read hostname 'smithi029' 2024-04-23T10:24:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x560c8e80d590 0x560c8e80d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 4 client.5538 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "af326a7b", "release": true, "await": true}] 2024-04-23T10:24:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f219dbca000 1 -- 172.21.15.29:0/3434461961 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "af326a7b", "release": true, "await": true}) -- 0x560c8e59b0d0 con 0x560c8e80d590 2024-04-23T10:24:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f218bfff640 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x560c8e80d590 0x560c8e80d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f218bfff640 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x560c8e80d590 0x560c8e80d9a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b235d1ef0e12c0b server_cookie=1ba8818938ff2c45 in_seq=0 out_seq=0 2024-04-23T10:24:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:26.717+0000 7f2172ffd640 10 client.5538 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f2172ffd640 1 -- 172.21.15.29:0/3434461961 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560c8e59b0d0 con 0x560c8e80d590 2024-04-23T10:24:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f2172ffd640 10 client.5538 handle_command_reply: tid=0 2024-04-23T10:24:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 client.5538 shutdown 2024-04-23T10:24:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 -- 172.21.15.29:0/3434461961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 msgr2=0x560c8e8113b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e8113b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f218401c530 tx=0x7f2184009240 comp rx=0 tx=0).stop 2024-04-23T10:24:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 -- 172.21.15.29:0/3434461961 shutdown_connections 2024-04-23T10:24:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x560c8e80d590 0x560c8e80d9a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560c8e7f1660 0x560c8e810650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560c8e7ec7b0 0x560c8e810110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 --2- 172.21.15.29:0/3434461961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560c8e7a7920 0x560c8e8113b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f2172ffd640 0 client.5538 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 -- 172.21.15.29:0/3434461961 >> 172.21.15.29:0/3434461961 conn(0x560c8e697b00 msgr2=0x560c8e7f07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 -- 172.21.15.29:0/3434461961 shutdown_connections 2024-04-23T10:24:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 1 -- 172.21.15.29:0/3434461961 wait complete. 2024-04-23T10:24:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.109+0000 7f219dbca000 20 client.5538 trim_cache size 0 max 16384 2024-04-23T10:24:27.112 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:24:27.112 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:24:27.112 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:24:27.112 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 32, 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "af326a7b": { 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 32, 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 76.3, 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:24:27.113 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:24:27.114 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:24:27.114 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:27.114 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:27.114 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:27.114 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:27.114 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:27.114 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 -- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2174068380 msgr2=0x7f217406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2174068380 0x7f217406a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f21840ae000 tx=0x7f21840a7000 comp rx=0 tx=0).stop 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 -- 172.21.15.29:0/2535699248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2194071160 msgr2=0x7f21940ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2194071160 0x7f21940ca5c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f218c00cc30 tx=0x7f218c00a5c0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 -- 172.21.15.29:0/2535699248 shutdown_connections 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2174068380 0x7f217406a840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2194071160 0x7f21940ca5c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219406f790 0x7f2194143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 --2- 172.21.15.29:0/2535699248 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f219406f3b0 0x7f219413f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 -- 172.21.15.29:0/2535699248 >> 172.21.15.29:0/2535699248 conn(0x7f219406cfb0 msgr2=0x7f2194150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:27.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 -- 172.21.15.29:0/2535699248 shutdown_connections 2024-04-23T10:24:27.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:27.113+0000 7f219aa48640 1 -- 172.21.15.29:0/2535699248 wait complete. 2024-04-23T10:24:27.142 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'af326a7b', seconds elapsed: 20.1 2024-04-23T10:24:51.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:51.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:57.415 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.2 2024-04-23T10:24:57.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:57.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb814c4640 1 Processor -- start 2024-04-23T10:24:57.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb814c4640 1 -- start start 2024-04-23T10:24:57.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb814c4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c153300 0x7ffb7c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb814c4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb7c067d30 con 0x7ffb7c06e7f0 2024-04-23T10:24:57.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb814c4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb7c068010 con 0x7ffb7c074400 2024-04-23T10:24:57.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb814c4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffb7c067ae0 con 0x7ffb7c153300 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ffb7c06e7f0 0x7ffb7c15c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41248/0 (socket says 172.21.15.29:41248) 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7b7fe640 1 -- 172.21.15.29:0/1629327824 learned_addr learned my addr 172.21.15.29:0/1629327824 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7affd640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c153300 0x7ffb7c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870582015 0 0) 0x7ffb7c067d30 con 0x7ffb7c06e7f0 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb64003530 con 0x7ffb7c06e7f0 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3528128441 0 0) 0x7ffb64003530 con 0x7ffb7c06e7f0 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c153300 msgr2=0x7ffb7c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c153300 0x7ffb7c0c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 >> v1:172.21.15.72:6789/0 conn(0x7ffb7c074400 legacy=0x7ffb7c06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c0c8a10 con 0x7ffb7c06e7f0 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7ffb74001680 con 0x7ffb7c06e7f0 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 >> v1:172.21.15.29:6789/0 conn(0x7ffb7c06e7f0 legacy=0x7ffb7c15c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c153300 0x7ffb640039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb64003fc0 0x7ffb64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64004d50 0x7ffb640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c067ae0 con 0x7ffb64003fc0 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6400bb10 con 0x7ffb64004d50 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6400bd10 con 0x7ffb7c153300 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7a7fc640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb64003fc0 0x7ffb64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7affd640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c153300 0x7ffb640039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7b7fe640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64004d50 0x7ffb640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7a7fc640 1 -- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c153300 msgr2=0x7ffb640039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7a7fc640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c153300 0x7ffb640039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7a7fc640 1 -- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64004d50 msgr2=0x7ffb640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7a7fc640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64004d50 0x7ffb640051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.552+0000 7ffb7a7fc640 1 -- 172.21.15.29:0/1629327824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb64003530 con 0x7ffb64003fc0 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb7a7fc640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb64003fc0 0x7ffb64004810 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffb70001e70 tx=0x7ffb7001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821a8683ae827d82 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70001a90 con 0x7ffb64003fc0 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb70003b80 con 0x7ffb64003fc0 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb79ffb640 1 -- 172.21.15.29:0/1629327824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb700050d0 con 0x7ffb64003fc0 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb814c4640 1 -- 172.21.15.29:0/1629327824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb64003fc0 msgr2=0x7ffb64004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb814c4640 1 --2- 172.21.15.29:0/1629327824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb64003fc0 0x7ffb64004810 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffb70001e70 tx=0x7ffb7001c6e0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb7b7fe640 1 -- 172.21.15.29:0/1629327824 reap_dead start 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb814c4640 1 -- 172.21.15.29:0/1629327824 shutdown_connections 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb814c4640 1 -- 172.21.15.29:0/1629327824 >> 172.21.15.29:0/1629327824 conn(0x7ffb7c0c9a90 msgr2=0x7ffb7c0c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb814c4640 1 -- 172.21.15.29:0/1629327824 shutdown_connections 2024-04-23T10:24:57.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb814c4640 1 -- 172.21.15.29:0/1629327824 wait complete. 2024-04-23T10:24:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb814c4640 1 Processor -- start 2024-04-23T10:24:57.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.556+0000 7ffb814c4640 1 -- start start 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64003fc0 0x7ffb7c1f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c0c3cc0 0x7ffb7c14f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c0c34a0 0x7ffb7c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c072e20 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c0c8fd0 con 0x7ffb64003fc0 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffb7c1536e0 con 0x7ffb7c0c34a0 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c0c3cc0 0x7ffb7c14f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c0c3cc0 0x7ffb7c14f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36232/0 (socket says 172.21.15.29:36232) 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 -- 172.21.15.29:0/317905817 learned_addr learned my addr 172.21.15.29:0/317905817 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:57.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7affd640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64003fc0 0x7ffb7c1f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7b7fe640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c0c34a0 0x7ffb7c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 -- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c0c34a0 msgr2=0x7ffb7c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c0c34a0 0x7ffb7c159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 -- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64003fc0 msgr2=0x7ffb7c1f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64003fc0 0x7ffb7c1f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 -- 172.21.15.29:0/317905817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c159590 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7a7fc640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c0c3cc0 0x7ffb7c14f480 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffb7001c510 tx=0x7ffb64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb637fe640 1 -- 172.21.15.29:0/317905817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb700be070 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb637fe640 1 -- 172.21.15.29:0/317905817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb700050d0 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c158cf0 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb637fe640 1 -- 172.21.15.29:0/317905817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70005480 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c1592b0 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c0693c0 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb637fe640 1 -- 172.21.15.29:0/317905817 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb700c1070 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb637fe640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb68068380 0x7ffb6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb637fe640 1 -- 172.21.15.29:0/317905817 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ffb70120f80 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.560+0000 7ffb7affd640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb68068380 0x7ffb6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.564+0000 7ffb7affd640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb68068380 0x7ffb6806a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009a30 tx=0x7ffb6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.568+0000 7ffb637fe640 1 -- 172.21.15.29:0/317905817 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb700ac020 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.776+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb7c073f00 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.776+0000 7ffb637fe640 1 -- 172.21.15.29:0/317905817 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7ffb700163f0 con 0x7ffb7c0c3cc0 2024-04-23T10:24:57.779 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:24:57.780 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:24:57.780 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb68068380 msgr2=0x7ffb6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb68068380 0x7ffb6806a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009a30 tx=0x7ffb6c008040 comp rx=0 tx=0).stop 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c0c3cc0 msgr2=0x7ffb7c14f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c0c3cc0 0x7ffb7c14f480 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffb7001c510 tx=0x7ffb64005840 comp rx=0 tx=0).stop 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 shutdown_connections 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ffb68068380 0x7ffb6806a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb7c0c34a0 0x7ffb7c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c0c3cc0 0x7ffb7c14f480 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 --2- 172.21.15.29:0/317905817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb64003fc0 0x7ffb7c1f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 >> 172.21.15.29:0/317905817 conn(0x7ffb7c0c9a90 msgr2=0x7ffb7c0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 shutdown_connections 2024-04-23T10:24:57.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.780+0000 7ffb814c4640 1 -- 172.21.15.29:0/317905817 wait complete. 2024-04-23T10:24:57.799 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 80.2 --await-for 42.0' 2024-04-23T10:24:57.799 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 80.2 --await-for 42.0 2024-04-23T10:24:57.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9c5d0c640 1 Processor -- start 2024-04-23T10:24:57.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9c5d0c640 1 -- start start 2024-04-23T10:24:57.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9c5d0c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9c0153260 0x7fa9c0073730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9c5d0c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00742e0 0x7fa9c015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9c5d0c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c00c5d70 con 0x7fa9c00ce860 2024-04-23T10:24:57.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9c5d0c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c00c6050 con 0x7fa9c0153260 2024-04-23T10:24:57.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9c5d0c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c015c390 con 0x7fa9c00742e0 2024-04-23T10:24:57.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9bf7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9c0153260 0x7fa9c0073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9bffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa9c00ce860 0x7fa9c0158d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:40184/0 (socket says 172.21.15.29:40184) 2024-04-23T10:24:57.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9bffff640 1 -- 172.21.15.29:0/3426717603 learned_addr learned my addr 172.21.15.29:0/3426717603 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:24:57.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9beffd640 1 --2- 172.21.15.29:0/3426717603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00742e0 0x7fa9c015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9beffd640 1 -- 172.21.15.29:0/3426717603 >> v2:172.21.15.72:3300/0 conn(0x7fa9c0153260 msgr2=0x7fa9c0073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9beffd640 1 --2- 172.21.15.29:0/3426717603 >> v2:172.21.15.72:3300/0 conn(0x7fa9c0153260 0x7fa9c0073730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9beffd640 1 -- 172.21.15.29:0/3426717603 >> v1:172.21.15.72:6789/0 conn(0x7fa9c00ce860 legacy=0x7fa9c0158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.944+0000 7fa9beffd640 1 -- 172.21.15.29:0/3426717603 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c015c670 con 0x7fa9c00742e0 2024-04-23T10:24:57.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9beffd640 1 --2- 172.21.15.29:0/3426717603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00742e0 0x7fa9c015cb90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40097c0 tx=0x7fa9b401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce181b9b691bf157 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9be7fc640 1 -- 172.21.15.29:0/3426717603 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40b5070 con 0x7fa9c00742e0 2024-04-23T10:24:57.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9be7fc640 1 -- 172.21.15.29:0/3426717603 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b40a8990 con 0x7fa9c00742e0 2024-04-23T10:24:57.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9be7fc640 1 -- 172.21.15.29:0/3426717603 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40a8d60 con 0x7fa9c00742e0 2024-04-23T10:24:57.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/3426717603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00742e0 msgr2=0x7fa9c015cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/3426717603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00742e0 0x7fa9c015cb90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40097c0 tx=0x7fa9b401ec90 comp rx=0 tx=0).stop 2024-04-23T10:24:57.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/3426717603 shutdown_connections 2024-04-23T10:24:57.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/3426717603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00742e0 0x7fa9c015cb90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/3426717603 >> v2:172.21.15.72:3300/0 conn(0x7fa9c0153260 0x7fa9c0073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/3426717603 >> 172.21.15.29:0/3426717603 conn(0x7fa9c006f460 msgr2=0x7fa9c0074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:57.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/3426717603 shutdown_connections 2024-04-23T10:24:57.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/3426717603 wait complete. 2024-04-23T10:24:57.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 Processor -- start 2024-04-23T10:24:57.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.948+0000 7fa9c5d0c640 1 -- start start 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9c5d0c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9c00742e0 0x7fa9c0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9c5d0c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00ce860 0x7fa9c01474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9c5d0c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9c0153260 0x7fa9c01eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9c5d0c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00c8870 con 0x7fa9c0153260 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9c5d0c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00c8bb0 con 0x7fa9c00742e0 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9c5d0c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c015d0d0 con 0x7fa9c00ce860 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9c0153260 0x7fa9c01eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9c0153260 0x7fa9c01eedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36236/0 (socket says 172.21.15.29:36236) 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 -- 172.21.15.29:0/471138581 learned_addr learned my addr 172.21.15.29:0/471138581 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:57.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9beffd640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00ce860 0x7fa9c01474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9c00742e0 0x7fa9c0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 -- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00ce860 msgr2=0x7fa9c01474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00ce860 0x7fa9c01474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 -- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9c00742e0 msgr2=0x7fa9c0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9c00742e0 0x7fa9c0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 -- 172.21.15.29:0/471138581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c01f2af0 con 0x7fa9c0153260 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9c00742e0 0x7fa9c0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9bffff640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9c0153260 0x7fa9c01eedb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800cbc0 tx=0x7fa9b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9a7fff640 1 -- 172.21.15.29:0/471138581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8017070 con 0x7fa9c0153260 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9a7fff640 1 -- 172.21.15.29:0/471138581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b800ad40 con 0x7fa9c0153260 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/471138581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c0143bf0 con 0x7fa9c0153260 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9a7fff640 1 -- 172.21.15.29:0/471138581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8012600 con 0x7fa9c0153260 2024-04-23T10:24:57.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/471138581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c01441b0 con 0x7fa9c0153260 2024-04-23T10:24:57.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9a7fff640 1 -- 172.21.15.29:0/471138581 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa9b801a070 con 0x7fa9c0153260 2024-04-23T10:24:57.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9a7fff640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa9ac0683b0 0x7fa9ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.952+0000 7fa9a7fff640 1 -- 172.21.15.29:0/471138581 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa9b80869d0 con 0x7fa9c0153260 2024-04-23T10:24:57.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa9ac0683b0 0x7fa9ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 Processor -- start 2024-04-23T10:24:57.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- start start 2024-04-23T10:24:57.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa9ac0683b0 0x7fa9ac06a870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009bb0 tx=0x7fa9b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7791600 0x5607f77919e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7796aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7796fe0 0x5607f77973c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5607f763d2a0 con 0x5607f7796fe0 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5607f75a35f0 con 0x5607f77966c0 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5607f753e820 con 0x5607f7791600 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7796fe0 0x5607f77973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7796fe0 0x5607f77973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36248/0 (socket says 172.21.15.29:36248) 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 -- 172.21.15.29:0/1809155176 learned_addr learned my addr 172.21.15.29:0/1809155176 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7791600 0x5607f77919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9beffd640 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7796aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 -- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7791600 msgr2=0x5607f77919e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7791600 0x5607f77919e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 -- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 msgr2=0x5607f7796aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7796aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 -- 172.21.15.29:0/1809155176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f75e9c00 con 0x5607f7796fe0 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9beffd640 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7796aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7791600 0x5607f77919e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9bffff640 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7796fe0 0x5607f77973c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8056540 tx=0x7fa9b805a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8713025bc780de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9a57fa640 1 -- 172.21.15.29:0/1809155176 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8052c20 con 0x5607f7796fe0 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9a57fa640 1 -- 172.21.15.29:0/1809155176 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b805ec50 con 0x5607f7796fe0 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9a57fa640 1 -- 172.21.15.29:0/1809155176 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8052dc0 con 0x5607f7796fe0 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/1809155176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7796fe0 msgr2=0x5607f77973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7796fe0 0x5607f77973c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8056540 tx=0x7fa9b805a8b0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/1809155176 shutdown_connections 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7796fe0 0x5607f77973c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7796aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/1809155176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7791600 0x5607f77919e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/1809155176 >> 172.21.15.29:0/1809155176 conn(0x5607f7792470 msgr2=0x5607f7794890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:57.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/1809155176 shutdown_connections 2024-04-23T10:24:57.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/1809155176 wait complete. 2024-04-23T10:24:57.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.956+0000 7fa9c8e8e000 1 -- start start 2024-04-23T10:24:57.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 Processor -- start 2024-04-23T10:24:57.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f77909e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7790f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f779c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5607f754ec60 con 0x5607f7791600 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5607f7625bf0 con 0x5607f7796fe0 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5607f7660560 con 0x5607f77966c0 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 10 client.0 _ll_register_callbacks cb 0x5607f757a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f77909e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f77909e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36252/0 (socket says 172.21.15.29:36252) 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/2375629788 learned_addr learned my addr 172.21.15.29:0/2375629788 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bffff640 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f779c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9beffd640 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7790f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 msgr2=0x5607f7790f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7790f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 msgr2=0x5607f779c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f779c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/2375629788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f75de630 con 0x5607f7791600 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f77909e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0015870 tx=0x7fa9b00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6be96c79a4318ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa99e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa99e7fc640 1 -- 172.21.15.29:0/2375629788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0026070 con 0x5607f7791600 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa99e7fc640 1 -- 172.21.15.29:0/2375629788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa9b0014b70 con 0x5607f7791600 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/2375629788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b805ec50 con 0x5607f7791600 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa99e7fc640 1 -- 172.21.15.29:0/2375629788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa9b0031050 con 0x5607f7791600 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 10 client.5553 fetch_fsmap learned FSMap version 18 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/2375629788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5607f7543490 con 0x5607f7791600 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa99e7fc640 1 -- 172.21.15.29:0/2375629788 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b805ec50 con 0x5607f7791600 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa99e7fc640 1 -- 172.21.15.29:0/2375629788 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fa9b0034020 con 0x5607f7791600 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 10 client.5553 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 10 client.5553 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:24:57.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 20 client.5553 populate_metadata read hostname 'smithi029' 2024-04-23T10:24:57.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5607f779d390 0x5607f779d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 4 client.5553 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:24:57.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/2375629788 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607f753d7f0 con 0x5607f779d390 2024-04-23T10:24:57.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9beffd640 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5607f779d390 0x5607f779d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa9beffd640 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5607f779d390 0x5607f779d7a0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7eeaa01ac36482 server_cookie=976a975f504806f7 in_seq=0 out_seq=0 2024-04-23T10:24:57.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.960+0000 7fa99e7fc640 10 client.5553 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:57.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa99e7fc640 1 -- 172.21.15.29:0/2375629788 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5607f753d7f0 con 0x5607f779d390 2024-04-23T10:24:57.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa99e7fc640 10 client.5553 handle_command_reply: tid=0 2024-04-23T10:24:57.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 client.5553 shutdown 2024-04-23T10:24:57.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/2375629788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 msgr2=0x5607f77909e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f77909e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0015870 tx=0x7fa9b00046d0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/2375629788 shutdown_connections 2024-04-23T10:24:57.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5607f779d390 0x5607f779d7a0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f779c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7790f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa99e7fc640 0 client.5553 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:57.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/2375629788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f77909e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/2375629788 >> 172.21.15.29:0/2375629788 conn(0x5607f7792470 msgr2=0x5607f77956b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:57.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/2375629788 shutdown_connections 2024-04-23T10:24:57.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/2375629788 wait complete. 2024-04-23T10:24:57.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.964+0000 7fa9c8e8e000 20 client.5553 trim_cache size 0 max 16384 2024-04-23T10:24:57.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 Processor -- start 2024-04-23T10:24:57.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- start start 2024-04-23T10:24:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7806e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7807370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7796fe0 0x5607f77a8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c01fc690 con 0x5607f7791600 2024-04-23T10:24:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c01fcd60 con 0x5607f77966c0 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c01fae00 con 0x5607f7796fe0 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7806e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7806e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36268/0 (socket says 172.21.15.29:36268) 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/190312637 learned_addr learned my addr 172.21.15.29:0/190312637 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bffff640 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7796fe0 0x5607f77a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9beffd640 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7807370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7796fe0 msgr2=0x5607f77a8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7796fe0 0x5607f77a8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 msgr2=0x5607f7807370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7807370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/190312637 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f753ea70 con 0x5607f7791600 2024-04-23T10:24:57.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bffff640 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7796fe0 0x5607f77a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7806e30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0011f70 tx=0x7fa9b0022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72025b5429a4488 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9a4ff9640 1 -- 172.21.15.29:0/190312637 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b003a070 con 0x5607f7791600 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9a4ff9640 1 -- 172.21.15.29:0/190312637 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b001a040 con 0x5607f7791600 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9a4ff9640 1 -- 172.21.15.29:0/190312637 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0026040 con 0x5607f7791600 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/190312637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 msgr2=0x5607f7806e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7806e30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0011f70 tx=0x7fa9b0022000 comp rx=0 tx=0).stop 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/190312637 shutdown_connections 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f7796fe0 0x5607f77a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f77966c0 0x5607f7807370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/190312637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7806e30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/190312637 >> 172.21.15.29:0/190312637 conn(0x5607f7792470 msgr2=0x5607f77b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/190312637 shutdown_connections 2024-04-23T10:24:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/190312637 wait complete. 2024-04-23T10:24:57.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 -- start start 2024-04-23T10:24:57.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.984+0000 7fa9c8e8e000 1 Processor -- start 2024-04-23T10:24:57.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7807e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7808350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f7759150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5607f75a2900 con 0x5607f7791600 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5607f756de60 con 0x5607f7796fe0 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5607f75a7c20 con 0x5607f77966c0 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 10 client.0 _ll_register_callbacks cb 0x7fa9b0009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7807e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7807e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36274/0 (socket says 172.21.15.29:36274) 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/4004068034 learned_addr learned my addr 172.21.15.29:0/4004068034 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bffff640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f7759150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9beffd640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7808350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 msgr2=0x5607f7808350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7808350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 msgr2=0x5607f7759150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f7759150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 -- 172.21.15.29:0/4004068034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f7626080 con 0x5607f7791600 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bffff640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f7759150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9beffd640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7808350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9bf7fe640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7807e10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00095d0 tx=0x7fa9b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c38b37fcc3fd89b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa99e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa99e7fc640 1 -- 172.21.15.29:0/4004068034 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b003a070 con 0x5607f7791600 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa99e7fc640 1 -- 172.21.15.29:0/4004068034 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa9b002b650 con 0x5607f7791600 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/4004068034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b001a040 con 0x5607f7791600 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa99e7fc640 1 -- 172.21.15.29:0/4004068034 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa9b0047050 con 0x5607f7791600 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 10 client.5559 fetch_fsmap learned FSMap version 18 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/4004068034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5607f75493e0 con 0x5607f7791600 2024-04-23T10:24:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa99e7fc640 1 -- 172.21.15.29:0/4004068034 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b001a040 con 0x5607f7791600 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa99e7fc640 1 -- 172.21.15.29:0/4004068034 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fa9b004a020 con 0x5607f7791600 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 10 client.5559 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 10 client.5559 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 20 client.5559 populate_metadata read hostname 'smithi029' 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5607f7759a80 0x5607f7759e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 4 client.5559 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.2, "await_for": 42.0}] 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/4004068034 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.2, "await_for": 42.0}) -- 0x5607f754c940 con 0x5607f7759a80 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9beffd640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5607f7759a80 0x5607f7759e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa99e7fc640 10 client.5559 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:57.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:57.988+0000 7fa9beffd640 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5607f7759a80 0x5607f7759e60 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ca350c3f98b5c56 server_cookie=13f0f522111a6a2 in_seq=0 out_seq=0 2024-04-23T10:24:59.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa99e7fc640 1 -- 172.21.15.29:0/4004068034 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5607f754c940 con 0x5607f7759a80 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa99e7fc640 10 client.5559 handle_command_reply: tid=0 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 client.5559 shutdown 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/4004068034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 msgr2=0x5607f7807e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7807e10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00095d0 tx=0x7fa9b0016000 comp rx=0 tx=0).stop 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/4004068034 shutdown_connections 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5607f7759a80 0x5607f7759e60 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5607f7796fe0 0x5607f7759150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5607f77966c0 0x5607f7808350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 --2- 172.21.15.29:0/4004068034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5607f7791600 0x5607f7807e10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/4004068034 >> 172.21.15.29:0/4004068034 conn(0x5607f7792470 msgr2=0x5607f77a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa99e7fc640 0 client.5559 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/4004068034 shutdown_connections 2024-04-23T10:24:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 1 -- 172.21.15.29:0/4004068034 wait complete. 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.460+0000 7fa9c8e8e000 20 client.5559 trim_cache size 0 max 16384 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 34, 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stdout: "7b5b03d9": { 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 34, 2024-04-23T10:24:59.464 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 80.2, 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:59.465 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:59.466 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:59.466 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:24:59.466 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:24:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa9ac0683b0 msgr2=0x7fa9ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa9ac0683b0 0x7fa9ac06a870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009bb0 tx=0x7fa9b0008040 comp rx=0 tx=0).stop 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/471138581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9c0153260 msgr2=0x7fa9c01eedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9c0153260 0x7fa9c01eedb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800cbc0 tx=0x7fa9b800a430 comp rx=0 tx=0).stop 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/471138581 shutdown_connections 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa9ac0683b0 0x7fa9ac06a870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9c0153260 0x7fa9c01eedb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9c00ce860 0x7fa9c01474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 --2- 172.21.15.29:0/471138581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9c00742e0 0x7fa9c0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/471138581 >> 172.21.15.29:0/471138581 conn(0x7fa9c006f460 msgr2=0x7fa9c00732b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/471138581 shutdown_connections 2024-04-23T10:24:59.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:24:59.464+0000 7fa9c5d0c640 1 -- 172.21.15.29:0/471138581 wait complete. 2024-04-23T10:24:59.491 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7b5b03d9', quiesce took 2.1 seconds. Will release after: 20.2 2024-04-23T10:25:19.693 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:25:19.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5de06ea640 1 Processor -- start 2024-04-23T10:25:19.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5de06ea640 1 -- start start 2024-04-23T10:25:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5de06ea640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5dd806f150 0x7f5dd806f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5de06ea640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd80ccc50 0x7f5dd80cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5de06ea640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd80cd5c0 con 0x7f5dd8153190 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5de06ea640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5dd8159f20 con 0x7f5dd806f150 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5de06ea640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd8159380 con 0x7f5dd80ccc50 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5dde486640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5dd8153190 0x7f5dd8159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51304/0 (socket says 172.21.15.29:51304) 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.832+0000 7f5dde486640 1 -- 172.21.15.29:0/803220757 learned_addr learned my addr 172.21.15.29:0/803220757 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5dddc85640 1 --2- 172.21.15.29:0/803220757 >> v2:172.21.15.72:3300/0 conn(0x7f5dd806f150 0x7f5dd806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddec87640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd80ccc50 0x7f5dd80cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3971065777 0 0) 0x7f5dd4001120 con 0x7f5dd8153190 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc4003530 con 0x7f5dd8153190 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 158467970 0 0) 0x7f5dc4003530 con 0x7f5dd8153190 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd80ccc50 msgr2=0x7f5dd80cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd80ccc50 0x7f5dd80cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 >> v2:172.21.15.72:3300/0 conn(0x7f5dd806f150 msgr2=0x7f5dd806f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 --2- 172.21.15.29:0/803220757 >> v2:172.21.15.72:3300/0 conn(0x7f5dd806f150 0x7f5dd806f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd80c3fe0 con 0x7f5dd8153190 2024-04-23T10:25:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f5dd4001850 con 0x7f5dd8153190 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 >> v1:172.21.15.29:6789/0 conn(0x7f5dd8153190 legacy=0x7f5dd8159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd80ccc50 0x7f5dc40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dc4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc4004d50 0x7f5dc40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd8159f20 con 0x7f5dc4003f40 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd8159380 con 0x7f5dc4004d50 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc400ba00 con 0x7f5dd80ccc50 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5dddc85640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dc4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5dddc85640 1 -- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd80ccc50 msgr2=0x7f5dc40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5dddc85640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd80ccc50 0x7f5dc40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5dddc85640 1 -- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc4004d50 msgr2=0x7f5dc40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5dddc85640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dc4004d50 0x7f5dc40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5dddc85640 1 -- 172.21.15.29:0/803220757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc4003530 con 0x7f5dc4003f40 2024-04-23T10:25:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5dddc85640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dc4004810 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009fc0 tx=0x7f5dcc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a7589026b1f078 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0b2070 con 0x7f5dc4003f40 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc0a5cd0 con 0x7f5dc4003f40 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddd484640 1 -- 172.21.15.29:0/803220757 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc009c10 con 0x7f5dc4003f40 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5de06ea640 1 -- 172.21.15.29:0/803220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 msgr2=0x7f5dc4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5de06ea640 1 --2- 172.21.15.29:0/803220757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dc4004810 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009fc0 tx=0x7f5dcc01ccc0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.836+0000 7f5ddec87640 1 -- 172.21.15.29:0/803220757 reap_dead start 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- 172.21.15.29:0/803220757 shutdown_connections 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- 172.21.15.29:0/803220757 >> 172.21.15.29:0/803220757 conn(0x7f5dd806cfb0 msgr2=0x7f5dd806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- 172.21.15.29:0/803220757 shutdown_connections 2024-04-23T10:25:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- 172.21.15.29:0/803220757 wait complete. 2024-04-23T10:25:19.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 Processor -- start 2024-04-23T10:25:19.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- start start 2024-04-23T10:25:19.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dd8158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8150c30 0x7f5dd815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd815a670 0x7f5dd81e5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd8159010 con 0x7f5dc4003f40 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd80c45a0 con 0x7f5dd8150c30 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd8153570 con 0x7f5dd815a670 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dd8158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dd8158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44922/0 (socket says 172.21.15.29:44922) 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 -- 172.21.15.29:0/1283091930 learned_addr learned my addr 172.21.15.29:0/1283091930 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dddc85640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8150c30 0x7f5dd815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5ddec87640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd815a670 0x7f5dd81e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 -- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd815a670 msgr2=0x7f5dd81e5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd815a670 0x7f5dd81e5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 -- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8150c30 msgr2=0x7f5dd815a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8150c30 0x7f5dd815a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 -- 172.21.15.29:0/1283091930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd815aaf0 con 0x7f5dc4003f40 2024-04-23T10:25:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5ddec87640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd815a670 0x7f5dd81e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dde486640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dd8158300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400c7a0 tx=0x7f5dd400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dcaffd640 1 -- 172.21.15.29:0/1283091930 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4018070 con 0x7f5dc4003f40 2024-04-23T10:25:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dcaffd640 1 -- 172.21.15.29:0/1283091930 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd40074e0 con 0x7f5dc4003f40 2024-04-23T10:25:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd80c2ce0 con 0x7f5dc4003f40 2024-04-23T10:25:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5dcaffd640 1 -- 172.21.15.29:0/1283091930 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4004a10 con 0x7f5dc4003f40 2024-04-23T10:25:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.840+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd815c890 con 0x7f5dc4003f40 2024-04-23T10:25:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.844+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd8068d70 con 0x7f5dc4003f40 2024-04-23T10:25:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.844+0000 7f5dcaffd640 1 -- 172.21.15.29:0/1283091930 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5dd401b070 con 0x7f5dc4003f40 2024-04-23T10:25:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.844+0000 7f5dcaffd640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5dbc068380 0x7f5dbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.844+0000 7f5dcaffd640 1 -- 172.21.15.29:0/1283091930 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5dd4086460 con 0x7f5dc4003f40 2024-04-23T10:25:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.844+0000 7f5dddc85640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5dbc068380 0x7f5dbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.844+0000 7f5dddc85640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5dbc068380 0x7f5dbc06a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0af000 tx=0x7f5dcc0a7040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:19.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:19.848+0000 7f5dcaffd640 1 -- 172.21.15.29:0/1283091930 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5dd815aaf0 con 0x7f5dc4003f40 2024-04-23T10:25:20.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dd80c68a0 con 0x7f5dc4003f40 2024-04-23T10:25:20.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5dcaffd640 1 -- 172.21.15.29:0/1283091930 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f5dd80cd5c0 con 0x7f5dc4003f40 2024-04-23T10:25:20.044 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:25:20.044 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:25:20.045 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5dbc068380 msgr2=0x7f5dbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5dbc068380 0x7f5dbc06a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0af000 tx=0x7f5dcc0a7040 comp rx=0 tx=0).stop 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 msgr2=0x7f5dd8158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dd8158300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400c7a0 tx=0x7f5dd400cc60 comp rx=0 tx=0).stop 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 shutdown_connections 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5dbc068380 0x7f5dbc06a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dd815a670 0x7f5dd81e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8150c30 0x7f5dd815a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 --2- 172.21.15.29:0/1283091930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5dc4003f40 0x7f5dd8158300 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 >> 172.21.15.29:0/1283091930 conn(0x7f5dd806cfb0 msgr2=0x7f5dd806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 shutdown_connections 2024-04-23T10:25:20.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.048+0000 7f5de06ea640 1 -- 172.21.15.29:0/1283091930 wait complete. 2024-04-23T10:25:20.063 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id 7b5b03d9 --release --await' 2024-04-23T10:25:20.063 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id 7b5b03d9 --release --await 2024-04-23T10:25:20.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f71585d9640 1 Processor -- start 2024-04-23T10:25:20.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f71585d9640 1 -- start start 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f71585d9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f715006f790 0x7f71500c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f71585d9640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7150071160 0x7f7150073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f71585d9640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7150072590 con 0x7f715006f3b0 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f71585d9640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7150072fe0 con 0x7f715006f790 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f71585d9640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7150158df0 con 0x7f7150071160 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7156375640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f715006f3b0 0x7f7150157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51320/0 (socket says 172.21.15.29:51320) 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7156375640 1 -- 172.21.15.29:0/1778467809 learned_addr learned my addr 172.21.15.29:0/1778467809 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7155b74640 1 --2- 172.21.15.29:0/1778467809 >> v2:172.21.15.29:3300/0 conn(0x7f715006f790 0x7f71500c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7156b76640 1 --2- 172.21.15.29:0/1778467809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7150071160 0x7f7150073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7155373640 1 -- 172.21.15.29:0/1778467809 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300716560 0 0) 0x7f7150072590 con 0x7f715006f3b0 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7155373640 1 -- 172.21.15.29:0/1778467809 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f713c003530 con 0x7f715006f3b0 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7155b74640 1 -- 172.21.15.29:0/1778467809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7150071160 msgr2=0x7f7150073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7155b74640 1 --2- 172.21.15.29:0/1778467809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7150071160 0x7f7150073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7155b74640 1 -- 172.21.15.29:0/1778467809 >> v1:172.21.15.29:6789/0 conn(0x7f715006f3b0 legacy=0x7f7150157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.204+0000 7f7155b74640 1 -- 172.21.15.29:0/1778467809 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7150158830 con 0x7f715006f790 2024-04-23T10:25:20.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f7155b74640 1 --2- 172.21.15.29:0/1778467809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f71500c4d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097c0 tx=0x7f714c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55220df1092f85a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:20.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f7155373640 1 -- 172.21.15.29:0/1778467809 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c0a7070 con 0x7f715006f790 2024-04-23T10:25:20.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f7155373640 1 -- 172.21.15.29:0/1778467809 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c0b0070 con 0x7f715006f790 2024-04-23T10:25:20.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f7155373640 1 -- 172.21.15.29:0/1778467809 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c0ab890 con 0x7f715006f790 2024-04-23T10:25:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 -- 172.21.15.29:0/1778467809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 msgr2=0x7f71500c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 --2- 172.21.15.29:0/1778467809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f71500c4d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097c0 tx=0x7f714c01c470 comp rx=0 tx=0).stop 2024-04-23T10:25:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 -- 172.21.15.29:0/1778467809 shutdown_connections 2024-04-23T10:25:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 --2- 172.21.15.29:0/1778467809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7150071160 0x7f7150073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 --2- 172.21.15.29:0/1778467809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f71500c4d70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 -- 172.21.15.29:0/1778467809 >> 172.21.15.29:0/1778467809 conn(0x7f715006cfb0 msgr2=0x7f715006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 -- 172.21.15.29:0/1778467809 shutdown_connections 2024-04-23T10:25:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 -- 172.21.15.29:0/1778467809 wait complete. 2024-04-23T10:25:20.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.208+0000 7f71585d9640 1 Processor -- start 2024-04-23T10:25:20.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 -- start start 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f715006f3b0 0x7f71500c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f7150155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7150071160 0x7f71501455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7150152330 con 0x7f715006f790 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7150158500 con 0x7f7150071160 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f71501524b0 con 0x7f715006f3b0 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f7150155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f7150155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44944/0 (socket says 172.21.15.29:44944) 2024-04-23T10:25:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 -- 172.21.15.29:0/594609442 learned_addr learned my addr 172.21.15.29:0/594609442 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7156b76640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7150071160 0x7f71501455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7156375640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f715006f3b0 0x7f71500c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 -- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f715006f3b0 msgr2=0x7f71500c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f715006f3b0 0x7f71500c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 -- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7150071160 msgr2=0x7f71501455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7150071160 0x7f71501455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 -- 172.21.15.29:0/594609442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7150145b20 con 0x7f715006f790 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7156b76640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7150071160 0x7f71501455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7155b74640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f7150155250 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f714c01ab20 tx=0x7f714c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7142ffd640 1 -- 172.21.15.29:0/594609442 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c0bf610 con 0x7f715006f790 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7142ffd640 1 -- 172.21.15.29:0/594609442 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c0bf7b0 con 0x7f715006f790 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 -- 172.21.15.29:0/594609442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71500c8200 con 0x7f715006f790 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7142ffd640 1 -- 172.21.15.29:0/594609442 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c0bfba0 con 0x7f715006f790 2024-04-23T10:25:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f71585d9640 1 -- 172.21.15.29:0/594609442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71500c9910 con 0x7f715006f790 2024-04-23T10:25:20.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.212+0000 7f7142ffd640 1 -- 172.21.15.29:0/594609442 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f714c0bd020 con 0x7f715006f790 2024-04-23T10:25:20.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7142ffd640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f71340683b0 0x7f713406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7142ffd640 1 -- 172.21.15.29:0/594609442 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f714c1215d0 con 0x7f715006f790 2024-04-23T10:25:20.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156375640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f71340683b0 0x7f713406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 Processor -- start 2024-04-23T10:25:20.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156375640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f71340683b0 0x7f713406a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7144007fd0 tx=0x7f7144009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:20.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- start start 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e7845e920 0x555e784a3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e782b4660 con 0x555e784a8660 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555e782595d0 con 0x555e784a37b0 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x555e782b0620 con 0x555e7845e920 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44956/0 (socket says 172.21.15.29:44956) 2024-04-23T10:25:20.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 -- 172.21.15.29:0/3020708001 learned_addr learned my addr 172.21.15.29:0/3020708001 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156375640 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e7845e920 0x555e784a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7155b74640 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 -- 172.21.15.29:0/3020708001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e7845e920 msgr2=0x555e784a3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e7845e920 0x555e784a3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 -- 172.21.15.29:0/3020708001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 msgr2=0x555e784a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 -- 172.21.15.29:0/3020708001 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e7828dbd0 con 0x555e784a8660 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7156b76640 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8a40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7148007680 tx=0x7f7148009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a81dcf49d9da7da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7133fff640 1 -- 172.21.15.29:0/3020708001 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71480147e0 con 0x555e784a8660 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7133fff640 1 -- 172.21.15.29:0/3020708001 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714801a070 con 0x555e784a8660 2024-04-23T10:25:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f7133fff640 1 -- 172.21.15.29:0/3020708001 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148014b80 con 0x555e784a8660 2024-04-23T10:25:20.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- 172.21.15.29:0/3020708001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 msgr2=0x555e784a8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8a40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7148007680 tx=0x7f7148009750 comp rx=0 tx=0).stop 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- 172.21.15.29:0/3020708001 shutdown_connections 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8a40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 --2- 172.21.15.29:0/3020708001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e7845e920 0x555e784a3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- 172.21.15.29:0/3020708001 >> 172.21.15.29:0/3020708001 conn(0x555e7834eb00 msgr2=0x555e784a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- 172.21.15.29:0/3020708001 shutdown_connections 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.216+0000 7f715b75b000 1 -- 172.21.15.29:0/3020708001 wait complete. 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 -- start start 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 Processor -- start 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 0x555e7846c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a37b0 0x555e784a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e78371d40 con 0x555e784a8660 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555e7826eeb0 con 0x555e7845e920 2024-04-23T10:25:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x555e782af2a0 con 0x555e784a37b0 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 10 client.0 _ll_register_callbacks cb 0x555e78452a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44972/0 (socket says 172.21.15.29:44972) 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 -- 172.21.15.29:0/184476975 learned_addr learned my addr 172.21.15.29:0/184476975 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7155b74640 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a37b0 0x555e784a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156375640 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 0x555e7846c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 -- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a37b0 msgr2=0x555e784a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a37b0 0x555e784a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 -- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 msgr2=0x555e7846c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 0x555e7846c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 -- 172.21.15.29:0/184476975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e782fab30 con 0x555e784a8660 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156b76640 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8f80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7148017040 tx=0x7f7148004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a00fbbb4553a52 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f71317fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f71317fa640 1 -- 172.21.15.29:0/184476975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148024070 con 0x555e784a8660 2024-04-23T10:25:20.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f71317fa640 1 -- 172.21.15.29:0/184476975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7148015670 con 0x555e784a8660 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 -- 172.21.15.29:0/184476975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e7824e060 con 0x555e784a8660 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f71317fa640 1 -- 172.21.15.29:0/184476975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7148015870 con 0x555e784a8660 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 10 client.5580 fetch_fsmap learned FSMap version 18 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 -- 172.21.15.29:0/184476975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555e78253b70 con 0x555e784a8660 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f71317fa640 1 -- 172.21.15.29:0/184476975 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555e7824e060 con 0x555e784a8660 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f71317fa640 1 -- 172.21.15.29:0/184476975 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f7148015a10 con 0x555e784a8660 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 10 client.5580 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 10 client.5580 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 20 client.5580 populate_metadata read hostname 'smithi029' 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x555e784a1f60 0x555e784a2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 4 client.5580 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f715b75b000 1 -- 172.21.15.29:0/184476975 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e7828ce30 con 0x555e784a1f60 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156375640 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x555e784a1f60 0x555e784a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f7156375640 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x555e784a1f60 0x555e784a2340 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5065ffe16fa86e4 server_cookie=d1aa003c99466e8a in_seq=0 out_seq=0 2024-04-23T10:25:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.220+0000 7f71317fa640 10 client.5580 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f71317fa640 1 -- 172.21.15.29:0/184476975 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555e7828ce30 con 0x555e784a1f60 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f71317fa640 10 client.5580 handle_command_reply: tid=0 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 client.5580 shutdown 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 -- 172.21.15.29:0/184476975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 msgr2=0x555e784a8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8f80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7148017040 tx=0x7f7148004ac0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 -- 172.21.15.29:0/184476975 shutdown_connections 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x555e784a1f60 0x555e784a2340 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a8660 0x555e784a8f80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a37b0 0x555e784a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f71317fa640 0 client.5580 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 --2- 172.21.15.29:0/184476975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 0x555e7846c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 -- 172.21.15.29:0/184476975 >> 172.21.15.29:0/184476975 conn(0x555e7834eb00 msgr2=0x555e784a5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 -- 172.21.15.29:0/184476975 shutdown_connections 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 1 -- 172.21.15.29:0/184476975 wait complete. 2024-04-23T10:25:20.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.224+0000 7f715b75b000 20 client.5580 trim_cache size 0 max 16384 2024-04-23T10:25:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f715b75b000 1 Processor -- start 2024-04-23T10:25:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f715b75b000 1 -- start start 2024-04-23T10:25:20.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f715b75b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 0x555e784bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f715b75b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a37b0 0x555e784bde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f715b75b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f715b75b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f71501fd0f0 con 0x555e784a37b0 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f715b75b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f71501fd7c0 con 0x555e7845e920 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f715b75b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7150157920 con 0x555e784a8660 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f7155b74640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a37b0 0x555e784bde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f7155b74640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a37b0 0x555e784bde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44984/0 (socket says 172.21.15.29:44984) 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.240+0000 7f7155b74640 1 -- 172.21.15.29:0/809246502 learned_addr learned my addr 172.21.15.29:0/809246502 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 0x555e784bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156b76640 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7155b74640 1 -- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 msgr2=0x555e784c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7155b74640 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7155b74640 1 -- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 msgr2=0x555e784bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7155b74640 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 0x555e784bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7155b74640 1 -- 172.21.15.29:0/809246502 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e783365e0 con 0x555e784a37b0 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156b76640 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7155b74640 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a37b0 0x555e784bde00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f714c0ed4c0 tx=0x7f714c0f1760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac23f31827ce57f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f71337fe640 1 -- 172.21.15.29:0/809246502 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c0f5410 con 0x555e784a37b0 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f71337fe640 1 -- 172.21.15.29:0/809246502 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c0b0040 con 0x555e784a37b0 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f71337fe640 1 -- 172.21.15.29:0/809246502 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c0f9c40 con 0x555e784a37b0 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- 172.21.15.29:0/809246502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a37b0 msgr2=0x555e784bde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a37b0 0x555e784bde00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f714c0ed4c0 tx=0x7f714c0f1760 comp rx=0 tx=0).stop 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- 172.21.15.29:0/809246502 shutdown_connections 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e784a37b0 0x555e784bde00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 --2- 172.21.15.29:0/809246502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e7845e920 0x555e784bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- 172.21.15.29:0/809246502 >> 172.21.15.29:0/809246502 conn(0x555e7834eb00 msgr2=0x555e7846b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- 172.21.15.29:0/809246502 shutdown_connections 2024-04-23T10:25:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- 172.21.15.29:0/809246502 wait complete. 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- start start 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 Processor -- start 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e7845e920 0x555e784c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e782b3970 con 0x555e7845e920 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555e782698f0 con 0x555e784a37b0 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x555e782b8c90 con 0x555e784a8660 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 10 client.0 _ll_register_callbacks cb 0x7f7148007550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e7845e920 0x555e784c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e7845e920 0x555e784c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44990/0 (socket says 172.21.15.29:44990) 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 -- 172.21.15.29:0/2412286161 learned_addr learned my addr 172.21.15.29:0/2412286161 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156b76640 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7155b74640 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 -- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 msgr2=0x555e784c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 -- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 msgr2=0x555e784c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 -- 172.21.15.29:0/2412286161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e78246ae0 con 0x555e7845e920 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7155b74640 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f7156375640 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e7845e920 0x555e784c45f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7144005aa0 tx=0x7f7144010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b9c045571b4f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f71317fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f71317fa640 1 -- 172.21.15.29:0/2412286161 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440075d0 con 0x555e7845e920 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f71317fa640 1 -- 172.21.15.29:0/2412286161 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f714402e450 con 0x555e7845e920 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- 172.21.15.29:0/2412286161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f714c0b0040 con 0x555e7845e920 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f71317fa640 1 -- 172.21.15.29:0/2412286161 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f714402e650 con 0x555e7845e920 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 10 client.5586 fetch_fsmap learned FSMap version 18 2024-04-23T10:25:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f715b75b000 1 -- 172.21.15.29:0/2412286161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555e78249d80 con 0x555e7845e920 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.244+0000 7f71317fa640 1 -- 172.21.15.29:0/2412286161 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c0b0040 con 0x555e7845e920 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f71317fa640 1 -- 172.21.15.29:0/2412286161 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f7144039080 con 0x555e7845e920 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f715b75b000 10 client.5586 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f715b75b000 10 client.5586 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f715b75b000 20 client.5586 populate_metadata read hostname 'smithi029' 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f715b75b000 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x555e78526b10 0x555e78528f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f715b75b000 4 client.5586 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7b5b03d9", "release": true, "await": true}] 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f715b75b000 1 -- 172.21.15.29:0/2412286161 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7b5b03d9", "release": true, "await": true}) -- 0x555e782520d0 con 0x555e78526b10 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f7155b74640 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x555e78526b10 0x555e78528f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f71317fa640 10 client.5586 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:25:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.248+0000 7f7155b74640 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x555e78526b10 0x555e78528f00 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55fc4902744ac105 server_cookie=4e8515e14cac0ed3 in_seq=0 out_seq=0 2024-04-23T10:25:20.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.548+0000 7f71317fa640 1 -- 172.21.15.29:0/2412286161 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555e782520d0 con 0x555e78526b10 2024-04-23T10:25:20.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.548+0000 7f71317fa640 10 client.5586 handle_command_reply: tid=0 2024-04-23T10:25:20.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.548+0000 7f715b75b000 1 client.5586 shutdown 2024-04-23T10:25:20.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 -- 172.21.15.29:0/2412286161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e7845e920 msgr2=0x555e784c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e7845e920 0x555e784c45f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7144005aa0 tx=0x7f7144010000 comp rx=0 tx=0).stop 2024-04-23T10:25:20.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 -- 172.21.15.29:0/2412286161 shutdown_connections 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x555e78526b10 0x555e78528f00 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x555e784a8660 0x555e784c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71317fa640 0 client.5586 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e784a37b0 0x555e784c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 --2- 172.21.15.29:0/2412286161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e7845e920 0x555e784c45f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 -- 172.21.15.29:0/2412286161 >> 172.21.15.29:0/2412286161 conn(0x555e7834eb00 msgr2=0x555e784a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 -- 172.21.15.29:0/2412286161 shutdown_connections 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 1 -- 172.21.15.29:0/2412286161 wait complete. 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f715b75b000 20 client.5586 trim_cache size 0 max 16384 2024-04-23T10:25:20.549 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 36, 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "7b5b03d9": { 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 36, 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 80.2, 2024-04-23T10:25:20.550 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:20.551 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:25:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 -- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f71340683b0 msgr2=0x7f713406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f71340683b0 0x7f713406a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7144007fd0 tx=0x7f7144009040 comp rx=0 tx=0).stop 2024-04-23T10:25:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 -- 172.21.15.29:0/594609442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 msgr2=0x7f7150155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f7150155250 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f714c01ab20 tx=0x7f714c01acb0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 -- 172.21.15.29:0/594609442 shutdown_connections 2024-04-23T10:25:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f71340683b0 0x7f713406a870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7150071160 0x7f71501455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f715006f790 0x7f7150155250 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 --2- 172.21.15.29:0/594609442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f715006f3b0 0x7f71500c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 -- 172.21.15.29:0/594609442 >> 172.21.15.29:0/594609442 conn(0x7f715006cfb0 msgr2=0x7f7150150dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 -- 172.21.15.29:0/594609442 shutdown_connections 2024-04-23T10:25:20.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:20.552+0000 7f71585d9640 1 -- 172.21.15.29:0/594609442 wait complete. 2024-04-23T10:25:20.573 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7b5b03d9', seconds elapsed: 23.2 2024-04-23T10:25:21.218 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:21.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:51.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:51.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:58.088 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.7 2024-04-23T10:25:58.089 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:25:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.231+0000 7f3fabca6640 1 Processor -- start 2024-04-23T10:25:58.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fabca6640 1 -- start start 2024-04-23T10:25:58.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fabca6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3fa40c9170 0x7f3fa40c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fabca6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fa40c9550 0x7f3fa40c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fabca6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa4155030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fabca6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa40ca7d0 con 0x7f3fa40c9550 2024-04-23T10:25:58.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fabca6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa40c7990 con 0x7f3fa40c9170 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fabca6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa415b4d0 con 0x7f3fa406e950 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fa40c9550 0x7f3fa40c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fa40c9550 0x7f3fa40c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40870/0 (socket says 172.21.15.29:40870) 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 -- 172.21.15.29:0/3309094141 learned_addr learned my addr 172.21.15.29:0/3309094141 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9a42640 1 --2- 172.21.15.29:0/3309094141 >> v2:172.21.15.72:3300/0 conn(0x7f3fa40c9170 0x7f3fa40c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3faa243640 1 --2- 172.21.15.29:0/3309094141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa4155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 -- 172.21.15.29:0/3309094141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 msgr2=0x7f3fa4155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 --2- 172.21.15.29:0/3309094141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa4155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 -- 172.21.15.29:0/3309094141 >> v2:172.21.15.72:3300/0 conn(0x7f3fa40c9170 msgr2=0x7f3fa40c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 --2- 172.21.15.29:0/3309094141 >> v2:172.21.15.72:3300/0 conn(0x7f3fa40c9170 0x7f3fa40c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 -- 172.21.15.29:0/3309094141 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa415b7b0 con 0x7f3fa40c9550 2024-04-23T10:25:58.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3faa243640 1 --2- 172.21.15.29:0/3309094141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa4155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:58.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.235+0000 7f3fa9241640 1 --2- 172.21.15.29:0/3309094141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa40c8360 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009870 tx=0x7f3f9401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b556f507ec41c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fa8a40640 1 -- 172.21.15.29:0/3309094141 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940ab5f0 con 0x7f3fa40c9550 2024-04-23T10:25:58.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fa8a40640 1 -- 172.21.15.29:0/3309094141 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f940b0070 con 0x7f3fa40c9550 2024-04-23T10:25:58.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fa8a40640 1 -- 172.21.15.29:0/3309094141 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940ab9b0 con 0x7f3fa40c9550 2024-04-23T10:25:58.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- 172.21.15.29:0/3309094141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 msgr2=0x7f3fa40c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 --2- 172.21.15.29:0/3309094141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa40c8360 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009870 tx=0x7f3f9401c520 comp rx=0 tx=0).stop 2024-04-23T10:25:58.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- 172.21.15.29:0/3309094141 shutdown_connections 2024-04-23T10:25:58.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 --2- 172.21.15.29:0/3309094141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa4155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 --2- 172.21.15.29:0/3309094141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa40c8360 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 --2- 172.21.15.29:0/3309094141 >> v2:172.21.15.72:3300/0 conn(0x7f3fa40c9170 0x7f3fa40c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- 172.21.15.29:0/3309094141 >> 172.21.15.29:0/3309094141 conn(0x7f3fa40c9a90 msgr2=0x7f3fa40c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:58.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- 172.21.15.29:0/3309094141 shutdown_connections 2024-04-23T10:25:58.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- 172.21.15.29:0/3309094141 wait complete. 2024-04-23T10:25:58.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 Processor -- start 2024-04-23T10:25:58.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- start start 2024-04-23T10:25:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa40c9170 0x7f3fa41f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa41f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa406e2e0 con 0x7f3fa40c9550 2024-04-23T10:25:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4155980 con 0x7f3fa40c9170 2024-04-23T10:25:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa406e460 con 0x7f3fa406e950 2024-04-23T10:25:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa41f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa41f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40874/0 (socket says 172.21.15.29:40874) 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 -- 172.21.15.29:0/2684186809 learned_addr learned my addr 172.21.15.29:0/2684186809 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fa9a42640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fa9241640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa40c9170 0x7f3fa41f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 -- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 msgr2=0x7f3fa415a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa415a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 -- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa40c9170 msgr2=0x7f3fa41f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa40c9170 0x7f3fa41f3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 -- 172.21.15.29:0/2684186809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa415e5f0 con 0x7f3fa40c9550 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3faa243640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa41f4140 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c007e20 tx=0x7f3f9c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3f9a7fc640 1 -- 172.21.15.29:0/2684186809 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c01a070 con 0x7f3fa40c9550 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3f9a7fc640 1 -- 172.21.15.29:0/2684186809 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c015620 con 0x7f3fa40c9550 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa414f860 con 0x7f3fa40c9550 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3f9a7fc640 1 -- 172.21.15.29:0/2684186809 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c015a10 con 0x7f3fa40c9550 2024-04-23T10:25:58.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.239+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa40cb0e0 con 0x7f3fa40c9550 2024-04-23T10:25:58.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.243+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa40693c0 con 0x7f3fa40c9550 2024-04-23T10:25:58.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.243+0000 7f3f9a7fc640 1 -- 172.21.15.29:0/2684186809 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f9c01d070 con 0x7f3fa40c9550 2024-04-23T10:25:58.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.243+0000 7f3f9a7fc640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f880683b0 0x7f3f8806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.243+0000 7f3f9a7fc640 1 -- 172.21.15.29:0/2684186809 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3f9c0870f0 con 0x7f3fa40c9550 2024-04-23T10:25:58.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.243+0000 7f3fa9a42640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f880683b0 0x7f3f8806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.243+0000 7f3fa9a42640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f880683b0 0x7f3f8806a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009af0 tx=0x7f3fa0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.247+0000 7f3f9a7fc640 1 -- 172.21.15.29:0/2684186809 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f9c010070 con 0x7f3fa40c9550 2024-04-23T10:25:58.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.455+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fa4150ef0 con 0x7f3fa40c9550 2024-04-23T10:25:58.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.455+0000 7f3f9a7fc640 1 -- 172.21.15.29:0/2684186809 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f3f9c0571f0 con 0x7f3fa40c9550 2024-04-23T10:25:58.453 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:25:58.453 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:25:58.454 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:25:58.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f880683b0 msgr2=0x7f3f8806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f880683b0 0x7f3f8806a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009af0 tx=0x7f3fa0008040 comp rx=0 tx=0).stop 2024-04-23T10:25:58.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 msgr2=0x7f3fa41f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa41f4140 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c007e20 tx=0x7f3f9c00d4a0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 shutdown_connections 2024-04-23T10:25:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f880683b0 0x7f3f8806a870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40c9550 0x7f3fa41f4140 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa40c9170 0x7f3fa41f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 --2- 172.21.15.29:0/2684186809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa406e950 0x7f3fa415a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 >> 172.21.15.29:0/2684186809 conn(0x7f3fa40c9a90 msgr2=0x7f3fa41507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 shutdown_connections 2024-04-23T10:25:58.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.459+0000 7f3fabca6640 1 -- 172.21.15.29:0/2684186809 wait complete. 2024-04-23T10:25:58.474 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 79.7 --await-for 42.0' 2024-04-23T10:25:58.474 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 79.7 --await-for 42.0 2024-04-23T10:25:58.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f1861469640 1 Processor -- start 2024-04-23T10:25:58.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f1861469640 1 -- start start 2024-04-23T10:25:58.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f1861469640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f185c0c9490 0x7f185c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f1861469640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f185c06fba0 con 0x7f185c15be90 2024-04-23T10:25:58.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f1861469640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f185c06fe80 con 0x7f185c144610 2024-04-23T10:25:58.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f1861469640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f185c070160 con 0x7f185c0c9490 2024-04-23T10:25:58.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f185a7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f185c15be90 0x7f185c074d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34136/0 (socket says 172.21.15.29:34136) 2024-04-23T10:25:58.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f185a7fc640 1 -- 172.21.15.29:0/4220509595 learned_addr learned my addr 172.21.15.29:0/4220509595 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f185b7fe640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f185c0c9490 0x7f185c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027031524 0 0) 0x7f185c06fba0 con 0x7f185c15be90 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.623+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1848003530 con 0x7f185c15be90 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3202374075 0 0) 0x7f1848003530 con 0x7f185c15be90 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f185c0c9490 msgr2=0x7f185c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f185c0c9490 0x7f185c0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 >> v1:172.21.15.72:6789/0 conn(0x7f185c144610 legacy=0x7f185c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185c070440 con 0x7f185c15be90 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f1844001680 con 0x7f185c15be90 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 >> v1:172.21.15.29:6789/0 conn(0x7f185c15be90 legacy=0x7f185c074d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18480039f0 0x7f1848003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18480043a0 0x7f1848004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f185c0c9490 0x7f18480050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f185c070160 con 0x7f18480043a0 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f184800b9d0 con 0x7f18480039f0 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f184800bbd0 con 0x7f185c0c9490 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185a7fc640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18480043a0 0x7f1848004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185affd640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18480039f0 0x7f1848003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185b7fe640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f185c0c9490 0x7f18480050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185a7fc640 1 -- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f185c0c9490 msgr2=0x7f18480050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185a7fc640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f185c0c9490 0x7f18480050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185a7fc640 1 -- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18480039f0 msgr2=0x7f1848003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185a7fc640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18480039f0 0x7f1848003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185a7fc640 1 -- 172.21.15.29:0/4220509595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1848003530 con 0x7f18480043a0 2024-04-23T10:25:58.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185a7fc640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18480043a0 0x7f1848004870 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f184400c2c0 tx=0x7f184401f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf187f716666a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844007d60 con 0x7f18480043a0 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1844005b00 con 0x7f18480043a0 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1859ffb640 1 -- 172.21.15.29:0/4220509595 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844007070 con 0x7f18480043a0 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1861469640 1 -- 172.21.15.29:0/4220509595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18480043a0 msgr2=0x7f1848004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1861469640 1 --2- 172.21.15.29:0/4220509595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18480043a0 0x7f1848004870 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f184400c2c0 tx=0x7f184401f490 comp rx=0 tx=0).stop 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f185b7fe640 1 -- 172.21.15.29:0/4220509595 reap_dead start 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1861469640 1 -- 172.21.15.29:0/4220509595 shutdown_connections 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1861469640 1 -- 172.21.15.29:0/4220509595 >> 172.21.15.29:0/4220509595 conn(0x7f185c0ca080 msgr2=0x7f185c0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1861469640 1 -- 172.21.15.29:0/4220509595 shutdown_connections 2024-04-23T10:25:58.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.627+0000 7f1861469640 1 -- 172.21.15.29:0/4220509595 wait complete. 2024-04-23T10:25:58.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 Processor -- start 2024-04-23T10:25:58.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 -- start start 2024-04-23T10:25:58.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18480043a0 0x7f185c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f185c15ef00 0x7f185c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f185c1f3e60 0x7f185c157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f185c0c8690 con 0x7f185c1f3e60 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f185c070720 con 0x7f185c15ef00 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f185c06f810 con 0x7f18480043a0 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f185c1f3e60 0x7f185c157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f185c1f3e60 0x7f185c157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40900/0 (socket says 172.21.15.29:40900) 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 -- 172.21.15.29:0/2245292198 learned_addr learned my addr 172.21.15.29:0/2245292198 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185affd640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18480043a0 0x7f185c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185a7fc640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f185c15ef00 0x7f185c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 -- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18480043a0 msgr2=0x7f185c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18480043a0 0x7f185c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 -- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f185c15ef00 msgr2=0x7f185c1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f185c15ef00 0x7f185c1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 -- 172.21.15.29:0/2245292198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185c1f0a00 con 0x7f185c1f3e60 2024-04-23T10:25:58.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f185c1f3e60 0x7f185c157930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f185c15c290 tx=0x7f1854011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f18537fe640 1 -- 172.21.15.29:0/2245292198 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854003620 con 0x7f185c1f3e60 2024-04-23T10:25:58.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f18537fe640 1 -- 172.21.15.29:0/2245292198 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185401b070 con 0x7f185c1f3e60 2024-04-23T10:25:58.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 -- 172.21.15.29:0/2245292198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185c1f0c70 con 0x7f185c1f3e60 2024-04-23T10:25:58.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f18537fe640 1 -- 172.21.15.29:0/2245292198 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854003a40 con 0x7f185c1f3e60 2024-04-23T10:25:58.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.631+0000 7f1861469640 1 -- 172.21.15.29:0/2245292198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185c1f1230 con 0x7f185c1f3e60 2024-04-23T10:25:58.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18537fe640 1 -- 172.21.15.29:0/2245292198 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1854003be0 con 0x7f185c1f3e60 2024-04-23T10:25:58.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18537fe640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f183c068380 0x7f183c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18537fe640 1 -- 172.21.15.29:0/2245292198 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f18540871a0 con 0x7f185c1f3e60 2024-04-23T10:25:58.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185affd640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f183c068380 0x7f183c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18645eb000 1 Processor -- start 2024-04-23T10:25:58.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18645eb000 1 -- start start 2024-04-23T10:25:58.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185affd640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f183c068380 0x7f183c06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f184c0019a0 tx=0x7f184c001930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18645eb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18645eb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18645eb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18645eb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556f630652a0 con 0x556f631befe0 2024-04-23T10:25:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18645eb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556f62fcb5f0 con 0x556f631b9600 2024-04-23T10:25:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f18645eb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556f62f66820 con 0x556f631be6c0 2024-04-23T10:25:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631bf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40904/0 (socket says 172.21.15.29:40904) 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 -- 172.21.15.29:0/2039767835 learned_addr learned my addr 172.21.15.29:0/2039767835 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185affd640 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185a7fc640 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 -- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 msgr2=0x556f631beaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631beaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 -- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 msgr2=0x556f631b99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 -- 172.21.15.29:0/2039767835 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f63011c00 con 0x556f631befe0 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185affd640 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631bf3c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1854085220 tx=0x7f18540567b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855ac253fdafbe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f1850ff9640 1 -- 172.21.15.29:0/2039767835 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854056bb0 con 0x556f631befe0 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f1850ff9640 1 -- 172.21.15.29:0/2039767835 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185405af60 con 0x556f631befe0 2024-04-23T10:25:58.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.635+0000 7f1850ff9640 1 -- 172.21.15.29:0/2039767835 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185405f820 con 0x556f631befe0 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- 172.21.15.29:0/2039767835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 msgr2=0x556f631bf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631bf3c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1854085220 tx=0x7f18540567b0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- 172.21.15.29:0/2039767835 shutdown_connections 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631bf3c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631beaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 --2- 172.21.15.29:0/2039767835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- 172.21.15.29:0/2039767835 >> 172.21.15.29:0/2039767835 conn(0x556f631ba470 msgr2=0x556f631bc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- 172.21.15.29:0/2039767835 shutdown_connections 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- 172.21.15.29:0/2039767835 wait complete. 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- start start 2024-04-23T10:25:58.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 Processor -- start 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556f62f76c60 con 0x556f631befe0 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556f6304dbf0 con 0x556f631b9600 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556f63088560 con 0x556f631be6c0 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 10 client.0 _ll_register_callbacks cb 0x556f62fa2570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40916/0 (socket says 172.21.15.29:40916) 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 -- 172.21.15.29:0/2898280312 learned_addr learned my addr 172.21.15.29:0/2898280312 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185affd640 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185a7fc640 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 -- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 msgr2=0x556f631b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 -- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 msgr2=0x556f631b89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 -- 172.21.15.29:0/2898280312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f63006630 con 0x556f631befe0 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185a7fc640 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185b7fe640 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631c4620 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1854001ec0 tx=0x7f1854000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3a9c3026e169e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f1839ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f1839ffb640 1 -- 172.21.15.29:0/2898280312 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854074060 con 0x556f631befe0 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f1839ffb640 1 -- 172.21.15.29:0/2898280312 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1854056000 con 0x556f631befe0 2024-04-23T10:25:58.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- 172.21.15.29:0/2898280312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f185405af60 con 0x556f631befe0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f1839ffb640 1 -- 172.21.15.29:0/2898280312 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1854056bb0 con 0x556f631befe0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 10 client.5604 fetch_fsmap learned FSMap version 18 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- 172.21.15.29:0/2898280312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556f62f6b490 con 0x556f631befe0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f1839ffb640 1 -- 172.21.15.29:0/2898280312 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185405af60 con 0x556f631befe0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f1839ffb640 1 -- 172.21.15.29:0/2898280312 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f1854052900 con 0x556f631befe0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 10 client.5604 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 10 client.5604 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 20 client.5604 populate_metadata read hostname 'smithi029' 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556f631c53c0 0x556f631c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 4 client.5604 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f18645eb000 1 -- 172.21.15.29:0/2898280312 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f62f657f0 con 0x556f631c53c0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.639+0000 7f185affd640 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556f631c53c0 0x556f631c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f185affd640 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556f631c53c0 0x556f631c57a0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf718781ef2b8324 server_cookie=f4a30184a0e90adf in_seq=0 out_seq=0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f1839ffb640 10 client.5604 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f1839ffb640 1 -- 172.21.15.29:0/2898280312 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556f62f657f0 con 0x556f631c53c0 2024-04-23T10:25:58.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f1839ffb640 10 client.5604 handle_command_reply: tid=0 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 client.5604 shutdown 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 -- 172.21.15.29:0/2898280312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 msgr2=0x556f631c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631c4620 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1854001ec0 tx=0x7f1854000bd0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 -- 172.21.15.29:0/2898280312 shutdown_connections 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556f631c53c0 0x556f631c57a0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631befe0 0x556f631c4620 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631be6c0 0x556f631b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f1839ffb640 0 client.5604 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 --2- 172.21.15.29:0/2898280312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631b89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 -- 172.21.15.29:0/2898280312 >> 172.21.15.29:0/2898280312 conn(0x556f631ba470 msgr2=0x556f631bd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 -- 172.21.15.29:0/2898280312 shutdown_connections 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 1 -- 172.21.15.29:0/2898280312 wait complete. 2024-04-23T10:25:58.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.643+0000 7f18645eb000 20 client.5604 trim_cache size 0 max 16384 2024-04-23T10:25:58.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 Processor -- start 2024-04-23T10:25:58.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- start start 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f631c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 0x556f631c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f185c1febc0 con 0x556f631be6c0 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f185c1ff290 con 0x556f631b9600 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f185c1568a0 con 0x556f631befe0 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f631c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f631c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40920/0 (socket says 172.21.15.29:40920) 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 -- 172.21.15.29:0/3063706464 learned_addr learned my addr 172.21.15.29:0/3063706464 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:58.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185affd640 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185b7fe640 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 0x556f631c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 -- 172.21.15.29:0/3063706464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 msgr2=0x556f631c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 0x556f631c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 -- 172.21.15.29:0/3063706464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 msgr2=0x556f631c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 -- 172.21.15.29:0/3063706464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f62f66a70 con 0x556f631be6c0 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f185a7fc640 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f631c57a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1844000c10 tx=0x7f1844001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c305d31e5abe505 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f183bfff640 1 -- 172.21.15.29:0/3063706464 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844001640 con 0x556f631be6c0 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f183bfff640 1 -- 172.21.15.29:0/3063706464 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18440047f0 con 0x556f631be6c0 2024-04-23T10:25:58.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f183bfff640 1 -- 172.21.15.29:0/3063706464 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844004ba0 con 0x556f631be6c0 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- 172.21.15.29:0/3063706464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 msgr2=0x556f631c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f631c57a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1844000c10 tx=0x7f1844001a50 comp rx=0 tx=0).stop 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- 172.21.15.29:0/3063706464 shutdown_connections 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 0x556f631c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f631c57a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 --2- 172.21.15.29:0/3063706464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- 172.21.15.29:0/3063706464 >> 172.21.15.29:0/3063706464 conn(0x556f631ba470 msgr2=0x556f631cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- 172.21.15.29:0/3063706464 shutdown_connections 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- 172.21.15.29:0/3063706464 wait complete. 2024-04-23T10:25:58.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 -- start start 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.663+0000 7f18645eb000 1 Processor -- start 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f6322dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 0x556f6322e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556f62fca900 con 0x556f631be6c0 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556f62f95e60 con 0x556f631b9600 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556f62fcfc20 con 0x556f631befe0 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 10 client.0 _ll_register_callbacks cb 0x7f1854056980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f6322dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f6322dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40922/0 (socket says 172.21.15.29:40922) 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 -- 172.21.15.29:0/3333944135 learned_addr learned my addr 172.21.15.29:0/3333944135 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185affd640 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185b7fe640 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 0x556f6322e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 -- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 msgr2=0x556f6322e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 0x556f6322e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 -- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 msgr2=0x556f631c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 -- 172.21.15.29:0/3333944135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f6304e080 con 0x556f631be6c0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185a7fc640 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f6322dc00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1844009040 tx=0x7f184401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f080e7427b9da98e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f1839ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f1839ffb640 1 -- 172.21.15.29:0/3333944135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18440049a0 con 0x556f631be6c0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 -- 172.21.15.29:0/3333944135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18440047f0 con 0x556f631be6c0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f1839ffb640 1 -- 172.21.15.29:0/3333944135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1844004b40 con 0x556f631be6c0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f1839ffb640 1 -- 172.21.15.29:0/3333944135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f18440cf050 con 0x556f631be6c0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 10 client.5610 fetch_fsmap learned FSMap version 18 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 -- 172.21.15.29:0/3333944135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556f62f713e0 con 0x556f631be6c0 2024-04-23T10:25:58.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f1839ffb640 1 -- 172.21.15.29:0/3333944135 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18440047f0 con 0x556f631be6c0 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f1839ffb640 1 -- 172.21.15.29:0/3333944135 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f18440d2020 con 0x556f631be6c0 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 10 client.5610 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 10 client.5610 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 20 client.5610 populate_metadata read hostname 'smithi029' 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556f6322c9e0 0x556f6322cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 4 client.5610 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.7, "await_for": 42.0}] 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f18645eb000 1 -- 172.21.15.29:0/3333944135 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.7, "await_for": 42.0}) -- 0x556f62f74940 con 0x556f6322c9e0 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185affd640 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556f6322c9e0 0x556f6322cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f185affd640 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556f6322c9e0 0x556f6322cdf0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2c47f841a105e0 server_cookie=35b452874c5bec0e in_seq=0 out_seq=0 2024-04-23T10:25:58.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:58.667+0000 7f1839ffb640 10 client.5610 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1839ffb640 1 -- 172.21.15.29:0/3333944135 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556f62f74940 con 0x556f6322c9e0 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1839ffb640 10 client.5610 handle_command_reply: tid=0 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 client.5610 shutdown 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 -- 172.21.15.29:0/3333944135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 msgr2=0x556f6322dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f6322dc00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1844009040 tx=0x7f184401c230 comp rx=0 tx=0).stop 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 -- 172.21.15.29:0/3333944135 shutdown_connections 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x556f6322c9e0 0x556f6322cdf0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556f631befe0 0x556f6322e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f631be6c0 0x556f6322dc00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1839ffb640 0 client.5610 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 --2- 172.21.15.29:0/3333944135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556f631b9600 0x556f631c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 -- 172.21.15.29:0/3333944135 >> 172.21.15.29:0/3333944135 conn(0x556f631ba470 msgr2=0x556f631c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 -- 172.21.15.29:0/3333944135 shutdown_connections 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 1 -- 172.21.15.29:0/3333944135 wait complete. 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f18645eb000 20 client.5610 trim_cache size 0 max 16384 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:25:59.586 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 38, 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "ee35ad8d": { 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 38, 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 79.7, 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:25:59.587 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:25:59.588 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:25:59.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:59.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:59.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:59.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:59.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:25:59.588 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 -- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f183c068380 msgr2=0x7f183c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f183c068380 0x7f183c06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f184c0019a0 tx=0x7f184c001930 comp rx=0 tx=0).stop 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 -- 172.21.15.29:0/2245292198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f185c1f3e60 msgr2=0x7f185c157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f185c1f3e60 0x7f185c157930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f185c15c290 tx=0x7f1854011920 comp rx=0 tx=0).stop 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 -- 172.21.15.29:0/2245292198 shutdown_connections 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f183c068380 0x7f183c06a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f185c1f3e60 0x7f185c157930 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f185c15ef00 0x7f185c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 --2- 172.21.15.29:0/2245292198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18480043a0 0x7f185c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 -- 172.21.15.29:0/2245292198 >> 172.21.15.29:0/2245292198 conn(0x7f185c0ca080 msgr2=0x7f185c141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 -- 172.21.15.29:0/2245292198 shutdown_connections 2024-04-23T10:25:59.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:25:59.587+0000 7f1861469640 1 -- 172.21.15.29:0/2245292198 wait complete. 2024-04-23T10:25:59.626 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ee35ad8d', quiesce took 1.5 seconds. Will release after: 19.7 2024-04-23T10:26:19.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:26:19.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27bcca0640 1 Processor -- start 2024-04-23T10:26:19.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27bcca0640 1 -- start start 2024-04-23T10:26:19.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27bcca0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b8159840 0x7f27b8072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27bcca0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27b80c70c0 0x7f27b8162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27bcca0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b8071400 con 0x7f27b81630b0 2024-04-23T10:26:19.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27bcca0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f27b8160030 con 0x7f27b80c70c0 2024-04-23T10:26:19.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27bcca0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f27b81604c0 con 0x7f27b8159840 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b659c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b8159840 0x7f27b8072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b5d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27b80c70c0 0x7f27b8162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b659c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b8159840 0x7f27b8072550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:35554/0 (socket says 172.21.15.29:35554) 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b6d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f27b81630b0 0x7f27b806f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:32810/0 (socket says 172.21.15.29:32810) 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b5d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27b80c70c0 0x7f27b8162b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:37440/0 (socket says 172.21.15.29:37440) 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b659c640 1 -- 172.21.15.29:0/1308566186 learned_addr learned my addr 172.21.15.29:0/1308566186 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b659c640 1 -- 172.21.15.29:0/1308566186 >> v2:172.21.15.72:3300/0 conn(0x7f27b80c70c0 msgr2=0x7f27b8162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b659c640 1 --2- 172.21.15.29:0/1308566186 >> v2:172.21.15.72:3300/0 conn(0x7f27b80c70c0 0x7f27b8162b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b659c640 1 -- 172.21.15.29:0/1308566186 >> v1:172.21.15.72:6789/0 conn(0x7f27b81630b0 legacy=0x7f27b806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b659c640 1 -- 172.21.15.29:0/1308566186 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b80c7890 con 0x7f27b8159840 2024-04-23T10:26:19.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.467+0000 7f27b5d9b640 1 --2- 172.21.15.29:0/1308566186 >> v2:172.21.15.72:3300/0 conn(0x7f27b80c70c0 0x7f27b8162b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:26:19.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27b659c640 1 --2- 172.21.15.29:0/1308566186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b8159840 0x7f27b8072550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009e50 tx=0x7f27b001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=995d5e7a9c58a96a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27b559a640 1 -- 172.21.15.29:0/1308566186 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b00a5830 con 0x7f27b8159840 2024-04-23T10:26:19.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27b559a640 1 -- 172.21.15.29:0/1308566186 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b00a59d0 con 0x7f27b8159840 2024-04-23T10:26:19.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27b559a640 1 -- 172.21.15.29:0/1308566186 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b00a5da0 con 0x7f27b8159840 2024-04-23T10:26:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27bcca0640 1 -- 172.21.15.29:0/1308566186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b8159840 msgr2=0x7f27b8072550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27bcca0640 1 --2- 172.21.15.29:0/1308566186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b8159840 0x7f27b8072550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009e50 tx=0x7f27b001c970 comp rx=0 tx=0).stop 2024-04-23T10:26:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27bcca0640 1 -- 172.21.15.29:0/1308566186 shutdown_connections 2024-04-23T10:26:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27bcca0640 1 --2- 172.21.15.29:0/1308566186 >> v2:172.21.15.72:3300/0 conn(0x7f27b80c70c0 0x7f27b8162b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27bcca0640 1 --2- 172.21.15.29:0/1308566186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b8159840 0x7f27b8072550 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27bcca0640 1 -- 172.21.15.29:0/1308566186 >> 172.21.15.29:0/1308566186 conn(0x7f27b806cfb0 msgr2=0x7f27b806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27bcca0640 1 -- 172.21.15.29:0/1308566186 shutdown_connections 2024-04-23T10:26:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.471+0000 7f27bcca0640 1 -- 172.21.15.29:0/1308566186 wait complete. 2024-04-23T10:26:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 Processor -- start 2024-04-23T10:26:19.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 -- start start 2024-04-23T10:26:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b80c70c0 0x7f27b8159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b8159840 0x7f27b8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b81630b0 0x7f27b815d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8159c20 con 0x7f27b81630b0 2024-04-23T10:26:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f27b815fcc0 con 0x7f27b8159840 2024-04-23T10:26:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f27b806f860 con 0x7f27b80c70c0 2024-04-23T10:26:19.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b81630b0 0x7f27b815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b81630b0 0x7f27b815d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44914/0 (socket says 172.21.15.29:44914) 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 -- 172.21.15.29:0/16280661 learned_addr learned my addr 172.21.15.29:0/16280661 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b5d9b640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b8159840 0x7f27b8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b659c640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b80c70c0 0x7f27b8159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 -- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b80c70c0 msgr2=0x7f27b8159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b80c70c0 0x7f27b8159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 -- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b8159840 msgr2=0x7f27b8158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b8159840 0x7f27b8158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 -- 172.21.15.29:0/16280661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b8161a40 con 0x7f27b81630b0 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27b6d9d640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b81630b0 0x7f27b815d410 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f27a800c3f0 tx=0x7f27a800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27aeffd640 1 -- 172.21.15.29:0/16280661 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80074e0 con 0x7f27b81630b0 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27aeffd640 1 -- 172.21.15.29:0/16280661 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a8007680 con 0x7f27b81630b0 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27aeffd640 1 -- 172.21.15.29:0/16280661 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8004a10 con 0x7f27b81630b0 2024-04-23T10:26:19.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b8161ce0 con 0x7f27b81630b0 2024-04-23T10:26:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b81622a0 con 0x7f27b81630b0 2024-04-23T10:26:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b8068d70 con 0x7f27b81630b0 2024-04-23T10:26:19.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.475+0000 7f27aeffd640 1 -- 172.21.15.29:0/16280661 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27a801a020 con 0x7f27b81630b0 2024-04-23T10:26:19.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.479+0000 7f27aeffd640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f27980683b0 0x7f279806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.479+0000 7f27aeffd640 1 -- 172.21.15.29:0/16280661 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f27a8086530 con 0x7f27b81630b0 2024-04-23T10:26:19.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.479+0000 7f27b659c640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f27980683b0 0x7f279806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.479+0000 7f27b659c640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f27980683b0 0x7f279806a870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f27b00ae000 tx=0x7f27b00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.483+0000 7f27aeffd640 1 -- 172.21.15.29:0/16280661 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f27a80566d0 con 0x7f27b81630b0 2024-04-23T10:26:19.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.679+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27b80c7a60 con 0x7f27b81630b0 2024-04-23T10:26:19.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.679+0000 7f27aeffd640 1 -- 172.21.15.29:0/16280661 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f27a8055fd0 con 0x7f27b81630b0 2024-04-23T10:26:19.678 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:26:19.678 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:26:19.679 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f27980683b0 msgr2=0x7f279806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f27980683b0 0x7f279806a870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f27b00ae000 tx=0x7f27b00a7070 comp rx=0 tx=0).stop 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b81630b0 msgr2=0x7f27b815d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b81630b0 0x7f27b815d410 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f27a800c3f0 tx=0x7f27a800c8b0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 shutdown_connections 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f27980683b0 0x7f279806a870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27b81630b0 0x7f27b815d410 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b8159840 0x7f27b8158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 --2- 172.21.15.29:0/16280661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b80c70c0 0x7f27b8159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 >> 172.21.15.29:0/16280661 conn(0x7f27b806cfb0 msgr2=0x7f27b81546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 shutdown_connections 2024-04-23T10:26:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.683+0000 7f27bcca0640 1 -- 172.21.15.29:0/16280661 wait complete. 2024-04-23T10:26:19.695 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id ee35ad8d --release --await' 2024-04-23T10:26:19.695 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id ee35ad8d --release --await 2024-04-23T10:26:19.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.819+0000 7f7e68bac640 1 Processor -- start 2024-04-23T10:26:19.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.819+0000 7f7e68bac640 1 -- start start 2024-04-23T10:26:19.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e68bac640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e640cbf50 0x7f7e6406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e68bac640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e6406c560 0x7f7e640c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e68bac640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e6415f7c0 con 0x7f7e6406bc40 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e68bac640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7e640c9820 con 0x7f7e640cbf50 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e68bac640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6415c0f0 con 0x7f7e6406c560 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e6259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7e6406bc40 0x7f7e640c84f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57552/0 (socket says 172.21.15.29:57552) 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e6259c640 1 -- 172.21.15.29:0/3138948787 learned_addr learned my addr 172.21.15.29:0/3138948787 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/3138948787 >> v2:172.21.15.72:3300/0 conn(0x7f7e640cbf50 0x7f7e6406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018094056 0 0) 0x7f7e6415f7c0 con 0x7f7e6406bc40 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e50003530 con 0x7f7e6406bc40 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e6406c560 0x7f7e640c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3115264667 0 0) 0x7f7e50003530 con 0x7f7e6406bc40 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e6406c560 msgr2=0x7f7e640c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e6406c560 0x7f7e640c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 >> v2:172.21.15.72:3300/0 conn(0x7f7e640cbf50 msgr2=0x7f7e6406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 --2- 172.21.15.29:0/3138948787 >> v2:172.21.15.72:3300/0 conn(0x7f7e640cbf50 0x7f7e6406c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6415b7c0 con 0x7f7e6406bc40 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f7e54001680 con 0x7f7e6406bc40 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 >> v1:172.21.15.29:6789/0 conn(0x7f7e6406bc40 legacy=0x7f7e640c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e6406c560 0x7f7e500039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e50003f40 0x7f7e50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50004d50 0x7f7e500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6415c0f0 con 0x7f7e50003f40 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5000b9d0 con 0x7f7e50004d50 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5000bb80 con 0x7f7e6406c560 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e50003f40 0x7f7e50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50004d50 0x7f7e500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e6259c640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e6406c560 0x7f7e500039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e59d9b640 1 -- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e6406c560 msgr2=0x7f7e500039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e6406c560 0x7f7e500039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e59d9b640 1 -- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50004d50 msgr2=0x7f7e500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50004d50 0x7f7e500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.823+0000 7f7e59d9b640 1 -- 172.21.15.29:0/3138948787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e50003530 con 0x7f7e50003f40 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e50003f40 0x7f7e50004810 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009ae0 tx=0x7f7e4c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61a9d12e2153a8a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0b2070 con 0x7f7e50003f40 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4c0a56a0 con 0x7f7e50003f40 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e61d9b640 1 -- 172.21.15.29:0/3138948787 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0096b0 con 0x7f7e50003f40 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- 172.21.15.29:0/3138948787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e50003f40 msgr2=0x7f7e50004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 --2- 172.21.15.29:0/3138948787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e50003f40 0x7f7e50004810 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009ae0 tx=0x7f7e4c01cab0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e62d9d640 1 -- 172.21.15.29:0/3138948787 reap_dead start 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- 172.21.15.29:0/3138948787 shutdown_connections 2024-04-23T10:26:19.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- 172.21.15.29:0/3138948787 >> 172.21.15.29:0/3138948787 conn(0x7f7e64074d60 msgr2=0x7f7e64075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- 172.21.15.29:0/3138948787 shutdown_connections 2024-04-23T10:26:19.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- 172.21.15.29:0/3138948787 wait complete. 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 Processor -- start 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- start start 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50003f40 0x7f7e64155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e641f4a20 0x7f7e640c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e64158340 0x7f7e641511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6415b470 con 0x7f7e64158340 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6415bd80 con 0x7f7e50003f40 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e68bac640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6415f3f0 con 0x7f7e641f4a20 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e64158340 0x7f7e641511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e64158340 0x7f7e641511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44920/0 (socket says 172.21.15.29:44920) 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e62d9d640 1 -- 172.21.15.29:0/4292369932 learned_addr learned my addr 172.21.15.29:0/4292369932 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e641f4a20 0x7f7e640c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e6259c640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50003f40 0x7f7e64155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.827+0000 7f7e62d9d640 1 -- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e641f4a20 msgr2=0x7f7e640c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e641f4a20 0x7f7e640c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e62d9d640 1 -- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50003f40 msgr2=0x7f7e64155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50003f40 0x7f7e64155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e62d9d640 1 -- 172.21.15.29:0/4292369932 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6415a280 con 0x7f7e64158340 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e641f4a20 0x7f7e640c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e64158340 0x7f7e641511b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7e6415faa0 tx=0x7f7e5c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e5b7fe640 1 -- 172.21.15.29:0/4292369932 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c011e40 con 0x7f7e64158340 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e5b7fe640 1 -- 172.21.15.29:0/4292369932 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c01b070 con 0x7f7e64158340 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e5b7fe640 1 -- 172.21.15.29:0/4292369932 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0039a0 con 0x7f7e64158340 2024-04-23T10:26:19.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e68bac640 1 -- 172.21.15.29:0/4292369932 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e641f0a80 con 0x7f7e64158340 2024-04-23T10:26:19.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e68bac640 1 -- 172.21.15.29:0/4292369932 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e641566a0 con 0x7f7e64158340 2024-04-23T10:26:19.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e5b7fe640 1 -- 172.21.15.29:0/4292369932 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e5c003b40 con 0x7f7e64158340 2024-04-23T10:26:19.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e5b7fe640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e44068380 0x7f7e4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e5b7fe640 1 -- 172.21.15.29:0/4292369932 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7e5c087590 con 0x7f7e64158340 2024-04-23T10:26:19.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e6259c640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e44068380 0x7f7e4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e6bd2e000 1 Processor -- start 2024-04-23T10:26:19.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e6bd2e000 1 -- start start 2024-04-23T10:26:19.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.831+0000 7f7e6259c640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e44068380 0x7f7e4406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000c10 tx=0x7f7e54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d55950d8a0 0x55d5594d69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d559512120 0x55d559512500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d55931e660 con 0x55d5594d6f00 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d5592c35d0 con 0x55d55950d8a0 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55d55931a620 con 0x55d559512120 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44926/0 (socket says 172.21.15.29:44926) 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 -- 172.21.15.29:0/2378143226 learned_addr learned my addr 172.21.15.29:0/2378143226 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d559512120 0x55d559512500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6259c640 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d55950d8a0 0x55d5594d69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 -- 172.21.15.29:0/2378143226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d559512120 msgr2=0x55d559512500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d559512120 0x55d559512500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 -- 172.21.15.29:0/2378143226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d55950d8a0 msgr2=0x55d5594d69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d55950d8a0 0x55d5594d69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 -- 172.21.15.29:0/2378143226 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5592f7bd0 con 0x55d5594d6f00 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d72e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c01caf0 tx=0x7f7e4c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7e2b90b8c52e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e43fff640 1 -- 172.21.15.29:0/2378143226 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0b2040 con 0x55d5594d6f00 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e43fff640 1 -- 172.21.15.29:0/2378143226 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4c004020 con 0x55d5594d6f00 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e43fff640 1 -- 172.21.15.29:0/2378143226 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0043f0 con 0x55d5594d6f00 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2378143226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 msgr2=0x55d5594d72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d72e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c01caf0 tx=0x7f7e4c004740 comp rx=0 tx=0).stop 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2378143226 shutdown_connections 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d559512120 0x55d559512500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d72e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2378143226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d55950d8a0 0x55d5594d69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2378143226 >> 172.21.15.29:0/2378143226 conn(0x55d5593b8b00 msgr2=0x55d55950fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2378143226 shutdown_connections 2024-04-23T10:26:19.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2378143226 wait complete. 2024-04-23T10:26:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- start start 2024-04-23T10:26:19.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 Processor -- start 2024-04-23T10:26:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d5594d6f00 0x55d55950c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d55950d8a0 0x55d55950cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d5593dbd40 con 0x55d55950d8a0 2024-04-23T10:26:19.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d5592d8eb0 con 0x55d559512120 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55d5593192a0 con 0x55d5594d6f00 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6bd2e000 10 client.0 _ll_register_callbacks cb 0x55d5594bca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d55950d8a0 0x55d55950cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d55950d8a0 0x55d55950cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44932/0 (socket says 172.21.15.29:44932) 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 -- 172.21.15.29:0/4191055933 learned_addr learned my addr 172.21.15.29:0/4191055933 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e6259c640 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d5594d6f00 0x55d55950c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 -- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d5594d6f00 msgr2=0x55d55950c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d5594d6f00 0x55d55950c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 -- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 msgr2=0x55d5594d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e59d9b640 1 -- 172.21.15.29:0/4191055933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d559364b30 con 0x55d55950d8a0 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.835+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:19.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d55950d8a0 0x55d55950cb90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c01cf90 tx=0x7f7e4c019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a518e4df79c9c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 1 -- 172.21.15.29:0/4191055933 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0c6060 con 0x55d55950d8a0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 1 -- 172.21.15.29:0/4191055933 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7e4c0a56a0 con 0x55d55950d8a0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/4191055933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d5592b8060 con 0x55d55950d8a0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 1 -- 172.21.15.29:0/4191055933 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7e4c0cc050 con 0x55d55950d8a0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 10 client.5625 fetch_fsmap learned FSMap version 18 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/4191055933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d5592bdb70 con 0x55d55950d8a0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 1 -- 172.21.15.29:0/4191055933 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d5592b8060 con 0x55d55950d8a0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 1 -- 172.21.15.29:0/4191055933 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f7e4c0cf020 con 0x55d55950d8a0 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 10 client.5625 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 10 client.5625 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 20 client.5625 populate_metadata read hostname 'smithi029' 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55d5594d2620 0x55d5594d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 4 client.5625 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:19.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/4191055933 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5592f6e30 con 0x55d5594d2620 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6259c640 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55d5594d2620 0x55d5594d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 10 client.5625 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6259c640 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55d5594d2620 0x55d5594d2a30 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8a095cd0b15fed4 server_cookie=974ea4aafb01812d in_seq=0 out_seq=0 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 1 -- 172.21.15.29:0/4191055933 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d5592f6e30 con 0x55d5594d2620 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 10 client.5625 handle_command_reply: tid=0 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 client.5625 shutdown 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/4191055933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d55950d8a0 msgr2=0x55d55950cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d55950d8a0 0x55d55950cb90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c01cf90 tx=0x7f7e4c019850 comp rx=0 tx=0).stop 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/4191055933 shutdown_connections 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55d5594d2620 0x55d5594d2a30 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d55950d8a0 0x55d55950cb90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/4191055933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d5594d6f00 0x55d55950c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e417fa640 0 client.5625 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:26:19.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/4191055933 >> 172.21.15.29:0/4191055933 conn(0x55d5593b8b00 msgr2=0x55d5595119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/4191055933 shutdown_connections 2024-04-23T10:26:19.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/4191055933 wait complete. 2024-04-23T10:26:19.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.839+0000 7f7e6bd2e000 20 client.5625 trim_cache size 0 max 16384 2024-04-23T10:26:19.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 Processor -- start 2024-04-23T10:26:19.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- start start 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 0x55d5594d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7e641fec70 con 0x55d5594d6f00 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e641ff340 con 0x55d559512120 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7e640ce480 con 0x55d55950d8a0 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44948/0 (socket says 172.21.15.29:44948) 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 -- 172.21.15.29:0/3322217364 learned_addr learned my addr 172.21.15.29:0/3322217364 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 -- 172.21.15.29:0/3322217364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 msgr2=0x55d5594d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 --2- 172.21.15.29:0/3322217364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 0x55d5594d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/3322217364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 -- 172.21.15.29:0/3322217364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 msgr2=0x55d5594d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 --2- 172.21.15.29:0/3322217364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 -- 172.21.15.29:0/3322217364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5593a05e0 con 0x55d5594d6f00 2024-04-23T10:26:19.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6259c640 1 --2- 172.21.15.29:0/3322217364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d5c60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7e540109f0 tx=0x7f7e5400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845c0922db499ec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e437fe640 1 -- 172.21.15.29:0/3322217364 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5402e070 con 0x55d5594d6f00 2024-04-23T10:26:19.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e437fe640 1 -- 172.21.15.29:0/3322217364 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e540281f0 con 0x55d5594d6f00 2024-04-23T10:26:19.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e437fe640 1 -- 172.21.15.29:0/3322217364 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5401a040 con 0x55d5594d6f00 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/3322217364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 msgr2=0x55d5594d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/3322217364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d5c60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7e540109f0 tx=0x7f7e5400e000 comp rx=0 tx=0).stop 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/3322217364 shutdown_connections 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/3322217364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d559512120 0x55d5594d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/3322217364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 0x55d5594d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/3322217364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d5594d6f00 0x55d5594d5c60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/3322217364 >> 172.21.15.29:0/3322217364 conn(0x55d5593b8b00 msgr2=0x55d5594d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/3322217364 shutdown_connections 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/3322217364 wait complete. 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- start start 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 Processor -- start 2024-04-23T10:26:19.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d5594d6f00 0x55d55957f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 0x55d55957fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d559512120 0x55d55952ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d55931d970 con 0x55d559512120 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d5592d38f0 con 0x55d5594d6f00 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55d559322c90 con 0x55d55950d8a0 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.859+0000 7f7e6bd2e000 10 client.0 _ll_register_callbacks cb 0x7f7e50003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d559512120 0x55d55952ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d559512120 0x55d55952ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44958/0 (socket says 172.21.15.29:44958) 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 -- 172.21.15.29:0/2563069089 learned_addr learned my addr 172.21.15.29:0/2563069089 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e59d9b640 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 0x55d55957fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6259c640 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d5594d6f00 0x55d55957f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 -- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 msgr2=0x55d55957fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 0x55d55957fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 -- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d5594d6f00 msgr2=0x55d55957f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d5594d6f00 0x55d55957f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 -- 172.21.15.29:0/2563069089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5592b0ae0 con 0x55d559512120 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6259c640 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d5594d6f00 0x55d55957f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e62d9d640 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d559512120 0x55d55952ae30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c05f640 tx=0x7f7e5c003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfb7129019a8575 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e417fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e417fa640 1 -- 172.21.15.29:0/2563069089 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c05f8e0 con 0x55d559512120 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e417fa640 1 -- 172.21.15.29:0/2563069089 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7e5c0870b0 con 0x55d559512120 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2563069089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e540281f0 con 0x55d559512120 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e417fa640 1 -- 172.21.15.29:0/2563069089 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7e5c085300 con 0x55d559512120 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 10 client.5631 fetch_fsmap learned FSMap version 18 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2563069089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d5592b3d80 con 0x55d559512120 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e417fa640 1 -- 172.21.15.29:0/2563069089 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e540281f0 con 0x55d559512120 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e417fa640 1 -- 172.21.15.29:0/2563069089 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f7e5c074070 con 0x55d559512120 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 10 client.5631 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:26:19.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 10 client.5631 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:26:19.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 20 client.5631 populate_metadata read hostname 'smithi029' 2024-04-23T10:26:19.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55d55952b7f0 0x55d55952bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 4 client.5631 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ee35ad8d", "release": true, "await": true}] 2024-04-23T10:26:19.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2563069089 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ee35ad8d", "release": true, "await": true}) -- 0x55d5592bc0d0 con 0x55d55952b7f0 2024-04-23T10:26:19.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6259c640 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55d55952b7f0 0x55d55952bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e6259c640 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55d55952b7f0 0x55d55952bbd0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36563e62d6db6ca7 server_cookie=f36070283348f0fd in_seq=0 out_seq=0 2024-04-23T10:26:19.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:19.863+0000 7f7e417fa640 10 client.5631 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e417fa640 1 -- 172.21.15.29:0/2563069089 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d5592bc0d0 con 0x55d55952b7f0 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e417fa640 10 client.5631 handle_command_reply: tid=0 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 client.5631 shutdown 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2563069089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d559512120 msgr2=0x55d55952ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d559512120 0x55d55952ae30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c05f640 tx=0x7f7e5c003f70 comp rx=0 tx=0).stop 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2563069089 shutdown_connections 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55d55952b7f0 0x55d55952bbd0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d559512120 0x55d55952ae30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d55950d8a0 0x55d55957fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 --2- 172.21.15.29:0/2563069089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d5594d6f00 0x55d55957f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e417fa640 0 client.5631 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2563069089 >> 172.21.15.29:0/2563069089 conn(0x55d5593b8b00 msgr2=0x55d5594d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2563069089 shutdown_connections 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 1 -- 172.21.15.29:0/2563069089 wait complete. 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e6bd2e000 20 client.5631 trim_cache size 0 max 16384 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 40, 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stdout: "ee35ad8d": { 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 40, 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 79.7, 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:26:20.065 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:26:20.065 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:26:20.065 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:26:20.065 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:26:20.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 -- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e44068380 msgr2=0x7f7e4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e44068380 0x7f7e4406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000c10 tx=0x7f7e54009040 comp rx=0 tx=0).stop 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 -- 172.21.15.29:0/4292369932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e64158340 msgr2=0x7f7e641511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e64158340 0x7f7e641511b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7e6415faa0 tx=0x7f7e5c0115a0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 -- 172.21.15.29:0/4292369932 shutdown_connections 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7e44068380 0x7f7e4406a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e64158340 0x7f7e641511b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e641f4a20 0x7f7e640c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.063+0000 7f7e68bac640 1 --2- 172.21.15.29:0/4292369932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e50003f40 0x7f7e64155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.067+0000 7f7e68bac640 1 -- 172.21.15.29:0/4292369932 >> 172.21.15.29:0/4292369932 conn(0x7f7e64074d60 msgr2=0x7f7e6415a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.067+0000 7f7e68bac640 1 -- 172.21.15.29:0/4292369932 shutdown_connections 2024-04-23T10:26:20.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:20.067+0000 7f7e68bac640 1 -- 172.21.15.29:0/4292369932 wait complete. 2024-04-23T10:26:20.088 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ee35ad8d', seconds elapsed: 22.0 2024-04-23T10:26:21.341 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:26:21.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:26:51.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:26:51.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:26:56.675 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T10:26:56.675 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-23T10:26:56.675 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:26:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458cb67640 1 Processor -- start 2024-04-23T10:26:56.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458cb67640 1 -- start start 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458cb67640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4588151bb0 0x7f458815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458cb67640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45880c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458cb67640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45880c6180 con 0x7f45880c5900 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458cb67640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f458806c910 con 0x7f4588151bb0 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458cb67640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f458806cbf0 con 0x7f45880c5d50 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f4586d9d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45880c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458659c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4588151bb0 0x7f458815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f4585d9b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f45880c5900 0x7f45880cb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:60066/0 (socket says 172.21.15.29:60066) 2024-04-23T10:26:56.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f4585d9b640 1 -- 172.21.15.29:0/3754868943 learned_addr learned my addr 172.21.15.29:0/3754868943 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:26:56.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f4586d9d640 1 -- 172.21.15.29:0/3754868943 >> v2:172.21.15.72:3300/0 conn(0x7f4588151bb0 msgr2=0x7f458815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:56.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f4586d9d640 1 --2- 172.21.15.29:0/3754868943 >> v2:172.21.15.72:3300/0 conn(0x7f4588151bb0 0x7f458815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f4586d9d640 1 -- 172.21.15.29:0/3754868943 >> v1:172.21.15.72:6789/0 conn(0x7f45880c5900 legacy=0x7f45880cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f4586d9d640 1 -- 172.21.15.29:0/3754868943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458806ced0 con 0x7f45880c5d50 2024-04-23T10:26:56.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.815+0000 7f458659c640 1 --2- 172.21.15.29:0/3754868943 >> v2:172.21.15.72:3300/0 conn(0x7f4588151bb0 0x7f458815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:26:56.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f4586d9d640 1 --2- 172.21.15.29:0/3754868943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45880c6840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4580009d90 tx=0x7f458001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32918e9c1a0dc443 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458559a640 1 -- 172.21.15.29:0/3754868943 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45800b4070 con 0x7f45880c5d50 2024-04-23T10:26:56.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458559a640 1 -- 172.21.15.29:0/3754868943 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45800af600 con 0x7f45880c5d50 2024-04-23T10:26:56.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458559a640 1 -- 172.21.15.29:0/3754868943 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45800af9d0 con 0x7f45880c5d50 2024-04-23T10:26:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458cb67640 1 -- 172.21.15.29:0/3754868943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 msgr2=0x7f45880c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458cb67640 1 --2- 172.21.15.29:0/3754868943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45880c6840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4580009d90 tx=0x7f458001f150 comp rx=0 tx=0).stop 2024-04-23T10:26:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458cb67640 1 -- 172.21.15.29:0/3754868943 shutdown_connections 2024-04-23T10:26:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458cb67640 1 --2- 172.21.15.29:0/3754868943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45880c6840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458cb67640 1 --2- 172.21.15.29:0/3754868943 >> v2:172.21.15.72:3300/0 conn(0x7f4588151bb0 0x7f458815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458cb67640 1 -- 172.21.15.29:0/3754868943 >> 172.21.15.29:0/3754868943 conn(0x7f45880730f0 msgr2=0x7f4588073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458cb67640 1 -- 172.21.15.29:0/3754868943 shutdown_connections 2024-04-23T10:26:56.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.819+0000 7f458cb67640 1 -- 172.21.15.29:0/3754868943 wait complete. 2024-04-23T10:26:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 Processor -- start 2024-04-23T10:26:56.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 -- start start 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45880c5900 0x7f45881f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45881f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4588151bb0 0x7f45881505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4588151f90 con 0x7f4588151bb0 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f458806d490 con 0x7f45880c5900 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f45880cbe80 con 0x7f45880c5d50 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4588151bb0 0x7f45881505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4588151bb0 0x7f45881505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49102/0 (socket says 172.21.15.29:49102) 2024-04-23T10:26:56.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 -- 172.21.15.29:0/707659801 learned_addr learned my addr 172.21.15.29:0/707659801 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458659c640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45880c5900 0x7f45881f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4585d9b640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45881f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 -- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 msgr2=0x7f45881f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45881f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 -- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45880c5900 msgr2=0x7f45881f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45880c5900 0x7f45881f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 -- 172.21.15.29:0/707659801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45881f1bd0 con 0x7f4588151bb0 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4585d9b640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45881f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4586d9d640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4588151bb0 0x7f45881505b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f45800b2040 tx=0x7f458001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4576ffd640 1 -- 172.21.15.29:0/707659801 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45800b4040 con 0x7f4588151bb0 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4576ffd640 1 -- 172.21.15.29:0/707659801 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45800c1070 con 0x7f4588151bb0 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45881f4930 con 0x7f4588151bb0 2024-04-23T10:26:56.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4576ffd640 1 -- 172.21.15.29:0/707659801 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580009450 con 0x7f4588151bb0 2024-04-23T10:26:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45881f4ef0 con 0x7f4588151bb0 2024-04-23T10:26:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45881f50f0 con 0x7f4588151bb0 2024-04-23T10:26:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.823+0000 7f4576ffd640 1 -- 172.21.15.29:0/707659801 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45800ba6b0 con 0x7f4588151bb0 2024-04-23T10:26:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.827+0000 7f4576ffd640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4568068380 0x7f456806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.827+0000 7f4576ffd640 1 -- 172.21.15.29:0/707659801 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f45801257a0 con 0x7f4588151bb0 2024-04-23T10:26:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.827+0000 7f458659c640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4568068380 0x7f456806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.827+0000 7f458659c640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4568068380 0x7f456806a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4578009a50 tx=0x7f4578008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:56.831+0000 7f4576ffd640 1 -- 172.21.15.29:0/707659801 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4580018cb0 con 0x7f4588151bb0 2024-04-23T10:26:57.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.107+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4588068d70 con 0x7f4588151bb0 2024-04-23T10:26:57.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.107+0000 7f4576ffd640 1 -- 172.21.15.29:0/707659801 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f45800f58b0 con 0x7f4588151bb0 2024-04-23T10:26:57.106 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:26:57.106 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:26:57.107 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:26:57.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4568068380 msgr2=0x7f456806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4568068380 0x7f456806a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4578009a50 tx=0x7f4578008040 comp rx=0 tx=0).stop 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4588151bb0 msgr2=0x7f45881505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4588151bb0 0x7f45881505b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f45800b2040 tx=0x7f458001bef0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 shutdown_connections 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4568068380 0x7f456806a840 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4578009a50 tx=0x7f4578008040 comp rx=0 tx=0).stop 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4588151bb0 0x7f45881505b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45880c5d50 0x7f45881f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 --2- 172.21.15.29:0/707659801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45880c5900 0x7f45881f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 >> 172.21.15.29:0/707659801 conn(0x7f45880730f0 msgr2=0x7f45880d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 shutdown_connections 2024-04-23T10:26:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.111+0000 7f458cb67640 1 -- 172.21.15.29:0/707659801 wait complete. 2024-04-23T10:26:57.125 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-23T10:26:57.125 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-23T10:26:57.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.251+0000 7f8e43ae5640 1 Processor -- start 2024-04-23T10:26:57.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.251+0000 7f8e43ae5640 1 -- start start 2024-04-23T10:26:57.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e43ae5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e3c0c6fd0 0x7f8e3c0ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e43ae5640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c73b0 0x7f8e3c159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e43ae5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e3c074f90 con 0x7f8e3c0c86c0 2024-04-23T10:26:57.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e43ae5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8e3c0cd790 con 0x7f8e3c0c6fd0 2024-04-23T10:26:57.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e43ae5640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c0cda70 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e41881640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e3c0c6fd0 0x7f8e3c0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e41080640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c73b0 0x7f8e3c159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e42082640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8e3c0c86c0 0x7f8e3c152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:60074/0 (socket says 172.21.15.29:60074) 2024-04-23T10:26:57.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e42082640 1 -- 172.21.15.29:0/2541678472 learned_addr learned my addr 172.21.15.29:0/2541678472 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e4087f640 1 -- 172.21.15.29:0/2541678472 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440805101 0 0) 0x7f8e3c074f90 con 0x7f8e3c0c86c0 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e4087f640 1 -- 172.21.15.29:0/2541678472 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e28003530 con 0x7f8e3c0c86c0 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e41881640 1 -- 172.21.15.29:0/2541678472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c73b0 msgr2=0x7f8e3c159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e41881640 1 --2- 172.21.15.29:0/2541678472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c73b0 0x7f8e3c159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e41881640 1 -- 172.21.15.29:0/2541678472 >> v1:172.21.15.72:6789/0 conn(0x7f8e3c0c86c0 legacy=0x7f8e3c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e41881640 1 -- 172.21.15.29:0/2541678472 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c0cdd50 con 0x7f8e3c0c6fd0 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e41080640 1 --2- 172.21.15.29:0/2541678472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c73b0 0x7f8e3c159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.255+0000 7f8e41881640 1 --2- 172.21.15.29:0/2541678472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 0x7f8e3c0ca640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e380097c0 tx=0x7f8e3801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20d4effef45d400a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e4087f640 1 -- 172.21.15.29:0/2541678472 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e380b5070 con 0x7f8e3c0c6fd0 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e4087f640 1 -- 172.21.15.29:0/2541678472 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e380a8990 con 0x7f8e3c0c6fd0 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e4087f640 1 -- 172.21.15.29:0/2541678472 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e380a8d40 con 0x7f8e3c0c6fd0 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- 172.21.15.29:0/2541678472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 msgr2=0x7f8e3c0ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/2541678472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 0x7f8e3c0ca640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e380097c0 tx=0x7f8e3801ec90 comp rx=0 tx=0).stop 2024-04-23T10:26:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- 172.21.15.29:0/2541678472 shutdown_connections 2024-04-23T10:26:57.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/2541678472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c73b0 0x7f8e3c159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/2541678472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 0x7f8e3c0ca640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- 172.21.15.29:0/2541678472 >> 172.21.15.29:0/2541678472 conn(0x7f8e3c06e730 msgr2=0x7f8e3c06fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- 172.21.15.29:0/2541678472 shutdown_connections 2024-04-23T10:26:57.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- 172.21.15.29:0/2541678472 wait complete. 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 Processor -- start 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- start start 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 0x7f8e3c154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e3c0c73b0 0x7f8e3c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c86c0 0x7f8e3c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c0cad00 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c0cab80 con 0x7f8e3c0c6fd0 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c0ccac0 con 0x7f8e3c0c86c0 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e3c0c73b0 0x7f8e3c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e3c0c73b0 0x7f8e3c0ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49106/0 (socket says 172.21.15.29:49106) 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 -- 172.21.15.29:0/1041365872 learned_addr learned my addr 172.21.15.29:0/1041365872 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41881640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 0x7f8e3c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e42082640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c86c0 0x7f8e3c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 -- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c86c0 msgr2=0x7f8e3c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c86c0 0x7f8e3c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 -- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 msgr2=0x7f8e3c154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 0x7f8e3c154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 -- 172.21.15.29:0/1041365872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c1570e0 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e41080640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e3c0c73b0 0x7f8e3c0ccf50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00e9d0 tx=0x7f8e2c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e327fc640 1 -- 172.21.15.29:0/1041365872 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c017070 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e327fc640 1 -- 172.21.15.29:0/1041365872 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c00ca60 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- 172.21.15.29:0/1041365872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3c0cbbd0 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e327fc640 1 -- 172.21.15.29:0/1041365872 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00ce50 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.259+0000 7f8e43ae5640 1 -- 172.21.15.29:0/1041365872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3c0cc190 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e327fc640 1 -- 172.21.15.29:0/1041365872 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e2c01a070 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e327fc640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e20068520 0x7f8e2006a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e327fc640 1 -- 172.21.15.29:0/1041365872 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8e2c086cc0 con 0x7f8e3c0c73b0 2024-04-23T10:26:57.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e41881640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e20068520 0x7f8e2006a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e46c67000 1 Processor -- start 2024-04-23T10:26:57.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e46c67000 1 -- start start 2024-04-23T10:26:57.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e41881640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e20068520 0x7f8e2006a9e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e380b2000 tx=0x7f8e380aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570501fd810 0x5570501fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570502026c0 0x557050202aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557050202fe0 0x5570502033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e46c67000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5570500a92a0 con 0x5570502026c0 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e46c67000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55705000f5f0 con 0x5570501fd810 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e46c67000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55704ffaa820 con 0x557050202fe0 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e41080640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570502026c0 0x557050202aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e41080640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570502026c0 0x557050202aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49118/0 (socket says 172.21.15.29:49118) 2024-04-23T10:26:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e41080640 1 -- 172.21.15.29:0/3837785982 learned_addr learned my addr 172.21.15.29:0/3837785982 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e42082640 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557050202fe0 0x5570502033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.263+0000 7f8e41881640 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570501fd810 0x5570501fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e41080640 1 -- 172.21.15.29:0/3837785982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557050202fe0 msgr2=0x5570502033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e41080640 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557050202fe0 0x5570502033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e41080640 1 -- 172.21.15.29:0/3837785982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570501fd810 msgr2=0x5570501fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e41080640 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570501fd810 0x5570501fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e41080640 1 -- 172.21.15.29:0/3837785982 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557050055c00 con 0x5570502026c0 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e41080640 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570502026c0 0x557050202aa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c052c80 tx=0x7f8e2c056960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81a5f8916857239 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e1f7fe640 1 -- 172.21.15.29:0/3837785982 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c021070 con 0x5570502026c0 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e1f7fe640 1 -- 172.21.15.29:0/3837785982 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c06c070 con 0x5570502026c0 2024-04-23T10:26:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e1f7fe640 1 -- 172.21.15.29:0/3837785982 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c054b20 con 0x5570502026c0 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- 172.21.15.29:0/3837785982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570502026c0 msgr2=0x557050202aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570502026c0 0x557050202aa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c052c80 tx=0x7f8e2c056960 comp rx=0 tx=0).stop 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- 172.21.15.29:0/3837785982 shutdown_connections 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557050202fe0 0x5570502033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570502026c0 0x557050202aa0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 --2- 172.21.15.29:0/3837785982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570501fd810 0x5570501fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- 172.21.15.29:0/3837785982 >> 172.21.15.29:0/3837785982 conn(0x5570501fe470 msgr2=0x557050200890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- 172.21.15.29:0/3837785982 shutdown_connections 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- 172.21.15.29:0/3837785982 wait complete. 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- start start 2024-04-23T10:26:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 Processor -- start 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570501fd810 0x5570501c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570502026c0 0x55705020cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557050202fe0 0x55705020d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55704ffbac60 con 0x5570501fd810 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557050091bf0 con 0x557050202fe0 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5570500cc560 con 0x5570502026c0 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 10 client.0 _ll_register_callbacks cb 0x55704ffe6570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557050202fe0 0x55705020d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e41080640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570502026c0 0x55705020cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557050202fe0 0x55705020d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:35678/0 (socket says 172.21.15.29:35678) 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 -- 172.21.15.29:0/1460113496 learned_addr learned my addr 172.21.15.29:0/1460113496 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e41080640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570502026c0 0x55705020cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:37862/0 (socket says 172.21.15.29:37862) 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 -- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570502026c0 msgr2=0x55705020cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570502026c0 0x55705020cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 -- 172.21.15.29:0/1460113496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570501fd810 msgr2=0x5570501c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570501fd810 0x5570501c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 -- 172.21.15.29:0/1460113496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55705004a630 con 0x557050202fe0 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e42082640 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557050202fe0 0x55705020d1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e34011940 tx=0x7f8e34011d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d33ccf61adb63fd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e1cff9640 1 -- 172.21.15.29:0/1460113496 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34005df0 con 0x557050202fe0 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e46c67000 1 -- 172.21.15.29:0/1460113496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e2c06c070 con 0x557050202fe0 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.267+0000 7f8e1cff9640 1 -- 172.21.15.29:0/1460113496 <== mon.1 v2:172.21.15.72:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8e3400f7b0 con 0x557050202fe0 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e1cff9640 1 -- 172.21.15.29:0/1460113496 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8e3400f9d0 con 0x557050202fe0 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e46c67000 10 client.5170 fetch_fsmap learned FSMap version 18 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e46c67000 1 -- 172.21.15.29:0/1460113496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55704ffaf490 con 0x557050202fe0 2024-04-23T10:26:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e1cff9640 1 -- 172.21.15.29:0/1460113496 <== mon.1 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c06c070 con 0x557050202fe0 2024-04-23T10:26:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e1cff9640 1 -- 172.21.15.29:0/1460113496 <== mon.1 v2:172.21.15.72:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f8e3400fb70 con 0x557050202fe0 2024-04-23T10:26:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e46c67000 10 client.5170 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:26:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e46c67000 10 client.5170 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:26:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e46c67000 20 client.5170 populate_metadata read hostname 'smithi029' 2024-04-23T10:26:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e46c67000 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5570501fcac0 0x5570501fced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e46c67000 4 client.5170 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e46c67000 1 -- 172.21.15.29:0/1460113496 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55704ffa97f0 con 0x5570501fcac0 2024-04-23T10:26:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e41881640 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5570501fcac0 0x5570501fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e41881640 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5570501fcac0 0x5570501fced0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea9ea9f602d9c5e8 server_cookie=aa79648a658cab97 in_seq=0 out_seq=0 2024-04-23T10:26:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.271+0000 7f8e1cff9640 10 client.5170 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e1cff9640 1 -- 172.21.15.29:0/1460113496 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55704ffa97f0 con 0x5570501fcac0 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e1cff9640 10 client.5170 handle_command_reply: tid=0 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 client.5170 shutdown 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 -- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557050202fe0 msgr2=0x55705020d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557050202fe0 0x55705020d1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e34011940 tx=0x7f8e34011d40 comp rx=0 tx=0).stop 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 -- 172.21.15.29:0/1460113496 shutdown_connections 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5570501fcac0 0x5570501fced0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557050202fe0 0x55705020d1d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570502026c0 0x55705020cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 --2- 172.21.15.29:0/1460113496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5570501fd810 0x5570501c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 -- 172.21.15.29:0/1460113496 >> 172.21.15.29:0/1460113496 conn(0x5570501fe470 msgr2=0x557050200860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e1cff9640 0 client.5170 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:26:57.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 -- 172.21.15.29:0/1460113496 shutdown_connections 2024-04-23T10:26:57.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 1 -- 172.21.15.29:0/1460113496 wait complete. 2024-04-23T10:26:57.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.275+0000 7f8e46c67000 20 client.5170 trim_cache size 0 max 16384 2024-04-23T10:26:57.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e46c67000 1 Processor -- start 2024-04-23T10:26:57.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e46c67000 1 -- start start 2024-04-23T10:26:57.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 0x5570501c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 0x5570502224a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x5570502229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e46c67000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c1fa330 con 0x557050202fe0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e46c67000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c1faa00 con 0x5570502026c0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e46c67000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c0c6910 con 0x5570501fd810 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x5570502229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x5570502229e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49136/0 (socket says 172.21.15.29:49136) 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 -- 172.21.15.29:0/2833777329 learned_addr learned my addr 172.21.15.29:0/2833777329 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e41080640 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 0x5570502224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e41881640 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 0x5570501c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 -- 172.21.15.29:0/2833777329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 msgr2=0x5570501c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 0x5570501c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 -- 172.21.15.29:0/2833777329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 msgr2=0x5570502224a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 0x5570502224a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 -- 172.21.15.29:0/2833777329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55704ffaaa70 con 0x557050202fe0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e42082640 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x5570502229e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8e34001590 tx=0x7f8e34007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c6ee55a5790543 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e1effd640 1 -- 172.21.15.29:0/2833777329 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3402d070 con 0x557050202fe0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e1effd640 1 -- 172.21.15.29:0/2833777329 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3401a070 con 0x557050202fe0 2024-04-23T10:26:57.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.295+0000 7f8e1effd640 1 -- 172.21.15.29:0/2833777329 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34001800 con 0x557050202fe0 2024-04-23T10:26:57.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- 172.21.15.29:0/2833777329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 msgr2=0x5570502229e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x5570502229e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8e34001590 tx=0x7f8e34007000 comp rx=0 tx=0).stop 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- 172.21.15.29:0/2833777329 shutdown_connections 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x5570502229e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 0x5570502224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2833777329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 0x5570501c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- 172.21.15.29:0/2833777329 >> 172.21.15.29:0/2833777329 conn(0x5570501fe470 msgr2=0x557050200860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- 172.21.15.29:0/2833777329 shutdown_connections 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- 172.21.15.29:0/2833777329 wait complete. 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- start start 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 Processor -- start 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 0x557050222930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 0x557050221690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x557050221bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55705000e900 con 0x557050202fe0 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55704ffd9e60 con 0x5570502026c0 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x557050013c20 con 0x5570501fd810 2024-04-23T10:26:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 10 client.0 _ll_register_callbacks cb 0x7f8e34001c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x557050221bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x557050221bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49144/0 (socket says 172.21.15.29:49144) 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 -- 172.21.15.29:0/2950526231 learned_addr learned my addr 172.21.15.29:0/2950526231 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e41881640 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 0x557050222930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e41080640 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 0x557050221690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 -- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 msgr2=0x557050222930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 0x557050222930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 -- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 msgr2=0x557050221690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 0x557050221690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 -- 172.21.15.29:0/2950526231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557050092080 con 0x557050202fe0 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e42082640 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x557050221bd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x55704ffd16e0 tx=0x7f8e340014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a754a55aaf8c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:26:57.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e1cff9640 1 -- 172.21.15.29:0/2950526231 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34038060 con 0x557050202fe0 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- 172.21.15.29:0/2950526231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e3401a070 con 0x557050202fe0 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e1cff9640 1 -- 172.21.15.29:0/2950526231 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8e34011580 con 0x557050202fe0 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e1cff9640 1 -- 172.21.15.29:0/2950526231 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8e3402d040 con 0x557050202fe0 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 10 client.5646 fetch_fsmap learned FSMap version 18 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- 172.21.15.29:0/2950526231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55704ffb53e0 con 0x557050202fe0 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e1cff9640 1 -- 172.21.15.29:0/2950526231 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3401a070 con 0x557050202fe0 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e1cff9640 1 -- 172.21.15.29:0/2950526231 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f8e34041080 con 0x557050202fe0 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 10 client.5646 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 10 client.5646 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 20 client.5646 populate_metadata read hostname 'smithi029' 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55705023cef0 0x55705023d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 4 client.5646 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e46c67000 1 -- 172.21.15.29:0/2950526231 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55704ffb8940 con 0x55705023cef0 2024-04-23T10:26:57.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.299+0000 7f8e41881640 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55705023cef0 0x55705023d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.303+0000 7f8e1cff9640 10 client.5646 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:26:57.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:26:57.303+0000 7f8e41881640 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55705023cef0 0x55705023d300 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed6835eef3c5a37 server_cookie=232325f7249705bd in_seq=0 out_seq=0 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e1cff9640 1 -- 172.21.15.29:0/2950526231 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55704ffb8940 con 0x55705023cef0 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e1cff9640 10 client.5646 handle_command_reply: tid=0 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 client.5646 shutdown 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 -- 172.21.15.29:0/2950526231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 msgr2=0x557050221bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x557050221bd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x55704ffd16e0 tx=0x7f8e340014e0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 -- 172.21.15.29:0/2950526231 shutdown_connections 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55705023cef0 0x55705023d300 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557050202fe0 0x557050221bd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e1cff9640 0 client.5646 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5570502026c0 0x557050221690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 --2- 172.21.15.29:0/2950526231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5570501fd810 0x557050222930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 -- 172.21.15.29:0/2950526231 >> 172.21.15.29:0/2950526231 conn(0x5570501fe470 msgr2=0x5570502010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 -- 172.21.15.29:0/2950526231 shutdown_connections 2024-04-23T10:27:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 1 -- 172.21.15.29:0/2950526231 wait complete. 2024-04-23T10:27:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e46c67000 20 client.5646 trim_cache size 0 max 16384 2024-04-23T10:27:00.134 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:27:00.134 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 42, 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "ed48a87": { 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 42, 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 90.0, 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:27:00.135 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:00.136 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:27:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 -- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e20068520 msgr2=0x7f8e2006a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e20068520 0x7f8e2006a9e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e380b2000 tx=0x7f8e380aa070 comp rx=0 tx=0).stop 2024-04-23T10:27:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 -- 172.21.15.29:0/1041365872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e3c0c73b0 msgr2=0x7f8e3c0ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e3c0c73b0 0x7f8e3c0ccf50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00e9d0 tx=0x7f8e2c00ee90 comp rx=0 tx=0).stop 2024-04-23T10:27:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 -- 172.21.15.29:0/1041365872 shutdown_connections 2024-04-23T10:27:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8e20068520 0x7f8e2006a9e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e3c0c86c0 0x7f8e3c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e3c0c73b0 0x7f8e3c0ccf50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 --2- 172.21.15.29:0/1041365872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e3c0c6fd0 0x7f8e3c154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 -- 172.21.15.29:0/1041365872 >> 172.21.15.29:0/1041365872 conn(0x7f8e3c06e730 msgr2=0x7f8e3c14fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:00.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 -- 172.21.15.29:0/1041365872 shutdown_connections 2024-04-23T10:27:00.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:00.134+0000 7f8e43ae5640 1 -- 172.21.15.29:0/1041365872 wait complete. 2024-04-23T10:27:00.161 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ed48a87', quiesce took 3.5 seconds. Will release after: 30.0 2024-04-23T10:27:22.151 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:27:22.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:27:30.162 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:27:30.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.298+0000 7f7ddb094640 1 Processor -- start 2024-04-23T10:27:30.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.298+0000 7f7ddb094640 1 -- start start 2024-04-23T10:27:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7ddb094640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7dd4151bb0 0x7f7dd415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7ddb094640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7dd40c5900 0x7f7dd40c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7ddb094640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd406c910 con 0x7f7dd40cb770 2024-04-23T10:27:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7ddb094640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd406cbf0 con 0x7f7dd4151bb0 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7ddb094640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd406ced0 con 0x7f7dd40c5900 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dd8e30640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7dd4151bb0 0x7f7dd415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dd8e30640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7dd4151bb0 0x7f7dd415bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36716/0 (socket says 172.21.15.29:36716) 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dd8e30640 1 -- 172.21.15.29:0/4024717857 learned_addr learned my addr 172.21.15.29:0/4024717857 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dcbfff640 1 --2- 172.21.15.29:0/4024717857 >> v2:172.21.15.72:3300/0 conn(0x7f7dd40c5900 0x7f7dd40c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dd8e30640 1 -- 172.21.15.29:0/4024717857 >> v2:172.21.15.72:3300/0 conn(0x7f7dd40c5900 msgr2=0x7f7dd40c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dd8e30640 1 --2- 172.21.15.29:0/4024717857 >> v2:172.21.15.72:3300/0 conn(0x7f7dd40c5900 0x7f7dd40c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dd8e30640 1 -- 172.21.15.29:0/4024717857 >> v1:172.21.15.72:6789/0 conn(0x7f7dd40cb770 legacy=0x7f7dd40c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dd8e30640 1 -- 172.21.15.29:0/4024717857 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd406d1b0 con 0x7f7dd4151bb0 2024-04-23T10:27:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.302+0000 7f7dd8e30640 1 --2- 172.21.15.29:0/4024717857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd415bd80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40cb6e0 tx=0x7f7dd001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff582b866dc6406f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dcb7fe640 1 -- 172.21.15.29:0/4024717857 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00b5070 con 0x7f7dd4151bb0 2024-04-23T10:27:30.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dcb7fe640 1 -- 172.21.15.29:0/4024717857 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd00a8a10 con 0x7f7dd4151bb0 2024-04-23T10:27:30.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dcb7fe640 1 -- 172.21.15.29:0/4024717857 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00a8de0 con 0x7f7dd4151bb0 2024-04-23T10:27:30.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- 172.21.15.29:0/4024717857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 msgr2=0x7f7dd415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 --2- 172.21.15.29:0/4024717857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd415bd80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40cb6e0 tx=0x7f7dd001ed10 comp rx=0 tx=0).stop 2024-04-23T10:27:30.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- 172.21.15.29:0/4024717857 shutdown_connections 2024-04-23T10:27:30.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 --2- 172.21.15.29:0/4024717857 >> v2:172.21.15.72:3300/0 conn(0x7f7dd40c5900 0x7f7dd40c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 --2- 172.21.15.29:0/4024717857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd415bd80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- 172.21.15.29:0/4024717857 >> 172.21.15.29:0/4024717857 conn(0x7f7dd40730f0 msgr2=0x7f7dd4073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- 172.21.15.29:0/4024717857 shutdown_connections 2024-04-23T10:27:30.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- 172.21.15.29:0/4024717857 wait complete. 2024-04-23T10:27:30.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 Processor -- start 2024-04-23T10:27:30.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- start start 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dd40c5900 0x7f7dd41e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dd40cb770 0x7f7dd40b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd4149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd40c6f50 con 0x7f7dd4151bb0 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4151f90 con 0x7f7dd40c5900 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd40c70d0 con 0x7f7dd40cb770 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd4149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd4149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36728/0 (socket says 172.21.15.29:36728) 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 -- 172.21.15.29:0/3899342190 learned_addr learned my addr 172.21.15.29:0/3899342190 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd8e30640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dd40c5900 0x7f7dd41e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dcbfff640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dd40cb770 0x7f7dd40b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 -- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dd40cb770 msgr2=0x7f7dd40b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dd40cb770 0x7f7dd40b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 -- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dd40c5900 msgr2=0x7f7dd41e49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dd40c5900 0x7f7dd41e49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 -- 172.21.15.29:0/3899342190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd41e6740 con 0x7f7dd4151bb0 2024-04-23T10:27:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dd9631640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd4149620 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c740 tx=0x7f7dcc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dc97fa640 1 -- 172.21.15.29:0/3899342190 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc016020 con 0x7f7dd4151bb0 2024-04-23T10:27:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dc97fa640 1 -- 172.21.15.29:0/3899342190 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00ce50 con 0x7f7dd4151bb0 2024-04-23T10:27:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd40b6520 con 0x7f7dd4151bb0 2024-04-23T10:27:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.306+0000 7f7dc97fa640 1 -- 172.21.15.29:0/3899342190 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc003980 con 0x7f7dd4151bb0 2024-04-23T10:27:30.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.310+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd41e7000 con 0x7f7dd4151bb0 2024-04-23T10:27:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.310+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd4068d70 con 0x7f7dd4151bb0 2024-04-23T10:27:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.310+0000 7f7dc97fa640 1 -- 172.21.15.29:0/3899342190 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7dcc003b20 con 0x7f7dd4151bb0 2024-04-23T10:27:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.310+0000 7f7dc97fa640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7dc00683b0 0x7f7dc006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.310+0000 7f7dc97fa640 1 -- 172.21.15.29:0/3899342190 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7dcc086ad0 con 0x7f7dd4151bb0 2024-04-23T10:27:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.310+0000 7f7dd8e30640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7dc00683b0 0x7f7dc006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.310+0000 7f7dd8e30640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7dc00683b0 0x7f7dc006a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00b2000 tx=0x7f7dd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.314+0000 7f7dc97fa640 1 -- 172.21.15.29:0/3899342190 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7dcc020020 con 0x7f7dd4151bb0 2024-04-23T10:27:30.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.514+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dd4158e00 con 0x7f7dd4151bb0 2024-04-23T10:27:30.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.514+0000 7f7dc97fa640 1 -- 172.21.15.29:0/3899342190 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f7dcc019310 con 0x7f7dd4151bb0 2024-04-23T10:27:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:27:30.514 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:27:30.515 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:27:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7dc00683b0 msgr2=0x7f7dc006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7dc00683b0 0x7f7dc006a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00b2000 tx=0x7f7dd0008040 comp rx=0 tx=0).stop 2024-04-23T10:27:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 msgr2=0x7f7dd4149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd4149620 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c740 tx=0x7f7dcc00cc00 comp rx=0 tx=0).stop 2024-04-23T10:27:30.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 shutdown_connections 2024-04-23T10:27:30.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7dc00683b0 0x7f7dc006a870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7dd4151bb0 0x7f7dd4149620 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dd40cb770 0x7f7dd40b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 --2- 172.21.15.29:0/3899342190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dd40c5900 0x7f7dd41e49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 >> 172.21.15.29:0/3899342190 conn(0x7f7dd40730f0 msgr2=0x7f7dd415b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 shutdown_connections 2024-04-23T10:27:30.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.518+0000 7f7ddb094640 1 -- 172.21.15.29:0/3899342190 wait complete. 2024-04-23T10:27:30.531 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id ed48a87 --release --await' 2024-04-23T10:27:30.531 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id ed48a87 --release --await 2024-04-23T10:27:30.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbfa1b3640 1 Processor -- start 2024-04-23T10:27:30.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbfa1b3640 1 -- start start 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbfa1b3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcbf4153190 0x7fcbf4159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbfa1b3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbf406f150 0x7fcbf406f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbfa1b3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf40ccc50 0x7fcbf40cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbfa1b3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf4159380 con 0x7fcbf4153190 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbfa1b3640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf40cd5c0 con 0x7fcbf406f150 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbfa1b3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf40c3fe0 con 0x7fcbf40ccc50 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcbf4153190 0x7fcbf4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf37fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcbf4153190 0x7fcbf4159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36732/0 (socket says 172.21.15.29:36732) 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf37fe640 1 -- 172.21.15.29:0/281894650 learned_addr learned my addr 172.21.15.29:0/281894650 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf3fff640 1 --2- 172.21.15.29:0/281894650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf40ccc50 0x7fcbf40cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/281894650 >> v2:172.21.15.72:3300/0 conn(0x7fcbf406f150 0x7fcbf406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf37fe640 1 -- 172.21.15.29:0/281894650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf40ccc50 msgr2=0x7fcbf40cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/281894650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf40ccc50 0x7fcbf40cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf37fe640 1 -- 172.21.15.29:0/281894650 >> v2:172.21.15.72:3300/0 conn(0x7fcbf406f150 msgr2=0x7fcbf406f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/281894650 >> v2:172.21.15.72:3300/0 conn(0x7fcbf406f150 0x7fcbf406f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.658+0000 7fcbf37fe640 1 -- 172.21.15.29:0/281894650 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf40c42c0 con 0x7fcbf4153190 2024-04-23T10:27:30.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/281894650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf4153190 0x7fcbf4159810 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40c8fc0 tx=0x7fcbe401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e17a60c8ccf69c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbf27fc640 1 -- 172.21.15.29:0/281894650 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40b5070 con 0x7fcbf4153190 2024-04-23T10:27:30.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbf27fc640 1 -- 172.21.15.29:0/281894650 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe40a89d0 con 0x7fcbf4153190 2024-04-23T10:27:30.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbf27fc640 1 -- 172.21.15.29:0/281894650 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40a8da0 con 0x7fcbf4153190 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/281894650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf4153190 msgr2=0x7fcbf4159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/281894650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf4153190 0x7fcbf4159810 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40c8fc0 tx=0x7fcbe401ed10 comp rx=0 tx=0).stop 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/281894650 shutdown_connections 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/281894650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf40ccc50 0x7fcbf40cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/281894650 >> v2:172.21.15.72:3300/0 conn(0x7fcbf406f150 0x7fcbf406f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/281894650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf4153190 0x7fcbf4159810 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/281894650 >> 172.21.15.29:0/281894650 conn(0x7fcbf406cfb0 msgr2=0x7fcbf406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/281894650 shutdown_connections 2024-04-23T10:27:30.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/281894650 wait complete. 2024-04-23T10:27:30.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 Processor -- start 2024-04-23T10:27:30.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.662+0000 7fcbfa1b3640 1 -- start start 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbfa1b3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf406f150 0x7fcbf415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbfa1b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf40ccc50 0x7fcbf414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbfa1b3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf4153190 0x7fcbf415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbfa1b3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf4153570 con 0x7fcbf40ccc50 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbfa1b3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf4159010 con 0x7fcbf406f150 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbfa1b3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf40c4880 con 0x7fcbf4153190 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf40ccc50 0x7fcbf414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf40ccc50 0x7fcbf414aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36746/0 (socket says 172.21.15.29:36746) 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/654282851 learned_addr learned my addr 172.21.15.29:0/654282851 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf406f150 0x7fcbf415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf3fff640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf4153190 0x7fcbf415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf4153190 msgr2=0x7fcbf415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf4153190 0x7fcbf415a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf406f150 msgr2=0x7fcbf415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf406f150 0x7fcbf415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/654282851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf41f2bd0 con 0x7fcbf40ccc50 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf40ccc50 0x7fcbf414aad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d830 tx=0x7fcbe800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbdbfff640 1 -- 172.21.15.29:0/654282851 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8018020 con 0x7fcbf40ccc50 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbdbfff640 1 -- 172.21.15.29:0/654282851 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe80096a0 con 0x7fcbf40ccc50 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbdbfff640 1 -- 172.21.15.29:0/654282851 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8009a50 con 0x7fcbf40ccc50 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/654282851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf41eebe0 con 0x7fcbf40ccc50 2024-04-23T10:27:30.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/654282851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf41ef1a0 con 0x7fcbf40ccc50 2024-04-23T10:27:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbdbfff640 1 -- 172.21.15.29:0/654282851 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcbe801b020 con 0x7fcbf40ccc50 2024-04-23T10:27:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbdbfff640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcbe0068380 0x7fcbe006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbdbfff640 1 -- 172.21.15.29:0/654282851 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcbe8087560 con 0x7fcbf40ccc50 2024-04-23T10:27:30.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.666+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcbe0068380 0x7fcbe006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 Processor -- start 2024-04-23T10:27:30.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- start start 2024-04-23T10:27:30.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcbe0068380 0x7fcbe006a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40b2000 tx=0x7fcbe4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 0x55a2c5548370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c5548c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2c5350660 con 0x55a2c5546a50 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a2c52f55d0 con 0x55a2c55488b0 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a2c534c620 con 0x55a2c55437f0 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36760/0 (socket says 172.21.15.29:36760) 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 -- 172.21.15.29:0/3782192875 learned_addr learned my addr 172.21.15.29:0/3782192875 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf3fff640 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c5548c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 -- 172.21.15.29:0/3782192875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 msgr2=0x55a2c5548370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 0x55a2c5548370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 0x55a2c5548370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 -- 172.21.15.29:0/3782192875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 msgr2=0x55a2c5548c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c5548c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 -- 172.21.15.29:0/3782192875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c5329bd0 con 0x55a2c5546a50 2024-04-23T10:27:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55432b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40b3040 tx=0x7fcbe4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fce267d2f4ac1a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbd97fa640 1 -- 172.21.15.29:0/3782192875 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40cb070 con 0x55a2c5546a50 2024-04-23T10:27:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbd97fa640 1 -- 172.21.15.29:0/3782192875 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe40b0440 con 0x55a2c5546a50 2024-04-23T10:27:30.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbd97fa640 1 -- 172.21.15.29:0/3782192875 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40b5040 con 0x55a2c5546a50 2024-04-23T10:27:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- 172.21.15.29:0/3782192875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 msgr2=0x55a2c55432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55432b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40b3040 tx=0x7fcbe4004740 comp rx=0 tx=0).stop 2024-04-23T10:27:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- 172.21.15.29:0/3782192875 shutdown_connections 2024-04-23T10:27:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c5548c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 0x55a2c5548370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3782192875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55432b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- 172.21.15.29:0/3782192875 >> 172.21.15.29:0/3782192875 conn(0x55a2c53eab00 msgr2=0x55a2c5546130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- 172.21.15.29:0/3782192875 shutdown_connections 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- 172.21.15.29:0/3782192875 wait complete. 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- start start 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 Processor -- start 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55437f0 0x55a2c55428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c5548c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55488b0 0x55a2c55491d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2c540dd40 con 0x55a2c5546a50 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a2c530aeb0 con 0x55a2c55437f0 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a2c534b2a0 con 0x55a2c55488b0 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbfd335000 10 client.0 _ll_register_callbacks cb 0x55a2c54eea90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c5548c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c5548c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36770/0 (socket says 172.21.15.29:36770) 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.670+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/3974713418 learned_addr learned my addr 172.21.15.29:0/3974713418 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55437f0 0x55a2c55428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf3fff640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55488b0 0x55a2c55491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55488b0 msgr2=0x55a2c55491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55488b0 0x55a2c55491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55437f0 msgr2=0x55a2c55428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55437f0 0x55a2c55428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/3974713418 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c5396b30 con 0x55a2c5546a50 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55437f0 0x55a2c55428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf3fff640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55488b0 0x55a2c55491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c5548c90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009490 tx=0x7fcbe80114a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5722fd0e179cb006 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 1 -- 172.21.15.29:0/3974713418 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe805fc70 con 0x55a2c5546a50 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 1 -- 172.21.15.29:0/3974713418 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcbe805b0d0 con 0x55a2c5546a50 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 1 -- 172.21.15.29:0/3974713418 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a2c52ea060 con 0x55a2c5546a50 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 1 -- 172.21.15.29:0/3974713418 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fcbe8053700 con 0x55a2c5546a50 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 10 client.5664 fetch_fsmap learned FSMap version 18 2024-04-23T10:27:30.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 1 -- 172.21.15.29:0/3974713418 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a2c52efb70 con 0x55a2c5546a50 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 1 -- 172.21.15.29:0/3974713418 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a2c52ea060 con 0x55a2c5546a50 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 1 -- 172.21.15.29:0/3974713418 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fcbe8013050 con 0x55a2c5546a50 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 10 client.5664 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 10 client.5664 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 20 client.5664 populate_metadata read hostname 'smithi029' 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a2c5549be0 0x55a2c5549fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 4 client.5664 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 1 -- 172.21.15.29:0/3974713418 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2c5328e30 con 0x55a2c5549be0 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a2c5549be0 0x55a2c5549fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 10 client.5664 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:30.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a2c5549be0 0x55a2c5549fc0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5524e30b7cd9e1c2 server_cookie=25229763ef78984c in_seq=0 out_seq=0 2024-04-23T10:27:30.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 1 -- 172.21.15.29:0/3974713418 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a2c5328e30 con 0x55a2c5549be0 2024-04-23T10:27:30.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbd27fc640 10 client.5664 handle_command_reply: tid=0 2024-04-23T10:27:30.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 1 client.5664 shutdown 2024-04-23T10:27:30.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 1 -- 172.21.15.29:0/3974713418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 msgr2=0x55a2c5548c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.674+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c5548c90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009490 tx=0x7fcbe80114a0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 1 -- 172.21.15.29:0/3974713418 shutdown_connections 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a2c5549be0 0x55a2c5549fc0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55488b0 0x55a2c55491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c5548c90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 1 --2- 172.21.15.29:0/3974713418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55437f0 0x55a2c55428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbd27fc640 0 client.5664 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 1 -- 172.21.15.29:0/3974713418 >> 172.21.15.29:0/3974713418 conn(0x55a2c53eab00 msgr2=0x55a2c5547360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 1 -- 172.21.15.29:0/3974713418 shutdown_connections 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 1 -- 172.21.15.29:0/3974713418 wait complete. 2024-04-23T10:27:30.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.678+0000 7fcbfd335000 20 client.5664 trim_cache size 0 max 16384 2024-04-23T10:27:30.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 Processor -- start 2024-04-23T10:27:30.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- start start 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 0x55a2c55b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55b9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c55b9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf41fa3b0 con 0x55a2c5546a50 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf41faa80 con 0x55a2c55488b0 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf4072c80 con 0x55a2c55437f0 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55b9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36776/0 (socket says 172.21.15.29:36776) 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/1757480213 learned_addr learned my addr 172.21.15.29:0/1757480213 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/1757480213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 msgr2=0x55a2c55b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/1757480213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 0x55a2c55b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/1757480213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 msgr2=0x55a2c55b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/1757480213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c55b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 -- 172.21.15.29:0/1757480213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c53d25e0 con 0x55a2c5546a50 2024-04-23T10:27:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/1757480213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55b9200 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8087880 tx=0x7fcbe8016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a049a66a05750a3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbd8ff9640 1 -- 172.21.15.29:0/1757480213 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe80569f0 con 0x55a2c5546a50 2024-04-23T10:27:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbd8ff9640 1 -- 172.21.15.29:0/1757480213 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe805fc70 con 0x55a2c5546a50 2024-04-23T10:27:30.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbd8ff9640 1 -- 172.21.15.29:0/1757480213 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8055130 con 0x55a2c5546a50 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- 172.21.15.29:0/1757480213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 msgr2=0x55a2c55b9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 --2- 172.21.15.29:0/1757480213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55b9200 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8087880 tx=0x7fcbe8016070 comp rx=0 tx=0).stop 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- 172.21.15.29:0/1757480213 shutdown_connections 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 --2- 172.21.15.29:0/1757480213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c55b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 --2- 172.21.15.29:0/1757480213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c5546a50 0x55a2c55b9200 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 --2- 172.21.15.29:0/1757480213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c55437f0 0x55a2c55b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- 172.21.15.29:0/1757480213 >> 172.21.15.29:0/1757480213 conn(0x55a2c53eab00 msgr2=0x55a2c5507110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- 172.21.15.29:0/1757480213 shutdown_connections 2024-04-23T10:27:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- 172.21.15.29:0/1757480213 wait complete. 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 -- start start 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.694+0000 7fcbfd335000 1 Processor -- start 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c55437f0 0x55a2c55bd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c5546a50 0x55a2c55bd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c5562f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a2c534f970 con 0x55a2c55437f0 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55a2c53058f0 con 0x55a2c55488b0 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55a2c5354c90 con 0x55a2c5546a50 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 10 client.0 _ll_register_callbacks cb 0x7fcbe80533b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c55437f0 0x55a2c55bd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c55437f0 0x55a2c55bd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36780/0 (socket says 172.21.15.29:36780) 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 -- 172.21.15.29:0/2183531557 learned_addr learned my addr 172.21.15.29:0/2183531557 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c5546a50 0x55a2c55bd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 -- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c5546a50 msgr2=0x55a2c55bd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c5546a50 0x55a2c55bd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 -- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 msgr2=0x55a2c5562f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf3fff640 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c5562f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c5562f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 -- 172.21.15.29:0/2183531557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c52e2ae0 con 0x55a2c55437f0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf37fe640 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c55437f0 0x55a2c55bd0f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009930 tx=0x7fcbe401d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647564131c2655c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbd27fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbd27fc640 1 -- 172.21.15.29:0/2183531557 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40cb040 con 0x55a2c55437f0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbd27fc640 1 -- 172.21.15.29:0/2183531557 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcbe40b06e0 con 0x55a2c55437f0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 -- 172.21.15.29:0/2183531557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbe805fc70 con 0x55a2c55437f0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbd27fc640 1 -- 172.21.15.29:0/2183531557 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fcbe40e1050 con 0x55a2c55437f0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 10 client.5670 fetch_fsmap learned FSMap version 18 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 -- 172.21.15.29:0/2183531557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a2c52e5d80 con 0x55a2c55437f0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbd27fc640 1 -- 172.21.15.29:0/2183531557 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe805fc70 con 0x55a2c55437f0 2024-04-23T10:27:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbd27fc640 1 -- 172.21.15.29:0/2183531557 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fcbe40e4020 con 0x55a2c55437f0 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 10 client.5670 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 10 client.5670 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 20 client.5670 populate_metadata read hostname 'smithi029' 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a2c55638d0 0x55a2c5563ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 4 client.5670 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ed48a87", "release": true, "await": true}] 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbfd335000 1 -- 172.21.15.29:0/2183531557 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ed48a87", "release": true, "await": true}) -- 0x55a2c52ee0d0 con 0x55a2c55638d0 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a2c55638d0 0x55a2c5563ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbf2ffd640 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a2c55638d0 0x55a2c5563ce0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbff39c9925c327c server_cookie=ed4c6bbbb33bdc3e in_seq=0 out_seq=0 2024-04-23T10:27:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.698+0000 7fcbd27fc640 10 client.5670 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:30.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbd27fc640 1 -- 172.21.15.29:0/2183531557 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55a2c52ee0d0 con 0x55a2c55638d0 2024-04-23T10:27:30.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbd27fc640 10 client.5670 handle_command_reply: tid=0 2024-04-23T10:27:30.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 client.5670 shutdown 2024-04-23T10:27:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 -- 172.21.15.29:0/2183531557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c55437f0 msgr2=0x55a2c55bd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c55437f0 0x55a2c55bd0f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009930 tx=0x7fcbe401d550 comp rx=0 tx=0).stop 2024-04-23T10:27:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 -- 172.21.15.29:0/2183531557 shutdown_connections 2024-04-23T10:27:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55a2c55638d0 0x55a2c5563ce0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2c55488b0 0x55a2c5562f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2c5546a50 0x55a2c55bd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 --2- 172.21.15.29:0/2183531557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a2c55437f0 0x55a2c55bd0f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 -- 172.21.15.29:0/2183531557 >> 172.21.15.29:0/2183531557 conn(0x55a2c53eab00 msgr2=0x55a2c55079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbd27fc640 0 client.5670 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 -- 172.21.15.29:0/2183531557 shutdown_connections 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 1 -- 172.21.15.29:0/2183531557 wait complete. 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfd335000 20 client.5670 trim_cache size 0 max 16384 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 44, 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:27:30.793 INFO:teuthology.orchestra.run.smithi029.stdout: "ed48a87": { 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 44, 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 90.0, 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:27:30.794 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:27:30.795 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:27:30.795 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:30.795 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:30.795 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:30.795 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:30.795 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:30.795 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcbe0068380 msgr2=0x7fcbe006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcbe0068380 0x7fcbe006a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40b2000 tx=0x7fcbe4008040 comp rx=0 tx=0).stop 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/654282851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf40ccc50 msgr2=0x7fcbf414aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf40ccc50 0x7fcbf414aad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d830 tx=0x7fcbe800dcf0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/654282851 shutdown_connections 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fcbe0068380 0x7fcbe006a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf4153190 0x7fcbf415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf40ccc50 0x7fcbf414aad0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 --2- 172.21.15.29:0/654282851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf406f150 0x7fcbf415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/654282851 >> 172.21.15.29:0/654282851 conn(0x7fcbf406cfb0 msgr2=0x7fcbf4151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/654282851 shutdown_connections 2024-04-23T10:27:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.794+0000 7fcbfa1b3640 1 -- 172.21.15.29:0/654282851 wait complete. 2024-04-23T10:27:30.809 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ed48a87', seconds elapsed: 34.1 2024-04-23T10:27:30.810 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-23T10:27:30.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:27:30.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c9e83640 1 Processor -- start 2024-04-23T10:27:30.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c9e83640 1 -- start start 2024-04-23T10:27:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c9e83640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4c40c6c30 0x7fa4c4158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c9e83640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c40cafc0 con 0x7fa4c4074d60 2024-04-23T10:27:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c9e83640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c415d480 con 0x7fa4c415d070 2024-04-23T10:27:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c9e83640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c415cbe0 con 0x7fa4c40c6c30 2024-04-23T10:27:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa4c4074d60 0x7fa4c40ca8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49156/0 (socket says 172.21.15.29:49156) 2024-04-23T10:27:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c37fe640 1 -- 172.21.15.29:0/2138850429 learned_addr learned my addr 172.21.15.29:0/2138850429 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:27:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c2ffd640 1 --2- 172.21.15.29:0/2138850429 >> v2:172.21.15.72:3300/0 conn(0x7fa4c40c6c30 0x7fa4c4158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523247592 0 0) 0x7fa4c40cafc0 con 0x7fa4c4074d60 2024-04-23T10:27:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4ac003530 con 0x7fa4c4074d60 2024-04-23T10:27:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3519571611 0 0) 0x7fa4ac003530 con 0x7fa4c4074d60 2024-04-23T10:27:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 >> v2:172.21.15.72:3300/0 conn(0x7fa4c40c6c30 msgr2=0x7fa4c4158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 --2- 172.21.15.29:0/2138850429 >> v2:172.21.15.72:3300/0 conn(0x7fa4c40c6c30 0x7fa4c4158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 >> v1:172.21.15.72:6789/0 conn(0x7fa4c415d070 legacy=0x7fa4c4152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c40c7160 con 0x7fa4c4074d60 2024-04-23T10:27:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fa4b40016a0 con 0x7fa4c4074d60 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 >> v1:172.21.15.29:6789/0 conn(0x7fa4c4074d60 legacy=0x7fa4c40ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0039c0 0x7fa4ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4ac004810 0x7fa4ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4ac0051d0 0x7fa4ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c415cbe0 con 0x7fa4ac0051d0 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac00c100 con 0x7fa4ac004810 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ac00c300 con 0x7fa4ac0039c0 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c3fff640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4ac0051d0 0x7fa4ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c2ffd640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4ac004810 0x7fa4ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c37fe640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0039c0 0x7fa4ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c3fff640 1 -- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0039c0 msgr2=0x7fa4ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c3fff640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0039c0 0x7fa4ac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c3fff640 1 -- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4ac004810 msgr2=0x7fa4ac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:30.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c3fff640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4ac004810 0x7fa4ac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c3fff640 1 -- 172.21.15.29:0/2138850429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac003530 con 0x7fa4ac0051d0 2024-04-23T10:27:30.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c2ffd640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4ac004810 0x7fa4ac004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:30.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.934+0000 7fa4c37fe640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0039c0 0x7fa4ac003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:30.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c3fff640 1 -- 172.21.15.29:0/2138850429 reap_dead start 2024-04-23T10:27:30.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c3fff640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4ac0051d0 0x7fa4ac00b9d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc001e70 tx=0x7fa4bc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd4c1ae4a9f67dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc001a90 con 0x7fa4ac0051d0 2024-04-23T10:27:30.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4bc003ba0 con 0x7fa4ac0051d0 2024-04-23T10:27:30.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c27fc640 1 -- 172.21.15.29:0/2138850429 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc005020 con 0x7fa4ac0051d0 2024-04-23T10:27:30.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2138850429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4ac0051d0 msgr2=0x7fa4ac00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4ac0051d0 0x7fa4ac00b9d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc001e70 tx=0x7fa4bc01c780 comp rx=0 tx=0).stop 2024-04-23T10:27:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2138850429 shutdown_connections 2024-04-23T10:27:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 --2- 172.21.15.29:0/2138850429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4ac0051d0 0x7fa4ac00b9d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2138850429 >> 172.21.15.29:0/2138850429 conn(0x7fa4c406b9e0 msgr2=0x7fa4c406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2138850429 shutdown_connections 2024-04-23T10:27:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2138850429 wait complete. 2024-04-23T10:27:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 Processor -- start 2024-04-23T10:27:30.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- start start 2024-04-23T10:27:30.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0051d0 0x7fa4c414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c414d8c0 0x7fa4c41f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c414e820 0x7fa4c4145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c40c7780 con 0x7fa4c414d8c0 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c40c7600 con 0x7fa4c414e820 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.938+0000 7fa4c9e83640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c40c79e0 con 0x7fa4ac0051d0 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c414d8c0 0x7fa4c41f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c414d8c0 0x7fa4c41f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36808/0 (socket says 172.21.15.29:36808) 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 -- 172.21.15.29:0/2715952805 learned_addr learned my addr 172.21.15.29:0/2715952805 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c37fe640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0051d0 0x7fa4c414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c3fff640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c414e820 0x7fa4c4145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 -- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0051d0 msgr2=0x7fa4c414ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0051d0 0x7fa4c414ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 -- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c414e820 msgr2=0x7fa4c4145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c414e820 0x7fa4c4145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 -- 172.21.15.29:0/2715952805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c41460e0 con 0x7fa4c414d8c0 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c3fff640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c414e820 0x7fa4c4145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c2ffd640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c414d8c0 0x7fa4c41f1be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800e870 tx=0x7fa4b800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4abfff640 1 -- 172.21.15.29:0/2715952805 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8017070 con 0x7fa4c414d8c0 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4abfff640 1 -- 172.21.15.29:0/2715952805 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b800c870 con 0x7fa4c414d8c0 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c414d1e0 con 0x7fa4c414d8c0 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4abfff640 1 -- 172.21.15.29:0/2715952805 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800f040 con 0x7fa4c414d8c0 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c414a640 con 0x7fa4c414d8c0 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c40693c0 con 0x7fa4c414d8c0 2024-04-23T10:27:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4abfff640 1 -- 172.21.15.29:0/2715952805 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa4b801a070 con 0x7fa4c414d8c0 2024-04-23T10:27:30.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4abfff640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa4b00683b0 0x7fa4b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:30.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4abfff640 1 -- 172.21.15.29:0/2715952805 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa4b80869d0 con 0x7fa4c414d8c0 2024-04-23T10:27:30.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c37fe640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa4b00683b0 0x7fa4b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:30.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.942+0000 7fa4c37fe640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa4b00683b0 0x7fa4b006a870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40011f0 tx=0x7fa4b4001540 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:30.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:30.946+0000 7fa4abfff640 1 -- 172.21.15.29:0/2715952805 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4b800ee60 con 0x7fa4c414d8c0 2024-04-23T10:27:31.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4c414f0c0 con 0x7fa4c414d8c0 2024-04-23T10:27:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4abfff640 1 -- 172.21.15.29:0/2715952805 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7fa4b8056ae0 con 0x7fa4c414d8c0 2024-04-23T10:27:31.156 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:27:31.156 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:27:31.156 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:27:31.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa4b00683b0 msgr2=0x7fa4b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa4b00683b0 0x7fa4b006a870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40011f0 tx=0x7fa4b4001540 comp rx=0 tx=0).stop 2024-04-23T10:27:31.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c414d8c0 msgr2=0x7fa4c41f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c414d8c0 0x7fa4c41f1be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800e870 tx=0x7fa4b800ed30 comp rx=0 tx=0).stop 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 shutdown_connections 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa4b00683b0 0x7fa4b006a870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c414e820 0x7fa4c4145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c414d8c0 0x7fa4c41f1be0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 --2- 172.21.15.29:0/2715952805 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4ac0051d0 0x7fa4c414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 >> 172.21.15.29:0/2715952805 conn(0x7fa4c406b9e0 msgr2=0x7fa4c40c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 shutdown_connections 2024-04-23T10:27:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.158+0000 7fa4c9e83640 1 -- 172.21.15.29:0/2715952805 wait complete. 2024-04-23T10:27:31.174 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-23T10:27:31.174 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-23T10:27:31.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f75390c0640 1 Processor -- start 2024-04-23T10:27:31.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f75390c0640 1 -- start start 2024-04-23T10:27:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f75390c0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75340c9490 0x7f75340c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f75390c0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753406fba0 con 0x7f7534144610 2024-04-23T10:27:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f75390c0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753406fe80 con 0x7f753415be90 2024-04-23T10:27:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f75390c0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7534070160 con 0x7f75340c9490 2024-04-23T10:27:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7532d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7534144610 0x7f75340c7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49170/0 (socket says 172.21.15.29:49170) 2024-04-23T10:27:31.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7532d9d640 1 -- 172.21.15.29:0/1317791094 learned_addr learned my addr 172.21.15.29:0/1317791094 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:27:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753359e640 1 --2- 172.21.15.29:0/1317791094 >> v2:172.21.15.72:3300/0 conn(0x7f75340c9490 0x7f75340c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469290183 0 0) 0x7f753406fba0 con 0x7f7534144610 2024-04-23T10:27:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7520003530 con 0x7f7534144610 2024-04-23T10:27:31.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2485626798 0 0) 0x7f7520003530 con 0x7f7534144610 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 >> v2:172.21.15.72:3300/0 conn(0x7f75340c9490 msgr2=0x7f75340c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 --2- 172.21.15.29:0/1317791094 >> v2:172.21.15.72:3300/0 conn(0x7f75340c9490 0x7f75340c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 >> v1:172.21.15.72:6789/0 conn(0x7f753415be90 legacy=0x7f7534074d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7534070440 con 0x7f7534144610 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f752c001a00 con 0x7f7534144610 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 >> v1:172.21.15.29:6789/0 conn(0x7f7534144610 legacy=0x7f75340c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75200039c0 0x7f7520003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7520004810 0x7f7520004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75200051d0 0x7f752000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7534070160 con 0x7f7520004810 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f752000c080 con 0x7f75200039c0 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f752000c280 con 0x7f75200051d0 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753259c640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7520004810 0x7f7520004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f7532d9d640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75200039c0 0x7f7520003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753359e640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75200051d0 0x7f752000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753259c640 1 -- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75200051d0 msgr2=0x7f752000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753259c640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75200051d0 0x7f752000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753259c640 1 -- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75200039c0 msgr2=0x7f7520003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753259c640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75200039c0 0x7f7520003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753259c640 1 -- 172.21.15.29:0/1317791094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7520003530 con 0x7f7520004810 2024-04-23T10:27:31.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753359e640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75200051d0 0x7f752000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:31.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.302+0000 7f753359e640 1 -- 172.21.15.29:0/1317791094 reap_dead start 2024-04-23T10:27:31.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f753259c640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7520004810 0x7f7520004c90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f751c001780 tx=0x7f751c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2122e394ee8b6bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:31.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0a8050 con 0x7f7520004810 2024-04-23T10:27:31.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f751c0052f0 con 0x7f7520004810 2024-04-23T10:27:31.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f7531d9b640 1 -- 172.21.15.29:0/1317791094 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0013a0 con 0x7f7520004810 2024-04-23T10:27:31.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f75390c0640 1 -- 172.21.15.29:0/1317791094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7520004810 msgr2=0x7f7520004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f75390c0640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7520004810 0x7f7520004c90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f751c001780 tx=0x7f751c01c400 comp rx=0 tx=0).stop 2024-04-23T10:27:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f75390c0640 1 -- 172.21.15.29:0/1317791094 shutdown_connections 2024-04-23T10:27:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f75390c0640 1 --2- 172.21.15.29:0/1317791094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7520004810 0x7f7520004c90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f75390c0640 1 -- 172.21.15.29:0/1317791094 >> 172.21.15.29:0/1317791094 conn(0x7f75340ca080 msgr2=0x7f75340ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f75390c0640 1 -- 172.21.15.29:0/1317791094 shutdown_connections 2024-04-23T10:27:31.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.306+0000 7f75390c0640 1 -- 172.21.15.29:0/1317791094 wait complete. 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 Processor -- start 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 -- start start 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7520004810 0x7f75341f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75341e5f30 0x7f753413ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7534140500 0x7f75341e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f753406f810 con 0x7f75341e5f30 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7534070720 con 0x7f7520004810 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f75340c98c0 con 0x7f7534140500 2024-04-23T10:27:31.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75341e5f30 0x7f753413ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75341e5f30 0x7f753413ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36826/0 (socket says 172.21.15.29:36826) 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 -- 172.21.15.29:0/1361468952 learned_addr learned my addr 172.21.15.29:0/1361468952 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f7532d9d640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7520004810 0x7f75341f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753359e640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7534140500 0x7f75341e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 -- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7534140500 msgr2=0x7f75341e69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7534140500 0x7f75341e69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 -- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7520004810 msgr2=0x7f75341f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7520004810 0x7f75341f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 -- 172.21.15.29:0/1361468952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75340c7940 con 0x7f75341e5f30 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f753259c640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75341e5f30 0x7f753413ffc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f751c01c230 tx=0x7f7520005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f752b7fe640 1 -- 172.21.15.29:0/1361468952 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0a8050 con 0x7f75341e5f30 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f752b7fe640 1 -- 172.21.15.29:0/1361468952 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f751c0ba070 con 0x7f75341e5f30 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 -- 172.21.15.29:0/1361468952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75341e4600 con 0x7f75341e5f30 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f752b7fe640 1 -- 172.21.15.29:0/1361468952 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0013a0 con 0x7f75341e5f30 2024-04-23T10:27:31.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f75390c0640 1 -- 172.21.15.29:0/1361468952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75341e4bc0 con 0x7f75341e5f30 2024-04-23T10:27:31.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.310+0000 7f752b7fe640 1 -- 172.21.15.29:0/1361468952 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f751c0052f0 con 0x7f75341e5f30 2024-04-23T10:27:31.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f752b7fe640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f75140683b0 0x7f751406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f752b7fe640 1 -- 172.21.15.29:0/1361468952 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f751c121110 con 0x7f75341e5f30 2024-04-23T10:27:31.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f75140683b0 0x7f751406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 Processor -- start 2024-04-23T10:27:31.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- start start 2024-04-23T10:27:31.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f75140683b0 0x7f751406a870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f752c005dc0 tx=0x7f752c002120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:31.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x5565454309e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x556545435aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x5565454363c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5565452dc2a0 con 0x556545430600 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5565452425f0 con 0x5565454356c0 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5565451dd820 con 0x556545435fe0 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x5565454309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x5565454309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36834/0 (socket says 172.21.15.29:36834) 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 -- 172.21.15.29:0/925015761 learned_addr learned my addr 172.21.15.29:0/925015761 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753359e640 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x5565454363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753259c640 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x556545435aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 -- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 msgr2=0x5565454363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x5565454363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 -- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 msgr2=0x556545435aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x556545435aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 -- 172.21.15.29:0/925015761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556545288c00 con 0x556545430600 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753259c640 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x556545435aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:31.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7532d9d640 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x5565454309e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f752c004c70 tx=0x7f752c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd354c13777a1dc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7528ff9640 1 -- 172.21.15.29:0/925015761 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c028070 con 0x556545430600 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7528ff9640 1 -- 172.21.15.29:0/925015761 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c005050 con 0x556545430600 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f7528ff9640 1 -- 172.21.15.29:0/925015761 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c005400 con 0x556545430600 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- 172.21.15.29:0/925015761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 msgr2=0x5565454309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x5565454309e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f752c004c70 tx=0x7f752c014000 comp rx=0 tx=0).stop 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- 172.21.15.29:0/925015761 shutdown_connections 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x5565454363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x556545435aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 --2- 172.21.15.29:0/925015761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x5565454309e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- 172.21.15.29:0/925015761 >> 172.21.15.29:0/925015761 conn(0x556545431470 msgr2=0x556545433890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- 172.21.15.29:0/925015761 shutdown_connections 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.314+0000 7f753c242000 1 -- 172.21.15.29:0/925015761 wait complete. 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 -- start start 2024-04-23T10:27:31.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 Processor -- start 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 0x55654542f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5565454356c0 0x55654542ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x55654543b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5565451edc60 con 0x5565454356c0 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5565452c4bf0 con 0x556545430600 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x5565452ff560 con 0x556545435fe0 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 10 client.0 _ll_register_callbacks cb 0x556545219570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5565454356c0 0x55654542ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5565454356c0 0x55654542ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36840/0 (socket says 172.21.15.29:36840) 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 -- 172.21.15.29:0/197448364 learned_addr learned my addr 172.21.15.29:0/197448364 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7532d9d640 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 0x55654542f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753359e640 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x55654543b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 -- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 msgr2=0x55654543b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x55654543b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 -- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 msgr2=0x55654542f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 0x55654542f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 -- 172.21.15.29:0/197448364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654527d630 con 0x5565454356c0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753259c640 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5565454356c0 0x55654542ff20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f751c0050a0 tx=0x7f751c007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce6195c19811d51 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7511ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7511ffb640 1 -- 172.21.15.29:0/197448364 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0f0160 con 0x5565454356c0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7511ffb640 1 -- 172.21.15.29:0/197448364 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f751c0f70c0 con 0x5565454356c0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 -- 172.21.15.29:0/197448364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f752c005050 con 0x5565454356c0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7511ffb640 1 -- 172.21.15.29:0/197448364 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f751c0076a0 con 0x5565454356c0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 10 client.5688 fetch_fsmap learned FSMap version 18 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 -- 172.21.15.29:0/197448364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5565451e2490 con 0x5565454356c0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7511ffb640 1 -- 172.21.15.29:0/197448364 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c005050 con 0x5565454356c0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7511ffb640 1 -- 172.21.15.29:0/197448364 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f751c118ae0 con 0x5565454356c0 2024-04-23T10:27:31.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 10 client.5688 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:27:31.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 10 client.5688 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:27:31.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 20 client.5688 populate_metadata read hostname 'smithi029' 2024-04-23T10:27:31.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55654543c360 0x55654543c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 4 client.5688 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:31.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f753c242000 1 -- 172.21.15.29:0/197448364 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565451dc7f0 con 0x55654543c360 2024-04-23T10:27:31.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7532d9d640 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55654543c360 0x55654543c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7511ffb640 10 client.5688 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:31.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.318+0000 7f7532d9d640 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55654543c360 0x55654543c770 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcef2b80c0690967 server_cookie=843373b28b161c3f in_seq=0 out_seq=0 2024-04-23T10:27:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f7511ffb640 1 -- 172.21.15.29:0/197448364 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5565451dc7f0 con 0x55654543c360 2024-04-23T10:27:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f7511ffb640 10 client.5688 handle_command_reply: tid=0 2024-04-23T10:27:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 client.5688 shutdown 2024-04-23T10:27:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 -- 172.21.15.29:0/197448364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5565454356c0 msgr2=0x55654542ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5565454356c0 0x55654542ff20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f751c0050a0 tx=0x7f751c007b00 comp rx=0 tx=0).stop 2024-04-23T10:27:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 -- 172.21.15.29:0/197448364 shutdown_connections 2024-04-23T10:27:31.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x55654543c360 0x55654543c770 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x55654543b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f7511ffb640 0 client.5688 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5565454356c0 0x55654542ff20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 --2- 172.21.15.29:0/197448364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 0x55654542f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 -- 172.21.15.29:0/197448364 >> 172.21.15.29:0/197448364 conn(0x556545431470 msgr2=0x5565454346b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 -- 172.21.15.29:0/197448364 shutdown_connections 2024-04-23T10:27:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 1 -- 172.21.15.29:0/197448364 wait complete. 2024-04-23T10:27:31.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.322+0000 7f753c242000 20 client.5688 trim_cache size 0 max 16384 2024-04-23T10:27:31.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753c242000 1 Processor -- start 2024-04-23T10:27:31.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753c242000 1 -- start start 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753c242000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 0x55654543df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753c242000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5565454356c0 0x556545446f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753c242000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545435fe0 0x556545447460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753c242000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f75341ff100 con 0x556545435fe0 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753c242000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f75341ff7d0 con 0x556545430600 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753c242000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f75341f5130 con 0x5565454356c0 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545435fe0 0x556545447460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545435fe0 0x556545447460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36852/0 (socket says 172.21.15.29:36852) 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753359e640 1 -- 172.21.15.29:0/2546682729 learned_addr learned my addr 172.21.15.29:0/2546682729 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:31.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753359e640 1 -- 172.21.15.29:0/2546682729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5565454356c0 msgr2=0x556545446f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753359e640 1 --2- 172.21.15.29:0/2546682729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5565454356c0 0x556545446f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f7532d9d640 1 --2- 172.21.15.29:0/2546682729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 0x55654543df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753359e640 1 -- 172.21.15.29:0/2546682729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 msgr2=0x55654543df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753359e640 1 --2- 172.21.15.29:0/2546682729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 0x55654543df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.338+0000 7f753359e640 1 -- 172.21.15.29:0/2546682729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565451dda70 con 0x556545435fe0 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753359e640 1 --2- 172.21.15.29:0/2546682729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545435fe0 0x556545447460 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f753415c290 tx=0x7f7524009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ab049edacd0ce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7513fff640 1 -- 172.21.15.29:0/2546682729 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752401c070 con 0x556545435fe0 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7513fff640 1 -- 172.21.15.29:0/2546682729 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524016c20 con 0x556545435fe0 2024-04-23T10:27:31.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7513fff640 1 -- 172.21.15.29:0/2546682729 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752400f040 con 0x556545435fe0 2024-04-23T10:27:31.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- 172.21.15.29:0/2546682729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545435fe0 msgr2=0x556545447460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:31.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 --2- 172.21.15.29:0/2546682729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545435fe0 0x556545447460 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f753415c290 tx=0x7f7524009190 comp rx=0 tx=0).stop 2024-04-23T10:27:31.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- 172.21.15.29:0/2546682729 shutdown_connections 2024-04-23T10:27:31.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 --2- 172.21.15.29:0/2546682729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545435fe0 0x556545447460 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 --2- 172.21.15.29:0/2546682729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x5565454356c0 0x556545446f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 --2- 172.21.15.29:0/2546682729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556545430600 0x55654543df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- 172.21.15.29:0/2546682729 >> 172.21.15.29:0/2546682729 conn(0x556545431470 msgr2=0x556545451230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- 172.21.15.29:0/2546682729 shutdown_connections 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- 172.21.15.29:0/2546682729 wait complete. 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- start start 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 Processor -- start 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x55654543da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x55654543df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x5565453f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556545241900 con 0x556545430600 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55654520ce60 con 0x5565454356c0 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x556545246c20 con 0x556545435fe0 2024-04-23T10:27:31.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 10 client.0 _ll_register_callbacks cb 0x7f751c001540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x55654543da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x55654543da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36856/0 (socket says 172.21.15.29:36856) 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 -- 172.21.15.29:0/1471744065 learned_addr learned my addr 172.21.15.29:0/1471744065 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753259c640 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x55654543df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 -- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 msgr2=0x5565453f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753359e640 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x5565453f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x5565453f6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 -- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 msgr2=0x55654543df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x55654543df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 -- 172.21.15.29:0/1471744065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565452c5080 con 0x556545430600 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7532d9d640 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x55654543da10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f752c0078b0 tx=0x7f752c001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236e430b2a2ea9d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7511ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7511ffb640 1 -- 172.21.15.29:0/1471744065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c028040 con 0x556545430600 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7511ffb640 1 -- 172.21.15.29:0/1471744065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f752c035c20 con 0x556545430600 2024-04-23T10:27:31.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- 172.21.15.29:0/1471744065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7524016c20 con 0x556545430600 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7511ffb640 1 -- 172.21.15.29:0/1471744065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f752c035e20 con 0x556545430600 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 10 client.5694 fetch_fsmap learned FSMap version 18 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- 172.21.15.29:0/1471744065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5565451e83e0 con 0x556545430600 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7511ffb640 1 -- 172.21.15.29:0/1471744065 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524016c20 con 0x556545430600 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f7511ffb640 1 -- 172.21.15.29:0/1471744065 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f752c02e040 con 0x556545430600 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 10 client.5694 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 10 client.5694 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 20 client.5694 populate_metadata read hostname 'smithi029' 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5565453f73c0 0x5565453f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 4 client.5694 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.342+0000 7f753c242000 1 -- 172.21.15.29:0/1471744065 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x5565451eb940 con 0x5565453f73c0 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.346+0000 7f753259c640 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5565453f73c0 0x5565453f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.346+0000 7f753259c640 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5565453f73c0 0x5565453f77d0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33b513f29b8d93ef server_cookie=3c59a82252f502ad in_seq=0 out_seq=0 2024-04-23T10:27:31.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:31.346+0000 7f7511ffb640 10 client.5694 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:34.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f7511ffb640 1 -- 172.21.15.29:0/1471744065 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5565451eb940 con 0x5565453f73c0 2024-04-23T10:27:34.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f7511ffb640 10 client.5694 handle_command_reply: tid=0 2024-04-23T10:27:34.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 client.5694 shutdown 2024-04-23T10:27:34.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 -- 172.21.15.29:0/1471744065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 msgr2=0x55654543da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:34.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x55654543da10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f752c0078b0 tx=0x7f752c001dd0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 -- 172.21.15.29:0/1471744065 shutdown_connections 2024-04-23T10:27:34.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x5565453f73c0 0x5565453f77d0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x556545435fe0 0x5565453f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5565454356c0 0x55654543df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 --2- 172.21.15.29:0/1471744065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556545430600 0x55654543da10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f7511ffb640 0 client.5694 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:27:34.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 -- 172.21.15.29:0/1471744065 >> 172.21.15.29:0/1471744065 conn(0x556545431470 msgr2=0x556545450010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:34.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 -- 172.21.15.29:0/1471744065 shutdown_connections 2024-04-23T10:27:34.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 1 -- 172.21.15.29:0/1471744065 wait complete. 2024-04-23T10:27:34.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f753c242000 20 client.5694 trim_cache size 0 max 16384 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 46, 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "1d552f69": { 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 46, 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:27:34.898 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 90.0, 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "QUIESCED", 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:27:34.899 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:27:34.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 -- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f75140683b0 msgr2=0x7f751406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:34.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f75140683b0 0x7f751406a870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f752c005dc0 tx=0x7f752c002120 comp rx=0 tx=0).stop 2024-04-23T10:27:34.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 -- 172.21.15.29:0/1361468952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75341e5f30 msgr2=0x7f753413ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:34.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75341e5f30 0x7f753413ffc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f751c01c230 tx=0x7f7520005840 comp rx=0 tx=0).stop 2024-04-23T10:27:34.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 -- 172.21.15.29:0/1361468952 shutdown_connections 2024-04-23T10:27:34.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f75140683b0 0x7f751406a870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7534140500 0x7f75341e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f75341e5f30 0x7f753413ffc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 --2- 172.21.15.29:0/1361468952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7520004810 0x7f75341f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:34.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 -- 172.21.15.29:0/1361468952 >> 172.21.15.29:0/1361468952 conn(0x7f75340ca080 msgr2=0x7f75340cc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:34.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 -- 172.21.15.29:0/1361468952 shutdown_connections 2024-04-23T10:27:34.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:27:34.898+0000 7f75390c0640 1 -- 172.21.15.29:0/1361468952 wait complete. 2024-04-23T10:27:34.924 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1d552f69', quiesce took 4.1 seconds. Will release after: 30.0 2024-04-23T10:27:52.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:27:52.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:28:04.925 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:28:05.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.062+0000 7f642d04d640 1 Processor -- start 2024-04-23T10:28:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.062+0000 7f642d04d640 1 -- start start 2024-04-23T10:28:05.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.062+0000 7f642d04d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f642806f790 0x7f64280c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.062+0000 7f642d04d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 0x7f6428073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642d04d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6428072590 con 0x7f642806f3b0 2024-04-23T10:28:05.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642d04d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6428072fe0 con 0x7f642806f790 2024-04-23T10:28:05.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642d04d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6428158df0 con 0x7f6428071160 2024-04-23T10:28:05.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6426d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f642806f3b0 0x7f6428157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59284/0 (socket says 172.21.15.29:59284) 2024-04-23T10:28:05.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6426d9d640 1 -- 172.21.15.29:0/1395463989 learned_addr learned my addr 172.21.15.29:0/1395463989 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642759e640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 0x7f6428073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642659c640 1 --2- 172.21.15.29:0/1395463989 >> v2:172.21.15.72:3300/0 conn(0x7f642806f790 0x7f64280c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049746466 0 0) 0x7f6428072590 con 0x7f642806f3b0 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6414005740 con 0x7f642806f3b0 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3607326216 0 0) 0x7f6414005740 con 0x7f642806f3b0 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 msgr2=0x7f6428073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 0x7f6428073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 >> v2:172.21.15.72:3300/0 conn(0x7f642806f790 msgr2=0x7f64280c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 --2- 172.21.15.29:0/1395463989 >> v2:172.21.15.72:3300/0 conn(0x7f642806f790 0x7f64280c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6428158830 con 0x7f642806f3b0 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f6418001680 con 0x7f642806f3b0 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 >> v1:172.21.15.29:6789/0 conn(0x7f642806f3b0 legacy=0x7f6428157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 0x7f6414005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64140061a0 0x7f6414006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6414006f60 0x7f64140073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6428072fe0 con 0x7f6414006f60 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6428158df0 con 0x7f64140061a0 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f641400dbe0 con 0x7f6428071160 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642759e640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6414006f60 0x7f64140073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642659c640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64140061a0 0x7f6414006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6426d9d640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 0x7f6414005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642759e640 1 -- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 msgr2=0x7f6414005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642759e640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 0x7f6414005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642759e640 1 -- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64140061a0 msgr2=0x7f6414006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642759e640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64140061a0 0x7f6414006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642759e640 1 -- 172.21.15.29:0/1395463989 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6414005740 con 0x7f6414006f60 2024-04-23T10:28:05.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6426d9d640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6428071160 0x7f6414005bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f642759e640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6414006f60 0x7f64140073e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f642000e170 tx=0x7f642001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a398315f2b449775 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64200b2070 con 0x7f6414006f60 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64200a5c70 con 0x7f6414006f60 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.066+0000 7f6425d9b640 1 -- 172.21.15.29:0/1395463989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420009c10 con 0x7f6414006f60 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- 172.21.15.29:0/1395463989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6414006f60 msgr2=0x7f64140073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 --2- 172.21.15.29:0/1395463989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6414006f60 0x7f64140073e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f642000e170 tx=0x7f642001cc60 comp rx=0 tx=0).stop 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642759e640 1 -- 172.21.15.29:0/1395463989 reap_dead start 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- 172.21.15.29:0/1395463989 shutdown_connections 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- 172.21.15.29:0/1395463989 >> 172.21.15.29:0/1395463989 conn(0x7f642806cfb0 msgr2=0x7f642806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- 172.21.15.29:0/1395463989 shutdown_connections 2024-04-23T10:28:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- 172.21.15.29:0/1395463989 wait complete. 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 Processor -- start 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- start start 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6414006f60 0x7f64281f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64280cc8f0 0x7f64280ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64280c8460 0x7f64280c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6428072c70 con 0x7f64280cc8f0 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6428072990 con 0x7f6414006f60 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6428158500 con 0x7f64280c8460 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64280cc8f0 0x7f64280ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64280cc8f0 0x7f64280ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37188/0 (socket says 172.21.15.29:37188) 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 -- 172.21.15.29:0/3239909996 learned_addr learned my addr 172.21.15.29:0/3239909996 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642759e640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64280c8460 0x7f64280c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f6426d9d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6414006f60 0x7f64281f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 -- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64280c8460 msgr2=0x7f64280c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64280c8460 0x7f64280c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 -- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6414006f60 msgr2=0x7f64281f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6414006f60 0x7f64281f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 -- 172.21.15.29:0/3239909996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64280c8e00 con 0x7f64280cc8f0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f6426d9d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6414006f60 0x7f64281f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642659c640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64280cc8f0 0x7f64280ccd30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f64100115c0 tx=0x7f6410011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f641f7fe640 1 -- 172.21.15.29:0/3239909996 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641000f9b0 con 0x7f64280cc8f0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f641f7fe640 1 -- 172.21.15.29:0/3239909996 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641000fb50 con 0x7f64280cc8f0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64281f09e0 con 0x7f64280cc8f0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f641f7fe640 1 -- 172.21.15.29:0/3239909996 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410015460 con 0x7f64280cc8f0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.070+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6428157420 con 0x7f64280cc8f0 2024-04-23T10:28:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.074+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6428068d70 con 0x7f64280cc8f0 2024-04-23T10:28:05.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.074+0000 7f641f7fe640 1 -- 172.21.15.29:0/3239909996 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6410015600 con 0x7f64280cc8f0 2024-04-23T10:28:05.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.074+0000 7f641f7fe640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f64080683b0 0x7f640806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.074+0000 7f641f7fe640 1 -- 172.21.15.29:0/3239909996 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f64100876b0 con 0x7f64280cc8f0 2024-04-23T10:28:05.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.074+0000 7f6426d9d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f64080683b0 0x7f640806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.074+0000 7f6426d9d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f64080683b0 0x7f640806a870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64180017f0 tx=0x7f6418001bb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.078+0000 7f641f7fe640 1 -- 172.21.15.29:0/3239909996 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6410019030 con 0x7f64280cc8f0 2024-04-23T10:28:05.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.274+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64281575f0 con 0x7f64280cc8f0 2024-04-23T10:28:05.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.274+0000 7f641f7fe640 1 -- 172.21.15.29:0/3239909996 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f6410057840 con 0x7f64280cc8f0 2024-04-23T10:28:05.273 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:05.273 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:28:05.274 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f64080683b0 msgr2=0x7f640806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f64080683b0 0x7f640806a870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64180017f0 tx=0x7f6418001bb0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64280cc8f0 msgr2=0x7f64280ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64280cc8f0 0x7f64280ccd30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f64100115c0 tx=0x7f6410011a80 comp rx=0 tx=0).stop 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 shutdown_connections 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f64080683b0 0x7f640806a870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64280c8460 0x7f64280c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64280cc8f0 0x7f64280ccd30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 --2- 172.21.15.29:0/3239909996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6414006f60 0x7f64281f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 >> 172.21.15.29:0/3239909996 conn(0x7f642806cfb0 msgr2=0x7f64281506e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 shutdown_connections 2024-04-23T10:28:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.278+0000 7f642d04d640 1 -- 172.21.15.29:0/3239909996 wait complete. 2024-04-23T10:28:05.291 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --set-id 1d552f69 --release --await' 2024-04-23T10:28:05.291 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --set-id 1d552f69 --release --await 2024-04-23T10:28:05.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5139e64640 1 Processor -- start 2024-04-23T10:28:05.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5139e64640 1 -- start start 2024-04-23T10:28:05.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5139e64640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5134151bb0 0x7f513415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5139e64640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51340c5900 0x7f51340c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5139e64640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513406c910 con 0x7f51340cb770 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5139e64640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f513406cbf0 con 0x7f5134151bb0 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5139e64640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f513406ced0 con 0x7f51340c5900 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f51337fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5134151bb0 0x7f513415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5133fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f51340cb770 0x7f51340c6840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59286/0 (socket says 172.21.15.29:59286) 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5133fff640 1 -- 172.21.15.29:0/137018722 learned_addr learned my addr 172.21.15.29:0/137018722 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f51337fe640 1 -- 172.21.15.29:0/137018722 >> v2:172.21.15.72:3300/0 conn(0x7f51340c5900 msgr2=0x7f51340c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f5132ffd640 1 --2- 172.21.15.29:0/137018722 >> v2:172.21.15.72:3300/0 conn(0x7f51340c5900 0x7f51340c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f51327fc640 1 -- 172.21.15.29:0/137018722 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970178293 0 0) 0x7f513406c910 con 0x7f51340cb770 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f51337fe640 1 --2- 172.21.15.29:0/137018722 >> v2:172.21.15.72:3300/0 conn(0x7f51340c5900 0x7f51340c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f51337fe640 1 -- 172.21.15.29:0/137018722 >> v1:172.21.15.29:6789/0 conn(0x7f51340cb770 legacy=0x7f51340c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.414+0000 7f51337fe640 1 -- 172.21.15.29:0/137018722 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513406d1b0 con 0x7f5134151bb0 2024-04-23T10:28:05.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 --2- 172.21.15.29:0/137018722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5134151bb0 0x7f513415bd80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f51340cb6e0 tx=0x7f512401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948e5bc1ca1d3001 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51327fc640 1 -- 172.21.15.29:0/137018722 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240b5070 con 0x7f5134151bb0 2024-04-23T10:28:05.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51327fc640 1 -- 172.21.15.29:0/137018722 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240a8970 con 0x7f5134151bb0 2024-04-23T10:28:05.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51327fc640 1 -- 172.21.15.29:0/137018722 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240a8d40 con 0x7f5134151bb0 2024-04-23T10:28:05.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- 172.21.15.29:0/137018722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5134151bb0 msgr2=0x7f513415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 --2- 172.21.15.29:0/137018722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5134151bb0 0x7f513415bd80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f51340cb6e0 tx=0x7f512401ec70 comp rx=0 tx=0).stop 2024-04-23T10:28:05.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- 172.21.15.29:0/137018722 shutdown_connections 2024-04-23T10:28:05.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 --2- 172.21.15.29:0/137018722 >> v2:172.21.15.72:3300/0 conn(0x7f51340c5900 0x7f51340c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 --2- 172.21.15.29:0/137018722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5134151bb0 0x7f513415bd80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- 172.21.15.29:0/137018722 >> 172.21.15.29:0/137018722 conn(0x7f51340730f0 msgr2=0x7f5134073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:05.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- 172.21.15.29:0/137018722 shutdown_connections 2024-04-23T10:28:05.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- 172.21.15.29:0/137018722 wait complete. 2024-04-23T10:28:05.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 Processor -- start 2024-04-23T10:28:05.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- start start 2024-04-23T10:28:05.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51340c5900 0x7f5134157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51340cb770 0x7f513415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5134151bb0 0x7f5134147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f51340c6f50 con 0x7f51340c5900 2024-04-23T10:28:05.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5134151f90 con 0x7f5134151bb0 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f51340c70d0 con 0x7f51340cb770 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51340c5900 0x7f5134157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51340c5900 0x7f5134157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37202/0 (socket says 172.21.15.29:37202) 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 -- 172.21.15.29:0/1430253402 learned_addr learned my addr 172.21.15.29:0/1430253402 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5133fff640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5134151bb0 0x7f5134147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 -- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51340cb770 msgr2=0x7f513415a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5132ffd640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51340cb770 0x7f513415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51340cb770 0x7f513415a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 -- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5134151bb0 msgr2=0x7f5134147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5134151bb0 0x7f5134147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 -- 172.21.15.29:0/1430253402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513415dfa0 con 0x7f51340c5900 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f51337fe640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51340c5900 0x7f5134157530 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f512401c8a0 tx=0x7f512401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f511bfff640 1 -- 172.21.15.29:0/1430253402 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240c0070 con 0x7f51340c5900 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f511bfff640 1 -- 172.21.15.29:0/1430253402 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5124004230 con 0x7f51340c5900 2024-04-23T10:28:05.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- 172.21.15.29:0/1430253402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513415e280 con 0x7f51340c5900 2024-04-23T10:28:05.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f511bfff640 1 -- 172.21.15.29:0/1430253402 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240b5040 con 0x7f51340c5900 2024-04-23T10:28:05.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.418+0000 7f5139e64640 1 -- 172.21.15.29:0/1430253402 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5134157010 con 0x7f51340c5900 2024-04-23T10:28:05.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f511bfff640 1 -- 172.21.15.29:0/1430253402 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51240c3070 con 0x7f51340c5900 2024-04-23T10:28:05.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f511bfff640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5120068380 0x7f512006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f511bfff640 1 -- 172.21.15.29:0/1430253402 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f51241238f0 con 0x7f51340c5900 2024-04-23T10:28:05.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5120068380 0x7f512006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f513cfe6000 1 Processor -- start 2024-04-23T10:28:05.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f513cfe6000 1 -- start start 2024-04-23T10:28:05.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5120068380 0x7f512006a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51340cdae0 tx=0x7f5128008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109dc38a0 0x561109d8c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109d8cf00 0x561109d8d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 0x561109dc8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f513cfe6000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561109bd4660 con 0x561109d8cf00 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f513cfe6000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561109b795d0 con 0x561109dc8120 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f513cfe6000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x561109bd0620 con 0x561109dc38a0 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109d8cf00 0x561109d8d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109d8cf00 0x561109d8d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37210/0 (socket says 172.21.15.29:37210) 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 -- 172.21.15.29:0/11355527 learned_addr learned my addr 172.21.15.29:0/11355527 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f51337fe640 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109dc38a0 0x561109d8c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 -- 172.21.15.29:0/11355527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109dc38a0 msgr2=0x561109d8c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5133fff640 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 0x561109dc8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109dc38a0 0x561109d8c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 -- 172.21.15.29:0/11355527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 msgr2=0x561109dc8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 0x561109dc8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 -- 172.21.15.29:0/11355527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561109badbd0 con 0x561109d8cf00 2024-04-23T10:28:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f5132ffd640 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109d8cf00 0x561109d8d2e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f512800db60 tx=0x7f5128010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84a0831279b83a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f51197fa640 1 -- 172.21.15.29:0/11355527 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128019050 con 0x561109d8cf00 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f51197fa640 1 -- 172.21.15.29:0/11355527 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5128023070 con 0x561109d8cf00 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.422+0000 7f51197fa640 1 -- 172.21.15.29:0/11355527 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128012bb0 con 0x561109d8cf00 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- 172.21.15.29:0/11355527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109d8cf00 msgr2=0x561109d8d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109d8cf00 0x561109d8d2e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f512800db60 tx=0x7f5128010000 comp rx=0 tx=0).stop 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- 172.21.15.29:0/11355527 shutdown_connections 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 0x561109dc8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109d8cf00 0x561109d8d2e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 --2- 172.21.15.29:0/11355527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109dc38a0 0x561109d8c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- 172.21.15.29:0/11355527 >> 172.21.15.29:0/11355527 conn(0x561109c6eb00 msgr2=0x561109dc5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- 172.21.15.29:0/11355527 shutdown_connections 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- 172.21.15.29:0/11355527 wait complete. 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- start start 2024-04-23T10:28:05.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 Processor -- start 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109dc2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 0x561109dc2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109d87900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561109c91d40 con 0x561109dc8120 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561109b8eeb0 con 0x561109dc38a0 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x561109bcf2a0 con 0x561109d8cf00 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 10 client.0 _ll_register_callbacks cb 0x561109d72a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109d87900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109d87900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37220/0 (socket says 172.21.15.29:37220) 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 -- 172.21.15.29:0/1845768184 learned_addr learned my addr 172.21.15.29:0/1845768184 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5132ffd640 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 0x561109dc2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51337fe640 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109dc2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 -- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 msgr2=0x561109dc2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109dc2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 -- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 msgr2=0x561109dc2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 0x561109dc2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 -- 172.21.15.29:0/1845768184 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561109c1ab30 con 0x561109dc8120 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51337fe640 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109dc2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f5133fff640 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109d87900 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f512c00e310 tx=0x7f512c00e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500e1603d957c1df server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51127fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51127fc640 1 -- 172.21.15.29:0/1845768184 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c019060 con 0x561109dc8120 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51127fc640 1 -- 172.21.15.29:0/1845768184 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f512c0070d0 con 0x561109dc8120 2024-04-23T10:28:05.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- 172.21.15.29:0/1845768184 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561109b6e060 con 0x561109dc8120 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51127fc640 1 -- 172.21.15.29:0/1845768184 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f512c0072d0 con 0x561109dc8120 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 10 client.5715 fetch_fsmap learned FSMap version 18 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- 172.21.15.29:0/1845768184 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561109b73b70 con 0x561109dc8120 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51127fc640 1 -- 172.21.15.29:0/1845768184 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x561109b6e060 con 0x561109dc8120 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51127fc640 1 -- 172.21.15.29:0/1845768184 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f512c007470 con 0x561109dc8120 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 10 client.5715 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 10 client.5715 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 20 client.5715 populate_metadata read hostname 'smithi029' 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x561109d88670 0x561109d88a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 4 client.5715 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f513cfe6000 1 -- 172.21.15.29:0/1845768184 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561109bace30 con 0x561109d88670 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.426+0000 7f51337fe640 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x561109d88670 0x561109d88a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f51337fe640 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x561109d88670 0x561109d88a80 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bfdf765cd037652 server_cookie=d3f1b7d8f4f6999e in_seq=0 out_seq=0 2024-04-23T10:28:05.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f51127fc640 10 client.5715 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f51127fc640 1 -- 172.21.15.29:0/1845768184 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561109bace30 con 0x561109d88670 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f51127fc640 10 client.5715 handle_command_reply: tid=0 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 client.5715 shutdown 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 -- 172.21.15.29:0/1845768184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 msgr2=0x561109d87900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109d87900 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f512c00e310 tx=0x7f512c00e7d0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 -- 172.21.15.29:0/1845768184 shutdown_connections 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x561109d88670 0x561109d88a80 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109d87900 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 0x561109dc2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f51127fc640 0 client.5715 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 --2- 172.21.15.29:0/1845768184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109dc2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 -- 172.21.15.29:0/1845768184 >> 172.21.15.29:0/1845768184 conn(0x561109c6eb00 msgr2=0x561109dc79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 -- 172.21.15.29:0/1845768184 shutdown_connections 2024-04-23T10:28:05.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 1 -- 172.21.15.29:0/1845768184 wait complete. 2024-04-23T10:28:05.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.430+0000 7f513cfe6000 20 client.5715 trim_cache size 0 max 16384 2024-04-23T10:28:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f513cfe6000 1 Processor -- start 2024-04-23T10:28:05.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f513cfe6000 1 -- start start 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109d8b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc38a0 0x561109d8b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 0x561109ddeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f513cfe6000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f51341fe460 con 0x561109dc38a0 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f513cfe6000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f51341feb30 con 0x561109dc8120 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f513cfe6000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f51341fcbd0 con 0x561109d8cf00 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f5132ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc38a0 0x561109d8b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f5132ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc38a0 0x561109d8b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37222/0 (socket says 172.21.15.29:37222) 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f5132ffd640 1 -- 172.21.15.29:0/3988845074 learned_addr learned my addr 172.21.15.29:0/3988845074 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f5132ffd640 1 -- 172.21.15.29:0/3988845074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 msgr2=0x561109d8b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f5132ffd640 1 --2- 172.21.15.29:0/3988845074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109d8b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f5132ffd640 1 -- 172.21.15.29:0/3988845074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 msgr2=0x561109ddeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f5132ffd640 1 --2- 172.21.15.29:0/3988845074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 0x561109ddeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.446+0000 7f5132ffd640 1 -- 172.21.15.29:0/3988845074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561109c565e0 con 0x561109dc38a0 2024-04-23T10:28:05.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5132ffd640 1 --2- 172.21.15.29:0/3988845074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc38a0 0x561109d8b830 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f512800db00 tx=0x7f5128012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7f1ae94584fe9c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5118ff9640 1 -- 172.21.15.29:0/3988845074 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128012990 con 0x561109dc38a0 2024-04-23T10:28:05.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5118ff9640 1 -- 172.21.15.29:0/3988845074 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5128023070 con 0x561109dc38a0 2024-04-23T10:28:05.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5118ff9640 1 -- 172.21.15.29:0/3988845074 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128012d90 con 0x561109dc38a0 2024-04-23T10:28:05.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- 172.21.15.29:0/3988845074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc38a0 msgr2=0x561109d8b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 --2- 172.21.15.29:0/3988845074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc38a0 0x561109d8b830 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f512800db00 tx=0x7f5128012000 comp rx=0 tx=0).stop 2024-04-23T10:28:05.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- 172.21.15.29:0/3988845074 shutdown_connections 2024-04-23T10:28:05.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 --2- 172.21.15.29:0/3988845074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc8120 0x561109ddeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 --2- 172.21.15.29:0/3988845074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc38a0 0x561109d8b830 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 --2- 172.21.15.29:0/3988845074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109d8b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- 172.21.15.29:0/3988845074 >> 172.21.15.29:0/3988845074 conn(0x561109c6eb00 msgr2=0x561109dc3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- 172.21.15.29:0/3988845074 shutdown_connections 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- 172.21.15.29:0/3988845074 wait complete. 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- start start 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 Processor -- start 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109e35f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 0x561109e36460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109de0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561109bd3970 con 0x561109dc8120 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x561109b898f0 con 0x561109dc38a0 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x561109bd8c90 con 0x561109d8cf00 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 10 client.0 _ll_register_callbacks cb 0x7f512c007e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:05.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109de0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109de0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37238/0 (socket says 172.21.15.29:37238) 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 -- 172.21.15.29:0/2750923505 learned_addr learned my addr 172.21.15.29:0/2750923505 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f51337fe640 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109e35f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 -- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 msgr2=0x561109e35f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109e35f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5132ffd640 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 0x561109e36460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 -- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 msgr2=0x561109e36460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 0x561109e36460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 -- 172.21.15.29:0/2750923505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561109b66ae0 con 0x561109dc8120 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f5133fff640 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109de0e30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f512c009010 tx=0x7f512c001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76daef946415c07 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f51127fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f51127fc640 1 -- 172.21.15.29:0/2750923505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c0020c0 con 0x561109dc8120 2024-04-23T10:28:05.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- 172.21.15.29:0/2750923505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5128023070 con 0x561109dc8120 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f51127fc640 1 -- 172.21.15.29:0/2750923505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f512c013440 con 0x561109dc8120 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f51127fc640 1 -- 172.21.15.29:0/2750923505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f512c033050 con 0x561109dc8120 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 10 client.5721 fetch_fsmap learned FSMap version 18 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- 172.21.15.29:0/2750923505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561109b69d80 con 0x561109dc8120 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f51127fc640 1 -- 172.21.15.29:0/2750923505 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5128023070 con 0x561109dc8120 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f51127fc640 1 -- 172.21.15.29:0/2750923505 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f512c036020 con 0x561109dc8120 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 10 client.5721 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 10 client.5721 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 20 client.5721 populate_metadata read hostname 'smithi029' 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x561109de1c70 0x561109de2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 4 client.5721 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1d552f69", "release": true, "await": true}] 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f513cfe6000 1 -- 172.21.15.29:0/2750923505 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1d552f69", "release": true, "await": true}) -- 0x561109b720d0 con 0x561109de1c70 2024-04-23T10:28:05.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.450+0000 7f51337fe640 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x561109de1c70 0x561109de2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:05.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.454+0000 7f51337fe640 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x561109de1c70 0x561109de2080 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247579f6275ecbce server_cookie=597cccdcbaea34a in_seq=0 out_seq=0 2024-04-23T10:28:05.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.454+0000 7f51127fc640 10 client.5721 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:28:05.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f51127fc640 1 -- 172.21.15.29:0/2750923505 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x561109b720d0 con 0x561109de1c70 2024-04-23T10:28:05.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f51127fc640 10 client.5721 handle_command_reply: tid=0 2024-04-23T10:28:05.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 client.5721 shutdown 2024-04-23T10:28:05.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 -- 172.21.15.29:0/2750923505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 msgr2=0x561109de0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109de0e30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f512c009010 tx=0x7f512c001490 comp rx=0 tx=0).stop 2024-04-23T10:28:05.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 -- 172.21.15.29:0/2750923505 shutdown_connections 2024-04-23T10:28:05.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x561109de1c70 0x561109de2080 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561109dc8120 0x561109de0e30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561109dc38a0 0x561109e36460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f51127fc640 0 client.5721 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 --2- 172.21.15.29:0/2750923505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x561109d8cf00 0x561109e35f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 -- 172.21.15.29:0/2750923505 >> 172.21.15.29:0/2750923505 conn(0x561109c6eb00 msgr2=0x561109de3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 -- 172.21.15.29:0/2750923505 shutdown_connections 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 1 -- 172.21.15.29:0/2750923505 wait complete. 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f513cfe6000 20 client.5721 trim_cache size 0 max 16384 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 48, 2024-04-23T10:28:05.565 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": { 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "1d552f69": { 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "version": 48, 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "age_ref": 0.0, 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "timeout": 60.0, 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "expiration": 90.0, 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "members": { 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "file:/": { 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "excluded": false, 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "state": { 2024-04-23T10:28:05.566 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RELEASED", 2024-04-23T10:28:05.567 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0 2024-04-23T10:28:05.567 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:28:05.567 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:28:05.567 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:28:05.567 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:28:05.567 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-23T10:28:05.567 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 -- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5120068380 msgr2=0x7f512006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5120068380 0x7f512006a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51340cdae0 tx=0x7f5128008040 comp rx=0 tx=0).stop 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 -- 172.21.15.29:0/1430253402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51340c5900 msgr2=0x7f5134157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51340c5900 0x7f5134157530 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f512401c8a0 tx=0x7f512401ba10 comp rx=0 tx=0).stop 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 -- 172.21.15.29:0/1430253402 shutdown_connections 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5120068380 0x7f512006a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5134151bb0 0x7f5134147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51340cb770 0x7f513415a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 --2- 172.21.15.29:0/1430253402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51340c5900 0x7f5134157530 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 -- 172.21.15.29:0/1430253402 >> 172.21.15.29:0/1430253402 conn(0x7f51340730f0 msgr2=0x7f51340cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 -- 172.21.15.29:0/1430253402 shutdown_connections 2024-04-23T10:28:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:05.566+0000 7f5139e64640 1 -- 172.21.15.29:0/1430253402 wait complete. 2024-04-23T10:28:05.585 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1d552f69', seconds elapsed: 34.8 2024-04-23T10:28:22.286 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:28:22.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:28:37.494 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-23T10:28:37.494 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-23T10:28:37.824 DEBUG:teuthology.parallel:result is None 2024-04-23T10:28:37.825 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T10:28:37.857 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T10:28:37.857 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-23T10:28:37.866 INFO:tasks.quiescer:joining Quiescers 2024-04-23T10:28:37.866 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-04-23T10:28:37.867 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:28:38.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b48da6640 1 Processor -- start 2024-04-23T10:28:38.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b48da6640 1 -- start start 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b48da6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b44153190 0x7f7b44159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b48da6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7b4406f150 0x7f7b4406f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b48da6640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b440c3fe0 con 0x7f7b440ccc50 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b48da6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7b44159380 con 0x7f7b4406f150 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b48da6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7b440c42c0 con 0x7f7b44153190 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b41d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7b4406f150 0x7f7b4406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b41d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7b4406f150 0x7f7b4406f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58240/0 (socket says 172.21.15.29:58240) 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b41d9b640 1 -- 172.21.15.29:0/283642289 learned_addr learned my addr 172.21.15.29:0/283642289 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b4259c640 1 --2- 172.21.15.29:0/283642289 >> v2:172.21.15.72:3300/0 conn(0x7f7b44153190 0x7f7b44159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b41d9b640 1 -- 172.21.15.29:0/283642289 >> v2:172.21.15.72:3300/0 conn(0x7f7b44153190 msgr2=0x7f7b44159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b41d9b640 1 --2- 172.21.15.29:0/283642289 >> v2:172.21.15.72:3300/0 conn(0x7f7b44153190 0x7f7b44159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b41d9b640 1 -- 172.21.15.29:0/283642289 >> v1:172.21.15.72:6789/0 conn(0x7f7b440ccc50 legacy=0x7f7b440cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.029+0000 7f7b41d9b640 1 -- 172.21.15.29:0/283642289 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b440c45a0 con 0x7f7b4406f150 2024-04-23T10:28:38.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b41d9b640 1 --2- 172.21.15.29:0/283642289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b4406f150 0x7f7b4406f580 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7b44159500 tx=0x7f7b3801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29728394146f7298 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b4159a640 1 -- 172.21.15.29:0/283642289 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b380b5070 con 0x7f7b4406f150 2024-04-23T10:28:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b4159a640 1 -- 172.21.15.29:0/283642289 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b380a89d0 con 0x7f7b4406f150 2024-04-23T10:28:38.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b4159a640 1 -- 172.21.15.29:0/283642289 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b380a8da0 con 0x7f7b4406f150 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- 172.21.15.29:0/283642289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b4406f150 msgr2=0x7f7b4406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 --2- 172.21.15.29:0/283642289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b4406f150 0x7f7b4406f580 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7b44159500 tx=0x7f7b3801ecd0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- 172.21.15.29:0/283642289 shutdown_connections 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 --2- 172.21.15.29:0/283642289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b4406f150 0x7f7b4406f580 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 --2- 172.21.15.29:0/283642289 >> v2:172.21.15.72:3300/0 conn(0x7f7b44153190 0x7f7b44159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- 172.21.15.29:0/283642289 >> 172.21.15.29:0/283642289 conn(0x7f7b4406cfb0 msgr2=0x7f7b4406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- 172.21.15.29:0/283642289 shutdown_connections 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- 172.21.15.29:0/283642289 wait complete. 2024-04-23T10:28:38.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 Processor -- start 2024-04-23T10:28:38.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- start start 2024-04-23T10:28:38.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b4406f150 0x7f7b441498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b440ccc50 0x7f7b4414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b44153190 0x7f7b4414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7b440c4880 con 0x7f7b44153190 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7b44153570 con 0x7f7b440ccc50 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.033+0000 7f7b48da6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7b440c9070 con 0x7f7b4406f150 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b44153190 0x7f7b4414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b44153190 0x7f7b4414d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58248/0 (socket says 172.21.15.29:58248) 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 -- 172.21.15.29:0/3413440769 learned_addr learned my addr 172.21.15.29:0/3413440769 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b41d9b640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b440ccc50 0x7f7b4414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 -- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b4406f150 msgr2=0x7f7b441498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b4259c640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b4406f150 0x7f7b441498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b4406f150 0x7f7b441498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 -- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b440ccc50 msgr2=0x7f7b4414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b440ccc50 0x7f7b4414d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 -- 172.21.15.29:0/3413440769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b441ef8b0 con 0x7f7b44153190 2024-04-23T10:28:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b42d9d640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b44153190 0x7f7b4414d6a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c7b0 tx=0x7f7b3c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b32ffd640 1 -- 172.21.15.29:0/3413440769 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c004b70 con 0x7f7b44153190 2024-04-23T10:28:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b32ffd640 1 -- 172.21.15.29:0/3413440769 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c004d10 con 0x7f7b44153190 2024-04-23T10:28:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b32ffd640 1 -- 172.21.15.29:0/3413440769 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00aa90 con 0x7f7b44153190 2024-04-23T10:28:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b440ca6d0 con 0x7f7b44153190 2024-04-23T10:28:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b440cac90 con 0x7f7b44153190 2024-04-23T10:28:38.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b44068d70 con 0x7f7b44153190 2024-04-23T10:28:38.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b32ffd640 1 -- 172.21.15.29:0/3413440769 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b3c00ac30 con 0x7f7b44153190 2024-04-23T10:28:38.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b32ffd640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7b24068380 0x7f7b2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b32ffd640 1 -- 172.21.15.29:0/3413440769 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7b3c0870b0 con 0x7f7b44153190 2024-04-23T10:28:38.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.037+0000 7f7b4259c640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7b24068380 0x7f7b2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.041+0000 7f7b4259c640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7b24068380 0x7f7b2406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7b340096f0 tx=0x7f7b34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.041+0000 7f7b32ffd640 1 -- 172.21.15.29:0/3413440769 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b3c020070 con 0x7f7b44153190 2024-04-23T10:28:38.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.273+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b44156920 con 0x7f7b44153190 2024-04-23T10:28:38.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.273+0000 7f7b32ffd640 1 -- 172.21.15.29:0/3413440769 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f7b3c057250 con 0x7f7b44153190 2024-04-23T10:28:38.272 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:38.272 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:28:38.273 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7b24068380 msgr2=0x7f7b2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7b24068380 0x7f7b2406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7b340096f0 tx=0x7f7b34008040 comp rx=0 tx=0).stop 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b44153190 msgr2=0x7f7b4414d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b44153190 0x7f7b4414d6a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c7b0 tx=0x7f7b3c00cc70 comp rx=0 tx=0).stop 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 shutdown_connections 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f7b24068380 0x7f7b2406a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b44153190 0x7f7b4414d6a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b440ccc50 0x7f7b4414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 --2- 172.21.15.29:0/3413440769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b4406f150 0x7f7b441498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 >> 172.21.15.29:0/3413440769 conn(0x7f7b4406cfb0 msgr2=0x7f7b44157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 shutdown_connections 2024-04-23T10:28:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.277+0000 7f7b48da6640 1 -- 172.21.15.29:0/3413440769 wait complete. 2024-04-23T10:28:38.292 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4288 quiesce db --cancel --all' 2024-04-23T10:28:38.292 DEBUG:teuthology.orchestra.run.smithi029:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4288 quiesce db --cancel --all 2024-04-23T10:28:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2b9ef640 1 Processor -- start 2024-04-23T10:28:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2b9ef640 1 -- start start 2024-04-23T10:28:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2b9ef640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e241554d0 0x7f4e240c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2b9ef640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e2406ec30 con 0x7f4e2415f010 2024-04-23T10:28:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2b9ef640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e2406dac0 con 0x7f4e2406e760 2024-04-23T10:28:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2b9ef640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2406e3f0 con 0x7f4e241554d0 2024-04-23T10:28:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e29f8c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4e2415f010 0x7f4e24165ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55104/0 (socket says 172.21.15.29:55104) 2024-04-23T10:28:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e29f8c640 1 -- 172.21.15.29:0/457146830 learned_addr learned my addr 172.21.15.29:0/457146830 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2978b640 1 --2- 172.21.15.29:0/457146830 >> v2:172.21.15.72:3300/0 conn(0x7f4e241554d0 0x7f4e240c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e1bfff640 1 -- 172.21.15.29:0/457146830 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1252455866 0 0) 0x7f4e2406ec30 con 0x7f4e2415f010 2024-04-23T10:28:38.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e1bfff640 1 -- 172.21.15.29:0/457146830 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e10003530 con 0x7f4e2415f010 2024-04-23T10:28:38.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e1bfff640 1 -- 172.21.15.29:0/457146830 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 905742966 0 0) 0x7f4e10003530 con 0x7f4e2415f010 2024-04-23T10:28:38.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2978b640 1 -- 172.21.15.29:0/457146830 >> v1:172.21.15.72:6789/0 conn(0x7f4e2406e760 legacy=0x7f4e2415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2978b640 1 -- 172.21.15.29:0/457146830 >> v1:172.21.15.29:6789/0 conn(0x7f4e2415f010 legacy=0x7f4e24165ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.417+0000 7f4e2978b640 1 -- 172.21.15.29:0/457146830 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2406dda0 con 0x7f4e241554d0 2024-04-23T10:28:38.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e2978b640 1 --2- 172.21.15.29:0/457146830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e241554d0 0x7f4e240c29c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4e140097c0 tx=0x7f4e1401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f42fc64d884cc783 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e1bfff640 1 -- 172.21.15.29:0/457146830 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e140b0070 con 0x7f4e241554d0 2024-04-23T10:28:38.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e1bfff640 1 -- 172.21.15.29:0/457146830 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e140a4e50 con 0x7f4e241554d0 2024-04-23T10:28:38.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e1bfff640 1 -- 172.21.15.29:0/457146830 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c001a00 con 0x7f4e241554d0 2024-04-23T10:28:38.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/457146830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e241554d0 msgr2=0x7f4e240c29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e2b9ef640 1 --2- 172.21.15.29:0/457146830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e241554d0 0x7f4e240c29c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4e140097c0 tx=0x7f4e1401c3c0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/457146830 shutdown_connections 2024-04-23T10:28:38.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e2b9ef640 1 --2- 172.21.15.29:0/457146830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e241554d0 0x7f4e240c29c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/457146830 >> 172.21.15.29:0/457146830 conn(0x7f4e240c9a90 msgr2=0x7f4e240c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/457146830 shutdown_connections 2024-04-23T10:28:38.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.421+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/457146830 wait complete. 2024-04-23T10:28:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 Processor -- start 2024-04-23T10:28:38.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 -- start start 2024-04-23T10:28:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2406e760 0x7f4e2414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e241554d0 0x7f4e24149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2415f010 0x7f4e241f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4e240c3080 con 0x7f4e241554d0 2024-04-23T10:28:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4e240c2f00 con 0x7f4e2415f010 2024-04-23T10:28:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4e240c3200 con 0x7f4e2406e760 2024-04-23T10:28:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e241554d0 0x7f4e24149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e241554d0 0x7f4e24149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58260/0 (socket says 172.21.15.29:58260) 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 -- 172.21.15.29:0/3251778024 learned_addr learned my addr 172.21.15.29:0/3251778024 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e29f8c640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2415f010 0x7f4e241f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2406e760 0x7f4e2414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 -- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2406e760 msgr2=0x7f4e2414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2406e760 0x7f4e2414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 -- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2415f010 msgr2=0x7f4e241f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2415f010 0x7f4e241f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 -- 172.21.15.29:0/3251778024 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e241f8550 con 0x7f4e241554d0 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2406e760 0x7f4e2414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e241554d0 0x7f4e24149700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c500 tx=0x7f4e2000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e19ffb640 1 -- 172.21.15.29:0/3251778024 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e200052d0 con 0x7f4e241554d0 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e19ffb640 1 -- 172.21.15.29:0/3251778024 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e20005470 con 0x7f4e241554d0 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/3251778024 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e241f8830 con 0x7f4e241554d0 2024-04-23T10:28:38.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e19ffb640 1 -- 172.21.15.29:0/3251778024 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e20012830 con 0x7f4e241554d0 2024-04-23T10:28:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.425+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/3251778024 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2414e890 con 0x7f4e241554d0 2024-04-23T10:28:38.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e19ffb640 1 -- 172.21.15.29:0/3251778024 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e200129d0 con 0x7f4e241554d0 2024-04-23T10:28:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e19ffb640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e08068380 0x7f4e0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e19ffb640 1 -- 172.21.15.29:0/3251778024 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4e20086970 con 0x7f4e241554d0 2024-04-23T10:28:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e08068380 0x7f4e0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 Processor -- start 2024-04-23T10:28:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- start start 2024-04-23T10:28:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e08068380 0x7f4e0806a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4e140ad000 tx=0x7f4e140a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a3431d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a3431dab0 0x557a34322460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a343229a0 0x557a34322d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557a341c8b30 con 0x557a3431d190 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557a3412f2c0 con 0x557a343229a0 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x557a340e84c0 con 0x557a3431dab0 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a3431d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a3431d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58272/0 (socket says 172.21.15.29:58272) 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 -- 172.21.15.29:0/2947691140 learned_addr learned my addr 172.21.15.29:0/2947691140 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/2947691140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a3431dab0 0x557a34322460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 -- 172.21.15.29:0/2947691140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a3431dab0 msgr2=0x557a34322460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 --2- 172.21.15.29:0/2947691140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a3431dab0 0x557a34322460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 -- 172.21.15.29:0/2947691140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a343229a0 msgr2=0x557a34322d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 --2- 172.21.15.29:0/2947691140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a343229a0 0x557a34322d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 -- 172.21.15.29:0/2947691140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a34129eb0 con 0x557a3431d190 2024-04-23T10:28:38.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2978b640 1 --2- 172.21.15.29:0/2947691140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a3431d570 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4e14097d10 tx=0x7f4e14004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39f25cfbc5dd819 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e0effd640 1 -- 172.21.15.29:0/2947691140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e140b0040 con 0x557a3431d190 2024-04-23T10:28:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e0effd640 1 -- 172.21.15.29:0/2947691140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e140c5070 con 0x557a3431d190 2024-04-23T10:28:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e0effd640 1 -- 172.21.15.29:0/2947691140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e140044e0 con 0x557a3431d190 2024-04-23T10:28:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- 172.21.15.29:0/2947691140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 msgr2=0x557a3431d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/2947691140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a3431d570 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4e14097d10 tx=0x7f4e14004740 comp rx=0 tx=0).stop 2024-04-23T10:28:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- 172.21.15.29:0/2947691140 shutdown_connections 2024-04-23T10:28:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/2947691140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a343229a0 0x557a34322d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/2947691140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a3431dab0 0x557a34322460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/2947691140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a3431d570 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- 172.21.15.29:0/2947691140 >> 172.21.15.29:0/2947691140 conn(0x557a3431e210 msgr2=0x557a34320600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- 172.21.15.29:0/2947691140 shutdown_connections 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.429+0000 7f4e2eb71000 1 -- 172.21.15.29:0/2947691140 wait complete. 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 -- start start 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 Processor -- start 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a342e6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a342e6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a3432b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557a3412b280 con 0x557a3431d190 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557a340ed9d0 con 0x557a3431dab0 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x557a340d41b0 con 0x557a343229a0 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 10 client.0 _ll_register_callbacks cb 0x557a341e3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a342e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a342e6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58284/0 (socket says 172.21.15.29:58284) 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 -- 172.21.15.29:0/1178374760 learned_addr learned my addr 172.21.15.29:0/1178374760 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a342e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 -- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 msgr2=0x557a3432b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e29f8c640 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a3432b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a3432b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 -- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 msgr2=0x557a342e6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a342e6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 -- 172.21.15.29:0/1178374760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a340b2e70 con 0x557a3431d190 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a342e6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2978b640 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a342e6450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4e14097d10 tx=0x7f4e1401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb61f12dc8bd0eb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e03fff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e03fff640 1 -- 172.21.15.29:0/1178374760 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e140b0040 con 0x557a3431d190 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e03fff640 1 -- 172.21.15.29:0/1178374760 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4e140b5720 con 0x557a3431d190 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 -- 172.21.15.29:0/1178374760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e140c5070 con 0x557a3431d190 2024-04-23T10:28:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e03fff640 1 -- 172.21.15.29:0/1178374760 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4e140b5920 con 0x557a3431d190 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 10 client.5739 fetch_fsmap learned FSMap version 18 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 -- 172.21.15.29:0/1178374760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x557a340e8710 con 0x557a3431d190 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e03fff640 1 -- 172.21.15.29:0/1178374760 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e140c5070 con 0x557a3431d190 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e03fff640 1 -- 172.21.15.29:0/1178374760 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f4e140b5ac0 con 0x557a3431d190 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 10 client.5739 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 10 client.5739 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 20 client.5739 populate_metadata read hostname 'smithi029' 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x557a3432bf50 0x557a3432c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 4 client.5739 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e2eb71000 1 -- 172.21.15.29:0/1178374760 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a340c8df0 con 0x557a3432bf50 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x557a3432bf50 0x557a3432c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x557a3432bf50 0x557a3432c330 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e087f9147bd177d server_cookie=8e6138a4e818eab in_seq=0 out_seq=0 2024-04-23T10:28:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.433+0000 7f4e03fff640 10 client.5739 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:28:38.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e03fff640 1 -- 172.21.15.29:0/1178374760 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557a340c8df0 con 0x557a3432bf50 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e03fff640 10 client.5739 handle_command_reply: tid=0 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 client.5739 shutdown 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 -- 172.21.15.29:0/1178374760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 msgr2=0x557a342e6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a342e6450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4e14097d10 tx=0x7f4e1401ac00 comp rx=0 tx=0).stop 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 -- 172.21.15.29:0/1178374760 shutdown_connections 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x557a3432bf50 0x557a3432c330 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a3432b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a342e6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e03fff640 0 client.5739 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/1178374760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a342e6450 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 -- 172.21.15.29:0/1178374760 >> 172.21.15.29:0/1178374760 conn(0x557a3431e210 msgr2=0x557a34320600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 -- 172.21.15.29:0/1178374760 shutdown_connections 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 1 -- 172.21.15.29:0/1178374760 wait complete. 2024-04-23T10:28:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.437+0000 7f4e2eb71000 20 client.5739 trim_cache size 0 max 16384 2024-04-23T10:28:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2eb71000 1 Processor -- start 2024-04-23T10:28:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2eb71000 1 -- start start 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a34321a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a34320600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a34320b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24201ce0 con 0x557a3431d190 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4e242023b0 con 0x557a3431dab0 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4e240cc540 con 0x557a343229a0 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2978b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a34321a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2978b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a34321a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58290/0 (socket says 172.21.15.29:58290) 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2978b640 1 -- 172.21.15.29:0/3126507394 learned_addr learned my addr 172.21.15.29:0/3126507394 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:38.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2978b640 1 -- 172.21.15.29:0/3126507394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 msgr2=0x557a34320b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3126507394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a34320b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2978b640 1 -- 172.21.15.29:0/3126507394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 msgr2=0x557a34320600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/3126507394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a34320600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3126507394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a34320600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.453+0000 7f4e2978b640 1 -- 172.21.15.29:0/3126507394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a342dfd50 con 0x557a3431d190 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3126507394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a34321a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4e1401c8a0 tx=0x7f4e140ca000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141c78b161fe0e17 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e0e7fc640 1 -- 172.21.15.29:0/3126507394 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e140b0040 con 0x557a3431d190 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e0e7fc640 1 -- 172.21.15.29:0/3126507394 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e140c5040 con 0x557a3431d190 2024-04-23T10:28:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e0e7fc640 1 -- 172.21.15.29:0/3126507394 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e140044e0 con 0x557a3431d190 2024-04-23T10:28:38.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3126507394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 msgr2=0x557a34321a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3126507394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a34321a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4e1401c8a0 tx=0x7f4e140ca000 comp rx=0 tx=0).stop 2024-04-23T10:28:38.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3126507394 shutdown_connections 2024-04-23T10:28:38.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3126507394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a34320b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3126507394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431dab0 0x557a34320600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3126507394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431d190 0x557a34321a30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3126507394 >> 172.21.15.29:0/3126507394 conn(0x557a3431e210 msgr2=0x557a342def30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3126507394 shutdown_connections 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3126507394 wait complete. 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- start start 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 Processor -- start 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431d190 0x557a34321cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431dab0 0x557a34391340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a34391880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557a3412e5d0 con 0x557a3431dab0 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557a340cf3d0 con 0x557a3431d190 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x557a341338f0 con 0x557a343229a0 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 10 client.0 _ll_register_callbacks cb 0x7f4e10003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431dab0 0x557a34391340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431dab0 0x557a34391340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58298/0 (socket says 172.21.15.29:58298) 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 -- 172.21.15.29:0/3123394424 learned_addr learned my addr 172.21.15.29:0/3123394424 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431d190 0x557a34321cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e29f8c640 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a34391880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 -- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 msgr2=0x557a34391880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a34391880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 -- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431d190 msgr2=0x557a34321cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431d190 0x557a34321cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 -- 172.21.15.29:0/3123394424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3431d8e0 con 0x557a3431dab0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e28f8a640 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431dab0 0x557a34391340 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4e2005ead0 tx=0x7f4e20075040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a99c96a429527 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e03fff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e03fff640 1 -- 172.21.15.29:0/3123394424 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2005f000 con 0x557a3431dab0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e03fff640 1 -- 172.21.15.29:0/3123394424 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4e20052a90 con 0x557a3431dab0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3123394424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e140c5040 con 0x557a3431dab0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e03fff640 1 -- 172.21.15.29:0/3123394424 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4e20012cc0 con 0x557a3431dab0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 10 client.5745 fetch_fsmap learned FSMap version 18 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3123394424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x557a341b19f0 con 0x557a3431dab0 2024-04-23T10:28:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e03fff640 1 -- 172.21.15.29:0/3123394424 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e140c5040 con 0x557a3431dab0 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e03fff640 1 -- 172.21.15.29:0/3123394424 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f4e2007e0c0 con 0x557a3431dab0 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 10 client.5745 fetch_fsmap finished waiting for FSMap version 18 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 10 client.5745 resolve_mds: validated gid 4288 aka daemon mds.f 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 20 client.5745 populate_metadata read hostname 'smithi029' 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x557a34390120 0x557a34390530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 4 client.5745 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.457+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3123394424 --> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x557a3413cce0 con 0x557a34390120 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x557a34390120 0x557a34390530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e03fff640 10 client.5745 ms_handle_connect on v2:172.21.15.72:6836/4284551087 2024-04-23T10:28:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2978b640 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x557a34390120 0x557a34390530 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3aa1d3e1c26871d server_cookie=eb5087ebbad89015 in_seq=0 out_seq=0 2024-04-23T10:28:38.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e03fff640 1 -- 172.21.15.29:0/3123394424 <== mds.0 v2:172.21.15.72:6836/4284551087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x557a3413cce0 con 0x557a34390120 2024-04-23T10:28:38.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e03fff640 10 client.5745 handle_command_reply: tid=0 2024-04-23T10:28:38.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 client.5745 shutdown 2024-04-23T10:28:38.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3123394424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431dab0 msgr2=0x557a34391340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431dab0 0x557a34391340 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4e2005ead0 tx=0x7f4e20075040 comp rx=0 tx=0).stop 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3123394424 shutdown_connections 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:6836/4284551087,v1:172.21.15.72:6838/4284551087] conn(0x557a34390120 0x557a34390530 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x557a343229a0 0x557a34391880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557a3431dab0 0x557a34391340 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e03fff640 0 client.5745 ms_handle_reset on v2:172.21.15.72:6836/4284551087 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 --2- 172.21.15.29:0/3123394424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a3431d190 0x557a34321cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3123394424 >> 172.21.15.29:0/3123394424 conn(0x557a3431e210 msgr2=0x557a342dd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3123394424 shutdown_connections 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 1 -- 172.21.15.29:0/3123394424 wait complete. 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2eb71000 20 client.5745 trim_cache size 0 max 16384 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-04-23T10:28:38.464 INFO:teuthology.orchestra.run.smithi029.stdout: "leader": 4288, 2024-04-23T10:28:38.465 INFO:teuthology.orchestra.run.smithi029.stdout: "set_version": 48, 2024-04-23T10:28:38.465 INFO:teuthology.orchestra.run.smithi029.stdout: "sets": {} 2024-04-23T10:28:38.465 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e08068380 msgr2=0x7f4e0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e08068380 0x7f4e0806a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4e140ad000 tx=0x7f4e140a6000 comp rx=0 tx=0).stop 2024-04-23T10:28:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/3251778024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e241554d0 msgr2=0x7f4e24149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e241554d0 0x7f4e24149700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c500 tx=0x7f4e2000c9c0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/3251778024 shutdown_connections 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f4e08068380 0x7f4e0806a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2415f010 0x7f4e241f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e241554d0 0x7f4e24149700 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 --2- 172.21.15.29:0/3251778024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2406e760 0x7f4e2414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/3251778024 >> 172.21.15.29:0/3251778024 conn(0x7f4e240c9a90 msgr2=0x7f4e2414ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/3251778024 shutdown_connections 2024-04-23T10:28:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.461+0000 7f4e2b9ef640 1 -- 172.21.15.29:0/3251778024 wait complete. 2024-04-23T10:28:38.478 INFO:tasks.quiescer:done joining Quiescers 2024-04-23T10:28:38.478 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-23T10:28:38.486 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-23T10:28:38.486 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:28:38.487 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:28:38.491 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:28:38.491 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:28:38.538 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:28:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.709+0000 7fdd3fffd640 1 Processor -- start 2024-04-23T10:28:38.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.709+0000 7fdd3fffd640 1 -- start start 2024-04-23T10:28:38.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3fffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd38153190 0x7fdd38159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3fffd640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd380c3fe0 con 0x7fdd380cd360 2024-04-23T10:28:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3fffd640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd380c42c0 con 0x7fdd3806f150 2024-04-23T10:28:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3fffd640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fdd38159380 con 0x7fdd38153190 2024-04-23T10:28:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3e59a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdd380cd360 0x7fdd38163880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55118/0 (socket says 172.21.15.29:55118) 2024-04-23T10:28:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3e59a640 1 -- 172.21.15.29:0/4207225355 learned_addr learned my addr 172.21.15.29:0/4207225355 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3dd99640 1 --2- 172.21.15.29:0/4207225355 >> v2:172.21.15.72:3300/0 conn(0x7fdd38153190 0x7fdd38159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271639079 0 0) 0x7fdd380c3fe0 con 0x7fdd380cd360 2024-04-23T10:28:38.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd24003530 con 0x7fdd380cd360 2024-04-23T10:28:38.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4084938776 0 0) 0x7fdd24003530 con 0x7fdd380cd360 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 >> v2:172.21.15.72:3300/0 conn(0x7fdd38153190 msgr2=0x7fdd38159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 --2- 172.21.15.29:0/4207225355 >> v2:172.21.15.72:3300/0 conn(0x7fdd38153190 0x7fdd38159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 >> v1:172.21.15.72:6789/0 conn(0x7fdd3806f150 legacy=0x7fdd380ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd380c45a0 con 0x7fdd380cd360 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fdd30001a00 con 0x7fdd380cd360 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 >> v1:172.21.15.29:6789/0 conn(0x7fdd380cd360 legacy=0x7fdd38163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd240039c0 0x7fdd24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd240051d0 0x7fdd2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38159380 con 0x7fdd24004810 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2400c080 con 0x7fdd240051d0 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2400c280 con 0x7fdd240039c0 2024-04-23T10:28:38.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3d598640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3e59a640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd240051d0 0x7fdd2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3dd99640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd240039c0 0x7fdd24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3d598640 1 -- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd240039c0 msgr2=0x7fdd24003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3d598640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd240039c0 0x7fdd24003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3d598640 1 -- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd240051d0 msgr2=0x7fdd2400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3d598640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd240051d0 0x7fdd2400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3d598640 1 -- 172.21.15.29:0/4207225355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd24003530 con 0x7fdd24004810 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3e59a640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd240051d0 0x7fdd2400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:38.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.713+0000 7fdd3e59a640 1 -- 172.21.15.29:0/4207225355 reap_dead start 2024-04-23T10:28:38.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3d598640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd24004c90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdd28001780 tx=0x7fdd2801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2d86faa53efa5b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd280013a0 con 0x7fdd24004810 2024-04-23T10:28:38.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd280052f0 con 0x7fdd24004810 2024-04-23T10:28:38.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3cd97640 1 -- 172.21.15.29:0/4207225355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28003840 con 0x7fdd24004810 2024-04-23T10:28:38.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- 172.21.15.29:0/4207225355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 msgr2=0x7fdd24004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd24004c90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdd28001780 tx=0x7fdd2801c400 comp rx=0 tx=0).stop 2024-04-23T10:28:38.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- 172.21.15.29:0/4207225355 shutdown_connections 2024-04-23T10:28:38.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 --2- 172.21.15.29:0/4207225355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd24004c90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- 172.21.15.29:0/4207225355 >> 172.21.15.29:0/4207225355 conn(0x7fdd3806cfb0 msgr2=0x7fdd3806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- 172.21.15.29:0/4207225355 shutdown_connections 2024-04-23T10:28:38.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- 172.21.15.29:0/4207225355 wait complete. 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 Processor -- start 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- start start 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd381f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd38150930 0x7fdd38155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd38150d70 0x7fdd38156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdd380c4880 con 0x7fdd24004810 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38153570 con 0x7fdd38150930 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3fffd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdd380c9070 con 0x7fdd38150d70 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd381f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd381f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58310/0 (socket says 172.21.15.29:58310) 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 -- 172.21.15.29:0/1385281761 learned_addr learned my addr 172.21.15.29:0/1385281761 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3d598640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd38150930 0x7fdd38155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3e59a640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd38150d70 0x7fdd38156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 -- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd38150d70 msgr2=0x7fdd38156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd38150d70 0x7fdd38156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 -- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd38150930 msgr2=0x7fdd38155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd38150930 0x7fdd38155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 -- 172.21.15.29:0/1385281761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd380ca8f0 con 0x7fdd24004810 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3d598640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd38150930 0x7fdd38155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.717+0000 7fdd3dd99640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd381f18f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdd34011660 tx=0x7fdd34011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd2e7fc640 1 -- 172.21.15.29:0/1385281761 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400f9c0 con 0x7fdd24004810 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd2e7fc640 1 -- 172.21.15.29:0/1385281761 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3400fb60 con 0x7fdd24004810 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd2e7fc640 1 -- 172.21.15.29:0/1385281761 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34015460 con 0x7fdd24004810 2024-04-23T10:28:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd380cabd0 con 0x7fdd24004810 2024-04-23T10:28:38.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd380cb190 con 0x7fdd24004810 2024-04-23T10:28:38.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd38068d70 con 0x7fdd24004810 2024-04-23T10:28:38.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd2e7fc640 1 -- 172.21.15.29:0/1385281761 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd34015600 con 0x7fdd24004810 2024-04-23T10:28:38.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd2e7fc640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdd1c068380 0x7fdd1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:38.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd2e7fc640 1 -- 172.21.15.29:0/1385281761 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fdd34087970 con 0x7fdd24004810 2024-04-23T10:28:38.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd3d598640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdd1c068380 0x7fdd1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:38.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.721+0000 7fdd3d598640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdd1c068380 0x7fdd1c06a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd28004000 tx=0x7fdd280011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:38.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.725+0000 7fdd2e7fc640 1 -- 172.21.15.29:0/1385281761 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd34019030 con 0x7fdd24004810 2024-04-23T10:28:38.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.893+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd38157aa0 con 0x7fdd24004810 2024-04-23T10:28:38.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.893+0000 7fdd2e7fc640 1 -- 172.21.15.29:0/1385281761 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18877 (secure 0 0 0) 0x7fdd34057a70 con 0x7fdd24004810 2024-04-23T10:28:38.893 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:38.893 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:16:26.277550+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.893+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdd1c068380 msgr2=0x7fdd1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.893+0000 7fdd3fffd640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdd1c068380 0x7fdd1c06a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd28004000 tx=0x7fdd280011a0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 msgr2=0x7fdd381f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd381f18f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdd34011660 tx=0x7fdd34011b20 comp rx=0 tx=0).stop 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 shutdown_connections 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdd1c068380 0x7fdd1c06a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd38150d70 0x7fdd38156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd38150930 0x7fdd38155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 --2- 172.21.15.29:0/1385281761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd24004810 0x7fdd381f18f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 >> 172.21.15.29:0/1385281761 conn(0x7fdd3806cfb0 msgr2=0x7fdd38074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 shutdown_connections 2024-04-23T10:28:38.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:38.897+0000 7fdd3fffd640 1 -- 172.21.15.29:0/1385281761 wait complete. 2024-04-23T10:28:38.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:28:38.913 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:28:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff5b540640 1 Processor -- start 2024-04-23T10:28:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff5b540640 1 -- start start 2024-04-23T10:28:39.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff5b540640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff54153190 0x7eff54159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff5b540640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7eff540cd360 0x7eff5406f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff5b540640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff540c3fe0 con 0x7eff5406f150 2024-04-23T10:28:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff5b540640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7eff54159380 con 0x7eff540cd360 2024-04-23T10:28:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff5b540640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7eff540c42c0 con 0x7eff54153190 2024-04-23T10:28:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff58adb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7eff5406f150 0x7eff540ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55128/0 (socket says 172.21.15.29:55128) 2024-04-23T10:28:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff59add640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7eff540cd360 0x7eff5406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff58adb640 1 -- 172.21.15.29:0/3706912430 learned_addr learned my addr 172.21.15.29:0/3706912430 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff592dc640 1 --2- 172.21.15.29:0/3706912430 >> v2:172.21.15.72:3300/0 conn(0x7eff54153190 0x7eff54159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff4bfff640 1 -- 172.21.15.29:0/3706912430 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470932507 0 0) 0x7eff540c3fe0 con 0x7eff5406f150 2024-04-23T10:28:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff4bfff640 1 -- 172.21.15.29:0/3706912430 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff40003530 con 0x7eff5406f150 2024-04-23T10:28:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff59add640 1 -- 172.21.15.29:0/3706912430 >> v2:172.21.15.72:3300/0 conn(0x7eff54153190 msgr2=0x7eff54159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff59add640 1 --2- 172.21.15.29:0/3706912430 >> v2:172.21.15.72:3300/0 conn(0x7eff54153190 0x7eff54159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff59add640 1 -- 172.21.15.29:0/3706912430 >> v1:172.21.15.29:6789/0 conn(0x7eff5406f150 legacy=0x7eff540ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.037+0000 7eff59add640 1 -- 172.21.15.29:0/3706912430 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff540c45a0 con 0x7eff540cd360 2024-04-23T10:28:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff59add640 1 --2- 172.21.15.29:0/3706912430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5406f580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7eff54159500 tx=0x7eff4c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c545a09ba8a38c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff4bfff640 1 -- 172.21.15.29:0/3706912430 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0b4070 con 0x7eff540cd360 2024-04-23T10:28:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff4bfff640 1 -- 172.21.15.29:0/3706912430 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c0af600 con 0x7eff540cd360 2024-04-23T10:28:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff4bfff640 1 -- 172.21.15.29:0/3706912430 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0af9d0 con 0x7eff540cd360 2024-04-23T10:28:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- 172.21.15.29:0/3706912430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 msgr2=0x7eff5406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 --2- 172.21.15.29:0/3706912430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5406f580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7eff54159500 tx=0x7eff4c01f110 comp rx=0 tx=0).stop 2024-04-23T10:28:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- 172.21.15.29:0/3706912430 shutdown_connections 2024-04-23T10:28:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 --2- 172.21.15.29:0/3706912430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5406f580 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 --2- 172.21.15.29:0/3706912430 >> v2:172.21.15.72:3300/0 conn(0x7eff54153190 0x7eff54159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- 172.21.15.29:0/3706912430 >> 172.21.15.29:0/3706912430 conn(0x7eff5406cfb0 msgr2=0x7eff5406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- 172.21.15.29:0/3706912430 shutdown_connections 2024-04-23T10:28:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- 172.21.15.29:0/3706912430 wait complete. 2024-04-23T10:28:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 Processor -- start 2024-04-23T10:28:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- start start 2024-04-23T10:28:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5406f150 0x7eff540cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff54153190 0x7eff541e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7eff540c4880 con 0x7eff540cd360 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7eff54153570 con 0x7eff5406f150 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff5b540640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7eff540c9070 con 0x7eff54153190 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff58adb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff58adb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5414ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58314/0 (socket says 172.21.15.29:58314) 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.041+0000 7eff58adb640 1 -- 172.21.15.29:0/1995524269 learned_addr learned my addr 172.21.15.29:0/1995524269 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff59add640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff54153190 0x7eff541e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff592dc640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5406f150 0x7eff540cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff58adb640 1 -- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff54153190 msgr2=0x7eff541e56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff58adb640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff54153190 0x7eff541e56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff58adb640 1 -- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5406f150 msgr2=0x7eff540cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff58adb640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5406f150 0x7eff540cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff58adb640 1 -- 172.21.15.29:0/1995524269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5414d210 con 0x7eff540cd360 2024-04-23T10:28:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff58adb640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5414ed40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7eff4400c450 tx=0x7eff4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff49ffb640 1 -- 172.21.15.29:0/1995524269 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff44017070 con 0x7eff540cd360 2024-04-23T10:28:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff49ffb640 1 -- 172.21.15.29:0/1995524269 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff44005cf0 con 0x7eff540cd360 2024-04-23T10:28:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5414d480 con 0x7eff540cd360 2024-04-23T10:28:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff49ffb640 1 -- 172.21.15.29:0/1995524269 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff44007290 con 0x7eff540cd360 2024-04-23T10:28:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5414d760 con 0x7eff540cd360 2024-04-23T10:28:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff54068d70 con 0x7eff540cd360 2024-04-23T10:28:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff49ffb640 1 -- 172.21.15.29:0/1995524269 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff4401a070 con 0x7eff540cd360 2024-04-23T10:28:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff49ffb640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff380683b0 0x7eff3806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff49ffb640 1 -- 172.21.15.29:0/1995524269 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7eff44086130 con 0x7eff540cd360 2024-04-23T10:28:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff592dc640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff380683b0 0x7eff3806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.045+0000 7eff592dc640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff380683b0 0x7eff3806a870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff5000b930 tx=0x7eff50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.049+0000 7eff49ffb640 1 -- 172.21.15.29:0/1995524269 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff440562d0 con 0x7eff540cd360 2024-04-23T10:28:39.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.281+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7eff54156920 con 0x7eff540cd360 2024-04-23T10:28:39.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff49ffb640 1 -- 172.21.15.29:0/1995524269 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7eff44055bd0 con 0x7eff540cd360 2024-04-23T10:28:39.283 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:28:39.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff380683b0 msgr2=0x7eff3806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff380683b0 0x7eff3806a870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff5000b930 tx=0x7eff50008040 comp rx=0 tx=0).stop 2024-04-23T10:28:39.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 msgr2=0x7eff5414ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5414ed40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7eff4400c450 tx=0x7eff4400c910 comp rx=0 tx=0).stop 2024-04-23T10:28:39.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 shutdown_connections 2024-04-23T10:28:39.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7eff380683b0 0x7eff3806a870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff54153190 0x7eff541e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff540cd360 0x7eff5414ed40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 --2- 172.21.15.29:0/1995524269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5406f150 0x7eff540cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 >> 172.21.15.29:0/1995524269 conn(0x7eff5406cfb0 msgr2=0x7eff5406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:39.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 shutdown_connections 2024-04-23T10:28:39.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.285+0000 7eff5b540640 1 -- 172.21.15.29:0/1995524269 wait complete. 2024-04-23T10:28:39.302 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:28:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.421+0000 7f2e0f078640 1 Processor -- start 2024-04-23T10:28:39.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.421+0000 7f2e0f078640 1 -- start start 2024-04-23T10:28:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0f078640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e08153190 0x7f2e08159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0f078640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e080cd360 0x7f2e0806f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0f078640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080c3fe0 con 0x7f2e0806f150 2024-04-23T10:28:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0f078640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2e08159380 con 0x7f2e08153190 2024-04-23T10:28:39.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0f078640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2e080c42c0 con 0x7f2e080cd360 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0d615640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e080cd360 0x7f2e0806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0ce14640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e08153190 0x7f2e08159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0ce14640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e08153190 0x7f2e08159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:37818/0 (socket says 172.21.15.29:37818) 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0ce14640 1 -- 172.21.15.29:0/2934841269 learned_addr learned my addr 172.21.15.29:0/2934841269 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e07fff640 1 --1- 172.21.15.29:0/2934841269 >> v1:172.21.15.72:6789/0 conn(0x7f2e0806f150 0x7f2e080ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:58046/0 (socket says 172.21.15.29:58046) 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0ce14640 1 -- 172.21.15.29:0/2934841269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e080cd360 msgr2=0x7f2e0806f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0ce14640 1 --2- 172.21.15.29:0/2934841269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e080cd360 0x7f2e0806f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0ce14640 1 -- 172.21.15.29:0/2934841269 >> v1:172.21.15.72:6789/0 conn(0x7f2e0806f150 legacy=0x7f2e080ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0ce14640 1 -- 172.21.15.29:0/2934841269 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e080c45a0 con 0x7f2e08153190 2024-04-23T10:28:39.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.425+0000 7f2e0ce14640 1 --2- 172.21.15.29:0/2934841269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 0x7f2e08159810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009870 tx=0x7f2dfc01ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83811e0115af81b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e077fe640 1 -- 172.21.15.29:0/2934841269 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0b5070 con 0x7f2e08153190 2024-04-23T10:28:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e077fe640 1 -- 172.21.15.29:0/2934841269 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0a8a50 con 0x7f2e08153190 2024-04-23T10:28:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e077fe640 1 -- 172.21.15.29:0/2934841269 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0a8e20 con 0x7f2e08153190 2024-04-23T10:28:39.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- 172.21.15.29:0/2934841269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 msgr2=0x7f2e08159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 --2- 172.21.15.29:0/2934841269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 0x7f2e08159810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009870 tx=0x7f2dfc01ed50 comp rx=0 tx=0).stop 2024-04-23T10:28:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- 172.21.15.29:0/2934841269 shutdown_connections 2024-04-23T10:28:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 --2- 172.21.15.29:0/2934841269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e080cd360 0x7f2e0806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 --2- 172.21.15.29:0/2934841269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 0x7f2e08159810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- 172.21.15.29:0/2934841269 >> 172.21.15.29:0/2934841269 conn(0x7f2e0806cfb0 msgr2=0x7f2e0806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- 172.21.15.29:0/2934841269 shutdown_connections 2024-04-23T10:28:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- 172.21.15.29:0/2934841269 wait complete. 2024-04-23T10:28:39.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 Processor -- start 2024-04-23T10:28:39.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- start start 2024-04-23T10:28:39.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e0806f150 0x7f2e0814de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e080cd360 0x7f2e080c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 0x7f2e080c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2e080c4880 con 0x7f2e080cd360 2024-04-23T10:28:39.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2e08153570 con 0x7f2e08153190 2024-04-23T10:28:39.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0f078640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2e080c9070 con 0x7f2e0806f150 2024-04-23T10:28:39.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e080cd360 0x7f2e080c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e080cd360 0x7f2e080c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58316/0 (socket says 172.21.15.29:58316) 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 -- 172.21.15.29:0/1437984412 learned_addr learned my addr 172.21.15.29:0/1437984412 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0ce14640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e0806f150 0x7f2e0814de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0d615640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 0x7f2e080c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 -- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e0806f150 msgr2=0x7f2e0814de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e0806f150 0x7f2e0814de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 -- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 msgr2=0x7f2e080c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 0x7f2e080c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 -- 172.21.15.29:0/1437984412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0814b0f0 con 0x7f2e080cd360 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e0d615640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 0x7f2e080c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.429+0000 7f2e07fff640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e080cd360 0x7f2e080c7e00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c3a0 tx=0x7f2df800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e057fa640 1 -- 172.21.15.29:0/1437984412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df80074e0 con 0x7f2e080cd360 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e057fa640 1 -- 172.21.15.29:0/1437984412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df8007680 con 0x7f2e080cd360 2024-04-23T10:28:39.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e081ef880 con 0x7f2e080cd360 2024-04-23T10:28:39.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e057fa640 1 -- 172.21.15.29:0/1437984412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8004a30 con 0x7f2e080cd360 2024-04-23T10:28:39.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e081eefe0 con 0x7f2e080cd360 2024-04-23T10:28:39.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e08068d70 con 0x7f2e080cd360 2024-04-23T10:28:39.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e057fa640 1 -- 172.21.15.29:0/1437984412 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2df801a020 con 0x7f2e080cd360 2024-04-23T10:28:39.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e057fa640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2df4068380 0x7f2df406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e057fa640 1 -- 172.21.15.29:0/1437984412 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2df80864f0 con 0x7f2e080cd360 2024-04-23T10:28:39.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e0ce14640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2df4068380 0x7f2df406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.433+0000 7f2e0ce14640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2df4068380 0x7f2df406a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0b2000 tx=0x7f2dfc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.437+0000 7f2e057fa640 1 -- 172.21.15.29:0/1437984412 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2e0814b0f0 con 0x7f2e080cd360 2024-04-23T10:28:39.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.601+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2e08069f10 con 0x7f2e080cd360 2024-04-23T10:28:39.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e057fa640 1 -- 172.21.15.29:0/1437984412 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2df8056670 con 0x7f2e080cd360 2024-04-23T10:28:39.603 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2df4068380 msgr2=0x7f2df406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2df4068380 0x7f2df406a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0b2000 tx=0x7f2dfc009040 comp rx=0 tx=0).stop 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e080cd360 msgr2=0x7f2e080c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e080cd360 0x7f2e080c7e00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c3a0 tx=0x7f2df800c860 comp rx=0 tx=0).stop 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 shutdown_connections 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2df4068380 0x7f2df406a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e08153190 0x7f2e080c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e080cd360 0x7f2e080c7e00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 --2- 172.21.15.29:0/1437984412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e0806f150 0x7f2e0814de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 >> 172.21.15.29:0/1437984412 conn(0x7f2e0806cfb0 msgr2=0x7f2e081587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:39.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 shutdown_connections 2024-04-23T10:28:39.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.605+0000 7f2e0f078640 1 -- 172.21.15.29:0/1437984412 wait complete. 2024-04-23T10:28:39.623 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:28:39.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.753+0000 7fdc131ce640 1 Processor -- start 2024-04-23T10:28:39.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.753+0000 7fdc131ce640 1 -- start start 2024-04-23T10:28:39.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.753+0000 7fdc131ce640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc0c151bb0 0x7fdc0c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.753+0000 7fdc131ce640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc0c0c5900 0x7fdc0c0c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.753+0000 7fdc131ce640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.753+0000 7fdc131ce640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0c06c910 con 0x7fdc0c0c5900 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.753+0000 7fdc131ce640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0c06cbf0 con 0x7fdc0c151bb0 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.753+0000 7fdc131ce640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0c06ced0 con 0x7fdc0c0cb770 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc0c0c5900 0x7fdc0c0c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc0c0c5900 0x7fdc0c0c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58318/0 (socket says 172.21.15.29:58318) 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 -- 172.21.15.29:0/2729894038 learned_addr learned my addr 172.21.15.29:0/2729894038 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc10f6a640 1 --2- 172.21.15.29:0/2729894038 >> v2:172.21.15.72:3300/0 conn(0x7fdc0c151bb0 0x7fdc0c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc1176b640 1 --2- 172.21.15.29:0/2729894038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c0cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 -- 172.21.15.29:0/2729894038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 msgr2=0x7fdc0c0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 --2- 172.21.15.29:0/2729894038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c0cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 -- 172.21.15.29:0/2729894038 >> v2:172.21.15.72:3300/0 conn(0x7fdc0c151bb0 msgr2=0x7fdc0c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 --2- 172.21.15.29:0/2729894038 >> v2:172.21.15.72:3300/0 conn(0x7fdc0c151bb0 0x7fdc0c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 -- 172.21.15.29:0/2729894038 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c06d1b0 con 0x7fdc0c0c5900 2024-04-23T10:28:39.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc1176b640 1 --2- 172.21.15.29:0/2729894038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c0cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:39.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0bfff640 1 --2- 172.21.15.29:0/2729894038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c0c5d50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0ce060 tx=0x7fdc0001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea26ee029b0fd68a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0b7fe640 1 -- 172.21.15.29:0/2729894038 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc000b5070 con 0x7fdc0c0c5900 2024-04-23T10:28:39.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0b7fe640 1 -- 172.21.15.29:0/2729894038 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc000a89d0 con 0x7fdc0c0c5900 2024-04-23T10:28:39.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc0b7fe640 1 -- 172.21.15.29:0/2729894038 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc000a8da0 con 0x7fdc0c0c5900 2024-04-23T10:28:39.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 -- 172.21.15.29:0/2729894038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 msgr2=0x7fdc0c0c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 --2- 172.21.15.29:0/2729894038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c0c5d50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0ce060 tx=0x7fdc0001ed10 comp rx=0 tx=0).stop 2024-04-23T10:28:39.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 -- 172.21.15.29:0/2729894038 shutdown_connections 2024-04-23T10:28:39.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 --2- 172.21.15.29:0/2729894038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c0cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 --2- 172.21.15.29:0/2729894038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c0c5d50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 --2- 172.21.15.29:0/2729894038 >> v2:172.21.15.72:3300/0 conn(0x7fdc0c151bb0 0x7fdc0c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 -- 172.21.15.29:0/2729894038 >> 172.21.15.29:0/2729894038 conn(0x7fdc0c0730f0 msgr2=0x7fdc0c073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 -- 172.21.15.29:0/2729894038 shutdown_connections 2024-04-23T10:28:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.757+0000 7fdc131ce640 1 -- 172.21.15.29:0/2729894038 wait complete. 2024-04-23T10:28:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 Processor -- start 2024-04-23T10:28:39.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 -- start start 2024-04-23T10:28:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc0c151bb0 0x7fdc0c14e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c0c6840 con 0x7fdc0c0c5900 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c151f90 con 0x7fdc0c151bb0 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0c0c69c0 con 0x7fdc0c0cb770 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c15af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58328/0 (socket says 172.21.15.29:58328) 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 -- 172.21.15.29:0/1733471246 learned_addr learned my addr 172.21.15.29:0/1733471246 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc1176b640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc0c151bb0 0x7fdc0c14e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc0bfff640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 -- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 msgr2=0x7fdc0c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c15d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 -- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc0c151bb0 msgr2=0x7fdc0c14e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc0c151bb0 0x7fdc0c14e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 -- 172.21.15.29:0/1733471246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c15ca40 con 0x7fdc0c0c5900 2024-04-23T10:28:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc10f6a640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c15af40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00e8a0 tx=0x7fdbfc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc097fa640 1 -- 172.21.15.29:0/1733471246 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc017070 con 0x7fdc0c0c5900 2024-04-23T10:28:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc097fa640 1 -- 172.21.15.29:0/1733471246 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc00c940 con 0x7fdc0c0c5900 2024-04-23T10:28:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c15cd00 con 0x7fdc0c0c5900 2024-04-23T10:28:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc097fa640 1 -- 172.21.15.29:0/1733471246 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc00ccf0 con 0x7fdc0c0c5900 2024-04-23T10:28:39.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c1f4410 con 0x7fdc0c0c5900 2024-04-23T10:28:39.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.761+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0c068d70 con 0x7fdc0c0c5900 2024-04-23T10:28:39.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.765+0000 7fdc097fa640 1 -- 172.21.15.29:0/1733471246 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdbfc01a070 con 0x7fdc0c0c5900 2024-04-23T10:28:39.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.765+0000 7fdc097fa640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdbf80683b0 0x7fdbf806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:39.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.765+0000 7fdc097fa640 1 -- 172.21.15.29:0/1733471246 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fdbfc086f90 con 0x7fdc0c0c5900 2024-04-23T10:28:39.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.765+0000 7fdc0bfff640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdbf80683b0 0x7fdbf806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:39.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.765+0000 7fdc0bfff640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdbf80683b0 0x7fdbf806a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdc000b2000 tx=0x7fdc00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:39.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.769+0000 7fdc097fa640 1 -- 172.21.15.29:0/1733471246 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdbfc056ae0 con 0x7fdc0c0c5900 2024-04-23T10:28:39.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.933+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdc0c15f640 con 0x7fdc0c0c5900 2024-04-23T10:28:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.933+0000 7fdc097fa640 1 -- 172.21.15.29:0/1733471246 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fdbfc05ade0 con 0x7fdc0c0c5900 2024-04-23T10:28:39.932 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdbf80683b0 msgr2=0x7fdbf806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdbf80683b0 0x7fdbf806a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdc000b2000 tx=0x7fdc00009040 comp rx=0 tx=0).stop 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 msgr2=0x7fdc0c15af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c15af40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00e8a0 tx=0x7fdbfc00eca0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 shutdown_connections 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fdbf80683b0 0x7fdbf806a870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc0c151bb0 0x7fdc0c14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc0c0cb770 0x7fdc0c15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 --2- 172.21.15.29:0/1733471246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc0c0c5900 0x7fdc0c15af40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 >> 172.21.15.29:0/1733471246 conn(0x7fdc0c0730f0 msgr2=0x7fdc0c0cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:39.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 shutdown_connections 2024-04-23T10:28:39.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:39.937+0000 7fdc131ce640 1 -- 172.21.15.29:0/1733471246 wait complete. 2024-04-23T10:28:39.953 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:28:40.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f57700640 1 Processor -- start 2024-04-23T10:28:40.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f57700640 1 -- start start 2024-04-23T10:28:40.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f57700640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3f500c5610 0x7f3f5015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f57700640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f5015b350 con 0x7f3f501518f0 2024-04-23T10:28:40.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f57700640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f5015b630 con 0x7f3f500c7730 2024-04-23T10:28:40.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f57700640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3f500c4280 con 0x7f3f500c5610 2024-04-23T10:28:40.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f5549c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3f501518f0 0x7f3f500c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55130/0 (socket says 172.21.15.29:55130) 2024-04-23T10:28:40.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f5549c640 1 -- 172.21.15.29:0/2823432774 learned_addr learned my addr 172.21.15.29:0/2823432774 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:40.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043834651 0 0) 0x7f3f5015b350 con 0x7f3f501518f0 2024-04-23T10:28:40.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f3c003450 con 0x7f3f501518f0 2024-04-23T10:28:40.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f55c9d640 1 --2- 172.21.15.29:0/2823432774 >> v2:172.21.15.72:3300/0 conn(0x7f3f500c5610 0x7f3f5015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1122189781 0 0) 0x7f3f3c003450 con 0x7f3f501518f0 2024-04-23T10:28:40.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 >> v2:172.21.15.72:3300/0 conn(0x7f3f500c5610 msgr2=0x7f3f5015ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:40.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 --2- 172.21.15.29:0/2823432774 >> v2:172.21.15.72:3300/0 conn(0x7f3f500c5610 0x7f3f5015ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 >> v1:172.21.15.72:6789/0 conn(0x7f3f500c7730 legacy=0x7f3f500c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5015b910 con 0x7f3f501518f0 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f3f4c001680 con 0x7f3f501518f0 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 >> v1:172.21.15.29:6789/0 conn(0x7f3f501518f0 legacy=0x7f3f500c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c003b00 0x7f3f3c003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f3c0088b0 0x7f3f3c00ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f3c00b520 0x7f3f3c00d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3f500c4280 con 0x7f3f3c00b520 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c00e2c0 con 0x7f3f3c003b00 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3c00e4c0 con 0x7f3f3c0088b0 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f55c9d640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f3c00b520 0x7f3f3c00d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f5549c640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c003b00 0x7f3f3c003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f54c9b640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f3c0088b0 0x7f3f3c00ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f55c9d640 1 -- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f3c0088b0 msgr2=0x7f3f3c00ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f55c9d640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f3c0088b0 0x7f3f3c00ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f55c9d640 1 -- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c003b00 msgr2=0x7f3f3c003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:40.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f55c9d640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c003b00 0x7f3f3c003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f55c9d640 1 -- 172.21.15.29:0/2823432774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c003450 con 0x7f3f3c00b520 2024-04-23T10:28:40.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.081+0000 7f3f54c9b640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f3c0088b0 0x7f3f3c00ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f55c9d640 1 -- 172.21.15.29:0/2823432774 reap_dead start 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f55c9d640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f3c00b520 0x7f3f3c00d9e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009fc0 tx=0x7f3f4801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e7cb45c8090f86 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48009c10 con 0x7f3f3c00b520 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f480a5d10 con 0x7f3f3c00b520 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f47fff640 1 -- 172.21.15.29:0/2823432774 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48003be0 con 0x7f3f3c00b520 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 -- 172.21.15.29:0/2823432774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f3c00b520 msgr2=0x7f3f3c00d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f3c00b520 0x7f3f3c00d9e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009fc0 tx=0x7f3f4801ccc0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 -- 172.21.15.29:0/2823432774 shutdown_connections 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 --2- 172.21.15.29:0/2823432774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f3c00b520 0x7f3f3c00d9e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 -- 172.21.15.29:0/2823432774 >> 172.21.15.29:0/2823432774 conn(0x7f3f5006cfb0 msgr2=0x7f3f5006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 -- 172.21.15.29:0/2823432774 shutdown_connections 2024-04-23T10:28:40.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 -- 172.21.15.29:0/2823432774 wait complete. 2024-04-23T10:28:40.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 Processor -- start 2024-04-23T10:28:40.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.085+0000 7f3f57700640 1 -- start start 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c00b520 0x7f3f501ec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f50152770 0x7f3f5015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f501e0b60 0x7f3f50153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3f50151cd0 con 0x7f3f501e0b60 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3f500c49e0 con 0x7f3f3c00b520 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3f50151e50 con 0x7f3f50152770 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f501e0b60 0x7f3f50153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f501e0b60 0x7f3f50153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58340/0 (socket says 172.21.15.29:58340) 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 -- 172.21.15.29:0/822649003 learned_addr learned my addr 172.21.15.29:0/822649003 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f5549c640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c00b520 0x7f3f501ec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f54c9b640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f50152770 0x7f3f5015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 -- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f50152770 msgr2=0x7f3f5015a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f50152770 0x7f3f5015a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 -- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c00b520 msgr2=0x7f3f501ec5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c00b520 0x7f3f501ec5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 -- 172.21.15.29:0/822649003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5015b460 con 0x7f3f501e0b60 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f5549c640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c00b520 0x7f3f501ec5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f54c9b640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f50152770 0x7f3f5015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f55c9d640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f501e0b60 0x7f3f50153ce0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3f4801d1a0 tx=0x7f3f48009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f45ffb640 1 -- 172.21.15.29:0/822649003 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48009c10 con 0x7f3f501e0b60 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f45ffb640 1 -- 172.21.15.29:0/822649003 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f480bd070 con 0x7f3f501e0b60 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f50155020 con 0x7f3f501e0b60 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f45ffb640 1 -- 172.21.15.29:0/822649003 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f480039a0 con 0x7f3f501e0b60 2024-04-23T10:28:40.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f501ecfd0 con 0x7f3f501e0b60 2024-04-23T10:28:40.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f50068d70 con 0x7f3f501e0b60 2024-04-23T10:28:40.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f45ffb640 1 -- 172.21.15.29:0/822649003 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f48003b40 con 0x7f3f501e0b60 2024-04-23T10:28:40.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f45ffb640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f34068380 0x7f3f3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f45ffb640 1 -- 172.21.15.29:0/822649003 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3f481228a0 con 0x7f3f501e0b60 2024-04-23T10:28:40.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.089+0000 7f3f5549c640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f34068380 0x7f3f3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.093+0000 7f3f5549c640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f34068380 0x7f3f3406a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c001060 tx=0x7f3f4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.093+0000 7f3f45ffb640 1 -- 172.21.15.29:0/822649003 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f480169d0 con 0x7f3f501e0b60 2024-04-23T10:28:40.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.261+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3f500c8dc0 con 0x7f3f501e0b60 2024-04-23T10:28:40.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.261+0000 7f3f45ffb640 1 -- 172.21.15.29:0/822649003 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f3f480c13c0 con 0x7f3f501e0b60 2024-04-23T10:28:40.262 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:28:40.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f34068380 msgr2=0x7f3f3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f34068380 0x7f3f3406a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c001060 tx=0x7f3f4c009040 comp rx=0 tx=0).stop 2024-04-23T10:28:40.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f501e0b60 msgr2=0x7f3f50153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f501e0b60 0x7f3f50153ce0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3f4801d1a0 tx=0x7f3f48009750 comp rx=0 tx=0).stop 2024-04-23T10:28:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 shutdown_connections 2024-04-23T10:28:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3f34068380 0x7f3f3406a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f501e0b60 0x7f3f50153ce0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f50152770 0x7f3f5015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 --2- 172.21.15.29:0/822649003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3c00b520 0x7f3f501ec5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 >> 172.21.15.29:0/822649003 conn(0x7f3f5006cfb0 msgr2=0x7f3f5014c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 shutdown_connections 2024-04-23T10:28:40.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.265+0000 7f3f57700640 1 -- 172.21.15.29:0/822649003 wait complete. 2024-04-23T10:28:40.284 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:28:40.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc876c6a640 1 Processor -- start 2024-04-23T10:28:40.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc876c6a640 1 -- start start 2024-04-23T10:28:40.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc876c6a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc870075470 0x7fc870072e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc876c6a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87015b1c0 con 0x7fc870154ed0 2024-04-23T10:28:40.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc876c6a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87015b4a0 con 0x7fc8701552b0 2024-04-23T10:28:40.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc876c6a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc87015c020 con 0x7fc870075470 2024-04-23T10:28:40.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc874a06640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc870154ed0 0x7fc8700704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55144/0 (socket says 172.21.15.29:55144) 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc874a06640 1 -- 172.21.15.29:0/1099149474 learned_addr learned my addr 172.21.15.29:0/1099149474 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc875207640 1 --2- 172.21.15.29:0/1099149474 >> v2:172.21.15.72:3300/0 conn(0x7fc870075470 0x7fc870072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806193545 0 0) 0x7fc87015b1c0 con 0x7fc870154ed0 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc85c003530 con 0x7fc870154ed0 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4251032117 0 0) 0x7fc85c003530 con 0x7fc870154ed0 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 >> v2:172.21.15.72:3300/0 conn(0x7fc870075470 msgr2=0x7fc870072e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 --2- 172.21.15.29:0/1099149474 >> v2:172.21.15.72:3300/0 conn(0x7fc870075470 0x7fc870072e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 >> v1:172.21.15.72:6789/0 conn(0x7fc8701552b0 legacy=0x7fc870074d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87015b780 con 0x7fc870154ed0 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fc860001a00 con 0x7fc870154ed0 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 >> v1:172.21.15.29:6789/0 conn(0x7fc870154ed0 legacy=0x7fc8700704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc85c0039c0 0x7fc85c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc85c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc85c0051d0 0x7fc85c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc87015c020 con 0x7fc85c004810 2024-04-23T10:28:40.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c00c170 con 0x7fc85c0051d0 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c00c370 con 0x7fc85c0039c0 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86ffff640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc85c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc875207640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc85c0051d0 0x7fc85c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc874a06640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc85c0039c0 0x7fc85c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86ffff640 1 -- 172.21.15.29:0/1099149474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc85c0039c0 msgr2=0x7fc85c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86ffff640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc85c0039c0 0x7fc85c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86ffff640 1 -- 172.21.15.29:0/1099149474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc85c0051d0 msgr2=0x7fc85c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86ffff640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc85c0051d0 0x7fc85c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc86ffff640 1 -- 172.21.15.29:0/1099149474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c003530 con 0x7fc85c004810 2024-04-23T10:28:40.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.413+0000 7fc875207640 1 -- 172.21.15.29:0/1099149474 reap_dead start 2024-04-23T10:28:40.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc86ffff640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc85c004c90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc858001780 tx=0x7fc85801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d102f1b2ec8bdda0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580013a0 con 0x7fc85c004810 2024-04-23T10:28:40.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580052f0 con 0x7fc85c004810 2024-04-23T10:28:40.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc86f7fe640 1 -- 172.21.15.29:0/1099149474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858003840 con 0x7fc85c004810 2024-04-23T10:28:40.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 -- 172.21.15.29:0/1099149474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 msgr2=0x7fc85c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc85c004c90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc858001780 tx=0x7fc85801c3d0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 -- 172.21.15.29:0/1099149474 shutdown_connections 2024-04-23T10:28:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 --2- 172.21.15.29:0/1099149474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc85c004c90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 -- 172.21.15.29:0/1099149474 >> 172.21.15.29:0/1099149474 conn(0x7fc87006b9e0 msgr2=0x7fc87006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 -- 172.21.15.29:0/1099149474 shutdown_connections 2024-04-23T10:28:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 -- 172.21.15.29:0/1099149474 wait complete. 2024-04-23T10:28:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 Processor -- start 2024-04-23T10:28:40.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.417+0000 7fc876c6a640 1 -- start start 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc8701e88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8700cd2c0 0x7fc8700c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870152230 0x7fc87014d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700752f0 con 0x7fc85c004810 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc870075170 con 0x7fc870152230 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc87015e9a0 con 0x7fc8700cd2c0 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc8701e88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc8701e88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58360/0 (socket says 172.21.15.29:58360) 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 -- 172.21.15.29:0/1091049846 learned_addr learned my addr 172.21.15.29:0/1091049846 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc875207640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870152230 0x7fc87014d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc86ffff640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8700cd2c0 0x7fc8700c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 -- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8700cd2c0 msgr2=0x7fc8700c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8700cd2c0 0x7fc8700c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 -- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870152230 msgr2=0x7fc87014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870152230 0x7fc87014d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 -- 172.21.15.29:0/1091049846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8701f4000 con 0x7fc85c004810 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc874a06640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc8701e88e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc860007a80 tx=0x7fc86000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc86d7fa640 1 -- 172.21.15.29:0/1091049846 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860013420 con 0x7fc85c004810 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc86d7fa640 1 -- 172.21.15.29:0/1091049846 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc860018070 con 0x7fc85c004810 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc870152800 con 0x7fc85c004810 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc86d7fa640 1 -- 172.21.15.29:0/1091049846 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860013800 con 0x7fc85c004810 2024-04-23T10:28:40.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8701f42c0 con 0x7fc85c004810 2024-04-23T10:28:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87006c970 con 0x7fc85c004810 2024-04-23T10:28:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc86d7fa640 1 -- 172.21.15.29:0/1091049846 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8600139a0 con 0x7fc85c004810 2024-04-23T10:28:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc86d7fa640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc850068380 0x7fc85006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc86d7fa640 1 -- 172.21.15.29:0/1091049846 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc860087420 con 0x7fc85c004810 2024-04-23T10:28:40.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.421+0000 7fc86ffff640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc850068380 0x7fc85006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.425+0000 7fc86ffff640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc850068380 0x7fc85006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc858001750 tx=0x7fc8580011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.425+0000 7fc86d7fa640 1 -- 172.21.15.29:0/1091049846 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc8600575c0 con 0x7fc85c004810 2024-04-23T10:28:40.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.605+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc8700693c0 con 0x7fc85c004810 2024-04-23T10:28:40.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.605+0000 7fc86d7fa640 1 -- 172.21.15.29:0/1091049846 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fc860056ec0 con 0x7fc85c004810 2024-04-23T10:28:40.605 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-23T10:28:40.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc850068380 msgr2=0x7fc85006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc850068380 0x7fc85006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc858001750 tx=0x7fc8580011a0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 msgr2=0x7fc8701e88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc8701e88e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc860007a80 tx=0x7fc86000e530 comp rx=0 tx=0).stop 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 shutdown_connections 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc850068380 0x7fc85006a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870152230 0x7fc87014d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8700cd2c0 0x7fc8700c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 --2- 172.21.15.29:0/1091049846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc85c004810 0x7fc8701e88e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 >> 172.21.15.29:0/1091049846 conn(0x7fc87006b9e0 msgr2=0x7fc8700ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 shutdown_connections 2024-04-23T10:28:40.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.609+0000 7fc876c6a640 1 -- 172.21.15.29:0/1091049846 wait complete. 2024-04-23T10:28:40.625 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-23T10:28:40.625 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:28:40.630 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:28:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.797+0000 7fe377b74640 1 Processor -- start 2024-04-23T10:28:40.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.797+0000 7fe377b74640 1 -- start start 2024-04-23T10:28:40.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.797+0000 7fe377b74640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe37006f3b0 0x7fe3700c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.797+0000 7fe377b74640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe370071160 0x7fe370073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.797+0000 7fe377b74640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe370072590 con 0x7fe37006f790 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.797+0000 7fe377b74640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe370072fe0 con 0x7fe370071160 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.797+0000 7fe377b74640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe370158df0 con 0x7fe37006f3b0 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.797+0000 7fe376111640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe370071160 0x7fe370073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe376111640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe370071160 0x7fe370073470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58376/0 (socket says 172.21.15.29:58376) 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe376111640 1 -- 172.21.15.29:0/3409602448 learned_addr learned my addr 172.21.15.29:0/3409602448 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe375910640 1 --2- 172.21.15.29:0/3409602448 >> v2:172.21.15.72:3300/0 conn(0x7fe37006f3b0 0x7fe3700c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe376111640 1 -- 172.21.15.29:0/3409602448 >> v2:172.21.15.72:3300/0 conn(0x7fe37006f3b0 msgr2=0x7fe3700c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:40.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe376111640 1 --2- 172.21.15.29:0/3409602448 >> v2:172.21.15.72:3300/0 conn(0x7fe37006f3b0 0x7fe3700c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe376111640 1 -- 172.21.15.29:0/3409602448 >> v1:172.21.15.72:6789/0 conn(0x7fe37006f790 legacy=0x7fe370157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe376111640 1 -- 172.21.15.29:0/3409602448 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe370158830 con 0x7fe370071160 2024-04-23T10:28:40.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe376111640 1 --2- 172.21.15.29:0/3409602448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe370071160 0x7fe370073470 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe3700c7d30 tx=0x7fe36801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feff3e7752c30cbe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe37490e640 1 -- 172.21.15.29:0/3409602448 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3680b4070 con 0x7fe370071160 2024-04-23T10:28:40.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe37490e640 1 -- 172.21.15.29:0/3409602448 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3680a7c90 con 0x7fe370071160 2024-04-23T10:28:40.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe37490e640 1 -- 172.21.15.29:0/3409602448 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3680af660 con 0x7fe370071160 2024-04-23T10:28:40.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe377b74640 1 -- 172.21.15.29:0/3409602448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe370071160 msgr2=0x7fe370073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe377b74640 1 --2- 172.21.15.29:0/3409602448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe370071160 0x7fe370073470 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe3700c7d30 tx=0x7fe36801ebc0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe377b74640 1 -- 172.21.15.29:0/3409602448 shutdown_connections 2024-04-23T10:28:40.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe377b74640 1 --2- 172.21.15.29:0/3409602448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe370071160 0x7fe370073470 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe377b74640 1 --2- 172.21.15.29:0/3409602448 >> v2:172.21.15.72:3300/0 conn(0x7fe37006f3b0 0x7fe3700c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe377b74640 1 -- 172.21.15.29:0/3409602448 >> 172.21.15.29:0/3409602448 conn(0x7fe37006cfb0 msgr2=0x7fe37006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:40.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe377b74640 1 -- 172.21.15.29:0/3409602448 shutdown_connections 2024-04-23T10:28:40.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.801+0000 7fe377b74640 1 -- 172.21.15.29:0/3409602448 wait complete. 2024-04-23T10:28:40.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 Processor -- start 2024-04-23T10:28:40.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 -- start start 2024-04-23T10:28:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37006f3b0 0x7fe370157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37006f790 0x7fe37013f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe370071160 0x7fe370143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe370152330 con 0x7fe37006f3b0 2024-04-23T10:28:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe370158500 con 0x7fe370071160 2024-04-23T10:28:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe3701524b0 con 0x7fe37006f790 2024-04-23T10:28:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37006f3b0 0x7fe370157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37006f3b0 0x7fe370157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58384/0 (socket says 172.21.15.29:58384) 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 -- 172.21.15.29:0/2123381958 learned_addr learned my addr 172.21.15.29:0/2123381958 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe376111640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe370071160 0x7fe370143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe37510f640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37006f790 0x7fe37013f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 -- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37006f790 msgr2=0x7fe37013f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37006f790 0x7fe37013f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 -- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe370071160 msgr2=0x7fe370143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe370071160 0x7fe370143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 -- 172.21.15.29:0/2123381958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3701571b0 con 0x7fe37006f3b0 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe375910640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37006f3b0 0x7fe370157500 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e870 tx=0x7fe36c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe3627fc640 1 -- 172.21.15.29:0/2123381958 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c017070 con 0x7fe37006f3b0 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe3627fc640 1 -- 172.21.15.29:0/2123381958 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe36c00c940 con 0x7fe37006f3b0 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe3627fc640 1 -- 172.21.15.29:0/2123381958 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c00ccf0 con 0x7fe37006f3b0 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe370157d40 con 0x7fe37006f3b0 2024-04-23T10:28:40.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe370143370 con 0x7fe37006f3b0 2024-04-23T10:28:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe370068d70 con 0x7fe37006f3b0 2024-04-23T10:28:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.805+0000 7fe3627fc640 1 -- 172.21.15.29:0/2123381958 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe36c01a070 con 0x7fe37006f3b0 2024-04-23T10:28:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.809+0000 7fe3627fc640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe3540683b0 0x7fe35406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.809+0000 7fe3627fc640 1 -- 172.21.15.29:0/2123381958 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe36c086c10 con 0x7fe37006f3b0 2024-04-23T10:28:40.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.809+0000 7fe37510f640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe3540683b0 0x7fe35406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:40.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.809+0000 7fe37510f640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe3540683b0 0x7fe35406a870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe37006d870 tx=0x7fe364009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:40.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.813+0000 7fe3627fc640 1 -- 172.21.15.29:0/2123381958 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe36c056db0 con 0x7fe37006f3b0 2024-04-23T10:28:40.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.977+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe37014be10 con 0x7fe37006f3b0 2024-04-23T10:28:40.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.981+0000 7fe3627fc640 1 -- 172.21.15.29:0/2123381958 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18877 (secure 0 0 0) 0x7fe36c0566b0 con 0x7fe37006f3b0 2024-04-23T10:28:40.981 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:40.981 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:16:26.277550+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:28:40.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe3540683b0 msgr2=0x7fe35406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe3540683b0 0x7fe35406a870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe37006d870 tx=0x7fe364009040 comp rx=0 tx=0).stop 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37006f3b0 msgr2=0x7fe370157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37006f3b0 0x7fe370157500 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e870 tx=0x7fe36c00ec70 comp rx=0 tx=0).stop 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 shutdown_connections 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe3540683b0 0x7fe35406a870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe370071160 0x7fe370143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37006f790 0x7fe37013f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 --2- 172.21.15.29:0/2123381958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37006f3b0 0x7fe370157500 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 >> 172.21.15.29:0/2123381958 conn(0x7fe37006cfb0 msgr2=0x7fe3700cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 shutdown_connections 2024-04-23T10:28:40.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:40.985+0000 7fe377b74640 1 -- 172.21.15.29:0/2123381958 wait complete. 2024-04-23T10:28:41.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:15:31.234422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:15:35.259947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:15:36.319607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:15:40.046712+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:28:41.001 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:28:41.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb66c7640 1 Processor -- start 2024-04-23T10:28:41.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb66c7640 1 -- start start 2024-04-23T10:28:41.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb66c7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb006f3b0 0x7f3eb00c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb66c7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3eb006f790 0x7f3eb0073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb66c7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb0072590 con 0x7f3eb0071160 2024-04-23T10:28:41.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb66c7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb0072fe0 con 0x7f3eb006f790 2024-04-23T10:28:41.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb66c7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb0158df0 con 0x7f3eb006f3b0 2024-04-23T10:28:41.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eaf7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3eb006f790 0x7f3eb0073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb4c64640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3eb0071160 0x7f3eb0157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55154/0 (socket says 172.21.15.29:55154) 2024-04-23T10:28:41.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eb4c64640 1 -- 172.21.15.29:0/3360308379 learned_addr learned my addr 172.21.15.29:0/3360308379 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:41.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eaffff640 1 --2- 172.21.15.29:0/3360308379 >> v2:172.21.15.72:3300/0 conn(0x7f3eb006f3b0 0x7f3eb00c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eaf7fe640 1 -- 172.21.15.29:0/3360308379 >> v2:172.21.15.72:3300/0 conn(0x7f3eb006f3b0 msgr2=0x7f3eb00c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:41.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eaf7fe640 1 --2- 172.21.15.29:0/3360308379 >> v2:172.21.15.72:3300/0 conn(0x7f3eb006f3b0 0x7f3eb00c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eaf7fe640 1 -- 172.21.15.29:0/3360308379 >> v1:172.21.15.29:6789/0 conn(0x7f3eb0071160 legacy=0x7f3eb0157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eaf7fe640 1 -- 172.21.15.29:0/3360308379 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb0158830 con 0x7f3eb006f790 2024-04-23T10:28:41.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.133+0000 7f3eaeffd640 1 -- 172.21.15.29:0/3360308379 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956168355 0 0) 0x7f3eb0072590 con 0x7f3eb0071160 2024-04-23T10:28:41.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eaf7fe640 1 --2- 172.21.15.29:0/3360308379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb006f790 0x7f3eb0073470 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00c7d30 tx=0x7f3ea401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2387fb3cdadf3cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eaeffd640 1 -- 172.21.15.29:0/3360308379 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40ab650 con 0x7f3eb006f790 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eaeffd640 1 -- 172.21.15.29:0/3360308379 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea40b0070 con 0x7f3eb006f790 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eaeffd640 1 -- 172.21.15.29:0/3360308379 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40aba10 con 0x7f3eb006f790 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- 172.21.15.29:0/3360308379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb006f790 msgr2=0x7f3eb0073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/3360308379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb006f790 0x7f3eb0073470 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00c7d30 tx=0x7f3ea401c450 comp rx=0 tx=0).stop 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- 172.21.15.29:0/3360308379 shutdown_connections 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/3360308379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb006f790 0x7f3eb0073470 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/3360308379 >> v2:172.21.15.72:3300/0 conn(0x7f3eb006f3b0 0x7f3eb00c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- 172.21.15.29:0/3360308379 >> 172.21.15.29:0/3360308379 conn(0x7f3eb006cfb0 msgr2=0x7f3eb006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- 172.21.15.29:0/3360308379 shutdown_connections 2024-04-23T10:28:41.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- 172.21.15.29:0/3360308379 wait complete. 2024-04-23T10:28:41.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 Processor -- start 2024-04-23T10:28:41.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- start start 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb006f3b0 0x7f3eb0157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb006f790 0x7f3eb00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb0071160 0x7f3eb0142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb0152330 con 0x7f3eb0071160 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb0158500 con 0x7f3eb006f3b0 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.137+0000 7f3eb66c7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb01524b0 con 0x7f3eb006f790 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb0071160 0x7f3eb0142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb0071160 0x7f3eb0142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58402/0 (socket says 172.21.15.29:58402) 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 -- 172.21.15.29:0/166013984 learned_addr learned my addr 172.21.15.29:0/166013984 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eaffff640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb006f3b0 0x7f3eb0157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eaf7fe640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb006f790 0x7f3eb00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 -- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb006f790 msgr2=0x7f3eb00c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb006f790 0x7f3eb00c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 -- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb006f3b0 msgr2=0x7f3eb0157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb006f3b0 0x7f3eb0157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 -- 172.21.15.29:0/166013984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb00c9af0 con 0x7f3eb0071160 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb4c64640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb0071160 0x7f3eb0142020 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800caf0 tx=0x7f3ea80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eacff9640 1 -- 172.21.15.29:0/166013984 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800ac00 con 0x7f3eb0071160 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eacff9640 1 -- 172.21.15.29:0/166013984 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea800ada0 con 0x7f3eb0071160 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb0155d90 con 0x7f3eb0071160 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eacff9640 1 -- 172.21.15.29:0/166013984 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8012640 con 0x7f3eb0071160 2024-04-23T10:28:41.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb0156350 con 0x7f3eb0071160 2024-04-23T10:28:41.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb0068d70 con 0x7f3eb0071160 2024-04-23T10:28:41.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eacff9640 1 -- 172.21.15.29:0/166013984 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3ea80127e0 con 0x7f3eb0071160 2024-04-23T10:28:41.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eacff9640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3e9c068380 0x7f3e9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eacff9640 1 -- 172.21.15.29:0/166013984 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3ea8087320 con 0x7f3eb0071160 2024-04-23T10:28:41.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.141+0000 7f3eaffff640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3e9c068380 0x7f3e9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.145+0000 7f3eaffff640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3e9c068380 0x7f3e9c06a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0007a60 tx=0x7f3ea0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.145+0000 7f3eacff9640 1 -- 172.21.15.29:0/166013984 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ea80574c0 con 0x7f3eb0071160 2024-04-23T10:28:41.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.309+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3eb006d530 con 0x7f3eb0071160 2024-04-23T10:28:41.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.309+0000 7f3eacff9640 1 -- 172.21.15.29:0/166013984 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f3ea8056dc0 con 0x7f3eb0071160 2024-04-23T10:28:41.310 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-23T10:28:41.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3e9c068380 msgr2=0x7f3e9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3e9c068380 0x7f3e9c06a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0007a60 tx=0x7f3ea0008040 comp rx=0 tx=0).stop 2024-04-23T10:28:41.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb0071160 msgr2=0x7f3eb0142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb0071160 0x7f3eb0142020 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800caf0 tx=0x7f3ea80021d0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 shutdown_connections 2024-04-23T10:28:41.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3e9c068380 0x7f3e9c06a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb0071160 0x7f3eb0142020 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb006f790 0x7f3eb00c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 --2- 172.21.15.29:0/166013984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb006f3b0 0x7f3eb0157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 >> 172.21.15.29:0/166013984 conn(0x7f3eb006cfb0 msgr2=0x7f3eb0146390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:41.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 shutdown_connections 2024-04-23T10:28:41.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.313+0000 7f3eb66c7640 1 -- 172.21.15.29:0/166013984 wait complete. 2024-04-23T10:28:41.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:28:41.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f8139f640 1 Processor -- start 2024-04-23T10:28:41.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f8139f640 1 -- start start 2024-04-23T10:28:41.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f8139f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f7c151ca0 0x7f1f7c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f8139f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f7c0c9b80 0x7f1f7c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f8139f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f7c158160 con 0x7f1f7c152080 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f8139f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1f7c0c8c70 con 0x7f1f7c0c9b80 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f8139f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1f7c158440 con 0x7f1f7c151ca0 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f7a7fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1f7c152080 0x7f1f7c0ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55168/0 (socket says 172.21.15.29:55168) 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f7b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f7c0c9b80 0x7f1f7c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f7a7fc640 1 -- 172.21.15.29:0/360287478 learned_addr learned my addr 172.21.15.29:0/360287478 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f7affd640 1 --2- 172.21.15.29:0/360287478 >> v2:172.21.15.72:3300/0 conn(0x7f1f7c151ca0 0x7f1f7c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/360287478 >> v2:172.21.15.72:3300/0 conn(0x7f1f7c151ca0 msgr2=0x7f1f7c0c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f7b7fe640 1 --2- 172.21.15.29:0/360287478 >> v2:172.21.15.72:3300/0 conn(0x7f1f7c151ca0 0x7f1f7c0c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/360287478 >> v1:172.21.15.29:6789/0 conn(0x7f1f7c152080 legacy=0x7f1f7c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f79ffb640 1 -- 172.21.15.29:0/360287478 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583050925 0 0) 0x7f1f7c158160 con 0x7f1f7c152080 2024-04-23T10:28:41.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.461+0000 7f1f7b7fe640 1 -- 172.21.15.29:0/360287478 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c158720 con 0x7f1f7c0c9b80 2024-04-23T10:28:41.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f7b7fe640 1 --2- 172.21.15.29:0/360287478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c0c9b80 0x7f1f7c15b6e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c070b30 tx=0x7f1f6c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5390d2f34403760 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f79ffb640 1 -- 172.21.15.29:0/360287478 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0b5070 con 0x7f1f7c0c9b80 2024-04-23T10:28:41.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f79ffb640 1 -- 172.21.15.29:0/360287478 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0a8970 con 0x7f1f7c0c9b80 2024-04-23T10:28:41.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f79ffb640 1 -- 172.21.15.29:0/360287478 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0a8d40 con 0x7f1f7c0c9b80 2024-04-23T10:28:41.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- 172.21.15.29:0/360287478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c0c9b80 msgr2=0x7f1f7c15b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 --2- 172.21.15.29:0/360287478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c0c9b80 0x7f1f7c15b6e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c070b30 tx=0x7f1f6c01ec70 comp rx=0 tx=0).stop 2024-04-23T10:28:41.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- 172.21.15.29:0/360287478 shutdown_connections 2024-04-23T10:28:41.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 --2- 172.21.15.29:0/360287478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c0c9b80 0x7f1f7c15b6e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 --2- 172.21.15.29:0/360287478 >> v2:172.21.15.72:3300/0 conn(0x7f1f7c151ca0 0x7f1f7c0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- 172.21.15.29:0/360287478 >> 172.21.15.29:0/360287478 conn(0x7f1f7c06b9e0 msgr2=0x7f1f7c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:41.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- 172.21.15.29:0/360287478 shutdown_connections 2024-04-23T10:28:41.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- 172.21.15.29:0/360287478 wait complete. 2024-04-23T10:28:41.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 Processor -- start 2024-04-23T10:28:41.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- start start 2024-04-23T10:28:41.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f7c0c9b80 0x7f1f7c1e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c151ca0 0x7f1f7c14e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f7c152080 0x7f1f7c0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c157e10 con 0x7f1f7c151ca0 2024-04-23T10:28:41.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c158ce0 con 0x7f1f7c0c9b80 2024-04-23T10:28:41.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f8139f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1f7c0ca860 con 0x7f1f7c152080 2024-04-23T10:28:41.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.465+0000 7f1f7a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c151ca0 0x7f1f7c14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7a7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c151ca0 0x7f1f7c14e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58420/0 (socket says 172.21.15.29:58420) 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7a7fc640 1 -- 172.21.15.29:0/723163263 learned_addr learned my addr 172.21.15.29:0/723163263 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7affd640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f7c0c9b80 0x7f1f7c1e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7b7fe640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f7c152080 0x7f1f7c0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7a7fc640 1 -- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f7c152080 msgr2=0x7f1f7c0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7a7fc640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f7c152080 0x7f1f7c0cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7a7fc640 1 -- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f7c0c9b80 msgr2=0x7f1f7c1e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7a7fc640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f7c0c9b80 0x7f1f7c1e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7a7fc640 1 -- 172.21.15.29:0/723163263 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c1e6a00 con 0x7f1f7c151ca0 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7b7fe640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f7c152080 0x7f1f7c0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:41.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7a7fc640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c151ca0 0x7f1f7c14e210 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400c4e0 tx=0x7f1f6400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f737fe640 1 -- 172.21.15.29:0/723163263 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64018070 con 0x7f1f7c151ca0 2024-04-23T10:28:41.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f737fe640 1 -- 172.21.15.29:0/723163263 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f64007500 con 0x7f1f7c151ca0 2024-04-23T10:28:41.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7c1577c0 con 0x7f1f7c151ca0 2024-04-23T10:28:41.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f737fe640 1 -- 172.21.15.29:0/723163263 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64004a30 con 0x7f1f7c151ca0 2024-04-23T10:28:41.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f7c1f0920 con 0x7f1f7c151ca0 2024-04-23T10:28:41.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7c0693c0 con 0x7f1f7c151ca0 2024-04-23T10:28:41.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f737fe640 1 -- 172.21.15.29:0/723163263 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f6401b070 con 0x7f1f7c151ca0 2024-04-23T10:28:41.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f737fe640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1f5c068400 0x7f1f5c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f737fe640 1 -- 172.21.15.29:0/723163263 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1f64086140 con 0x7f1f7c151ca0 2024-04-23T10:28:41.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.469+0000 7f1f7affd640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1f5c068400 0x7f1f5c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.473+0000 7f1f7affd640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1f5c068400 0x7f1f5c06a8c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1f74003fd0 tx=0x7f1f740039a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.473+0000 7f1f737fe640 1 -- 172.21.15.29:0/723163263 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f640563f0 con 0x7f1f7c151ca0 2024-04-23T10:28:41.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.637+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1f7c1514d0 con 0x7f1f7c151ca0 2024-04-23T10:28:41.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.637+0000 7f1f737fe640 1 -- 172.21.15.29:0/723163263 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f1f64055cf0 con 0x7f1f7c151ca0 2024-04-23T10:28:41.637 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:28:41.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1f5c068400 msgr2=0x7f1f5c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1f5c068400 0x7f1f5c06a8c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1f74003fd0 tx=0x7f1f740039a0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c151ca0 msgr2=0x7f1f7c14e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c151ca0 0x7f1f7c14e210 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400c4e0 tx=0x7f1f6400c9a0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 shutdown_connections 2024-04-23T10:28:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1f5c068400 0x7f1f5c06a8c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f7c152080 0x7f1f7c0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f7c151ca0 0x7f1f7c14e210 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 --2- 172.21.15.29:0/723163263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f7c0c9b80 0x7f1f7c1e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 >> 172.21.15.29:0/723163263 conn(0x7f1f7c06b9e0 msgr2=0x7f1f7c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 shutdown_connections 2024-04-23T10:28:41.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.641+0000 7f1f8139f640 1 -- 172.21.15.29:0/723163263 wait complete. 2024-04-23T10:28:41.657 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:28:41.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.785+0000 7f25d0a88640 1 Processor -- start 2024-04-23T10:28:41.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.785+0000 7f25d0a88640 1 -- start start 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25d0a88640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25cc153190 0x7f25cc159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25d0a88640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc06f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25d0a88640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25cc0c3fe0 con 0x7f25cc0ccc50 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25d0a88640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc159380 con 0x7f25cc153190 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25d0a88640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc0c42c0 con 0x7f25cc06f150 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25ca59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25cc153190 0x7f25cc159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25ca59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25cc153190 0x7f25cc159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58424/0 (socket says 172.21.15.29:58424) 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25ca59c640 1 -- 172.21.15.29:0/3685609162 learned_addr learned my addr 172.21.15.29:0/3685609162 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25c9d9b640 1 --2- 172.21.15.29:0/3685609162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25ca59c640 1 -- 172.21.15.29:0/3685609162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 msgr2=0x7f25cc06f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25ca59c640 1 --2- 172.21.15.29:0/3685609162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc06f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25ca59c640 1 -- 172.21.15.29:0/3685609162 >> v1:172.21.15.72:6789/0 conn(0x7f25cc0ccc50 legacy=0x7f25cc0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:41.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25ca59c640 1 -- 172.21.15.29:0/3685609162 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc0c45a0 con 0x7f25cc153190 2024-04-23T10:28:41.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25ca59c640 1 --2- 172.21.15.29:0/3685609162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc153190 0x7f25cc159810 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009870 tx=0x7f25b401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a794296fc20ac1d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25c959a640 1 -- 172.21.15.29:0/3685609162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b40b5070 con 0x7f25cc153190 2024-04-23T10:28:41.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25c959a640 1 -- 172.21.15.29:0/3685609162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b40a89d0 con 0x7f25cc153190 2024-04-23T10:28:41.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25c959a640 1 -- 172.21.15.29:0/3685609162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b40a8da0 con 0x7f25cc153190 2024-04-23T10:28:41.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25d0a88640 1 -- 172.21.15.29:0/3685609162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc153190 msgr2=0x7f25cc159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.789+0000 7f25d0a88640 1 --2- 172.21.15.29:0/3685609162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc153190 0x7f25cc159810 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009870 tx=0x7f25b401ed10 comp rx=0 tx=0).stop 2024-04-23T10:28:41.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- 172.21.15.29:0/3685609162 shutdown_connections 2024-04-23T10:28:41.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 --2- 172.21.15.29:0/3685609162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 --2- 172.21.15.29:0/3685609162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc153190 0x7f25cc159810 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- 172.21.15.29:0/3685609162 >> 172.21.15.29:0/3685609162 conn(0x7f25cc06cfb0 msgr2=0x7f25cc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:41.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- 172.21.15.29:0/3685609162 shutdown_connections 2024-04-23T10:28:41.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- 172.21.15.29:0/3685609162 wait complete. 2024-04-23T10:28:41.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 Processor -- start 2024-04-23T10:28:41.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- start start 2024-04-23T10:28:41.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc1f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc0ccc50 0x7f25cc1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc153190 0x7f25cc14b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0c4880 con 0x7f25cc0ccc50 2024-04-23T10:28:41.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc153570 con 0x7f25cc153190 2024-04-23T10:28:41.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc0c9070 con 0x7f25cc06f150 2024-04-23T10:28:41.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc0ccc50 0x7f25cc1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc0ccc50 0x7f25cc1549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58436/0 (socket says 172.21.15.29:58436) 2024-04-23T10:28:41.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 -- 172.21.15.29:0/1201045598 learned_addr learned my addr 172.21.15.29:0/1201045598 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:41.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25cad9d640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc153190 0x7f25cc14b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25ca59c640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc1f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 -- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 msgr2=0x7f25cc1f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc1f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 -- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc153190 msgr2=0x7f25cc14b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc153190 0x7f25cc14b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 -- 172.21.15.29:0/1201045598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc150700 con 0x7f25cc0ccc50 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25ca59c640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc1f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c9d9b640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc0ccc50 0x7f25cc1549f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c820 tx=0x7f25bc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c2ffd640 1 -- 172.21.15.29:0/1201045598 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc015070 con 0x7f25cc0ccc50 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c2ffd640 1 -- 172.21.15.29:0/1201045598 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25bc004240 con 0x7f25cc0ccc50 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc1f1dc0 con 0x7f25cc0ccc50 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25c2ffd640 1 -- 172.21.15.29:0/1201045598 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00ce10 con 0x7f25cc0ccc50 2024-04-23T10:28:41.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc150c50 con 0x7f25cc0ccc50 2024-04-23T10:28:41.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.793+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25cc068d70 con 0x7f25cc0ccc50 2024-04-23T10:28:41.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.797+0000 7f25c2ffd640 1 -- 172.21.15.29:0/1201045598 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f25bc007830 con 0x7f25cc0ccc50 2024-04-23T10:28:41.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.797+0000 7f25c2ffd640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f25ac0683b0 0x7f25ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:41.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.797+0000 7f25c2ffd640 1 -- 172.21.15.29:0/1201045598 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f25bc086b70 con 0x7f25cc0ccc50 2024-04-23T10:28:41.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.797+0000 7f25ca59c640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f25ac0683b0 0x7f25ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:41.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.797+0000 7f25ca59c640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f25ac0683b0 0x7f25ac06a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f25b40b2000 tx=0x7f25b40aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:41.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.801+0000 7f25c2ffd640 1 -- 172.21.15.29:0/1201045598 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f25bc056da0 con 0x7f25cc0ccc50 2024-04-23T10:28:41.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.961+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25cc150e50 con 0x7f25cc0ccc50 2024-04-23T10:28:41.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.961+0000 7f25c2ffd640 1 -- 172.21.15.29:0/1201045598 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f25bc0566a0 con 0x7f25cc0ccc50 2024-04-23T10:28:41.962 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f25ac0683b0 msgr2=0x7f25ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f25ac0683b0 0x7f25ac06a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f25b40b2000 tx=0x7f25b40aa070 comp rx=0 tx=0).stop 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc0ccc50 msgr2=0x7f25cc1549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc0ccc50 0x7f25cc1549f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c820 tx=0x7f25bc00cce0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 shutdown_connections 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f25ac0683b0 0x7f25ac06a870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25cc153190 0x7f25cc14b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25cc0ccc50 0x7f25cc1549f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 --2- 172.21.15.29:0/1201045598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25cc06f150 0x7f25cc1f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 >> 172.21.15.29:0/1201045598 conn(0x7f25cc06cfb0 msgr2=0x7f25cc158690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 shutdown_connections 2024-04-23T10:28:41.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:41.965+0000 7f25d0a88640 1 -- 172.21.15.29:0/1201045598 wait complete. 2024-04-23T10:28:41.982 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:28:42.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f3701640 1 Processor -- start 2024-04-23T10:28:42.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f3701640 1 -- start start 2024-04-23T10:28:42.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f3701640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12ec0ca3e0 0x7f12ec15f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f3701640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec06bdc0 0x7f12ec15b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f3701640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12ec071490 con 0x7f12ec06b9e0 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f3701640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f12ec15b6b0 con 0x7f12ec0ca3e0 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f3701640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f12ec0c9220 con 0x7f12ec06bdc0 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f149d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f12ec06b9e0 0x7f12ec0732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55172/0 (socket says 172.21.15.29:55172) 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f149d640 1 -- 172.21.15.29:0/3161800443 learned_addr learned my addr 172.21.15.29:0/3161800443 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f0c9c640 1 --2- 172.21.15.29:0/3161800443 >> v2:172.21.15.72:3300/0 conn(0x7f12ec0ca3e0 0x7f12ec15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f1c9e640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec06bdc0 0x7f12ec15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383987473 0 0) 0x7f12ec071490 con 0x7f12ec06b9e0 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12d8003530 con 0x7f12ec06b9e0 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3262947374 0 0) 0x7f12d8003530 con 0x7f12ec06b9e0 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec06bdc0 msgr2=0x7f12ec15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec06bdc0 0x7f12ec15b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 >> v2:172.21.15.72:3300/0 conn(0x7f12ec0ca3e0 msgr2=0x7f12ec15f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 --2- 172.21.15.29:0/3161800443 >> v2:172.21.15.72:3300/0 conn(0x7f12ec0ca3e0 0x7f12ec15f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec15e780 con 0x7f12ec06b9e0 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f12e8001a00 con 0x7f12ec06b9e0 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 >> v1:172.21.15.29:6789/0 conn(0x7f12ec06b9e0 legacy=0x7f12ec0732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d80039c0 0x7f12d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8004810 0x7f12d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec06bdc0 0x7f12d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec0c9220 con 0x7f12d80039c0 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f12d800b9d0 con 0x7f12d8004810 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f12d800bb50 con 0x7f12ec06bdc0 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f149d640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d80039c0 0x7f12d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f0c9c640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8004810 0x7f12d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f1c9e640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec06bdc0 0x7f12d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f149d640 1 -- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec06bdc0 msgr2=0x7f12d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f149d640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec06bdc0 0x7f12d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f149d640 1 -- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8004810 msgr2=0x7f12d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:42.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f149d640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8004810 0x7f12d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.117+0000 7f12f149d640 1 -- 172.21.15.29:0/3161800443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d8003530 con 0x7f12d80039c0 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f149d640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d80039c0 0x7f12d8003de0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f12e80013e0 tx=0x7f12e801fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dd4d2a92786628 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e800a4e0 con 0x7f12d80039c0 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e80aa650 con 0x7f12d80039c0 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12e3fff640 1 -- 172.21.15.29:0/3161800443 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e80aaa40 con 0x7f12d80039c0 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f3701640 1 -- 172.21.15.29:0/3161800443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d80039c0 msgr2=0x7f12d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f3701640 1 --2- 172.21.15.29:0/3161800443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d80039c0 0x7f12d8003de0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f12e80013e0 tx=0x7f12e801fb00 comp rx=0 tx=0).stop 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f1c9e640 1 -- 172.21.15.29:0/3161800443 reap_dead start 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f3701640 1 -- 172.21.15.29:0/3161800443 shutdown_connections 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f3701640 1 -- 172.21.15.29:0/3161800443 >> 172.21.15.29:0/3161800443 conn(0x7f12ec074d60 msgr2=0x7f12ec075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f3701640 1 -- 172.21.15.29:0/3161800443 shutdown_connections 2024-04-23T10:28:42.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f3701640 1 -- 172.21.15.29:0/3161800443 wait complete. 2024-04-23T10:28:42.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.121+0000 7f12f3701640 1 Processor -- start 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 -- start start 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d80039c0 0x7f12ec0c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ec15ab50 0x7f12ec159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec0c0cf0 0x7f12ec0bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec06c230 con 0x7f12ec15ab50 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec15ed40 con 0x7f12d80039c0 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f12ec071c80 con 0x7f12ec0c0cf0 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ec15ab50 0x7f12ec159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ec15ab50 0x7f12ec159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58446/0 (socket says 172.21.15.29:58446) 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 -- 172.21.15.29:0/2395161445 learned_addr learned my addr 172.21.15.29:0/2395161445 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f149d640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d80039c0 0x7f12ec0c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f1c9e640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec0c0cf0 0x7f12ec0bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 -- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec0c0cf0 msgr2=0x7f12ec0bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec0c0cf0 0x7f12ec0bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 -- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d80039c0 msgr2=0x7f12ec0c0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d80039c0 0x7f12ec0c0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 -- 172.21.15.29:0/2395161445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec0c0750 con 0x7f12ec15ab50 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f1c9e640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec0c0cf0 0x7f12ec0bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f0c9c640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ec15ab50 0x7f12ec159c50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f12dc011610 tx=0x7f12dc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12e1ffb640 1 -- 172.21.15.29:0/2395161445 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00f8f0 con 0x7f12ec15ab50 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12e1ffb640 1 -- 172.21.15.29:0/2395161445 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc00fa90 con 0x7f12ec15ab50 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ec15b090 con 0x7f12ec15ab50 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12e1ffb640 1 -- 172.21.15.29:0/2395161445 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00fe40 con 0x7f12ec15ab50 2024-04-23T10:28:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ec15a190 con 0x7f12ec15ab50 2024-04-23T10:28:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ec068d70 con 0x7f12ec15ab50 2024-04-23T10:28:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12e1ffb640 1 -- 172.21.15.29:0/2395161445 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12dc015460 con 0x7f12ec15ab50 2024-04-23T10:28:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12e1ffb640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12d00683b0 0x7f12d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.125+0000 7f12e1ffb640 1 -- 172.21.15.29:0/2395161445 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f12dc0876a0 con 0x7f12ec15ab50 2024-04-23T10:28:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.129+0000 7f12f149d640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12d00683b0 0x7f12d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.129+0000 7f12f149d640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12d00683b0 0x7f12d006a870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f12e80b0000 tx=0x7f12e8007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:42.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.133+0000 7f12e1ffb640 1 -- 172.21.15.29:0/2395161445 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12dc019030 con 0x7f12ec15ab50 2024-04-23T10:28:42.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f12ec071a60 con 0x7f12ec15ab50 2024-04-23T10:28:42.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12e1ffb640 1 -- 172.21.15.29:0/2395161445 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f12dc0577b0 con 0x7f12ec15ab50 2024-04-23T10:28:42.300 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12d00683b0 msgr2=0x7f12d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12d00683b0 0x7f12d006a870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f12e80b0000 tx=0x7f12e8007040 comp rx=0 tx=0).stop 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ec15ab50 msgr2=0x7f12ec159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ec15ab50 0x7f12ec159c50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f12dc011610 tx=0x7f12dc011ad0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 shutdown_connections 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f12d00683b0 0x7f12d006a870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12ec0c0cf0 0x7f12ec0bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12ec15ab50 0x7f12ec159c50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 --2- 172.21.15.29:0/2395161445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d80039c0 0x7f12ec0c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 >> 172.21.15.29:0/2395161445 conn(0x7f12ec074d60 msgr2=0x7f12ec0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 shutdown_connections 2024-04-23T10:28:42.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.301+0000 7f12f3701640 1 -- 172.21.15.29:0/2395161445 wait complete. 2024-04-23T10:28:42.320 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:28:42.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a297c640 1 Processor -- start 2024-04-23T10:28:42.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a297c640 1 -- start start 2024-04-23T10:28:42.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a297c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f689c0c7a40 0x7f689c0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a297c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f689c06da10 0x7f689c0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a297c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689c0c4120 con 0x7f689c15bd10 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a297c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f689c15f560 con 0x7f689c06da10 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a297c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f689c0b20e0 con 0x7f689c0c7a40 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f689bfff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f689c15bd10 0x7f689c0c2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55186/0 (socket says 172.21.15.29:55186) 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a0f19640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f689c06da10 0x7f689c0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f689bfff640 1 -- 172.21.15.29:0/4194021721 learned_addr learned my addr 172.21.15.29:0/4194021721 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a0f19640 1 -- 172.21.15.29:0/4194021721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f689c0c7a40 msgr2=0x7f689c0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a0f19640 1 --2- 172.21.15.29:0/4194021721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f689c0c7a40 0x7f689c0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a0f19640 1 -- 172.21.15.29:0/4194021721 >> v1:172.21.15.29:6789/0 conn(0x7f689c15bd10 legacy=0x7f689c0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f689b7fe640 1 -- 172.21.15.29:0/4194021721 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608881703 0 0) 0x7f689c0c4120 con 0x7f689c15bd10 2024-04-23T10:28:42.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.449+0000 7f68a0f19640 1 -- 172.21.15.29:0/4194021721 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c15f250 con 0x7f689c06da10 2024-04-23T10:28:42.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a0f19640 1 --2- 172.21.15.29:0/4194021721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c0cd590 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6894009d90 tx=0x7f689401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a2fb18899ad5d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:42.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689b7fe640 1 -- 172.21.15.29:0/4194021721 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68940b2070 con 0x7f689c06da10 2024-04-23T10:28:42.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689b7fe640 1 -- 172.21.15.29:0/4194021721 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68940a5940 con 0x7f689c06da10 2024-04-23T10:28:42.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689b7fe640 1 -- 172.21.15.29:0/4194021721 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68940a5d10 con 0x7f689c06da10 2024-04-23T10:28:42.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- 172.21.15.29:0/4194021721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 msgr2=0x7f689c0cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 --2- 172.21.15.29:0/4194021721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c0cd590 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6894009d90 tx=0x7f689401c970 comp rx=0 tx=0).stop 2024-04-23T10:28:42.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- 172.21.15.29:0/4194021721 shutdown_connections 2024-04-23T10:28:42.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 --2- 172.21.15.29:0/4194021721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c0cd590 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 --2- 172.21.15.29:0/4194021721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f689c0c7a40 0x7f689c0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- 172.21.15.29:0/4194021721 >> 172.21.15.29:0/4194021721 conn(0x7f689c06b9e0 msgr2=0x7f689c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:42.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- 172.21.15.29:0/4194021721 shutdown_connections 2024-04-23T10:28:42.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- 172.21.15.29:0/4194021721 wait complete. 2024-04-23T10:28:42.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 Processor -- start 2024-04-23T10:28:42.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- start start 2024-04-23T10:28:42.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c0c7a40 0x7f689c1f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f689c15bd10 0x7f689c1f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f689c06e660 con 0x7f689c06da10 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f689c06e4e0 con 0x7f689c0c7a40 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68a297c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f689c15c0f0 con 0x7f689c15bd10 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58466/0 (socket says 172.21.15.29:58466) 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689bfff640 1 -- 172.21.15.29:0/3697771191 learned_addr learned my addr 172.21.15.29:0/3697771191 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f68937fe640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c0c7a40 0x7f689c1f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689bfff640 1 -- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f689c15bd10 msgr2=0x7f689c1f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689bfff640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f689c15bd10 0x7f689c1f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689bfff640 1 -- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c0c7a40 msgr2=0x7f689c1f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689bfff640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c0c7a40 0x7f689c1f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.453+0000 7f689bfff640 1 -- 172.21.15.29:0/3697771191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c15c7a0 con 0x7f689c06da10 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68937fe640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c0c7a40 0x7f689c1f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f689bfff640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c15d7d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f688c0010f0 tx=0x7f688c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68997fa640 1 -- 172.21.15.29:0/3697771191 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c017070 con 0x7f689c06da10 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68997fa640 1 -- 172.21.15.29:0/3697771191 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c0074e0 con 0x7f689c06da10 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c0c4580 con 0x7f689c06da10 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68997fa640 1 -- 172.21.15.29:0/3697771191 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0059f0 con 0x7f689c06da10 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c1f3b90 con 0x7f689c06da10 2024-04-23T10:28:42.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689c1f3d90 con 0x7f689c06da10 2024-04-23T10:28:42.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68997fa640 1 -- 172.21.15.29:0/3697771191 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f688c01a070 con 0x7f689c06da10 2024-04-23T10:28:42.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68997fa640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f687c068380 0x7f687c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:42.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68997fa640 1 -- 172.21.15.29:0/3697771191 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f688c0860a0 con 0x7f689c06da10 2024-04-23T10:28:42.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68937fe640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f687c068380 0x7f687c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:42.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.457+0000 7f68937fe640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f687c068380 0x7f687c06a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f689c0c82c0 tx=0x7f6884008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:42.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.461+0000 7f68997fa640 1 -- 172.21.15.29:0/3697771191 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f688c0562d0 con 0x7f689c06da10 2024-04-23T10:28:42.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f689c0693c0 con 0x7f689c06da10 2024-04-23T10:28:42.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68997fa640 1 -- 172.21.15.29:0/3697771191 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f688c055bd0 con 0x7f689c06da10 2024-04-23T10:28:42.639 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-23T10:28:42.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f687c068380 msgr2=0x7f687c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f687c068380 0x7f687c06a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f689c0c82c0 tx=0x7f6884008040 comp rx=0 tx=0).stop 2024-04-23T10:28:42.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 msgr2=0x7f689c15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:42.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c15d7d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f688c0010f0 tx=0x7f688c00c8b0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 shutdown_connections 2024-04-23T10:28:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f687c068380 0x7f687c06a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f689c15bd10 0x7f689c1f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f689c0c7a40 0x7f689c1f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 --2- 172.21.15.29:0/3697771191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c06da10 0x7f689c15d7d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 >> 172.21.15.29:0/3697771191 conn(0x7f689c06b9e0 msgr2=0x7f689c071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 shutdown_connections 2024-04-23T10:28:42.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:42.641+0000 7f68a297c640 1 -- 172.21.15.29:0/3697771191 wait complete. 2024-04-23T10:28:42.661 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-04-23T10:28:42.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:28:42.661 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-23T10:28:42.671 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[35564]: fuse finished with error 0 and tester_r 0 2024-04-23T10:28:42.672 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:28:48.774 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:28:48.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:28:48.774 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-23T10:28:48.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:28:48.782 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-23T10:28:48.832 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-23T10:28:48.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:28:48.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:28:48.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:28:48.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-04-23T10:28:49.101 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-23T10:28:49.111 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T10:28:49.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:28:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.237+0000 7fbd85393640 1 Processor -- start 2024-04-23T10:28:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.237+0000 7fbd85393640 1 -- start start 2024-04-23T10:28:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd85393640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd800cee20 0x7fbd80073f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd85393640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd800c8f30 con 0x7fbd800cf200 2024-04-23T10:28:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd85393640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd800c62d0 con 0x7fbd80158ed0 2024-04-23T10:28:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd85393640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbd800c65b0 con 0x7fbd800cee20 2024-04-23T10:28:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd77fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbd800cf200 0x7fbd800c8480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34922/0 (socket says 172.21.15.29:34922) 2024-04-23T10:28:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd77fff640 1 -- 172.21.15.29:0/2523454454 learned_addr learned my addr 172.21.15.29:0/2523454454 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7effd640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd800cee20 0x7fbd80073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498779036 0 0) 0x7fbd800c8f30 con 0x7fbd800cf200 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd6c003530 con 0x7fbd800cf200 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 985247068 0 0) 0x7fbd6c003530 con 0x7fbd800cf200 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd800cee20 msgr2=0x7fbd80073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd800cee20 0x7fbd80073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 >> v1:172.21.15.72:6789/0 conn(0x7fbd80158ed0 legacy=0x7fbd80159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd800c6890 con 0x7fbd800cf200 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fbd68001680 con 0x7fbd800cf200 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 >> v1:172.21.15.29:6789/0 conn(0x7fbd800cf200 legacy=0x7fbd800c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6c0039f0 0x7fbd6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd800cee20 0x7fbd6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd6c004d50 0x7fbd6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbd800c65b0 con 0x7fbd6c0039f0 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c00b9d0 con 0x7fbd6c004d50 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c00bbd0 con 0x7fbd800cee20 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7effd640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6c0039f0 0x7fbd6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd77fff640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd800cee20 0x7fbd6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7f7fe640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd6c004d50 0x7fbd6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7effd640 1 -- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd800cee20 msgr2=0x7fbd6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7effd640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd800cee20 0x7fbd6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7effd640 1 -- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd6c004d50 msgr2=0x7fbd6c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7effd640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd6c004d50 0x7fbd6c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7effd640 1 -- 172.21.15.29:0/2523454454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c003530 con 0x7fbd6c0039f0 2024-04-23T10:28:49.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.241+0000 7fbd7f7fe640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd6c004d50 0x7fbd6c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd7effd640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6c0039f0 0x7fbd6c003dd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009ae0 tx=0x7fbd7001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5274c5dc9702626a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd700b2070 con 0x7fbd6c0039f0 2024-04-23T10:28:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd700a55a0 con 0x7fbd6c0039f0 2024-04-23T10:28:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd7e7fc640 1 -- 172.21.15.29:0/2523454454 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd700096b0 con 0x7fbd6c0039f0 2024-04-23T10:28:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- 172.21.15.29:0/2523454454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6c0039f0 msgr2=0x7fbd6c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 --2- 172.21.15.29:0/2523454454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd6c0039f0 0x7fbd6c003dd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009ae0 tx=0x7fbd7001c9b0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd7f7fe640 1 -- 172.21.15.29:0/2523454454 reap_dead start 2024-04-23T10:28:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- 172.21.15.29:0/2523454454 shutdown_connections 2024-04-23T10:28:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- 172.21.15.29:0/2523454454 >> 172.21.15.29:0/2523454454 conn(0x7fbd8006fc90 msgr2=0x7fbd80074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- 172.21.15.29:0/2523454454 shutdown_connections 2024-04-23T10:28:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- 172.21.15.29:0/2523454454 wait complete. 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 Processor -- start 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- start start 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd6c0039f0 0x7fbd8014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd80154920 0x7fbd80154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd801f1b80 0x7fbd801f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbd800740c0 con 0x7fbd80154920 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbd80073f40 con 0x7fbd801f1b80 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd85393640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbd80074240 con 0x7fbd6c0039f0 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd80154920 0x7fbd80154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd80154920 0x7fbd80154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39800/0 (socket says 172.21.15.29:39800) 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd77fff640 1 -- 172.21.15.29:0/3204787971 learned_addr learned my addr 172.21.15.29:0/3204787971 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd7effd640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd6c0039f0 0x7fbd8014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd7f7fe640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd801f1b80 0x7fbd801f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd77fff640 1 -- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd6c0039f0 msgr2=0x7fbd8014b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd77fff640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd6c0039f0 0x7fbd8014b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd77fff640 1 -- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd801f1b80 msgr2=0x7fbd801f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd77fff640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd801f1b80 0x7fbd801f1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd77fff640 1 -- 172.21.15.29:0/3204787971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd801f2520 con 0x7fbd80154920 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.245+0000 7fbd7effd640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd6c0039f0 0x7fbd8014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd77fff640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd80154920 0x7fbd80154d60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbd68004f80 tx=0x7fbd680074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd777fe640 1 -- 172.21.15.29:0/3204787971 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68007740 con 0x7fbd80154920 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd777fe640 1 -- 172.21.15.29:0/3204787971 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd68018070 con 0x7fbd80154920 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd777fe640 1 -- 172.21.15.29:0/3204787971 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800fb60 con 0x7fbd80154920 2024-04-23T10:28:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd80153880 con 0x7fbd80154920 2024-04-23T10:28:49.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd80153e40 con 0x7fbd80154920 2024-04-23T10:28:49.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd800693c0 con 0x7fbd80154920 2024-04-23T10:28:49.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd777fe640 1 -- 172.21.15.29:0/3204787971 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd6800fd00 con 0x7fbd80154920 2024-04-23T10:28:49.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd777fe640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbd600683b0 0x7fbd6006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd777fe640 1 -- 172.21.15.29:0/3204787971 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbd68086cf0 con 0x7fbd80154920 2024-04-23T10:28:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd7effd640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbd600683b0 0x7fbd6006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.249+0000 7fbd7effd640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbd600683b0 0x7fbd6006a870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbd700af000 tx=0x7fbd700046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:49.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.253+0000 7fbd777fe640 1 -- 172.21.15.29:0/3204787971 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd68056e80 con 0x7fbd80154920 2024-04-23T10:28:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.413+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd80073600 con 0x7fbd600683b0 2024-04-23T10:28:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.441+0000 7fbd777fe640 1 -- 172.21.15.29:0/3204787971 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334548 (secure 0 0 0) 0x7fbd7010eaf0 con 0x7fbd600683b0 2024-04-23T10:28:49.443 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:28:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbd600683b0 msgr2=0x7fbd6006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbd600683b0 0x7fbd6006a870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbd700af000 tx=0x7fbd700046d0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd80154920 msgr2=0x7fbd80154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd80154920 0x7fbd80154d60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbd68004f80 tx=0x7fbd680074f0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 shutdown_connections 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbd600683b0 0x7fbd6006a870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd801f1b80 0x7fbd801f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd80154920 0x7fbd80154d60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 --2- 172.21.15.29:0/3204787971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd6c0039f0 0x7fbd8014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 >> 172.21.15.29:0/3204787971 conn(0x7fbd8006fc90 msgr2=0x7fbd800cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 shutdown_connections 2024-04-23T10:28:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.445+0000 7fbd85393640 1 -- 172.21.15.29:0/3204787971 wait complete. 2024-04-23T10:28:49.463 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":417,"stamp":"2024-04-23T10:28:47.503897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137757708,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":3613,"num_read_kb":1517165,"num_write":34599,"num_write_kb":4410472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49038,"ondisk_log_size":49038,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":939960,"kb_used_data":271480,"kb_used_omap":12,"kb_used_meta":668403,"kb_avail":754034760,"statfs":{"total":773094113280,"available":772131594240,"internally_reserved":0,"allocated":277995520,"data_stored":276431000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":684445232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3637565,"num_objects":-496,"num_object_clones":0,"num_object_copies":-1976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-496,"num_whiteouts":0,"num_read":22,"num_read_kb":73,"num_write":607,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004531"},"pg_stats":[{"pgid":"2.1f","version":"26'99","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:33.266625+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:28:33.266625+0000","last_peered":"2024-04-23T10:28:33.266625+0000","last_clean":"2024-04-23T10:28:33.266625+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:28:33.266625+0000","last_undegraded":"2024-04-23T10:28:33.266625+0000","last_fullsized":"2024-04-23T10:28:33.266625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.761244+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:28:42.761244+0000","last_peered":"2024-04-23T10:28:42.761244+0000","last_clean":"2024-04-23T10:28:42.761244+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:28:42.761244+0000","last_undegraded":"2024-04-23T10:28:42.761244+0000","last_fullsized":"2024-04-23T10:28:42.761244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'789","reported_seq":878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.235748+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:28:39.235748+0000","last_peered":"2024-04-23T10:28:39.235748+0000","last_clean":"2024-04-23T10:28:39.235748+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:28:39.235748+0000","last_undegraded":"2024-04-23T10:28:39.235748+0000","last_fullsized":"2024-04-23T10:28:39.235748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31845,"num_write":775,"num_write_kb":142945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'95","reported_seq":127,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.125361+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:28:30.125361+0000","last_peered":"2024-04-23T10:28:30.125361+0000","last_clean":"2024-04-23T10:28:30.125361+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:28:30.125361+0000","last_undegraded":"2024-04-23T10:28:30.125361+0000","last_fullsized":"2024-04-23T10:28:30.125361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.786472+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:28:42.786472+0000","last_peered":"2024-04-23T10:28:42.786472+0000","last_clean":"2024-04-23T10:28:42.786472+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:28:42.786472+0000","last_undegraded":"2024-04-23T10:28:42.786472+0000","last_fullsized":"2024-04-23T10:28:42.786472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'755","reported_seq":872,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.217040+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:28:39.217040+0000","last_peered":"2024-04-23T10:28:39.217040+0000","last_clean":"2024-04-23T10:28:39.217040+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:28:39.217040+0000","last_undegraded":"2024-04-23T10:28:39.217040+0000","last_fullsized":"2024-04-23T10:28:39.217040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":56312,"num_write":739,"num_write_kb":106537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'962","reported_seq":993,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.157999+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:28:38.157999+0000","last_peered":"2024-04-23T10:28:38.157999+0000","last_clean":"2024-04-23T10:28:38.157999+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:28:38.157999+0000","last_undegraded":"2024-04-23T10:28:38.157999+0000","last_fullsized":"2024-04-23T10:28:38.157999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":12538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'189","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791598+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:28:42.791598+0000","last_peered":"2024-04-23T10:28:42.791598+0000","last_clean":"2024-04-23T10:28:42.791598+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:28:42.791598+0000","last_undegraded":"2024-04-23T10:28:42.791598+0000","last_fullsized":"2024-04-23T10:28:42.791598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'777","reported_seq":887,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.206811+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:28:39.206811+0000","last_peered":"2024-04-23T10:28:39.206811+0000","last_clean":"2024-04-23T10:28:39.206811+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:28:39.206811+0000","last_undegraded":"2024-04-23T10:28:39.206811+0000","last_fullsized":"2024-04-23T10:28:39.206811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47927,"num_write":766,"num_write_kb":159845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'381","reported_seq":412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:34.176429+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:28:34.176429+0000","last_peered":"2024-04-23T10:28:34.176429+0000","last_clean":"2024-04-23T10:28:34.176429+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:28:34.176429+0000","last_undegraded":"2024-04-23T10:28:34.176429+0000","last_fullsized":"2024-04-23T10:28:34.176429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791818+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:28:42.791818+0000","last_peered":"2024-04-23T10:28:42.791818+0000","last_clean":"2024-04-23T10:28:42.791818+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:28:42.791818+0000","last_undegraded":"2024-04-23T10:28:42.791818+0000","last_fullsized":"2024-04-23T10:28:42.791818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'750","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.175260+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:28:39.175260+0000","last_peered":"2024-04-23T10:28:39.175260+0000","last_clean":"2024-04-23T10:28:39.175260+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:28:39.175260+0000","last_undegraded":"2024-04-23T10:28:39.175260+0000","last_fullsized":"2024-04-23T10:28:39.175260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32547,"num_write":740,"num_write_kb":109806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'207","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.774782+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:28:42.774782+0000","last_peered":"2024-04-23T10:28:42.774782+0000","last_clean":"2024-04-23T10:28:42.774782+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:28:42.774782+0000","last_undegraded":"2024-04-23T10:28:42.774782+0000","last_fullsized":"2024-04-23T10:28:42.774782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'271","reported_seq":302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.085034+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:28:32.085034+0000","last_peered":"2024-04-23T10:28:32.085034+0000","last_clean":"2024-04-23T10:28:32.085034+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:28:32.085034+0000","last_undegraded":"2024-04-23T10:28:32.085034+0000","last_fullsized":"2024-04-23T10:28:32.085034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":8310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'776","reported_seq":911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.169088+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:28:38.169088+0000","last_peered":"2024-04-23T10:28:38.169088+0000","last_clean":"2024-04-23T10:28:38.169088+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:28:38.169088+0000","last_undegraded":"2024-04-23T10:28:38.169088+0000","last_fullsized":"2024-04-23T10:28:38.169088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57747,"num_write":758,"num_write_kb":151052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735623+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:28:42.735623+0000","last_peered":"2024-04-23T10:28:42.735623+0000","last_clean":"2024-04-23T10:28:42.735623+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:28:42.735623+0000","last_undegraded":"2024-04-23T10:28:42.735623+0000","last_fullsized":"2024-04-23T10:28:42.735623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'236","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.395266+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:28:38.395266+0000","last_peered":"2024-04-23T10:28:38.395266+0000","last_clean":"2024-04-23T10:28:38.395266+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:28:38.395266+0000","last_undegraded":"2024-04-23T10:28:38.395266+0000","last_fullsized":"2024-04-23T10:28:38.395266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.147546+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:28:39.147546+0000","last_peered":"2024-04-23T10:28:39.147546+0000","last_clean":"2024-04-23T10:28:39.147546+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:28:39.147546+0000","last_undegraded":"2024-04-23T10:28:39.147546+0000","last_fullsized":"2024-04-23T10:28:39.147546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":42307,"num_write":786,"num_write_kb":84940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'208","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746296+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:28:42.746296+0000","last_peered":"2024-04-23T10:28:42.746296+0000","last_clean":"2024-04-23T10:28:42.746296+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:28:42.746296+0000","last_undegraded":"2024-04-23T10:28:42.746296+0000","last_fullsized":"2024-04-23T10:28:42.746296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'75","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.187469+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:28:32.187469+0000","last_peered":"2024-04-23T10:28:32.187469+0000","last_clean":"2024-04-23T10:28:32.187469+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:28:32.187469+0000","last_undegraded":"2024-04-23T10:28:32.187469+0000","last_fullsized":"2024-04-23T10:28:32.187469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'766","reported_seq":886,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.194471+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:28:39.194471+0000","last_peered":"2024-04-23T10:28:39.194471+0000","last_clean":"2024-04-23T10:28:39.194471+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:28:39.194471+0000","last_undegraded":"2024-04-23T10:28:39.194471+0000","last_fullsized":"2024-04-23T10:28:39.194471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":54473,"num_write":759,"num_write_kb":130945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.690464+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:28:42.690464+0000","last_peered":"2024-04-23T10:28:42.690464+0000","last_clean":"2024-04-23T10:28:42.690464+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:28:42.690464+0000","last_undegraded":"2024-04-23T10:28:42.690464+0000","last_fullsized":"2024-04-23T10:28:42.690464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'963","reported_seq":995,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:34.174254+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:28:34.174254+0000","last_peered":"2024-04-23T10:28:34.174254+0000","last_clean":"2024-04-23T10:28:34.174254+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:28:34.174254+0000","last_undegraded":"2024-04-23T10:28:34.174254+0000","last_fullsized":"2024-04-23T10:28:34.174254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":4487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'727","reported_seq":836,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.246601+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:28:39.246601+0000","last_peered":"2024-04-23T10:28:39.246601+0000","last_clean":"2024-04-23T10:28:39.246601+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:28:39.246601+0000","last_undegraded":"2024-04-23T10:28:39.246601+0000","last_fullsized":"2024-04-23T10:28:39.246601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46853,"num_write":712,"num_write_kb":125891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'218","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746113+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:28:42.746113+0000","last_peered":"2024-04-23T10:28:42.746113+0000","last_clean":"2024-04-23T10:28:42.746113+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:28:42.746113+0000","last_undegraded":"2024-04-23T10:28:42.746113+0000","last_fullsized":"2024-04-23T10:28:42.746113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'73","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:36.425633+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:28:36.425633+0000","last_peered":"2024-04-23T10:28:36.425633+0000","last_clean":"2024-04-23T10:28:36.425633+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:28:36.425633+0000","last_undegraded":"2024-04-23T10:28:36.425633+0000","last_fullsized":"2024-04-23T10:28:36.425633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'725","reported_seq":813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.177812+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:28:39.177812+0000","last_peered":"2024-04-23T10:28:39.177812+0000","last_clean":"2024-04-23T10:28:39.177812+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:28:39.177812+0000","last_undegraded":"2024-04-23T10:28:39.177812+0000","last_fullsized":"2024-04-23T10:28:39.177812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33152,"num_write":717,"num_write_kb":76622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.771760+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:28:42.771760+0000","last_peered":"2024-04-23T10:28:42.771760+0000","last_clean":"2024-04-23T10:28:42.771760+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:28:42.771760+0000","last_undegraded":"2024-04-23T10:28:42.771760+0000","last_fullsized":"2024-04-23T10:28:42.771760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'520","reported_seq":552,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.924119+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:28:38.924119+0000","last_peered":"2024-04-23T10:28:38.924119+0000","last_clean":"2024-04-23T10:28:38.924119+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:28:38.924119+0000","last_undegraded":"2024-04-23T10:28:38.924119+0000","last_fullsized":"2024-04-23T10:28:38.924119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":1827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'785","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.161865+0000","last_change":"2024-04-23T10:16:27.066954+0000","last_active":"2024-04-23T10:28:38.161865+0000","last_peered":"2024-04-23T10:28:38.161865+0000","last_clean":"2024-04-23T10:28:38.161865+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:28:38.161865+0000","last_undegraded":"2024-04-23T10:28:38.161865+0000","last_fullsized":"2024-04-23T10:28:38.161865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:04:19.036666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28458,"num_write":774,"num_write_kb":115794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.737757+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:28:42.737757+0000","last_peered":"2024-04-23T10:28:42.737757+0000","last_clean":"2024-04-23T10:28:42.737757+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:28:42.737757+0000","last_undegraded":"2024-04-23T10:28:42.737757+0000","last_fullsized":"2024-04-23T10:28:42.737757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'255","reported_seq":287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.151694+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:28:32.151694+0000","last_peered":"2024-04-23T10:28:32.151694+0000","last_clean":"2024-04-23T10:28:32.151694+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:28:32.151694+0000","last_undegraded":"2024-04-23T10:28:32.151694+0000","last_fullsized":"2024-04-23T10:28:32.151694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'721","reported_seq":782,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.138151+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:28:39.138151+0000","last_peered":"2024-04-23T10:28:39.138151+0000","last_clean":"2024-04-23T10:28:39.138151+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:28:39.138151+0000","last_undegraded":"2024-04-23T10:28:39.138151+0000","last_fullsized":"2024-04-23T10:28:39.138151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21238,"num_write":700,"num_write_kb":76444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'211","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791453+0000","last_change":"2024-04-23T10:16:26.682509+0000","last_active":"2024-04-23T10:28:42.791453+0000","last_peered":"2024-04-23T10:28:42.791453+0000","last_clean":"2024-04-23T10:28:42.791453+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:28:42.791453+0000","last_undegraded":"2024-04-23T10:28:42.791453+0000","last_fullsized":"2024-04-23T10:28:42.791453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:03.876389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.092820+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:28:32.092820+0000","last_peered":"2024-04-23T10:28:32.092820+0000","last_clean":"2024-04-23T10:28:32.092820+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:28:32.092820+0000","last_undegraded":"2024-04-23T10:28:32.092820+0000","last_fullsized":"2024-04-23T10:28:32.092820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'775","reported_seq":838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.163395+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:28:39.163395+0000","last_peered":"2024-04-23T10:28:39.163395+0000","last_clean":"2024-04-23T10:28:39.163395+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:28:39.163395+0000","last_undegraded":"2024-04-23T10:28:39.163395+0000","last_fullsized":"2024-04-23T10:28:39.163395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25895,"num_write":752,"num_write_kb":125637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.726054+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:28:42.726054+0000","last_peered":"2024-04-23T10:28:42.726054+0000","last_clean":"2024-04-23T10:28:42.726054+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:28:42.726054+0000","last_undegraded":"2024-04-23T10:28:42.726054+0000","last_fullsized":"2024-04-23T10:28:42.726054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'706","reported_seq":738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:22.080601+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:28:22.080601+0000","last_peered":"2024-04-23T10:28:22.080601+0000","last_clean":"2024-04-23T10:28:22.080601+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:28:22.080601+0000","last_undegraded":"2024-04-23T10:28:22.080601+0000","last_fullsized":"2024-04-23T10:28:22.080601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":8518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'759","reported_seq":968,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.261178+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:28:39.261178+0000","last_peered":"2024-04-23T10:28:39.261178+0000","last_clean":"2024-04-23T10:28:39.261178+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:28:39.261178+0000","last_undegraded":"2024-04-23T10:28:39.261178+0000","last_fullsized":"2024-04-23T10:28:39.261178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":98862,"num_write":741,"num_write_kb":163671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'207","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.731572+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:28:42.731572+0000","last_peered":"2024-04-23T10:28:42.731572+0000","last_clean":"2024-04-23T10:28:42.731572+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:28:42.731572+0000","last_undegraded":"2024-04-23T10:28:42.731572+0000","last_fullsized":"2024-04-23T10:28:42.731572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'729","reported_seq":1409,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:40.123720+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:28:40.123720+0000","last_peered":"2024-04-23T10:28:40.123720+0000","last_clean":"2024-04-23T10:28:40.123720+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:28:40.123720+0000","last_undegraded":"2024-04-23T10:28:40.123720+0000","last_fullsized":"2024-04-23T10:28:40.123720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554323,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":662,"num_write_kb":1972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'710","reported_seq":799,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.217512+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:28:39.217512+0000","last_peered":"2024-04-23T10:28:39.217512+0000","last_clean":"2024-04-23T10:28:39.217512+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:28:39.217512+0000","last_undegraded":"2024-04-23T10:28:39.217512+0000","last_fullsized":"2024-04-23T10:28:39.217512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33554,"num_write":702,"num_write_kb":88722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759922+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:28:42.759922+0000","last_peered":"2024-04-23T10:28:42.759922+0000","last_clean":"2024-04-23T10:28:42.759922+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:28:42.759922+0000","last_undegraded":"2024-04-23T10:28:42.759922+0000","last_fullsized":"2024-04-23T10:28:42.759922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'335","reported_seq":367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.185295+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:28:32.185295+0000","last_peered":"2024-04-23T10:28:32.185295+0000","last_clean":"2024-04-23T10:28:32.185295+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:28:32.185295+0000","last_undegraded":"2024-04-23T10:28:32.185295+0000","last_fullsized":"2024-04-23T10:28:32.185295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'893","reported_seq":1085,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.223914+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:28:39.223914+0000","last_peered":"2024-04-23T10:28:39.223914+0000","last_clean":"2024-04-23T10:28:39.223914+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:28:39.223914+0000","last_undegraded":"2024-04-23T10:28:39.223914+0000","last_fullsized":"2024-04-23T10:28:39.223914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":90539,"num_write":885,"num_write_kb":222131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735139+0000","last_change":"2024-04-23T10:16:26.682268+0000","last_active":"2024-04-23T10:28:42.735139+0000","last_peered":"2024-04-23T10:28:42.735139+0000","last_clean":"2024-04-23T10:28:42.735139+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:28:42.735139+0000","last_undegraded":"2024-04-23T10:28:42.735139+0000","last_fullsized":"2024-04-23T10:28:42.735139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:30:42.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'76","reported_seq":108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.160988+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:28:38.160988+0000","last_peered":"2024-04-23T10:28:38.160988+0000","last_clean":"2024-04-23T10:28:38.160988+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:28:38.160988+0000","last_undegraded":"2024-04-23T10:28:38.160988+0000","last_fullsized":"2024-04-23T10:28:38.160988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:36.395058+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:25:36.395058+0000","last_peered":"2024-04-23T10:25:36.395058+0000","last_clean":"2024-04-23T10:25:36.395058+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:25:36.395058+0000","last_undegraded":"2024-04-23T10:25:36.395058+0000","last_fullsized":"2024-04-23T10:25:36.395058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'772","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.252010+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:28:39.252010+0000","last_peered":"2024-04-23T10:28:39.252010+0000","last_clean":"2024-04-23T10:28:39.252010+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:28:39.252010+0000","last_undegraded":"2024-04-23T10:28:39.252010+0000","last_fullsized":"2024-04-23T10:28:39.252010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47063,"num_write":757,"num_write_kb":125918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792417+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:28:42.792417+0000","last_peered":"2024-04-23T10:28:42.792417+0000","last_clean":"2024-04-23T10:28:42.792417+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:28:42.792417+0000","last_undegraded":"2024-04-23T10:28:42.792417+0000","last_fullsized":"2024-04-23T10:28:42.792417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'64","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.170196+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:28:39.170196+0000","last_peered":"2024-04-23T10:28:39.170196+0000","last_clean":"2024-04-23T10:28:39.170196+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:28:39.170196+0000","last_undegraded":"2024-04-23T10:28:39.170196+0000","last_fullsized":"2024-04-23T10:28:39.170196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'800","reported_seq":922,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.273293+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:28:39.273293+0000","last_peered":"2024-04-23T10:28:39.273293+0000","last_clean":"2024-04-23T10:28:39.273293+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:28:39.273293+0000","last_undegraded":"2024-04-23T10:28:39.273293+0000","last_fullsized":"2024-04-23T10:28:39.273293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":46277,"num_write":791,"num_write_kb":155967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.788550+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:28:42.788550+0000","last_peered":"2024-04-23T10:28:42.788550+0000","last_clean":"2024-04-23T10:28:42.788550+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:28:42.788550+0000","last_undegraded":"2024-04-23T10:28:42.788550+0000","last_fullsized":"2024-04-23T10:28:42.788550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'673","reported_seq":704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.209024+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:28:31.209024+0000","last_peered":"2024-04-23T10:28:31.209024+0000","last_clean":"2024-04-23T10:28:31.209024+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:28:31.209024+0000","last_undegraded":"2024-04-23T10:28:31.209024+0000","last_fullsized":"2024-04-23T10:28:31.209024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'770","reported_seq":890,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.295167+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:28:37.295167+0000","last_peered":"2024-04-23T10:28:37.295167+0000","last_clean":"2024-04-23T10:28:37.295167+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:28:37.295167+0000","last_undegraded":"2024-04-23T10:28:37.295167+0000","last_fullsized":"2024-04-23T10:28:37.295167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":57774,"num_write":776,"num_write_kb":117908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.778691+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:28:42.778691+0000","last_peered":"2024-04-23T10:28:42.778691+0000","last_clean":"2024-04-23T10:28:42.778691+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:28:42.778691+0000","last_undegraded":"2024-04-23T10:28:42.778691+0000","last_fullsized":"2024-04-23T10:28:42.778691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'437","reported_seq":468,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:27.091495+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:28:27.091495+0000","last_peered":"2024-04-23T10:28:27.091495+0000","last_clean":"2024-04-23T10:28:27.091495+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:28:27.091495+0000","last_undegraded":"2024-04-23T10:28:27.091495+0000","last_fullsized":"2024-04-23T10:28:27.091495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'820","reported_seq":989,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.242668+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:28:39.242668+0000","last_peered":"2024-04-23T10:28:39.242668+0000","last_clean":"2024-04-23T10:28:39.242668+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:28:39.242668+0000","last_undegraded":"2024-04-23T10:28:39.242668+0000","last_fullsized":"2024-04-23T10:28:39.242668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":78747,"num_write":811,"num_write_kb":155987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'186","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777993+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:28:42.777993+0000","last_peered":"2024-04-23T10:28:42.777993+0000","last_clean":"2024-04-23T10:28:42.777993+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:28:42.777993+0000","last_undegraded":"2024-04-23T10:28:42.777993+0000","last_fullsized":"2024-04-23T10:28:42.777993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'187","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.275846+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:28:37.275846+0000","last_peered":"2024-04-23T10:28:37.275846+0000","last_clean":"2024-04-23T10:28:37.275846+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:28:37.275846+0000","last_undegraded":"2024-04-23T10:28:37.275846+0000","last_fullsized":"2024-04-23T10:28:37.275846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'819","reported_seq":905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.269480+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:28:39.269480+0000","last_peered":"2024-04-23T10:28:39.269480+0000","last_clean":"2024-04-23T10:28:39.269480+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:28:39.269480+0000","last_undegraded":"2024-04-23T10:28:39.269480+0000","last_fullsized":"2024-04-23T10:28:39.269480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":36072,"num_write":807,"num_write_kb":130604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765068+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:28:42.765068+0000","last_peered":"2024-04-23T10:28:42.765068+0000","last_clean":"2024-04-23T10:28:42.765068+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:28:42.765068+0000","last_undegraded":"2024-04-23T10:28:42.765068+0000","last_fullsized":"2024-04-23T10:28:42.765068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'275","reported_seq":306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.141294+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:28:39.141294+0000","last_peered":"2024-04-23T10:28:39.141294+0000","last_clean":"2024-04-23T10:28:39.141294+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:28:39.141294+0000","last_undegraded":"2024-04-23T10:28:39.141294+0000","last_fullsized":"2024-04-23T10:28:39.141294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'783","reported_seq":890,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.205009+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:28:39.205009+0000","last_peered":"2024-04-23T10:28:39.205009+0000","last_clean":"2024-04-23T10:28:39.205009+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:28:39.205009+0000","last_undegraded":"2024-04-23T10:28:39.205009+0000","last_fullsized":"2024-04-23T10:28:39.205009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":28210,"num_write":769,"num_write_kb":122559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.725278+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:28:42.725278+0000","last_peered":"2024-04-23T10:28:42.725278+0000","last_clean":"2024-04-23T10:28:42.725278+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:28:42.725278+0000","last_undegraded":"2024-04-23T10:28:42.725278+0000","last_fullsized":"2024-04-23T10:28:42.725278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'67","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:28.067048+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:28:28.067048+0000","last_peered":"2024-04-23T10:28:28.067048+0000","last_clean":"2024-04-23T10:28:28.067048+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:28:28.067048+0000","last_undegraded":"2024-04-23T10:28:28.067048+0000","last_fullsized":"2024-04-23T10:28:28.067048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'801","reported_seq":932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.307545+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:28:37.307545+0000","last_peered":"2024-04-23T10:28:37.307545+0000","last_clean":"2024-04-23T10:28:37.307545+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:28:37.307545+0000","last_undegraded":"2024-04-23T10:28:37.307545+0000","last_fullsized":"2024-04-23T10:28:37.307545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":64319,"num_write":793,"num_write_kb":152801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.778485+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:28:42.778485+0000","last_peered":"2024-04-23T10:28:42.778485+0000","last_clean":"2024-04-23T10:28:42.778485+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:28:42.778485+0000","last_undegraded":"2024-04-23T10:28:42.778485+0000","last_fullsized":"2024-04-23T10:28:42.778485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'71","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.127628+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:28:39.127628+0000","last_peered":"2024-04-23T10:28:39.127628+0000","last_clean":"2024-04-23T10:28:39.127628+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:28:39.127628+0000","last_undegraded":"2024-04-23T10:28:39.127628+0000","last_fullsized":"2024-04-23T10:28:39.127628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'716","reported_seq":841,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.181269+0000","last_change":"2024-04-23T10:16:26.368606+0000","last_active":"2024-04-23T10:28:39.181269+0000","last_peered":"2024-04-23T10:28:39.181269+0000","last_clean":"2024-04-23T10:28:39.181269+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:28:39.181269+0000","last_undegraded":"2024-04-23T10:28:39.181269+0000","last_fullsized":"2024-04-23T10:28:39.181269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:02.237968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50110,"num_write":710,"num_write_kb":147181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.768300+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:28:42.768300+0000","last_peered":"2024-04-23T10:28:42.768300+0000","last_clean":"2024-04-23T10:28:42.768300+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:28:42.768300+0000","last_undegraded":"2024-04-23T10:28:42.768300+0000","last_fullsized":"2024-04-23T10:28:42.768300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'594","reported_seq":625,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:25.069702+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:28:25.069702+0000","last_peered":"2024-04-23T10:28:25.069702+0000","last_clean":"2024-04-23T10:28:25.069702+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:28:25.069702+0000","last_undegraded":"2024-04-23T10:28:25.069702+0000","last_fullsized":"2024-04-23T10:28:25.069702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.258805+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:28:39.258805+0000","last_peered":"2024-04-23T10:28:39.258805+0000","last_clean":"2024-04-23T10:28:39.258805+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:28:39.258805+0000","last_undegraded":"2024-04-23T10:28:39.258805+0000","last_fullsized":"2024-04-23T10:28:39.258805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41492,"num_write":740,"num_write_kb":126321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777861+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:28:42.777861+0000","last_peered":"2024-04-23T10:28:42.777861+0000","last_clean":"2024-04-23T10:28:42.777861+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:28:42.777861+0000","last_undegraded":"2024-04-23T10:28:42.777861+0000","last_fullsized":"2024-04-23T10:28:42.777861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'447","reported_seq":478,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.230434+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:28:30.230434+0000","last_peered":"2024-04-23T10:28:30.230434+0000","last_clean":"2024-04-23T10:28:30.230434+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:28:30.230434+0000","last_undegraded":"2024-04-23T10:28:30.230434+0000","last_fullsized":"2024-04-23T10:28:30.230434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'781","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.162612+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:28:39.162612+0000","last_peered":"2024-04-23T10:28:39.162612+0000","last_clean":"2024-04-23T10:28:39.162612+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:28:39.162612+0000","last_undegraded":"2024-04-23T10:28:39.162612+0000","last_fullsized":"2024-04-23T10:28:39.162612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":27921,"num_write":758,"num_write_kb":97957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'198","reported_seq":213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.769078+0000","last_change":"2024-04-23T10:16:26.366127+0000","last_active":"2024-04-23T10:28:42.769078+0000","last_peered":"2024-04-23T10:28:42.769078+0000","last_clean":"2024-04-23T10:28:42.769078+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:28:42.769078+0000","last_undegraded":"2024-04-23T10:28:42.769078+0000","last_fullsized":"2024-04-23T10:28:42.769078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:26.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"26'360","reported_seq":391,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:44.554991+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:28:44.554991+0000","last_peered":"2024-04-23T10:28:44.554991+0000","last_clean":"2024-04-23T10:28:44.554991+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:28:44.554991+0000","last_undegraded":"2024-04-23T10:28:44.554991+0000","last_fullsized":"2024-04-23T10:28:44.554991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1387233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'726","reported_seq":837,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.207970+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:28:39.207970+0000","last_peered":"2024-04-23T10:28:39.207970+0000","last_clean":"2024-04-23T10:28:39.207970+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:28:39.207970+0000","last_undegraded":"2024-04-23T10:28:39.207970+0000","last_fullsized":"2024-04-23T10:28:39.207970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44100,"num_write":714,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.744791+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:28:42.744791+0000","last_peered":"2024-04-23T10:28:42.744791+0000","last_clean":"2024-04-23T10:28:42.744791+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:28:42.744791+0000","last_undegraded":"2024-04-23T10:28:42.744791+0000","last_fullsized":"2024-04-23T10:28:42.744791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'237","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:36.118118+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:28:36.118118+0000","last_peered":"2024-04-23T10:28:36.118118+0000","last_clean":"2024-04-23T10:28:36.118118+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:28:36.118118+0000","last_undegraded":"2024-04-23T10:28:36.118118+0000","last_fullsized":"2024-04-23T10:28:36.118118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'829","reported_seq":953,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.250609+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:28:39.250609+0000","last_peered":"2024-04-23T10:28:39.250609+0000","last_clean":"2024-04-23T10:28:39.250609+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:28:39.250609+0000","last_undegraded":"2024-04-23T10:28:39.250609+0000","last_fullsized":"2024-04-23T10:28:39.250609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":58607,"num_write":815,"num_write_kb":134637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'221","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792069+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:28:42.792069+0000","last_peered":"2024-04-23T10:28:42.792069+0000","last_clean":"2024-04-23T10:28:42.792069+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:28:42.792069+0000","last_undegraded":"2024-04-23T10:28:42.792069+0000","last_fullsized":"2024-04-23T10:28:42.792069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'71","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.682822+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:28:42.682822+0000","last_peered":"2024-04-23T10:28:42.682822+0000","last_clean":"2024-04-23T10:28:42.682822+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:28:42.682822+0000","last_undegraded":"2024-04-23T10:28:42.682822+0000","last_fullsized":"2024-04-23T10:28:42.682822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'829","reported_seq":947,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.248571+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:28:39.248571+0000","last_peered":"2024-04-23T10:28:39.248571+0000","last_clean":"2024-04-23T10:28:39.248571+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:28:39.248571+0000","last_undegraded":"2024-04-23T10:28:39.248571+0000","last_fullsized":"2024-04-23T10:28:39.248571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":52124,"num_write":807,"num_write_kb":167221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'853","reported_seq":1000,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.219943+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:28:39.219943+0000","last_peered":"2024-04-23T10:28:39.219943+0000","last_clean":"2024-04-23T10:28:39.219943+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:28:39.219943+0000","last_undegraded":"2024-04-23T10:28:39.219943+0000","last_fullsized":"2024-04-23T10:28:39.219943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":70228,"num_write":840,"num_write_kb":218801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.758002+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:28:42.758002+0000","last_peered":"2024-04-23T10:28:42.758002+0000","last_clean":"2024-04-23T10:28:42.758002+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:28:42.758002+0000","last_undegraded":"2024-04-23T10:28:42.758002+0000","last_fullsized":"2024-04-23T10:28:42.758002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1123","reported_seq":1154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.131685+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:28:31.131685+0000","last_peered":"2024-04-23T10:28:31.131685+0000","last_clean":"2024-04-23T10:28:31.131685+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:28:31.131685+0000","last_undegraded":"2024-04-23T10:28:31.131685+0000","last_fullsized":"2024-04-23T10:28:31.131685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'763","reported_seq":848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.139173+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:28:37.139173+0000","last_peered":"2024-04-23T10:28:37.139173+0000","last_clean":"2024-04-23T10:28:37.139173+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:28:37.139173+0000","last_undegraded":"2024-04-23T10:28:37.139173+0000","last_fullsized":"2024-04-23T10:28:37.139173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":755,"num_write_kb":160183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746444+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:28:42.746444+0000","last_peered":"2024-04-23T10:28:42.746444+0000","last_clean":"2024-04-23T10:28:42.746444+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:42.746444+0000","last_undegraded":"2024-04-23T10:28:42.746444+0000","last_fullsized":"2024-04-23T10:28:42.746444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'101","reported_seq":132,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.163083+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:28:31.163083+0000","last_peered":"2024-04-23T10:28:31.163083+0000","last_clean":"2024-04-23T10:28:31.163083+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:28:31.163083+0000","last_undegraded":"2024-04-23T10:28:31.163083+0000","last_fullsized":"2024-04-23T10:28:31.163083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'346","reported_seq":377,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.151218+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:28:30.151218+0000","last_peered":"2024-04-23T10:28:30.151218+0000","last_clean":"2024-04-23T10:28:30.151218+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:28:30.151218+0000","last_undegraded":"2024-04-23T10:28:30.151218+0000","last_fullsized":"2024-04-23T10:28:30.151218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":12468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'181","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.758412+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:28:42.758412+0000","last_peered":"2024-04-23T10:28:42.758412+0000","last_clean":"2024-04-23T10:28:42.758412+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:42.758412+0000","last_undegraded":"2024-04-23T10:28:42.758412+0000","last_fullsized":"2024-04-23T10:28:42.758412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'746","reported_seq":883,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.187774+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:28:39.187774+0000","last_peered":"2024-04-23T10:28:39.187774+0000","last_clean":"2024-04-23T10:28:39.187774+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:28:39.187774+0000","last_undegraded":"2024-04-23T10:28:39.187774+0000","last_fullsized":"2024-04-23T10:28:39.187774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":53240,"num_write":729,"num_write_kb":139197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'111","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.092373+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:28:32.092373+0000","last_peered":"2024-04-23T10:28:32.092373+0000","last_clean":"2024-04-23T10:28:32.092373+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:28:32.092373+0000","last_undegraded":"2024-04-23T10:28:32.092373+0000","last_fullsized":"2024-04-23T10:28:32.092373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.761091+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:28:42.761091+0000","last_peered":"2024-04-23T10:28:42.761091+0000","last_clean":"2024-04-23T10:28:42.761091+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:28:42.761091+0000","last_undegraded":"2024-04-23T10:28:42.761091+0000","last_fullsized":"2024-04-23T10:28:42.761091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'701","reported_seq":783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.135009+0000","last_change":"2024-04-23T10:16:26.958520+0000","last_active":"2024-04-23T10:28:38.135009+0000","last_peered":"2024-04-23T10:28:38.135009+0000","last_clean":"2024-04-23T10:28:38.135009+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:28:38.135009+0000","last_undegraded":"2024-04-23T10:28:38.135009+0000","last_fullsized":"2024-04-23T10:28:38.135009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.464656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24902,"num_write":688,"num_write_kb":109624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'212","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.764520+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:28:42.764520+0000","last_peered":"2024-04-23T10:28:42.764520+0000","last_clean":"2024-04-23T10:28:42.764520+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:28:42.764520+0000","last_undegraded":"2024-04-23T10:28:42.764520+0000","last_fullsized":"2024-04-23T10:28:42.764520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'216","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.787955+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:28:42.787955+0000","last_peered":"2024-04-23T10:28:42.787955+0000","last_clean":"2024-04-23T10:28:42.787955+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:28:42.787955+0000","last_undegraded":"2024-04-23T10:28:42.787955+0000","last_fullsized":"2024-04-23T10:28:42.787955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'240","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.724207+0000","last_change":"2024-04-23T10:16:26.295163+0000","last_active":"2024-04-23T10:28:42.724207+0000","last_peered":"2024-04-23T10:28:42.724207+0000","last_clean":"2024-04-23T10:28:42.724207+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:28:42.724207+0000","last_undegraded":"2024-04-23T10:28:42.724207+0000","last_fullsized":"2024-04-23T10:28:42.724207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:23.533100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.747300+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:28:42.747300+0000","last_peered":"2024-04-23T10:28:42.747300+0000","last_clean":"2024-04-23T10:28:42.747300+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:28:42.747300+0000","last_undegraded":"2024-04-23T10:28:42.747300+0000","last_fullsized":"2024-04-23T10:28:42.747300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'187","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759594+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:28:42.759594+0000","last_peered":"2024-04-23T10:28:42.759594+0000","last_clean":"2024-04-23T10:28:42.759594+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:28:42.759594+0000","last_undegraded":"2024-04-23T10:28:42.759594+0000","last_fullsized":"2024-04-23T10:28:42.759594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'203","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746454+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:28:42.746454+0000","last_peered":"2024-04-23T10:28:42.746454+0000","last_clean":"2024-04-23T10:28:42.746454+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:28:42.746454+0000","last_undegraded":"2024-04-23T10:28:42.746454+0000","last_fullsized":"2024-04-23T10:28:42.746454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'239","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.767869+0000","last_change":"2024-04-23T10:16:26.295515+0000","last_active":"2024-04-23T10:28:42.767869+0000","last_peered":"2024-04-23T10:28:42.767869+0000","last_clean":"2024-04-23T10:28:42.767869+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:28:42.767869+0000","last_undegraded":"2024-04-23T10:28:42.767869+0000","last_fullsized":"2024-04-23T10:28:42.767869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:44:48.448837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.739678+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:28:42.739678+0000","last_peered":"2024-04-23T10:28:42.739678+0000","last_clean":"2024-04-23T10:28:42.739678+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:28:42.739678+0000","last_undegraded":"2024-04-23T10:28:42.739678+0000","last_fullsized":"2024-04-23T10:28:42.739678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'218","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.788708+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:28:42.788708+0000","last_peered":"2024-04-23T10:28:42.788708+0000","last_clean":"2024-04-23T10:28:42.788708+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:28:42.788708+0000","last_undegraded":"2024-04-23T10:28:42.788708+0000","last_fullsized":"2024-04-23T10:28:42.788708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759208+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:28:42.759208+0000","last_peered":"2024-04-23T10:28:42.759208+0000","last_clean":"2024-04-23T10:28:42.759208+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:28:42.759208+0000","last_undegraded":"2024-04-23T10:28:42.759208+0000","last_fullsized":"2024-04-23T10:28:42.759208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'207","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792281+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:28:42.792281+0000","last_peered":"2024-04-23T10:28:42.792281+0000","last_clean":"2024-04-23T10:28:42.792281+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:28:42.792281+0000","last_undegraded":"2024-04-23T10:28:42.792281+0000","last_fullsized":"2024-04-23T10:28:42.792281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'209","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.772044+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:28:42.772044+0000","last_peered":"2024-04-23T10:28:42.772044+0000","last_clean":"2024-04-23T10:28:42.772044+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:28:42.772044+0000","last_undegraded":"2024-04-23T10:28:42.772044+0000","last_fullsized":"2024-04-23T10:28:42.772044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'221","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.774617+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:28:42.774617+0000","last_peered":"2024-04-23T10:28:42.774617+0000","last_clean":"2024-04-23T10:28:42.774617+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:28:42.774617+0000","last_undegraded":"2024-04-23T10:28:42.774617+0000","last_fullsized":"2024-04-23T10:28:42.774617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.776817+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:28:42.776817+0000","last_peered":"2024-04-23T10:28:42.776817+0000","last_clean":"2024-04-23T10:28:42.776817+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:28:42.776817+0000","last_undegraded":"2024-04-23T10:28:42.776817+0000","last_fullsized":"2024-04-23T10:28:42.776817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.769568+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:28:42.769568+0000","last_peered":"2024-04-23T10:28:42.769568+0000","last_clean":"2024-04-23T10:28:42.769568+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:28:42.769568+0000","last_undegraded":"2024-04-23T10:28:42.769568+0000","last_fullsized":"2024-04-23T10:28:42.769568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.790426+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:28:42.790426+0000","last_peered":"2024-04-23T10:28:42.790426+0000","last_clean":"2024-04-23T10:28:42.790426+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:28:42.790426+0000","last_undegraded":"2024-04-23T10:28:42.790426+0000","last_fullsized":"2024-04-23T10:28:42.790426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791320+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:28:42.791320+0000","last_peered":"2024-04-23T10:28:42.791320+0000","last_clean":"2024-04-23T10:28:42.791320+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:28:42.791320+0000","last_undegraded":"2024-04-23T10:28:42.791320+0000","last_fullsized":"2024-04-23T10:28:42.791320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.739588+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:28:42.739588+0000","last_peered":"2024-04-23T10:28:42.739588+0000","last_clean":"2024-04-23T10:28:42.739588+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:28:42.739588+0000","last_undegraded":"2024-04-23T10:28:42.739588+0000","last_fullsized":"2024-04-23T10:28:42.739588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'211","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.752016+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:28:42.752016+0000","last_peered":"2024-04-23T10:28:42.752016+0000","last_clean":"2024-04-23T10:28:42.752016+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:28:42.752016+0000","last_undegraded":"2024-04-23T10:28:42.752016+0000","last_fullsized":"2024-04-23T10:28:42.752016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'198","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765626+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:28:42.765626+0000","last_peered":"2024-04-23T10:28:42.765626+0000","last_clean":"2024-04-23T10:28:42.765626+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:28:42.765626+0000","last_undegraded":"2024-04-23T10:28:42.765626+0000","last_fullsized":"2024-04-23T10:28:42.765626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.771282+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:28:42.771282+0000","last_peered":"2024-04-23T10:28:42.771282+0000","last_clean":"2024-04-23T10:28:42.771282+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:28:42.771282+0000","last_undegraded":"2024-04-23T10:28:42.771282+0000","last_fullsized":"2024-04-23T10:28:42.771282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.789862+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:28:42.789862+0000","last_peered":"2024-04-23T10:28:42.789862+0000","last_clean":"2024-04-23T10:28:42.789862+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:28:42.789862+0000","last_undegraded":"2024-04-23T10:28:42.789862+0000","last_fullsized":"2024-04-23T10:28:42.789862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.790198+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:28:42.790198+0000","last_peered":"2024-04-23T10:28:42.790198+0000","last_clean":"2024-04-23T10:28:42.790198+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:28:42.790198+0000","last_undegraded":"2024-04-23T10:28:42.790198+0000","last_fullsized":"2024-04-23T10:28:42.790198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'212","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792384+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:28:42.792384+0000","last_peered":"2024-04-23T10:28:42.792384+0000","last_clean":"2024-04-23T10:28:42.792384+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:28:42.792384+0000","last_undegraded":"2024-04-23T10:28:42.792384+0000","last_fullsized":"2024-04-23T10:28:42.792384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'194","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.993413+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:28:42.993413+0000","last_peered":"2024-04-23T10:28:42.993413+0000","last_clean":"2024-04-23T10:28:42.993413+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:28:42.993413+0000","last_undegraded":"2024-04-23T10:28:42.993413+0000","last_fullsized":"2024-04-23T10:28:42.993413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.753223+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:28:42.753223+0000","last_peered":"2024-04-23T10:28:42.753223+0000","last_clean":"2024-04-23T10:28:42.753223+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:28:42.753223+0000","last_undegraded":"2024-04-23T10:28:42.753223+0000","last_fullsized":"2024-04-23T10:28:42.753223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791471+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:28:42.791471+0000","last_peered":"2024-04-23T10:28:42.791471+0000","last_clean":"2024-04-23T10:28:42.791471+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:28:42.791471+0000","last_undegraded":"2024-04-23T10:28:42.791471+0000","last_fullsized":"2024-04-23T10:28:42.791471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'211","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765496+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:28:42.765496+0000","last_peered":"2024-04-23T10:28:42.765496+0000","last_clean":"2024-04-23T10:28:42.765496+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:28:42.765496+0000","last_undegraded":"2024-04-23T10:28:42.765496+0000","last_fullsized":"2024-04-23T10:28:42.765496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'201","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791523+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:28:42.791523+0000","last_peered":"2024-04-23T10:28:42.791523+0000","last_clean":"2024-04-23T10:28:42.791523+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:28:42.791523+0000","last_undegraded":"2024-04-23T10:28:42.791523+0000","last_fullsized":"2024-04-23T10:28:42.791523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'192","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.751731+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:28:42.751731+0000","last_peered":"2024-04-23T10:28:42.751731+0000","last_clean":"2024-04-23T10:28:42.751731+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:28:42.751731+0000","last_undegraded":"2024-04-23T10:28:42.751731+0000","last_fullsized":"2024-04-23T10:28:42.751731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.723451+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:28:42.723451+0000","last_peered":"2024-04-23T10:28:42.723451+0000","last_clean":"2024-04-23T10:28:42.723451+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:28:42.723451+0000","last_undegraded":"2024-04-23T10:28:42.723451+0000","last_fullsized":"2024-04-23T10:28:42.723451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'214","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.773391+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:28:42.773391+0000","last_peered":"2024-04-23T10:28:42.773391+0000","last_clean":"2024-04-23T10:28:42.773391+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:28:42.773391+0000","last_undegraded":"2024-04-23T10:28:42.773391+0000","last_fullsized":"2024-04-23T10:28:42.773391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2849,"num_read_kb":1515105,"num_write":24366,"num_write_kb":4267173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24772,"ondisk_log_size":24772,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13142,"ondisk_log_size":13142,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":137167340,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":10074,"num_write_kb":140883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274579456,"data_stored":274334680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11007,"ondisk_log_size":11007,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139456,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94232384,"statfs":{"total":96636764160,"available":96493961216,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111508,"kb_used_data":26252,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94260332,"statfs":{"total":96636764160,"available":96522579968,"internally_reserved":0,"allocated":26882048,"data_stored":26671347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142116,"kb_used_data":34588,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94229724,"statfs":{"total":96636764160,"available":96491237376,"internally_reserved":0,"allocated":35418112,"data_stored":35225169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73128,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298712,"statfs":{"total":96636764160,"available":96561881088,"internally_reserved":0,"allocated":10256384,"data_stored":10059311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137856,"kb_used_data":30328,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94233984,"statfs":{"total":96636764160,"available":96495599616,"internally_reserved":0,"allocated":31055872,"data_stored":30862669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30777344,"data_stored":30748221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9977856,"data_stored":9944863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35139584,"data_stored":35110721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26603520,"data_stored":26556899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:28:49.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:28:49.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff9a6280640 1 Processor -- start 2024-04-23T10:28:49.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff9a6280640 1 -- start start 2024-04-23T10:28:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff9a6280640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9a006f3b0 0x7ff9a00c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff9a6280640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a0154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff9a6280640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a015eae0 con 0x7ff9a00c7600 2024-04-23T10:28:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff9a6280640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a0073b70 con 0x7ff9a006f3b0 2024-04-23T10:28:49.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff9a6280640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a015edc0 con 0x7ff9a00c8950 2024-04-23T10:28:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff99ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9a006f3b0 0x7ff9a00c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff99f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a0154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff99ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9a006f3b0 0x7ff9a00c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.29:42100/0 (socket says 172.21.15.29:42100) 2024-04-23T10:28:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff99ffff640 1 -- 172.21.15.29:0/956299783 learned_addr learned my addr 172.21.15.29:0/956299783 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff99ffff640 1 -- 172.21.15.29:0/956299783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 msgr2=0x7ff9a0154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff99ffff640 1 --2- 172.21.15.29:0/956299783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a0154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff99ffff640 1 -- 172.21.15.29:0/956299783 >> v1:172.21.15.72:6789/0 conn(0x7ff9a00c7600 legacy=0x7ff9a0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.633+0000 7ff99ffff640 1 -- 172.21.15.29:0/956299783 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a015f0a0 con 0x7ff9a006f3b0 2024-04-23T10:28:49.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff99ffff640 1 --2- 172.21.15.29:0/956299783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a006f3b0 0x7ff9a00c70c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff998009870 tx=0x7ff99801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f5eeed4a5a970ff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:49.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff99effd640 1 -- 172.21.15.29:0/956299783 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980b5070 con 0x7ff9a006f3b0 2024-04-23T10:28:49.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff99effd640 1 -- 172.21.15.29:0/956299783 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9980a8a50 con 0x7ff9a006f3b0 2024-04-23T10:28:49.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff99effd640 1 -- 172.21.15.29:0/956299783 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a8e20 con 0x7ff9a006f3b0 2024-04-23T10:28:49.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 -- 172.21.15.29:0/956299783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a006f3b0 msgr2=0x7ff9a00c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 --2- 172.21.15.29:0/956299783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a006f3b0 0x7ff9a00c70c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff998009870 tx=0x7ff99801ed50 comp rx=0 tx=0).stop 2024-04-23T10:28:49.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 -- 172.21.15.29:0/956299783 shutdown_connections 2024-04-23T10:28:49.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 --2- 172.21.15.29:0/956299783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a0154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 --2- 172.21.15.29:0/956299783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a006f3b0 0x7ff9a00c70c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 -- 172.21.15.29:0/956299783 >> 172.21.15.29:0/956299783 conn(0x7ff9a006cfb0 msgr2=0x7ff9a006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:49.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 -- 172.21.15.29:0/956299783 shutdown_connections 2024-04-23T10:28:49.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 -- 172.21.15.29:0/956299783 wait complete. 2024-04-23T10:28:49.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.637+0000 7ff9a6280640 1 Processor -- start 2024-04-23T10:28:49.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 -- start start 2024-04-23T10:28:49.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a006f3b0 0x7ff9a0149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a00c7600 0x7ff9a00be350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a00c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a0071960 con 0x7ff9a006f3b0 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a015f660 con 0x7ff9a00c7600 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a015e780 con 0x7ff9a00c8950 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a006f3b0 0x7ff9a0149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a006f3b0 0x7ff9a0149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39814/0 (socket says 172.21.15.29:39814) 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 -- 172.21.15.29:0/2298410622 learned_addr learned my addr 172.21.15.29:0/2298410622 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99f7fe640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a00c7600 0x7ff9a00be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a481d640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a00c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 -- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 msgr2=0x7ff9a00c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a00c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 -- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a00c7600 msgr2=0x7ff9a00be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a00c7600 0x7ff9a00be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 -- 172.21.15.29:0/2298410622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a01f4fc0 con 0x7ff9a006f3b0 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a481d640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a00c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99ffff640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a006f3b0 0x7ff9a0149240 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff99801d400 tx=0x7ff99801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99cff9640 1 -- 172.21.15.29:0/2298410622 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980b5070 con 0x7ff9a006f3b0 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99cff9640 1 -- 172.21.15.29:0/2298410622 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9980b0de0 con 0x7ff9a006f3b0 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a01f52a0 con 0x7ff9a006f3b0 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99cff9640 1 -- 172.21.15.29:0/2298410622 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980bb670 con 0x7ff9a006f3b0 2024-04-23T10:28:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a01f1560 con 0x7ff9a006f3b0 2024-04-23T10:28:49.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a0068d70 con 0x7ff9a006f3b0 2024-04-23T10:28:49.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99cff9640 1 -- 172.21.15.29:0/2298410622 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff9980c2060 con 0x7ff9a006f3b0 2024-04-23T10:28:49.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99cff9640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff980068380 0x7ff98006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:49.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99cff9640 1 -- 172.21.15.29:0/2298410622 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff998124720 con 0x7ff9a006f3b0 2024-04-23T10:28:49.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.641+0000 7ff99f7fe640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff980068380 0x7ff98006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:49.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.645+0000 7ff99f7fe640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff980068380 0x7ff98006a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff9a015e750 tx=0x7ff988008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:49.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.645+0000 7ff99cff9640 1 -- 172.21.15.29:0/2298410622 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9980188b0 con 0x7ff9a006f3b0 2024-04-23T10:28:49.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.801+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9a00c7a60 con 0x7ff980068380 2024-04-23T10:28:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.825+0000 7ff99cff9640 1 -- 172.21.15.29:0/2298410622 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334544 (secure 0 0 0) 0x7ff9a00c7a60 con 0x7ff980068380 2024-04-23T10:28:49.826 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:49.829 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:28:49.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff980068380 msgr2=0x7ff98006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff980068380 0x7ff98006a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff9a015e750 tx=0x7ff988008040 comp rx=0 tx=0).stop 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a006f3b0 msgr2=0x7ff9a0149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a006f3b0 0x7ff9a0149240 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff99801d400 tx=0x7ff99801baf0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 shutdown_connections 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff980068380 0x7ff98006a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9a00c8950 0x7ff9a00c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9a00c7600 0x7ff9a00be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 --2- 172.21.15.29:0/2298410622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9a006f3b0 0x7ff9a0149240 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 >> 172.21.15.29:0/2298410622 conn(0x7ff9a006cfb0 msgr2=0x7ff9a00c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 shutdown_connections 2024-04-23T10:28:49.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:49.829+0000 7ff9a6280640 1 -- 172.21.15.29:0/2298410622 wait complete. 2024-04-23T10:28:49.846 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":418,"stamp":"2024-04-23T10:28:49.505031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137757708,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":3613,"num_read_kb":1517165,"num_write":34599,"num_write_kb":4410472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49038,"ondisk_log_size":49038,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":939960,"kb_used_data":271480,"kb_used_omap":12,"kb_used_meta":668403,"kb_avail":754034760,"statfs":{"total":773094113280,"available":772131594240,"internally_reserved":0,"allocated":277995520,"data_stored":276431000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":684445232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-816434,"num_objects":-197,"num_object_clones":0,"num_object_copies":-788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-197,"num_whiteouts":0,"num_read":10,"num_read_kb":30,"num_write":253,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005096"},"pg_stats":[{"pgid":"2.1f","version":"26'99","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:33.266625+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:28:33.266625+0000","last_peered":"2024-04-23T10:28:33.266625+0000","last_clean":"2024-04-23T10:28:33.266625+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:28:33.266625+0000","last_undegraded":"2024-04-23T10:28:33.266625+0000","last_fullsized":"2024-04-23T10:28:33.266625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.761244+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:28:42.761244+0000","last_peered":"2024-04-23T10:28:42.761244+0000","last_clean":"2024-04-23T10:28:42.761244+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:28:42.761244+0000","last_undegraded":"2024-04-23T10:28:42.761244+0000","last_fullsized":"2024-04-23T10:28:42.761244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'789","reported_seq":878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.235748+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:28:39.235748+0000","last_peered":"2024-04-23T10:28:39.235748+0000","last_clean":"2024-04-23T10:28:39.235748+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:28:39.235748+0000","last_undegraded":"2024-04-23T10:28:39.235748+0000","last_fullsized":"2024-04-23T10:28:39.235748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31845,"num_write":775,"num_write_kb":142945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'95","reported_seq":127,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.125361+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:28:30.125361+0000","last_peered":"2024-04-23T10:28:30.125361+0000","last_clean":"2024-04-23T10:28:30.125361+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:28:30.125361+0000","last_undegraded":"2024-04-23T10:28:30.125361+0000","last_fullsized":"2024-04-23T10:28:30.125361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.786472+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:28:42.786472+0000","last_peered":"2024-04-23T10:28:42.786472+0000","last_clean":"2024-04-23T10:28:42.786472+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:28:42.786472+0000","last_undegraded":"2024-04-23T10:28:42.786472+0000","last_fullsized":"2024-04-23T10:28:42.786472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'755","reported_seq":872,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.217040+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:28:39.217040+0000","last_peered":"2024-04-23T10:28:39.217040+0000","last_clean":"2024-04-23T10:28:39.217040+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:28:39.217040+0000","last_undegraded":"2024-04-23T10:28:39.217040+0000","last_fullsized":"2024-04-23T10:28:39.217040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":56312,"num_write":739,"num_write_kb":106537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'962","reported_seq":993,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.157999+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:28:38.157999+0000","last_peered":"2024-04-23T10:28:38.157999+0000","last_clean":"2024-04-23T10:28:38.157999+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:28:38.157999+0000","last_undegraded":"2024-04-23T10:28:38.157999+0000","last_fullsized":"2024-04-23T10:28:38.157999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":12538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'189","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791598+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:28:42.791598+0000","last_peered":"2024-04-23T10:28:42.791598+0000","last_clean":"2024-04-23T10:28:42.791598+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:28:42.791598+0000","last_undegraded":"2024-04-23T10:28:42.791598+0000","last_fullsized":"2024-04-23T10:28:42.791598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'777","reported_seq":887,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.206811+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:28:39.206811+0000","last_peered":"2024-04-23T10:28:39.206811+0000","last_clean":"2024-04-23T10:28:39.206811+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:28:39.206811+0000","last_undegraded":"2024-04-23T10:28:39.206811+0000","last_fullsized":"2024-04-23T10:28:39.206811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47927,"num_write":766,"num_write_kb":159845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'381","reported_seq":412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:34.176429+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:28:34.176429+0000","last_peered":"2024-04-23T10:28:34.176429+0000","last_clean":"2024-04-23T10:28:34.176429+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:28:34.176429+0000","last_undegraded":"2024-04-23T10:28:34.176429+0000","last_fullsized":"2024-04-23T10:28:34.176429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791818+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:28:42.791818+0000","last_peered":"2024-04-23T10:28:42.791818+0000","last_clean":"2024-04-23T10:28:42.791818+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:28:42.791818+0000","last_undegraded":"2024-04-23T10:28:42.791818+0000","last_fullsized":"2024-04-23T10:28:42.791818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'750","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.175260+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:28:39.175260+0000","last_peered":"2024-04-23T10:28:39.175260+0000","last_clean":"2024-04-23T10:28:39.175260+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:28:39.175260+0000","last_undegraded":"2024-04-23T10:28:39.175260+0000","last_fullsized":"2024-04-23T10:28:39.175260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32547,"num_write":740,"num_write_kb":109806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'207","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.774782+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:28:42.774782+0000","last_peered":"2024-04-23T10:28:42.774782+0000","last_clean":"2024-04-23T10:28:42.774782+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:28:42.774782+0000","last_undegraded":"2024-04-23T10:28:42.774782+0000","last_fullsized":"2024-04-23T10:28:42.774782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'271","reported_seq":302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.085034+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:28:32.085034+0000","last_peered":"2024-04-23T10:28:32.085034+0000","last_clean":"2024-04-23T10:28:32.085034+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:28:32.085034+0000","last_undegraded":"2024-04-23T10:28:32.085034+0000","last_fullsized":"2024-04-23T10:28:32.085034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":8310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'776","reported_seq":911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.169088+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:28:38.169088+0000","last_peered":"2024-04-23T10:28:38.169088+0000","last_clean":"2024-04-23T10:28:38.169088+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:28:38.169088+0000","last_undegraded":"2024-04-23T10:28:38.169088+0000","last_fullsized":"2024-04-23T10:28:38.169088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57747,"num_write":758,"num_write_kb":151052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735623+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:28:42.735623+0000","last_peered":"2024-04-23T10:28:42.735623+0000","last_clean":"2024-04-23T10:28:42.735623+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:28:42.735623+0000","last_undegraded":"2024-04-23T10:28:42.735623+0000","last_fullsized":"2024-04-23T10:28:42.735623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'236","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.395266+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:28:38.395266+0000","last_peered":"2024-04-23T10:28:38.395266+0000","last_clean":"2024-04-23T10:28:38.395266+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:28:38.395266+0000","last_undegraded":"2024-04-23T10:28:38.395266+0000","last_fullsized":"2024-04-23T10:28:38.395266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.147546+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:28:39.147546+0000","last_peered":"2024-04-23T10:28:39.147546+0000","last_clean":"2024-04-23T10:28:39.147546+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:28:39.147546+0000","last_undegraded":"2024-04-23T10:28:39.147546+0000","last_fullsized":"2024-04-23T10:28:39.147546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":42307,"num_write":786,"num_write_kb":84940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'208","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746296+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:28:42.746296+0000","last_peered":"2024-04-23T10:28:42.746296+0000","last_clean":"2024-04-23T10:28:42.746296+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:28:42.746296+0000","last_undegraded":"2024-04-23T10:28:42.746296+0000","last_fullsized":"2024-04-23T10:28:42.746296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'75","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.187469+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:28:32.187469+0000","last_peered":"2024-04-23T10:28:32.187469+0000","last_clean":"2024-04-23T10:28:32.187469+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:28:32.187469+0000","last_undegraded":"2024-04-23T10:28:32.187469+0000","last_fullsized":"2024-04-23T10:28:32.187469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'766","reported_seq":886,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.194471+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:28:39.194471+0000","last_peered":"2024-04-23T10:28:39.194471+0000","last_clean":"2024-04-23T10:28:39.194471+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:28:39.194471+0000","last_undegraded":"2024-04-23T10:28:39.194471+0000","last_fullsized":"2024-04-23T10:28:39.194471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":54473,"num_write":759,"num_write_kb":130945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.690464+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:28:42.690464+0000","last_peered":"2024-04-23T10:28:42.690464+0000","last_clean":"2024-04-23T10:28:42.690464+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:28:42.690464+0000","last_undegraded":"2024-04-23T10:28:42.690464+0000","last_fullsized":"2024-04-23T10:28:42.690464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'963","reported_seq":995,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:34.174254+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:28:34.174254+0000","last_peered":"2024-04-23T10:28:34.174254+0000","last_clean":"2024-04-23T10:28:34.174254+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:28:34.174254+0000","last_undegraded":"2024-04-23T10:28:34.174254+0000","last_fullsized":"2024-04-23T10:28:34.174254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":4487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'727","reported_seq":836,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.246601+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:28:39.246601+0000","last_peered":"2024-04-23T10:28:39.246601+0000","last_clean":"2024-04-23T10:28:39.246601+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:28:39.246601+0000","last_undegraded":"2024-04-23T10:28:39.246601+0000","last_fullsized":"2024-04-23T10:28:39.246601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46853,"num_write":712,"num_write_kb":125891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'218","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746113+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:28:42.746113+0000","last_peered":"2024-04-23T10:28:42.746113+0000","last_clean":"2024-04-23T10:28:42.746113+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:28:42.746113+0000","last_undegraded":"2024-04-23T10:28:42.746113+0000","last_fullsized":"2024-04-23T10:28:42.746113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'73","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:36.425633+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:28:36.425633+0000","last_peered":"2024-04-23T10:28:36.425633+0000","last_clean":"2024-04-23T10:28:36.425633+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:28:36.425633+0000","last_undegraded":"2024-04-23T10:28:36.425633+0000","last_fullsized":"2024-04-23T10:28:36.425633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'725","reported_seq":813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.177812+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:28:39.177812+0000","last_peered":"2024-04-23T10:28:39.177812+0000","last_clean":"2024-04-23T10:28:39.177812+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:28:39.177812+0000","last_undegraded":"2024-04-23T10:28:39.177812+0000","last_fullsized":"2024-04-23T10:28:39.177812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33152,"num_write":717,"num_write_kb":76622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.771760+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:28:42.771760+0000","last_peered":"2024-04-23T10:28:42.771760+0000","last_clean":"2024-04-23T10:28:42.771760+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:28:42.771760+0000","last_undegraded":"2024-04-23T10:28:42.771760+0000","last_fullsized":"2024-04-23T10:28:42.771760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'520","reported_seq":552,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.924119+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:28:38.924119+0000","last_peered":"2024-04-23T10:28:38.924119+0000","last_clean":"2024-04-23T10:28:38.924119+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:28:38.924119+0000","last_undegraded":"2024-04-23T10:28:38.924119+0000","last_fullsized":"2024-04-23T10:28:38.924119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":1827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'785","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.161865+0000","last_change":"2024-04-23T10:16:27.066954+0000","last_active":"2024-04-23T10:28:38.161865+0000","last_peered":"2024-04-23T10:28:38.161865+0000","last_clean":"2024-04-23T10:28:38.161865+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:28:38.161865+0000","last_undegraded":"2024-04-23T10:28:38.161865+0000","last_fullsized":"2024-04-23T10:28:38.161865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:04:19.036666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28458,"num_write":774,"num_write_kb":115794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.737757+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:28:42.737757+0000","last_peered":"2024-04-23T10:28:42.737757+0000","last_clean":"2024-04-23T10:28:42.737757+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:28:42.737757+0000","last_undegraded":"2024-04-23T10:28:42.737757+0000","last_fullsized":"2024-04-23T10:28:42.737757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'255","reported_seq":287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.151694+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:28:32.151694+0000","last_peered":"2024-04-23T10:28:32.151694+0000","last_clean":"2024-04-23T10:28:32.151694+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:28:32.151694+0000","last_undegraded":"2024-04-23T10:28:32.151694+0000","last_fullsized":"2024-04-23T10:28:32.151694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'721","reported_seq":782,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.138151+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:28:39.138151+0000","last_peered":"2024-04-23T10:28:39.138151+0000","last_clean":"2024-04-23T10:28:39.138151+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:28:39.138151+0000","last_undegraded":"2024-04-23T10:28:39.138151+0000","last_fullsized":"2024-04-23T10:28:39.138151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21238,"num_write":700,"num_write_kb":76444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'211","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791453+0000","last_change":"2024-04-23T10:16:26.682509+0000","last_active":"2024-04-23T10:28:42.791453+0000","last_peered":"2024-04-23T10:28:42.791453+0000","last_clean":"2024-04-23T10:28:42.791453+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:28:42.791453+0000","last_undegraded":"2024-04-23T10:28:42.791453+0000","last_fullsized":"2024-04-23T10:28:42.791453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:03.876389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.092820+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:28:32.092820+0000","last_peered":"2024-04-23T10:28:32.092820+0000","last_clean":"2024-04-23T10:28:32.092820+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:28:32.092820+0000","last_undegraded":"2024-04-23T10:28:32.092820+0000","last_fullsized":"2024-04-23T10:28:32.092820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'775","reported_seq":838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.163395+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:28:39.163395+0000","last_peered":"2024-04-23T10:28:39.163395+0000","last_clean":"2024-04-23T10:28:39.163395+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:28:39.163395+0000","last_undegraded":"2024-04-23T10:28:39.163395+0000","last_fullsized":"2024-04-23T10:28:39.163395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25895,"num_write":752,"num_write_kb":125637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.726054+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:28:42.726054+0000","last_peered":"2024-04-23T10:28:42.726054+0000","last_clean":"2024-04-23T10:28:42.726054+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:28:42.726054+0000","last_undegraded":"2024-04-23T10:28:42.726054+0000","last_fullsized":"2024-04-23T10:28:42.726054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'706","reported_seq":738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:22.080601+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:28:22.080601+0000","last_peered":"2024-04-23T10:28:22.080601+0000","last_clean":"2024-04-23T10:28:22.080601+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:28:22.080601+0000","last_undegraded":"2024-04-23T10:28:22.080601+0000","last_fullsized":"2024-04-23T10:28:22.080601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":8518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'759","reported_seq":968,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.261178+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:28:39.261178+0000","last_peered":"2024-04-23T10:28:39.261178+0000","last_clean":"2024-04-23T10:28:39.261178+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:28:39.261178+0000","last_undegraded":"2024-04-23T10:28:39.261178+0000","last_fullsized":"2024-04-23T10:28:39.261178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":98862,"num_write":741,"num_write_kb":163671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'207","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.731572+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:28:42.731572+0000","last_peered":"2024-04-23T10:28:42.731572+0000","last_clean":"2024-04-23T10:28:42.731572+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:28:42.731572+0000","last_undegraded":"2024-04-23T10:28:42.731572+0000","last_fullsized":"2024-04-23T10:28:42.731572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'729","reported_seq":1409,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:40.123720+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:28:40.123720+0000","last_peered":"2024-04-23T10:28:40.123720+0000","last_clean":"2024-04-23T10:28:40.123720+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:28:40.123720+0000","last_undegraded":"2024-04-23T10:28:40.123720+0000","last_fullsized":"2024-04-23T10:28:40.123720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554323,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":662,"num_write_kb":1972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'710","reported_seq":799,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.217512+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:28:39.217512+0000","last_peered":"2024-04-23T10:28:39.217512+0000","last_clean":"2024-04-23T10:28:39.217512+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:28:39.217512+0000","last_undegraded":"2024-04-23T10:28:39.217512+0000","last_fullsized":"2024-04-23T10:28:39.217512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33554,"num_write":702,"num_write_kb":88722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759922+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:28:42.759922+0000","last_peered":"2024-04-23T10:28:42.759922+0000","last_clean":"2024-04-23T10:28:42.759922+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:28:42.759922+0000","last_undegraded":"2024-04-23T10:28:42.759922+0000","last_fullsized":"2024-04-23T10:28:42.759922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'335","reported_seq":367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.185295+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:28:32.185295+0000","last_peered":"2024-04-23T10:28:32.185295+0000","last_clean":"2024-04-23T10:28:32.185295+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:28:32.185295+0000","last_undegraded":"2024-04-23T10:28:32.185295+0000","last_fullsized":"2024-04-23T10:28:32.185295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'893","reported_seq":1085,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.223914+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:28:39.223914+0000","last_peered":"2024-04-23T10:28:39.223914+0000","last_clean":"2024-04-23T10:28:39.223914+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:28:39.223914+0000","last_undegraded":"2024-04-23T10:28:39.223914+0000","last_fullsized":"2024-04-23T10:28:39.223914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":90539,"num_write":885,"num_write_kb":222131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735139+0000","last_change":"2024-04-23T10:16:26.682268+0000","last_active":"2024-04-23T10:28:42.735139+0000","last_peered":"2024-04-23T10:28:42.735139+0000","last_clean":"2024-04-23T10:28:42.735139+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:28:42.735139+0000","last_undegraded":"2024-04-23T10:28:42.735139+0000","last_fullsized":"2024-04-23T10:28:42.735139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:30:42.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'76","reported_seq":108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.160988+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:28:38.160988+0000","last_peered":"2024-04-23T10:28:38.160988+0000","last_clean":"2024-04-23T10:28:38.160988+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:28:38.160988+0000","last_undegraded":"2024-04-23T10:28:38.160988+0000","last_fullsized":"2024-04-23T10:28:38.160988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:36.395058+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:25:36.395058+0000","last_peered":"2024-04-23T10:25:36.395058+0000","last_clean":"2024-04-23T10:25:36.395058+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:25:36.395058+0000","last_undegraded":"2024-04-23T10:25:36.395058+0000","last_fullsized":"2024-04-23T10:25:36.395058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'772","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.252010+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:28:39.252010+0000","last_peered":"2024-04-23T10:28:39.252010+0000","last_clean":"2024-04-23T10:28:39.252010+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:28:39.252010+0000","last_undegraded":"2024-04-23T10:28:39.252010+0000","last_fullsized":"2024-04-23T10:28:39.252010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47063,"num_write":757,"num_write_kb":125918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792417+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:28:42.792417+0000","last_peered":"2024-04-23T10:28:42.792417+0000","last_clean":"2024-04-23T10:28:42.792417+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:28:42.792417+0000","last_undegraded":"2024-04-23T10:28:42.792417+0000","last_fullsized":"2024-04-23T10:28:42.792417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'64","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.170196+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:28:39.170196+0000","last_peered":"2024-04-23T10:28:39.170196+0000","last_clean":"2024-04-23T10:28:39.170196+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:28:39.170196+0000","last_undegraded":"2024-04-23T10:28:39.170196+0000","last_fullsized":"2024-04-23T10:28:39.170196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'800","reported_seq":922,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.273293+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:28:39.273293+0000","last_peered":"2024-04-23T10:28:39.273293+0000","last_clean":"2024-04-23T10:28:39.273293+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:28:39.273293+0000","last_undegraded":"2024-04-23T10:28:39.273293+0000","last_fullsized":"2024-04-23T10:28:39.273293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":46277,"num_write":791,"num_write_kb":155967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.788550+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:28:42.788550+0000","last_peered":"2024-04-23T10:28:42.788550+0000","last_clean":"2024-04-23T10:28:42.788550+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:28:42.788550+0000","last_undegraded":"2024-04-23T10:28:42.788550+0000","last_fullsized":"2024-04-23T10:28:42.788550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'673","reported_seq":704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.209024+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:28:31.209024+0000","last_peered":"2024-04-23T10:28:31.209024+0000","last_clean":"2024-04-23T10:28:31.209024+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:28:31.209024+0000","last_undegraded":"2024-04-23T10:28:31.209024+0000","last_fullsized":"2024-04-23T10:28:31.209024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'770","reported_seq":890,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.295167+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:28:37.295167+0000","last_peered":"2024-04-23T10:28:37.295167+0000","last_clean":"2024-04-23T10:28:37.295167+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:28:37.295167+0000","last_undegraded":"2024-04-23T10:28:37.295167+0000","last_fullsized":"2024-04-23T10:28:37.295167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":57774,"num_write":776,"num_write_kb":117908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.778691+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:28:42.778691+0000","last_peered":"2024-04-23T10:28:42.778691+0000","last_clean":"2024-04-23T10:28:42.778691+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:28:42.778691+0000","last_undegraded":"2024-04-23T10:28:42.778691+0000","last_fullsized":"2024-04-23T10:28:42.778691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'437","reported_seq":468,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:27.091495+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:28:27.091495+0000","last_peered":"2024-04-23T10:28:27.091495+0000","last_clean":"2024-04-23T10:28:27.091495+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:28:27.091495+0000","last_undegraded":"2024-04-23T10:28:27.091495+0000","last_fullsized":"2024-04-23T10:28:27.091495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'820","reported_seq":989,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.242668+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:28:39.242668+0000","last_peered":"2024-04-23T10:28:39.242668+0000","last_clean":"2024-04-23T10:28:39.242668+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:28:39.242668+0000","last_undegraded":"2024-04-23T10:28:39.242668+0000","last_fullsized":"2024-04-23T10:28:39.242668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":78747,"num_write":811,"num_write_kb":155987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'186","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777993+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:28:42.777993+0000","last_peered":"2024-04-23T10:28:42.777993+0000","last_clean":"2024-04-23T10:28:42.777993+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:28:42.777993+0000","last_undegraded":"2024-04-23T10:28:42.777993+0000","last_fullsized":"2024-04-23T10:28:42.777993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'187","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.275846+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:28:37.275846+0000","last_peered":"2024-04-23T10:28:37.275846+0000","last_clean":"2024-04-23T10:28:37.275846+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:28:37.275846+0000","last_undegraded":"2024-04-23T10:28:37.275846+0000","last_fullsized":"2024-04-23T10:28:37.275846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'819","reported_seq":905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.269480+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:28:39.269480+0000","last_peered":"2024-04-23T10:28:39.269480+0000","last_clean":"2024-04-23T10:28:39.269480+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:28:39.269480+0000","last_undegraded":"2024-04-23T10:28:39.269480+0000","last_fullsized":"2024-04-23T10:28:39.269480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":36072,"num_write":807,"num_write_kb":130604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765068+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:28:42.765068+0000","last_peered":"2024-04-23T10:28:42.765068+0000","last_clean":"2024-04-23T10:28:42.765068+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:28:42.765068+0000","last_undegraded":"2024-04-23T10:28:42.765068+0000","last_fullsized":"2024-04-23T10:28:42.765068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'275","reported_seq":306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.141294+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:28:39.141294+0000","last_peered":"2024-04-23T10:28:39.141294+0000","last_clean":"2024-04-23T10:28:39.141294+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:28:39.141294+0000","last_undegraded":"2024-04-23T10:28:39.141294+0000","last_fullsized":"2024-04-23T10:28:39.141294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'783","reported_seq":890,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.205009+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:28:39.205009+0000","last_peered":"2024-04-23T10:28:39.205009+0000","last_clean":"2024-04-23T10:28:39.205009+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:28:39.205009+0000","last_undegraded":"2024-04-23T10:28:39.205009+0000","last_fullsized":"2024-04-23T10:28:39.205009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":28210,"num_write":769,"num_write_kb":122559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.725278+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:28:42.725278+0000","last_peered":"2024-04-23T10:28:42.725278+0000","last_clean":"2024-04-23T10:28:42.725278+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:28:42.725278+0000","last_undegraded":"2024-04-23T10:28:42.725278+0000","last_fullsized":"2024-04-23T10:28:42.725278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'67","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:28.067048+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:28:28.067048+0000","last_peered":"2024-04-23T10:28:28.067048+0000","last_clean":"2024-04-23T10:28:28.067048+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:28:28.067048+0000","last_undegraded":"2024-04-23T10:28:28.067048+0000","last_fullsized":"2024-04-23T10:28:28.067048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'801","reported_seq":932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.307545+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:28:37.307545+0000","last_peered":"2024-04-23T10:28:37.307545+0000","last_clean":"2024-04-23T10:28:37.307545+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:28:37.307545+0000","last_undegraded":"2024-04-23T10:28:37.307545+0000","last_fullsized":"2024-04-23T10:28:37.307545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":64319,"num_write":793,"num_write_kb":152801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.778485+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:28:42.778485+0000","last_peered":"2024-04-23T10:28:42.778485+0000","last_clean":"2024-04-23T10:28:42.778485+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:28:42.778485+0000","last_undegraded":"2024-04-23T10:28:42.778485+0000","last_fullsized":"2024-04-23T10:28:42.778485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'71","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.127628+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:28:39.127628+0000","last_peered":"2024-04-23T10:28:39.127628+0000","last_clean":"2024-04-23T10:28:39.127628+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:28:39.127628+0000","last_undegraded":"2024-04-23T10:28:39.127628+0000","last_fullsized":"2024-04-23T10:28:39.127628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'716","reported_seq":841,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.181269+0000","last_change":"2024-04-23T10:16:26.368606+0000","last_active":"2024-04-23T10:28:39.181269+0000","last_peered":"2024-04-23T10:28:39.181269+0000","last_clean":"2024-04-23T10:28:39.181269+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:28:39.181269+0000","last_undegraded":"2024-04-23T10:28:39.181269+0000","last_fullsized":"2024-04-23T10:28:39.181269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:02.237968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50110,"num_write":710,"num_write_kb":147181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.768300+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:28:42.768300+0000","last_peered":"2024-04-23T10:28:42.768300+0000","last_clean":"2024-04-23T10:28:42.768300+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:28:42.768300+0000","last_undegraded":"2024-04-23T10:28:42.768300+0000","last_fullsized":"2024-04-23T10:28:42.768300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'594","reported_seq":625,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:25.069702+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:28:25.069702+0000","last_peered":"2024-04-23T10:28:25.069702+0000","last_clean":"2024-04-23T10:28:25.069702+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:28:25.069702+0000","last_undegraded":"2024-04-23T10:28:25.069702+0000","last_fullsized":"2024-04-23T10:28:25.069702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.258805+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:28:39.258805+0000","last_peered":"2024-04-23T10:28:39.258805+0000","last_clean":"2024-04-23T10:28:39.258805+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:28:39.258805+0000","last_undegraded":"2024-04-23T10:28:39.258805+0000","last_fullsized":"2024-04-23T10:28:39.258805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41492,"num_write":740,"num_write_kb":126321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777861+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:28:42.777861+0000","last_peered":"2024-04-23T10:28:42.777861+0000","last_clean":"2024-04-23T10:28:42.777861+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:28:42.777861+0000","last_undegraded":"2024-04-23T10:28:42.777861+0000","last_fullsized":"2024-04-23T10:28:42.777861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'447","reported_seq":478,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.230434+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:28:30.230434+0000","last_peered":"2024-04-23T10:28:30.230434+0000","last_clean":"2024-04-23T10:28:30.230434+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:28:30.230434+0000","last_undegraded":"2024-04-23T10:28:30.230434+0000","last_fullsized":"2024-04-23T10:28:30.230434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'781","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.162612+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:28:39.162612+0000","last_peered":"2024-04-23T10:28:39.162612+0000","last_clean":"2024-04-23T10:28:39.162612+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:28:39.162612+0000","last_undegraded":"2024-04-23T10:28:39.162612+0000","last_fullsized":"2024-04-23T10:28:39.162612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":27921,"num_write":758,"num_write_kb":97957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'198","reported_seq":213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.769078+0000","last_change":"2024-04-23T10:16:26.366127+0000","last_active":"2024-04-23T10:28:42.769078+0000","last_peered":"2024-04-23T10:28:42.769078+0000","last_clean":"2024-04-23T10:28:42.769078+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:28:42.769078+0000","last_undegraded":"2024-04-23T10:28:42.769078+0000","last_fullsized":"2024-04-23T10:28:42.769078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:26.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"26'360","reported_seq":391,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:44.554991+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:28:44.554991+0000","last_peered":"2024-04-23T10:28:44.554991+0000","last_clean":"2024-04-23T10:28:44.554991+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:28:44.554991+0000","last_undegraded":"2024-04-23T10:28:44.554991+0000","last_fullsized":"2024-04-23T10:28:44.554991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1387233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'726","reported_seq":837,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.207970+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:28:39.207970+0000","last_peered":"2024-04-23T10:28:39.207970+0000","last_clean":"2024-04-23T10:28:39.207970+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:28:39.207970+0000","last_undegraded":"2024-04-23T10:28:39.207970+0000","last_fullsized":"2024-04-23T10:28:39.207970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44100,"num_write":714,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.744791+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:28:42.744791+0000","last_peered":"2024-04-23T10:28:42.744791+0000","last_clean":"2024-04-23T10:28:42.744791+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:28:42.744791+0000","last_undegraded":"2024-04-23T10:28:42.744791+0000","last_fullsized":"2024-04-23T10:28:42.744791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'237","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:36.118118+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:28:36.118118+0000","last_peered":"2024-04-23T10:28:36.118118+0000","last_clean":"2024-04-23T10:28:36.118118+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:28:36.118118+0000","last_undegraded":"2024-04-23T10:28:36.118118+0000","last_fullsized":"2024-04-23T10:28:36.118118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'829","reported_seq":953,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.250609+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:28:39.250609+0000","last_peered":"2024-04-23T10:28:39.250609+0000","last_clean":"2024-04-23T10:28:39.250609+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:28:39.250609+0000","last_undegraded":"2024-04-23T10:28:39.250609+0000","last_fullsized":"2024-04-23T10:28:39.250609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":58607,"num_write":815,"num_write_kb":134637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'221","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792069+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:28:42.792069+0000","last_peered":"2024-04-23T10:28:42.792069+0000","last_clean":"2024-04-23T10:28:42.792069+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:28:42.792069+0000","last_undegraded":"2024-04-23T10:28:42.792069+0000","last_fullsized":"2024-04-23T10:28:42.792069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'71","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.682822+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:28:42.682822+0000","last_peered":"2024-04-23T10:28:42.682822+0000","last_clean":"2024-04-23T10:28:42.682822+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:28:42.682822+0000","last_undegraded":"2024-04-23T10:28:42.682822+0000","last_fullsized":"2024-04-23T10:28:42.682822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'829","reported_seq":947,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.248571+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:28:39.248571+0000","last_peered":"2024-04-23T10:28:39.248571+0000","last_clean":"2024-04-23T10:28:39.248571+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:28:39.248571+0000","last_undegraded":"2024-04-23T10:28:39.248571+0000","last_fullsized":"2024-04-23T10:28:39.248571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":52124,"num_write":807,"num_write_kb":167221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'853","reported_seq":1000,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.219943+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:28:39.219943+0000","last_peered":"2024-04-23T10:28:39.219943+0000","last_clean":"2024-04-23T10:28:39.219943+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:28:39.219943+0000","last_undegraded":"2024-04-23T10:28:39.219943+0000","last_fullsized":"2024-04-23T10:28:39.219943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":70228,"num_write":840,"num_write_kb":218801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.758002+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:28:42.758002+0000","last_peered":"2024-04-23T10:28:42.758002+0000","last_clean":"2024-04-23T10:28:42.758002+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:28:42.758002+0000","last_undegraded":"2024-04-23T10:28:42.758002+0000","last_fullsized":"2024-04-23T10:28:42.758002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1123","reported_seq":1154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.131685+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:28:31.131685+0000","last_peered":"2024-04-23T10:28:31.131685+0000","last_clean":"2024-04-23T10:28:31.131685+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:28:31.131685+0000","last_undegraded":"2024-04-23T10:28:31.131685+0000","last_fullsized":"2024-04-23T10:28:31.131685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'763","reported_seq":848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.139173+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:28:37.139173+0000","last_peered":"2024-04-23T10:28:37.139173+0000","last_clean":"2024-04-23T10:28:37.139173+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:28:37.139173+0000","last_undegraded":"2024-04-23T10:28:37.139173+0000","last_fullsized":"2024-04-23T10:28:37.139173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":755,"num_write_kb":160183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746444+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:28:42.746444+0000","last_peered":"2024-04-23T10:28:42.746444+0000","last_clean":"2024-04-23T10:28:42.746444+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:42.746444+0000","last_undegraded":"2024-04-23T10:28:42.746444+0000","last_fullsized":"2024-04-23T10:28:42.746444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'101","reported_seq":132,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.163083+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:28:31.163083+0000","last_peered":"2024-04-23T10:28:31.163083+0000","last_clean":"2024-04-23T10:28:31.163083+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:28:31.163083+0000","last_undegraded":"2024-04-23T10:28:31.163083+0000","last_fullsized":"2024-04-23T10:28:31.163083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'346","reported_seq":377,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.151218+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:28:30.151218+0000","last_peered":"2024-04-23T10:28:30.151218+0000","last_clean":"2024-04-23T10:28:30.151218+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:28:30.151218+0000","last_undegraded":"2024-04-23T10:28:30.151218+0000","last_fullsized":"2024-04-23T10:28:30.151218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":12468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'181","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.758412+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:28:42.758412+0000","last_peered":"2024-04-23T10:28:42.758412+0000","last_clean":"2024-04-23T10:28:42.758412+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:42.758412+0000","last_undegraded":"2024-04-23T10:28:42.758412+0000","last_fullsized":"2024-04-23T10:28:42.758412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'746","reported_seq":883,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.187774+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:28:39.187774+0000","last_peered":"2024-04-23T10:28:39.187774+0000","last_clean":"2024-04-23T10:28:39.187774+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:28:39.187774+0000","last_undegraded":"2024-04-23T10:28:39.187774+0000","last_fullsized":"2024-04-23T10:28:39.187774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":53240,"num_write":729,"num_write_kb":139197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'111","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.092373+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:28:32.092373+0000","last_peered":"2024-04-23T10:28:32.092373+0000","last_clean":"2024-04-23T10:28:32.092373+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:28:32.092373+0000","last_undegraded":"2024-04-23T10:28:32.092373+0000","last_fullsized":"2024-04-23T10:28:32.092373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.761091+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:28:42.761091+0000","last_peered":"2024-04-23T10:28:42.761091+0000","last_clean":"2024-04-23T10:28:42.761091+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:28:42.761091+0000","last_undegraded":"2024-04-23T10:28:42.761091+0000","last_fullsized":"2024-04-23T10:28:42.761091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'701","reported_seq":783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.135009+0000","last_change":"2024-04-23T10:16:26.958520+0000","last_active":"2024-04-23T10:28:38.135009+0000","last_peered":"2024-04-23T10:28:38.135009+0000","last_clean":"2024-04-23T10:28:38.135009+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:28:38.135009+0000","last_undegraded":"2024-04-23T10:28:38.135009+0000","last_fullsized":"2024-04-23T10:28:38.135009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.464656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24902,"num_write":688,"num_write_kb":109624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'212","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.764520+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:28:42.764520+0000","last_peered":"2024-04-23T10:28:42.764520+0000","last_clean":"2024-04-23T10:28:42.764520+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:28:42.764520+0000","last_undegraded":"2024-04-23T10:28:42.764520+0000","last_fullsized":"2024-04-23T10:28:42.764520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'216","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.787955+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:28:42.787955+0000","last_peered":"2024-04-23T10:28:42.787955+0000","last_clean":"2024-04-23T10:28:42.787955+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:28:42.787955+0000","last_undegraded":"2024-04-23T10:28:42.787955+0000","last_fullsized":"2024-04-23T10:28:42.787955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'240","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.724207+0000","last_change":"2024-04-23T10:16:26.295163+0000","last_active":"2024-04-23T10:28:42.724207+0000","last_peered":"2024-04-23T10:28:42.724207+0000","last_clean":"2024-04-23T10:28:42.724207+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:28:42.724207+0000","last_undegraded":"2024-04-23T10:28:42.724207+0000","last_fullsized":"2024-04-23T10:28:42.724207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:23.533100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.747300+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:28:42.747300+0000","last_peered":"2024-04-23T10:28:42.747300+0000","last_clean":"2024-04-23T10:28:42.747300+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:28:42.747300+0000","last_undegraded":"2024-04-23T10:28:42.747300+0000","last_fullsized":"2024-04-23T10:28:42.747300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'187","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759594+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:28:42.759594+0000","last_peered":"2024-04-23T10:28:42.759594+0000","last_clean":"2024-04-23T10:28:42.759594+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:28:42.759594+0000","last_undegraded":"2024-04-23T10:28:42.759594+0000","last_fullsized":"2024-04-23T10:28:42.759594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'203","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746454+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:28:42.746454+0000","last_peered":"2024-04-23T10:28:42.746454+0000","last_clean":"2024-04-23T10:28:42.746454+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:28:42.746454+0000","last_undegraded":"2024-04-23T10:28:42.746454+0000","last_fullsized":"2024-04-23T10:28:42.746454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'239","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.767869+0000","last_change":"2024-04-23T10:16:26.295515+0000","last_active":"2024-04-23T10:28:42.767869+0000","last_peered":"2024-04-23T10:28:42.767869+0000","last_clean":"2024-04-23T10:28:42.767869+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:28:42.767869+0000","last_undegraded":"2024-04-23T10:28:42.767869+0000","last_fullsized":"2024-04-23T10:28:42.767869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:44:48.448837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.739678+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:28:42.739678+0000","last_peered":"2024-04-23T10:28:42.739678+0000","last_clean":"2024-04-23T10:28:42.739678+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:28:42.739678+0000","last_undegraded":"2024-04-23T10:28:42.739678+0000","last_fullsized":"2024-04-23T10:28:42.739678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'218","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.788708+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:28:42.788708+0000","last_peered":"2024-04-23T10:28:42.788708+0000","last_clean":"2024-04-23T10:28:42.788708+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:28:42.788708+0000","last_undegraded":"2024-04-23T10:28:42.788708+0000","last_fullsized":"2024-04-23T10:28:42.788708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759208+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:28:42.759208+0000","last_peered":"2024-04-23T10:28:42.759208+0000","last_clean":"2024-04-23T10:28:42.759208+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:28:42.759208+0000","last_undegraded":"2024-04-23T10:28:42.759208+0000","last_fullsized":"2024-04-23T10:28:42.759208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'207","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792281+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:28:42.792281+0000","last_peered":"2024-04-23T10:28:42.792281+0000","last_clean":"2024-04-23T10:28:42.792281+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:28:42.792281+0000","last_undegraded":"2024-04-23T10:28:42.792281+0000","last_fullsized":"2024-04-23T10:28:42.792281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'209","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.772044+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:28:42.772044+0000","last_peered":"2024-04-23T10:28:42.772044+0000","last_clean":"2024-04-23T10:28:42.772044+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:28:42.772044+0000","last_undegraded":"2024-04-23T10:28:42.772044+0000","last_fullsized":"2024-04-23T10:28:42.772044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'221","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.774617+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:28:42.774617+0000","last_peered":"2024-04-23T10:28:42.774617+0000","last_clean":"2024-04-23T10:28:42.774617+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:28:42.774617+0000","last_undegraded":"2024-04-23T10:28:42.774617+0000","last_fullsized":"2024-04-23T10:28:42.774617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.776817+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:28:42.776817+0000","last_peered":"2024-04-23T10:28:42.776817+0000","last_clean":"2024-04-23T10:28:42.776817+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:28:42.776817+0000","last_undegraded":"2024-04-23T10:28:42.776817+0000","last_fullsized":"2024-04-23T10:28:42.776817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.769568+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:28:42.769568+0000","last_peered":"2024-04-23T10:28:42.769568+0000","last_clean":"2024-04-23T10:28:42.769568+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:28:42.769568+0000","last_undegraded":"2024-04-23T10:28:42.769568+0000","last_fullsized":"2024-04-23T10:28:42.769568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.790426+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:28:42.790426+0000","last_peered":"2024-04-23T10:28:42.790426+0000","last_clean":"2024-04-23T10:28:42.790426+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:28:42.790426+0000","last_undegraded":"2024-04-23T10:28:42.790426+0000","last_fullsized":"2024-04-23T10:28:42.790426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791320+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:28:42.791320+0000","last_peered":"2024-04-23T10:28:42.791320+0000","last_clean":"2024-04-23T10:28:42.791320+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:28:42.791320+0000","last_undegraded":"2024-04-23T10:28:42.791320+0000","last_fullsized":"2024-04-23T10:28:42.791320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.739588+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:28:42.739588+0000","last_peered":"2024-04-23T10:28:42.739588+0000","last_clean":"2024-04-23T10:28:42.739588+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:28:42.739588+0000","last_undegraded":"2024-04-23T10:28:42.739588+0000","last_fullsized":"2024-04-23T10:28:42.739588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'211","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.752016+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:28:42.752016+0000","last_peered":"2024-04-23T10:28:42.752016+0000","last_clean":"2024-04-23T10:28:42.752016+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:28:42.752016+0000","last_undegraded":"2024-04-23T10:28:42.752016+0000","last_fullsized":"2024-04-23T10:28:42.752016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'198","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765626+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:28:42.765626+0000","last_peered":"2024-04-23T10:28:42.765626+0000","last_clean":"2024-04-23T10:28:42.765626+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:28:42.765626+0000","last_undegraded":"2024-04-23T10:28:42.765626+0000","last_fullsized":"2024-04-23T10:28:42.765626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.771282+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:28:42.771282+0000","last_peered":"2024-04-23T10:28:42.771282+0000","last_clean":"2024-04-23T10:28:42.771282+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:28:42.771282+0000","last_undegraded":"2024-04-23T10:28:42.771282+0000","last_fullsized":"2024-04-23T10:28:42.771282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.789862+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:28:42.789862+0000","last_peered":"2024-04-23T10:28:42.789862+0000","last_clean":"2024-04-23T10:28:42.789862+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:28:42.789862+0000","last_undegraded":"2024-04-23T10:28:42.789862+0000","last_fullsized":"2024-04-23T10:28:42.789862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.790198+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:28:42.790198+0000","last_peered":"2024-04-23T10:28:42.790198+0000","last_clean":"2024-04-23T10:28:42.790198+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:28:42.790198+0000","last_undegraded":"2024-04-23T10:28:42.790198+0000","last_fullsized":"2024-04-23T10:28:42.790198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'212","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792384+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:28:42.792384+0000","last_peered":"2024-04-23T10:28:42.792384+0000","last_clean":"2024-04-23T10:28:42.792384+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:28:42.792384+0000","last_undegraded":"2024-04-23T10:28:42.792384+0000","last_fullsized":"2024-04-23T10:28:42.792384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'194","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.993413+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:28:42.993413+0000","last_peered":"2024-04-23T10:28:42.993413+0000","last_clean":"2024-04-23T10:28:42.993413+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:28:42.993413+0000","last_undegraded":"2024-04-23T10:28:42.993413+0000","last_fullsized":"2024-04-23T10:28:42.993413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.753223+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:28:42.753223+0000","last_peered":"2024-04-23T10:28:42.753223+0000","last_clean":"2024-04-23T10:28:42.753223+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:28:42.753223+0000","last_undegraded":"2024-04-23T10:28:42.753223+0000","last_fullsized":"2024-04-23T10:28:42.753223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791471+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:28:42.791471+0000","last_peered":"2024-04-23T10:28:42.791471+0000","last_clean":"2024-04-23T10:28:42.791471+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:28:42.791471+0000","last_undegraded":"2024-04-23T10:28:42.791471+0000","last_fullsized":"2024-04-23T10:28:42.791471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'211","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765496+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:28:42.765496+0000","last_peered":"2024-04-23T10:28:42.765496+0000","last_clean":"2024-04-23T10:28:42.765496+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:28:42.765496+0000","last_undegraded":"2024-04-23T10:28:42.765496+0000","last_fullsized":"2024-04-23T10:28:42.765496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'201","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791523+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:28:42.791523+0000","last_peered":"2024-04-23T10:28:42.791523+0000","last_clean":"2024-04-23T10:28:42.791523+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:28:42.791523+0000","last_undegraded":"2024-04-23T10:28:42.791523+0000","last_fullsized":"2024-04-23T10:28:42.791523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'192","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.751731+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:28:42.751731+0000","last_peered":"2024-04-23T10:28:42.751731+0000","last_clean":"2024-04-23T10:28:42.751731+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:28:42.751731+0000","last_undegraded":"2024-04-23T10:28:42.751731+0000","last_fullsized":"2024-04-23T10:28:42.751731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.723451+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:28:42.723451+0000","last_peered":"2024-04-23T10:28:42.723451+0000","last_clean":"2024-04-23T10:28:42.723451+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:28:42.723451+0000","last_undegraded":"2024-04-23T10:28:42.723451+0000","last_fullsized":"2024-04-23T10:28:42.723451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'214","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.773391+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:28:42.773391+0000","last_peered":"2024-04-23T10:28:42.773391+0000","last_clean":"2024-04-23T10:28:42.773391+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:28:42.773391+0000","last_undegraded":"2024-04-23T10:28:42.773391+0000","last_fullsized":"2024-04-23T10:28:42.773391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2849,"num_read_kb":1515105,"num_write":24366,"num_write_kb":4267173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24772,"ondisk_log_size":24772,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13142,"ondisk_log_size":13142,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":137167340,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":10074,"num_write_kb":140883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274579456,"data_stored":274334680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11007,"ondisk_log_size":11007,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139456,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94232384,"statfs":{"total":96636764160,"available":96493961216,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111508,"kb_used_data":26252,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94260332,"statfs":{"total":96636764160,"available":96522579968,"internally_reserved":0,"allocated":26882048,"data_stored":26671347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142116,"kb_used_data":34588,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94229724,"statfs":{"total":96636764160,"available":96491237376,"internally_reserved":0,"allocated":35418112,"data_stored":35225169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73128,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298712,"statfs":{"total":96636764160,"available":96561881088,"internally_reserved":0,"allocated":10256384,"data_stored":10059311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137856,"kb_used_data":30328,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94233984,"statfs":{"total":96636764160,"available":96495599616,"internally_reserved":0,"allocated":31055872,"data_stored":30862669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30777344,"data_stored":30748221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9977856,"data_stored":9944863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35139584,"data_stored":35110721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26603520,"data_stored":26556899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:28:49.851 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T10:28:49.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:28:50.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7e2208640 1 Processor -- start 2024-04-23T10:28:50.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7e2208640 1 -- start start 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7e2208640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7dc0c3e60 0x7fe7dc0c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7e2208640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7dc073c80 0x7fe7dc162700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7e2208640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7dc0c1fb0 con 0x7fe7dc0c2630 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7e2208640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe7dc0b2b60 con 0x7fe7dc0c3e60 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7e2208640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe7dc06ec40 con 0x7fe7dc073c80 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7daffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7dc0c3e60 0x7fe7dc0c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7daffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7dc0c3e60 0x7fe7dc0c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39822/0 (socket says 172.21.15.29:39822) 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7daffd640 1 -- 172.21.15.29:0/2869440097 learned_addr learned my addr 172.21.15.29:0/2869440097 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7dbfff640 1 --2- 172.21.15.29:0/2869440097 >> v2:172.21.15.72:3300/0 conn(0x7fe7dc073c80 0x7fe7dc162700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7daffd640 1 -- 172.21.15.29:0/2869440097 >> v2:172.21.15.72:3300/0 conn(0x7fe7dc073c80 msgr2=0x7fe7dc162700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7daffd640 1 --2- 172.21.15.29:0/2869440097 >> v2:172.21.15.72:3300/0 conn(0x7fe7dc073c80 0x7fe7dc162700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7daffd640 1 -- 172.21.15.29:0/2869440097 >> v1:172.21.15.72:6789/0 conn(0x7fe7dc0c2630 legacy=0x7fe7dc0c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:50.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.017+0000 7fe7daffd640 1 -- 172.21.15.29:0/2869440097 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7dc0b2ed0 con 0x7fe7dc0c3e60 2024-04-23T10:28:50.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7daffd640 1 --2- 172.21.15.29:0/2869440097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c3e60 0x7fe7dc0c2a10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc050de0 tx=0x7fe7c401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55400383e64eee33 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:50.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7da7fc640 1 -- 172.21.15.29:0/2869440097 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40b5070 con 0x7fe7dc0c3e60 2024-04-23T10:28:50.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7da7fc640 1 -- 172.21.15.29:0/2869440097 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c40a89d0 con 0x7fe7dc0c3e60 2024-04-23T10:28:50.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7da7fc640 1 -- 172.21.15.29:0/2869440097 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40a8da0 con 0x7fe7dc0c3e60 2024-04-23T10:28:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 -- 172.21.15.29:0/2869440097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c3e60 msgr2=0x7fe7dc0c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 --2- 172.21.15.29:0/2869440097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c3e60 0x7fe7dc0c2a10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc050de0 tx=0x7fe7c401ecd0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 -- 172.21.15.29:0/2869440097 shutdown_connections 2024-04-23T10:28:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 --2- 172.21.15.29:0/2869440097 >> v2:172.21.15.72:3300/0 conn(0x7fe7dc073c80 0x7fe7dc162700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 --2- 172.21.15.29:0/2869440097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c3e60 0x7fe7dc0c2a10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 -- 172.21.15.29:0/2869440097 >> 172.21.15.29:0/2869440097 conn(0x7fe7dc0c9a90 msgr2=0x7fe7dc0c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 -- 172.21.15.29:0/2869440097 shutdown_connections 2024-04-23T10:28:50.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 -- 172.21.15.29:0/2869440097 wait complete. 2024-04-23T10:28:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 Processor -- start 2024-04-23T10:28:50.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 -- start start 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7dc073c80 0x7fe7dc14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c2630 0x7fe7dc1f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.021+0000 7fe7e2208640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0c3e60 0x7fe7dc1e0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7e2208640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc0c2250 con 0x7fe7dc0c2630 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7e2208640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc067eb0 con 0x7fe7dc0c3e60 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7e2208640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe7dc152410 con 0x7fe7dc073c80 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c2630 0x7fe7dc1f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c2630 0x7fe7dc1f0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39826/0 (socket says 172.21.15.29:39826) 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 -- 172.21.15.29:0/1077654008 learned_addr learned my addr 172.21.15.29:0/1077654008 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7dbfff640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0c3e60 0x7fe7dc1e0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7db7fe640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7dc073c80 0x7fe7dc14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 -- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7dc073c80 msgr2=0x7fe7dc14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7dc073c80 0x7fe7dc14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 -- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0c3e60 msgr2=0x7fe7dc1e0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0c3e60 0x7fe7dc1e0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 -- 172.21.15.29:0/1077654008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7dc14f9c0 con 0x7fe7dc0c2630 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7db7fe640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7dc073c80 0x7fe7dc14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7daffd640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c2630 0x7fe7dc1f0740 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40b3040 tx=0x7fe7c401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7d3fff640 1 -- 172.21.15.29:0/1077654008 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40c0070 con 0x7fe7dc0c2630 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7d3fff640 1 -- 172.21.15.29:0/1077654008 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c40b0a50 con 0x7fe7dc0c2630 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7dc150bb0 con 0x7fe7dc0c2630 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7d3fff640 1 -- 172.21.15.29:0/1077654008 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40b5070 con 0x7fe7dc0c2630 2024-04-23T10:28:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7dc151170 con 0x7fe7dc0c2630 2024-04-23T10:28:50.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7dc0693c0 con 0x7fe7dc0c2630 2024-04-23T10:28:50.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7d3fff640 1 -- 172.21.15.29:0/1077654008 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7c40c3070 con 0x7fe7dc0c2630 2024-04-23T10:28:50.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7d3fff640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe7bc068380 0x7fe7bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7d3fff640 1 -- 172.21.15.29:0/1077654008 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe7c4123db0 con 0x7fe7dc0c2630 2024-04-23T10:28:50.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.025+0000 7fe7db7fe640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe7bc068380 0x7fe7bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.029+0000 7fe7db7fe640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe7bc068380 0x7fe7bc06a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4003ec0 tx=0x7fe7d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:50.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.029+0000 7fe7d3fff640 1 -- 172.21.15.29:0/1077654008 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe7c4018830 con 0x7fe7dc0c2630 2024-04-23T10:28:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.193+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7dc067c90 con 0x7fe7bc068380 2024-04-23T10:28:50.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.217+0000 7fe7d3fff640 1 -- 172.21.15.29:0/1077654008 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334544 (secure 0 0 0) 0x7fe7d406aae0 con 0x7fe7bc068380 2024-04-23T10:28:50.217 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:50.220 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:28:50.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe7bc068380 msgr2=0x7fe7bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe7bc068380 0x7fe7bc06a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4003ec0 tx=0x7fe7d4009040 comp rx=0 tx=0).stop 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c2630 msgr2=0x7fe7dc1f0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c2630 0x7fe7dc1f0740 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40b3040 tx=0x7fe7c401ba70 comp rx=0 tx=0).stop 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 shutdown_connections 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe7bc068380 0x7fe7bc06a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0c3e60 0x7fe7dc1e0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7dc0c2630 0x7fe7dc1f0740 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 --2- 172.21.15.29:0/1077654008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7dc073c80 0x7fe7dc14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 >> 172.21.15.29:0/1077654008 conn(0x7fe7dc0c9a90 msgr2=0x7fe7dc0c2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 shutdown_connections 2024-04-23T10:28:50.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.221+0000 7fe7e2208640 1 -- 172.21.15.29:0/1077654008 wait complete. 2024-04-23T10:28:50.240 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":418,"stamp":"2024-04-23T10:28:49.505031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137757708,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":3613,"num_read_kb":1517165,"num_write":34599,"num_write_kb":4410472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49038,"ondisk_log_size":49038,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":939960,"kb_used_data":271480,"kb_used_omap":12,"kb_used_meta":668403,"kb_avail":754034760,"statfs":{"total":773094113280,"available":772131594240,"internally_reserved":0,"allocated":277995520,"data_stored":276431000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":684445232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-816434,"num_objects":-197,"num_object_clones":0,"num_object_copies":-788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-197,"num_whiteouts":0,"num_read":10,"num_read_kb":30,"num_write":253,"num_write_kb":552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005096"},"pg_stats":[{"pgid":"2.1f","version":"26'99","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:33.266625+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:28:33.266625+0000","last_peered":"2024-04-23T10:28:33.266625+0000","last_clean":"2024-04-23T10:28:33.266625+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:28:33.266625+0000","last_undegraded":"2024-04-23T10:28:33.266625+0000","last_fullsized":"2024-04-23T10:28:33.266625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.761244+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:28:42.761244+0000","last_peered":"2024-04-23T10:28:42.761244+0000","last_clean":"2024-04-23T10:28:42.761244+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:28:42.761244+0000","last_undegraded":"2024-04-23T10:28:42.761244+0000","last_fullsized":"2024-04-23T10:28:42.761244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'789","reported_seq":878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.235748+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:28:39.235748+0000","last_peered":"2024-04-23T10:28:39.235748+0000","last_clean":"2024-04-23T10:28:39.235748+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:28:39.235748+0000","last_undegraded":"2024-04-23T10:28:39.235748+0000","last_fullsized":"2024-04-23T10:28:39.235748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31845,"num_write":775,"num_write_kb":142945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'95","reported_seq":127,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.125361+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:28:30.125361+0000","last_peered":"2024-04-23T10:28:30.125361+0000","last_clean":"2024-04-23T10:28:30.125361+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:28:30.125361+0000","last_undegraded":"2024-04-23T10:28:30.125361+0000","last_fullsized":"2024-04-23T10:28:30.125361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.786472+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:28:42.786472+0000","last_peered":"2024-04-23T10:28:42.786472+0000","last_clean":"2024-04-23T10:28:42.786472+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:28:42.786472+0000","last_undegraded":"2024-04-23T10:28:42.786472+0000","last_fullsized":"2024-04-23T10:28:42.786472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'755","reported_seq":872,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.217040+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:28:39.217040+0000","last_peered":"2024-04-23T10:28:39.217040+0000","last_clean":"2024-04-23T10:28:39.217040+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:28:39.217040+0000","last_undegraded":"2024-04-23T10:28:39.217040+0000","last_fullsized":"2024-04-23T10:28:39.217040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":56312,"num_write":739,"num_write_kb":106537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'962","reported_seq":993,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.157999+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:28:38.157999+0000","last_peered":"2024-04-23T10:28:38.157999+0000","last_clean":"2024-04-23T10:28:38.157999+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:28:38.157999+0000","last_undegraded":"2024-04-23T10:28:38.157999+0000","last_fullsized":"2024-04-23T10:28:38.157999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":12538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'189","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791598+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:28:42.791598+0000","last_peered":"2024-04-23T10:28:42.791598+0000","last_clean":"2024-04-23T10:28:42.791598+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:28:42.791598+0000","last_undegraded":"2024-04-23T10:28:42.791598+0000","last_fullsized":"2024-04-23T10:28:42.791598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'777","reported_seq":887,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.206811+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:28:39.206811+0000","last_peered":"2024-04-23T10:28:39.206811+0000","last_clean":"2024-04-23T10:28:39.206811+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:28:39.206811+0000","last_undegraded":"2024-04-23T10:28:39.206811+0000","last_fullsized":"2024-04-23T10:28:39.206811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47927,"num_write":766,"num_write_kb":159845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'381","reported_seq":412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:34.176429+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:28:34.176429+0000","last_peered":"2024-04-23T10:28:34.176429+0000","last_clean":"2024-04-23T10:28:34.176429+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:28:34.176429+0000","last_undegraded":"2024-04-23T10:28:34.176429+0000","last_fullsized":"2024-04-23T10:28:34.176429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791818+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:28:42.791818+0000","last_peered":"2024-04-23T10:28:42.791818+0000","last_clean":"2024-04-23T10:28:42.791818+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:28:42.791818+0000","last_undegraded":"2024-04-23T10:28:42.791818+0000","last_fullsized":"2024-04-23T10:28:42.791818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'750","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.175260+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:28:39.175260+0000","last_peered":"2024-04-23T10:28:39.175260+0000","last_clean":"2024-04-23T10:28:39.175260+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:28:39.175260+0000","last_undegraded":"2024-04-23T10:28:39.175260+0000","last_fullsized":"2024-04-23T10:28:39.175260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32547,"num_write":740,"num_write_kb":109806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'207","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.774782+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:28:42.774782+0000","last_peered":"2024-04-23T10:28:42.774782+0000","last_clean":"2024-04-23T10:28:42.774782+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:28:42.774782+0000","last_undegraded":"2024-04-23T10:28:42.774782+0000","last_fullsized":"2024-04-23T10:28:42.774782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'271","reported_seq":302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.085034+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:28:32.085034+0000","last_peered":"2024-04-23T10:28:32.085034+0000","last_clean":"2024-04-23T10:28:32.085034+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:28:32.085034+0000","last_undegraded":"2024-04-23T10:28:32.085034+0000","last_fullsized":"2024-04-23T10:28:32.085034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":8310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'776","reported_seq":911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.169088+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:28:38.169088+0000","last_peered":"2024-04-23T10:28:38.169088+0000","last_clean":"2024-04-23T10:28:38.169088+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:28:38.169088+0000","last_undegraded":"2024-04-23T10:28:38.169088+0000","last_fullsized":"2024-04-23T10:28:38.169088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57747,"num_write":758,"num_write_kb":151052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735623+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:28:42.735623+0000","last_peered":"2024-04-23T10:28:42.735623+0000","last_clean":"2024-04-23T10:28:42.735623+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:28:42.735623+0000","last_undegraded":"2024-04-23T10:28:42.735623+0000","last_fullsized":"2024-04-23T10:28:42.735623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'236","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.395266+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:28:38.395266+0000","last_peered":"2024-04-23T10:28:38.395266+0000","last_clean":"2024-04-23T10:28:38.395266+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:28:38.395266+0000","last_undegraded":"2024-04-23T10:28:38.395266+0000","last_fullsized":"2024-04-23T10:28:38.395266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.147546+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:28:39.147546+0000","last_peered":"2024-04-23T10:28:39.147546+0000","last_clean":"2024-04-23T10:28:39.147546+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:28:39.147546+0000","last_undegraded":"2024-04-23T10:28:39.147546+0000","last_fullsized":"2024-04-23T10:28:39.147546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":42307,"num_write":786,"num_write_kb":84940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'208","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746296+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:28:42.746296+0000","last_peered":"2024-04-23T10:28:42.746296+0000","last_clean":"2024-04-23T10:28:42.746296+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:28:42.746296+0000","last_undegraded":"2024-04-23T10:28:42.746296+0000","last_fullsized":"2024-04-23T10:28:42.746296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'75","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.187469+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:28:32.187469+0000","last_peered":"2024-04-23T10:28:32.187469+0000","last_clean":"2024-04-23T10:28:32.187469+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:28:32.187469+0000","last_undegraded":"2024-04-23T10:28:32.187469+0000","last_fullsized":"2024-04-23T10:28:32.187469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'766","reported_seq":886,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.194471+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:28:39.194471+0000","last_peered":"2024-04-23T10:28:39.194471+0000","last_clean":"2024-04-23T10:28:39.194471+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:28:39.194471+0000","last_undegraded":"2024-04-23T10:28:39.194471+0000","last_fullsized":"2024-04-23T10:28:39.194471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":54473,"num_write":759,"num_write_kb":130945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.690464+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:28:42.690464+0000","last_peered":"2024-04-23T10:28:42.690464+0000","last_clean":"2024-04-23T10:28:42.690464+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:28:42.690464+0000","last_undegraded":"2024-04-23T10:28:42.690464+0000","last_fullsized":"2024-04-23T10:28:42.690464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'963","reported_seq":995,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:34.174254+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:28:34.174254+0000","last_peered":"2024-04-23T10:28:34.174254+0000","last_clean":"2024-04-23T10:28:34.174254+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:28:34.174254+0000","last_undegraded":"2024-04-23T10:28:34.174254+0000","last_fullsized":"2024-04-23T10:28:34.174254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":4487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'727","reported_seq":836,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.246601+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:28:39.246601+0000","last_peered":"2024-04-23T10:28:39.246601+0000","last_clean":"2024-04-23T10:28:39.246601+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:28:39.246601+0000","last_undegraded":"2024-04-23T10:28:39.246601+0000","last_fullsized":"2024-04-23T10:28:39.246601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46853,"num_write":712,"num_write_kb":125891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'218","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746113+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:28:42.746113+0000","last_peered":"2024-04-23T10:28:42.746113+0000","last_clean":"2024-04-23T10:28:42.746113+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:28:42.746113+0000","last_undegraded":"2024-04-23T10:28:42.746113+0000","last_fullsized":"2024-04-23T10:28:42.746113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'73","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:36.425633+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:28:36.425633+0000","last_peered":"2024-04-23T10:28:36.425633+0000","last_clean":"2024-04-23T10:28:36.425633+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:28:36.425633+0000","last_undegraded":"2024-04-23T10:28:36.425633+0000","last_fullsized":"2024-04-23T10:28:36.425633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'725","reported_seq":813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.177812+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:28:39.177812+0000","last_peered":"2024-04-23T10:28:39.177812+0000","last_clean":"2024-04-23T10:28:39.177812+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:28:39.177812+0000","last_undegraded":"2024-04-23T10:28:39.177812+0000","last_fullsized":"2024-04-23T10:28:39.177812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33152,"num_write":717,"num_write_kb":76622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.771760+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:28:42.771760+0000","last_peered":"2024-04-23T10:28:42.771760+0000","last_clean":"2024-04-23T10:28:42.771760+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:28:42.771760+0000","last_undegraded":"2024-04-23T10:28:42.771760+0000","last_fullsized":"2024-04-23T10:28:42.771760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'520","reported_seq":552,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.924119+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:28:38.924119+0000","last_peered":"2024-04-23T10:28:38.924119+0000","last_clean":"2024-04-23T10:28:38.924119+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:28:38.924119+0000","last_undegraded":"2024-04-23T10:28:38.924119+0000","last_fullsized":"2024-04-23T10:28:38.924119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":1827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'785","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.161865+0000","last_change":"2024-04-23T10:16:27.066954+0000","last_active":"2024-04-23T10:28:38.161865+0000","last_peered":"2024-04-23T10:28:38.161865+0000","last_clean":"2024-04-23T10:28:38.161865+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:28:38.161865+0000","last_undegraded":"2024-04-23T10:28:38.161865+0000","last_fullsized":"2024-04-23T10:28:38.161865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:04:19.036666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28458,"num_write":774,"num_write_kb":115794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.737757+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:28:42.737757+0000","last_peered":"2024-04-23T10:28:42.737757+0000","last_clean":"2024-04-23T10:28:42.737757+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:28:42.737757+0000","last_undegraded":"2024-04-23T10:28:42.737757+0000","last_fullsized":"2024-04-23T10:28:42.737757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'255","reported_seq":287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.151694+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:28:32.151694+0000","last_peered":"2024-04-23T10:28:32.151694+0000","last_clean":"2024-04-23T10:28:32.151694+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:28:32.151694+0000","last_undegraded":"2024-04-23T10:28:32.151694+0000","last_fullsized":"2024-04-23T10:28:32.151694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'721","reported_seq":782,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.138151+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:28:39.138151+0000","last_peered":"2024-04-23T10:28:39.138151+0000","last_clean":"2024-04-23T10:28:39.138151+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:28:39.138151+0000","last_undegraded":"2024-04-23T10:28:39.138151+0000","last_fullsized":"2024-04-23T10:28:39.138151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21238,"num_write":700,"num_write_kb":76444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'211","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791453+0000","last_change":"2024-04-23T10:16:26.682509+0000","last_active":"2024-04-23T10:28:42.791453+0000","last_peered":"2024-04-23T10:28:42.791453+0000","last_clean":"2024-04-23T10:28:42.791453+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:28:42.791453+0000","last_undegraded":"2024-04-23T10:28:42.791453+0000","last_fullsized":"2024-04-23T10:28:42.791453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:03.876389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.092820+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:28:32.092820+0000","last_peered":"2024-04-23T10:28:32.092820+0000","last_clean":"2024-04-23T10:28:32.092820+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:28:32.092820+0000","last_undegraded":"2024-04-23T10:28:32.092820+0000","last_fullsized":"2024-04-23T10:28:32.092820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'775","reported_seq":838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.163395+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:28:39.163395+0000","last_peered":"2024-04-23T10:28:39.163395+0000","last_clean":"2024-04-23T10:28:39.163395+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:28:39.163395+0000","last_undegraded":"2024-04-23T10:28:39.163395+0000","last_fullsized":"2024-04-23T10:28:39.163395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25895,"num_write":752,"num_write_kb":125637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.726054+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:28:42.726054+0000","last_peered":"2024-04-23T10:28:42.726054+0000","last_clean":"2024-04-23T10:28:42.726054+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:28:42.726054+0000","last_undegraded":"2024-04-23T10:28:42.726054+0000","last_fullsized":"2024-04-23T10:28:42.726054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'706","reported_seq":738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:22.080601+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:28:22.080601+0000","last_peered":"2024-04-23T10:28:22.080601+0000","last_clean":"2024-04-23T10:28:22.080601+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:28:22.080601+0000","last_undegraded":"2024-04-23T10:28:22.080601+0000","last_fullsized":"2024-04-23T10:28:22.080601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":8518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'759","reported_seq":968,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.261178+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:28:39.261178+0000","last_peered":"2024-04-23T10:28:39.261178+0000","last_clean":"2024-04-23T10:28:39.261178+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:28:39.261178+0000","last_undegraded":"2024-04-23T10:28:39.261178+0000","last_fullsized":"2024-04-23T10:28:39.261178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":98862,"num_write":741,"num_write_kb":163671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'207","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.731572+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:28:42.731572+0000","last_peered":"2024-04-23T10:28:42.731572+0000","last_clean":"2024-04-23T10:28:42.731572+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:28:42.731572+0000","last_undegraded":"2024-04-23T10:28:42.731572+0000","last_fullsized":"2024-04-23T10:28:42.731572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'729","reported_seq":1409,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:40.123720+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:28:40.123720+0000","last_peered":"2024-04-23T10:28:40.123720+0000","last_clean":"2024-04-23T10:28:40.123720+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:28:40.123720+0000","last_undegraded":"2024-04-23T10:28:40.123720+0000","last_fullsized":"2024-04-23T10:28:40.123720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554323,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":662,"num_write_kb":1972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'710","reported_seq":799,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.217512+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:28:39.217512+0000","last_peered":"2024-04-23T10:28:39.217512+0000","last_clean":"2024-04-23T10:28:39.217512+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:28:39.217512+0000","last_undegraded":"2024-04-23T10:28:39.217512+0000","last_fullsized":"2024-04-23T10:28:39.217512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33554,"num_write":702,"num_write_kb":88722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759922+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:28:42.759922+0000","last_peered":"2024-04-23T10:28:42.759922+0000","last_clean":"2024-04-23T10:28:42.759922+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:28:42.759922+0000","last_undegraded":"2024-04-23T10:28:42.759922+0000","last_fullsized":"2024-04-23T10:28:42.759922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'335","reported_seq":367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.185295+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:28:32.185295+0000","last_peered":"2024-04-23T10:28:32.185295+0000","last_clean":"2024-04-23T10:28:32.185295+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:28:32.185295+0000","last_undegraded":"2024-04-23T10:28:32.185295+0000","last_fullsized":"2024-04-23T10:28:32.185295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'893","reported_seq":1085,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.223914+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:28:39.223914+0000","last_peered":"2024-04-23T10:28:39.223914+0000","last_clean":"2024-04-23T10:28:39.223914+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:28:39.223914+0000","last_undegraded":"2024-04-23T10:28:39.223914+0000","last_fullsized":"2024-04-23T10:28:39.223914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":90539,"num_write":885,"num_write_kb":222131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735139+0000","last_change":"2024-04-23T10:16:26.682268+0000","last_active":"2024-04-23T10:28:42.735139+0000","last_peered":"2024-04-23T10:28:42.735139+0000","last_clean":"2024-04-23T10:28:42.735139+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:28:42.735139+0000","last_undegraded":"2024-04-23T10:28:42.735139+0000","last_fullsized":"2024-04-23T10:28:42.735139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:30:42.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'76","reported_seq":108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.160988+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:28:38.160988+0000","last_peered":"2024-04-23T10:28:38.160988+0000","last_clean":"2024-04-23T10:28:38.160988+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:28:38.160988+0000","last_undegraded":"2024-04-23T10:28:38.160988+0000","last_fullsized":"2024-04-23T10:28:38.160988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:36.395058+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:25:36.395058+0000","last_peered":"2024-04-23T10:25:36.395058+0000","last_clean":"2024-04-23T10:25:36.395058+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:25:36.395058+0000","last_undegraded":"2024-04-23T10:25:36.395058+0000","last_fullsized":"2024-04-23T10:25:36.395058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'772","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.252010+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:28:39.252010+0000","last_peered":"2024-04-23T10:28:39.252010+0000","last_clean":"2024-04-23T10:28:39.252010+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:28:39.252010+0000","last_undegraded":"2024-04-23T10:28:39.252010+0000","last_fullsized":"2024-04-23T10:28:39.252010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47063,"num_write":757,"num_write_kb":125918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792417+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:28:42.792417+0000","last_peered":"2024-04-23T10:28:42.792417+0000","last_clean":"2024-04-23T10:28:42.792417+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:28:42.792417+0000","last_undegraded":"2024-04-23T10:28:42.792417+0000","last_fullsized":"2024-04-23T10:28:42.792417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'64","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.170196+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:28:39.170196+0000","last_peered":"2024-04-23T10:28:39.170196+0000","last_clean":"2024-04-23T10:28:39.170196+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:28:39.170196+0000","last_undegraded":"2024-04-23T10:28:39.170196+0000","last_fullsized":"2024-04-23T10:28:39.170196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'800","reported_seq":922,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.273293+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:28:39.273293+0000","last_peered":"2024-04-23T10:28:39.273293+0000","last_clean":"2024-04-23T10:28:39.273293+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:28:39.273293+0000","last_undegraded":"2024-04-23T10:28:39.273293+0000","last_fullsized":"2024-04-23T10:28:39.273293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":46277,"num_write":791,"num_write_kb":155967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.788550+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:28:42.788550+0000","last_peered":"2024-04-23T10:28:42.788550+0000","last_clean":"2024-04-23T10:28:42.788550+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:28:42.788550+0000","last_undegraded":"2024-04-23T10:28:42.788550+0000","last_fullsized":"2024-04-23T10:28:42.788550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'673","reported_seq":704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.209024+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:28:31.209024+0000","last_peered":"2024-04-23T10:28:31.209024+0000","last_clean":"2024-04-23T10:28:31.209024+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:28:31.209024+0000","last_undegraded":"2024-04-23T10:28:31.209024+0000","last_fullsized":"2024-04-23T10:28:31.209024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'770","reported_seq":890,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.295167+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:28:37.295167+0000","last_peered":"2024-04-23T10:28:37.295167+0000","last_clean":"2024-04-23T10:28:37.295167+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:28:37.295167+0000","last_undegraded":"2024-04-23T10:28:37.295167+0000","last_fullsized":"2024-04-23T10:28:37.295167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":57774,"num_write":776,"num_write_kb":117908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.778691+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:28:42.778691+0000","last_peered":"2024-04-23T10:28:42.778691+0000","last_clean":"2024-04-23T10:28:42.778691+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:28:42.778691+0000","last_undegraded":"2024-04-23T10:28:42.778691+0000","last_fullsized":"2024-04-23T10:28:42.778691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'437","reported_seq":468,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:27.091495+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:28:27.091495+0000","last_peered":"2024-04-23T10:28:27.091495+0000","last_clean":"2024-04-23T10:28:27.091495+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:28:27.091495+0000","last_undegraded":"2024-04-23T10:28:27.091495+0000","last_fullsized":"2024-04-23T10:28:27.091495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'820","reported_seq":989,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.242668+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:28:39.242668+0000","last_peered":"2024-04-23T10:28:39.242668+0000","last_clean":"2024-04-23T10:28:39.242668+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:28:39.242668+0000","last_undegraded":"2024-04-23T10:28:39.242668+0000","last_fullsized":"2024-04-23T10:28:39.242668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":78747,"num_write":811,"num_write_kb":155987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'186","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777993+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:28:42.777993+0000","last_peered":"2024-04-23T10:28:42.777993+0000","last_clean":"2024-04-23T10:28:42.777993+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:28:42.777993+0000","last_undegraded":"2024-04-23T10:28:42.777993+0000","last_fullsized":"2024-04-23T10:28:42.777993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'187","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.275846+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:28:37.275846+0000","last_peered":"2024-04-23T10:28:37.275846+0000","last_clean":"2024-04-23T10:28:37.275846+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:28:37.275846+0000","last_undegraded":"2024-04-23T10:28:37.275846+0000","last_fullsized":"2024-04-23T10:28:37.275846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'819","reported_seq":905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.269480+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:28:39.269480+0000","last_peered":"2024-04-23T10:28:39.269480+0000","last_clean":"2024-04-23T10:28:39.269480+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:28:39.269480+0000","last_undegraded":"2024-04-23T10:28:39.269480+0000","last_fullsized":"2024-04-23T10:28:39.269480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":36072,"num_write":807,"num_write_kb":130604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765068+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:28:42.765068+0000","last_peered":"2024-04-23T10:28:42.765068+0000","last_clean":"2024-04-23T10:28:42.765068+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:28:42.765068+0000","last_undegraded":"2024-04-23T10:28:42.765068+0000","last_fullsized":"2024-04-23T10:28:42.765068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'275","reported_seq":306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.141294+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:28:39.141294+0000","last_peered":"2024-04-23T10:28:39.141294+0000","last_clean":"2024-04-23T10:28:39.141294+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:28:39.141294+0000","last_undegraded":"2024-04-23T10:28:39.141294+0000","last_fullsized":"2024-04-23T10:28:39.141294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'783","reported_seq":890,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.205009+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:28:39.205009+0000","last_peered":"2024-04-23T10:28:39.205009+0000","last_clean":"2024-04-23T10:28:39.205009+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:28:39.205009+0000","last_undegraded":"2024-04-23T10:28:39.205009+0000","last_fullsized":"2024-04-23T10:28:39.205009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":28210,"num_write":769,"num_write_kb":122559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.725278+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:28:42.725278+0000","last_peered":"2024-04-23T10:28:42.725278+0000","last_clean":"2024-04-23T10:28:42.725278+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:28:42.725278+0000","last_undegraded":"2024-04-23T10:28:42.725278+0000","last_fullsized":"2024-04-23T10:28:42.725278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'67","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:28.067048+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:28:28.067048+0000","last_peered":"2024-04-23T10:28:28.067048+0000","last_clean":"2024-04-23T10:28:28.067048+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:28:28.067048+0000","last_undegraded":"2024-04-23T10:28:28.067048+0000","last_fullsized":"2024-04-23T10:28:28.067048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'801","reported_seq":932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.307545+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:28:37.307545+0000","last_peered":"2024-04-23T10:28:37.307545+0000","last_clean":"2024-04-23T10:28:37.307545+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:28:37.307545+0000","last_undegraded":"2024-04-23T10:28:37.307545+0000","last_fullsized":"2024-04-23T10:28:37.307545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":64319,"num_write":793,"num_write_kb":152801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.778485+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:28:42.778485+0000","last_peered":"2024-04-23T10:28:42.778485+0000","last_clean":"2024-04-23T10:28:42.778485+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:28:42.778485+0000","last_undegraded":"2024-04-23T10:28:42.778485+0000","last_fullsized":"2024-04-23T10:28:42.778485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'71","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.127628+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:28:39.127628+0000","last_peered":"2024-04-23T10:28:39.127628+0000","last_clean":"2024-04-23T10:28:39.127628+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:28:39.127628+0000","last_undegraded":"2024-04-23T10:28:39.127628+0000","last_fullsized":"2024-04-23T10:28:39.127628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'716","reported_seq":841,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.181269+0000","last_change":"2024-04-23T10:16:26.368606+0000","last_active":"2024-04-23T10:28:39.181269+0000","last_peered":"2024-04-23T10:28:39.181269+0000","last_clean":"2024-04-23T10:28:39.181269+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:28:39.181269+0000","last_undegraded":"2024-04-23T10:28:39.181269+0000","last_fullsized":"2024-04-23T10:28:39.181269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:02.237968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50110,"num_write":710,"num_write_kb":147181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.768300+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:28:42.768300+0000","last_peered":"2024-04-23T10:28:42.768300+0000","last_clean":"2024-04-23T10:28:42.768300+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:28:42.768300+0000","last_undegraded":"2024-04-23T10:28:42.768300+0000","last_fullsized":"2024-04-23T10:28:42.768300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'594","reported_seq":625,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:25.069702+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:28:25.069702+0000","last_peered":"2024-04-23T10:28:25.069702+0000","last_clean":"2024-04-23T10:28:25.069702+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:28:25.069702+0000","last_undegraded":"2024-04-23T10:28:25.069702+0000","last_fullsized":"2024-04-23T10:28:25.069702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.258805+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:28:39.258805+0000","last_peered":"2024-04-23T10:28:39.258805+0000","last_clean":"2024-04-23T10:28:39.258805+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:28:39.258805+0000","last_undegraded":"2024-04-23T10:28:39.258805+0000","last_fullsized":"2024-04-23T10:28:39.258805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41492,"num_write":740,"num_write_kb":126321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777861+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:28:42.777861+0000","last_peered":"2024-04-23T10:28:42.777861+0000","last_clean":"2024-04-23T10:28:42.777861+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:28:42.777861+0000","last_undegraded":"2024-04-23T10:28:42.777861+0000","last_fullsized":"2024-04-23T10:28:42.777861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'447","reported_seq":478,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.230434+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:28:30.230434+0000","last_peered":"2024-04-23T10:28:30.230434+0000","last_clean":"2024-04-23T10:28:30.230434+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:28:30.230434+0000","last_undegraded":"2024-04-23T10:28:30.230434+0000","last_fullsized":"2024-04-23T10:28:30.230434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'781","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.162612+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:28:39.162612+0000","last_peered":"2024-04-23T10:28:39.162612+0000","last_clean":"2024-04-23T10:28:39.162612+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:28:39.162612+0000","last_undegraded":"2024-04-23T10:28:39.162612+0000","last_fullsized":"2024-04-23T10:28:39.162612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":27921,"num_write":758,"num_write_kb":97957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'198","reported_seq":213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.769078+0000","last_change":"2024-04-23T10:16:26.366127+0000","last_active":"2024-04-23T10:28:42.769078+0000","last_peered":"2024-04-23T10:28:42.769078+0000","last_clean":"2024-04-23T10:28:42.769078+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:28:42.769078+0000","last_undegraded":"2024-04-23T10:28:42.769078+0000","last_fullsized":"2024-04-23T10:28:42.769078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:26.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"26'360","reported_seq":391,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:44.554991+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:28:44.554991+0000","last_peered":"2024-04-23T10:28:44.554991+0000","last_clean":"2024-04-23T10:28:44.554991+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:28:44.554991+0000","last_undegraded":"2024-04-23T10:28:44.554991+0000","last_fullsized":"2024-04-23T10:28:44.554991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1387233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'726","reported_seq":837,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.207970+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:28:39.207970+0000","last_peered":"2024-04-23T10:28:39.207970+0000","last_clean":"2024-04-23T10:28:39.207970+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:28:39.207970+0000","last_undegraded":"2024-04-23T10:28:39.207970+0000","last_fullsized":"2024-04-23T10:28:39.207970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44100,"num_write":714,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.744791+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:28:42.744791+0000","last_peered":"2024-04-23T10:28:42.744791+0000","last_clean":"2024-04-23T10:28:42.744791+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:28:42.744791+0000","last_undegraded":"2024-04-23T10:28:42.744791+0000","last_fullsized":"2024-04-23T10:28:42.744791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'237","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:36.118118+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:28:36.118118+0000","last_peered":"2024-04-23T10:28:36.118118+0000","last_clean":"2024-04-23T10:28:36.118118+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:28:36.118118+0000","last_undegraded":"2024-04-23T10:28:36.118118+0000","last_fullsized":"2024-04-23T10:28:36.118118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'829","reported_seq":953,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.250609+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:28:39.250609+0000","last_peered":"2024-04-23T10:28:39.250609+0000","last_clean":"2024-04-23T10:28:39.250609+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:28:39.250609+0000","last_undegraded":"2024-04-23T10:28:39.250609+0000","last_fullsized":"2024-04-23T10:28:39.250609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":58607,"num_write":815,"num_write_kb":134637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'221","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792069+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:28:42.792069+0000","last_peered":"2024-04-23T10:28:42.792069+0000","last_clean":"2024-04-23T10:28:42.792069+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:28:42.792069+0000","last_undegraded":"2024-04-23T10:28:42.792069+0000","last_fullsized":"2024-04-23T10:28:42.792069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'71","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.682822+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:28:42.682822+0000","last_peered":"2024-04-23T10:28:42.682822+0000","last_clean":"2024-04-23T10:28:42.682822+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:28:42.682822+0000","last_undegraded":"2024-04-23T10:28:42.682822+0000","last_fullsized":"2024-04-23T10:28:42.682822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'829","reported_seq":947,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.248571+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:28:39.248571+0000","last_peered":"2024-04-23T10:28:39.248571+0000","last_clean":"2024-04-23T10:28:39.248571+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:28:39.248571+0000","last_undegraded":"2024-04-23T10:28:39.248571+0000","last_fullsized":"2024-04-23T10:28:39.248571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":52124,"num_write":807,"num_write_kb":167221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'853","reported_seq":1000,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.219943+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:28:39.219943+0000","last_peered":"2024-04-23T10:28:39.219943+0000","last_clean":"2024-04-23T10:28:39.219943+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:28:39.219943+0000","last_undegraded":"2024-04-23T10:28:39.219943+0000","last_fullsized":"2024-04-23T10:28:39.219943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":70228,"num_write":840,"num_write_kb":218801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.758002+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:28:42.758002+0000","last_peered":"2024-04-23T10:28:42.758002+0000","last_clean":"2024-04-23T10:28:42.758002+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:28:42.758002+0000","last_undegraded":"2024-04-23T10:28:42.758002+0000","last_fullsized":"2024-04-23T10:28:42.758002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1123","reported_seq":1154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.131685+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:28:31.131685+0000","last_peered":"2024-04-23T10:28:31.131685+0000","last_clean":"2024-04-23T10:28:31.131685+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:28:31.131685+0000","last_undegraded":"2024-04-23T10:28:31.131685+0000","last_fullsized":"2024-04-23T10:28:31.131685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'763","reported_seq":848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.139173+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:28:37.139173+0000","last_peered":"2024-04-23T10:28:37.139173+0000","last_clean":"2024-04-23T10:28:37.139173+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:28:37.139173+0000","last_undegraded":"2024-04-23T10:28:37.139173+0000","last_fullsized":"2024-04-23T10:28:37.139173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":755,"num_write_kb":160183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746444+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:28:42.746444+0000","last_peered":"2024-04-23T10:28:42.746444+0000","last_clean":"2024-04-23T10:28:42.746444+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:42.746444+0000","last_undegraded":"2024-04-23T10:28:42.746444+0000","last_fullsized":"2024-04-23T10:28:42.746444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'101","reported_seq":132,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.163083+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:28:31.163083+0000","last_peered":"2024-04-23T10:28:31.163083+0000","last_clean":"2024-04-23T10:28:31.163083+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:28:31.163083+0000","last_undegraded":"2024-04-23T10:28:31.163083+0000","last_fullsized":"2024-04-23T10:28:31.163083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'346","reported_seq":377,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.151218+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:28:30.151218+0000","last_peered":"2024-04-23T10:28:30.151218+0000","last_clean":"2024-04-23T10:28:30.151218+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:28:30.151218+0000","last_undegraded":"2024-04-23T10:28:30.151218+0000","last_fullsized":"2024-04-23T10:28:30.151218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":12468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'181","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.758412+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:28:42.758412+0000","last_peered":"2024-04-23T10:28:42.758412+0000","last_clean":"2024-04-23T10:28:42.758412+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:42.758412+0000","last_undegraded":"2024-04-23T10:28:42.758412+0000","last_fullsized":"2024-04-23T10:28:42.758412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'746","reported_seq":883,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.187774+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:28:39.187774+0000","last_peered":"2024-04-23T10:28:39.187774+0000","last_clean":"2024-04-23T10:28:39.187774+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:28:39.187774+0000","last_undegraded":"2024-04-23T10:28:39.187774+0000","last_fullsized":"2024-04-23T10:28:39.187774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":53240,"num_write":729,"num_write_kb":139197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'111","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.092373+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:28:32.092373+0000","last_peered":"2024-04-23T10:28:32.092373+0000","last_clean":"2024-04-23T10:28:32.092373+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:28:32.092373+0000","last_undegraded":"2024-04-23T10:28:32.092373+0000","last_fullsized":"2024-04-23T10:28:32.092373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.761091+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:28:42.761091+0000","last_peered":"2024-04-23T10:28:42.761091+0000","last_clean":"2024-04-23T10:28:42.761091+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:28:42.761091+0000","last_undegraded":"2024-04-23T10:28:42.761091+0000","last_fullsized":"2024-04-23T10:28:42.761091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'701","reported_seq":783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.135009+0000","last_change":"2024-04-23T10:16:26.958520+0000","last_active":"2024-04-23T10:28:38.135009+0000","last_peered":"2024-04-23T10:28:38.135009+0000","last_clean":"2024-04-23T10:28:38.135009+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:28:38.135009+0000","last_undegraded":"2024-04-23T10:28:38.135009+0000","last_fullsized":"2024-04-23T10:28:38.135009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.464656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24902,"num_write":688,"num_write_kb":109624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'212","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.764520+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:28:42.764520+0000","last_peered":"2024-04-23T10:28:42.764520+0000","last_clean":"2024-04-23T10:28:42.764520+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:28:42.764520+0000","last_undegraded":"2024-04-23T10:28:42.764520+0000","last_fullsized":"2024-04-23T10:28:42.764520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'216","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.787955+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:28:42.787955+0000","last_peered":"2024-04-23T10:28:42.787955+0000","last_clean":"2024-04-23T10:28:42.787955+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:28:42.787955+0000","last_undegraded":"2024-04-23T10:28:42.787955+0000","last_fullsized":"2024-04-23T10:28:42.787955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'240","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.724207+0000","last_change":"2024-04-23T10:16:26.295163+0000","last_active":"2024-04-23T10:28:42.724207+0000","last_peered":"2024-04-23T10:28:42.724207+0000","last_clean":"2024-04-23T10:28:42.724207+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:28:42.724207+0000","last_undegraded":"2024-04-23T10:28:42.724207+0000","last_fullsized":"2024-04-23T10:28:42.724207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:23.533100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.747300+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:28:42.747300+0000","last_peered":"2024-04-23T10:28:42.747300+0000","last_clean":"2024-04-23T10:28:42.747300+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:28:42.747300+0000","last_undegraded":"2024-04-23T10:28:42.747300+0000","last_fullsized":"2024-04-23T10:28:42.747300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'187","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759594+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:28:42.759594+0000","last_peered":"2024-04-23T10:28:42.759594+0000","last_clean":"2024-04-23T10:28:42.759594+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:28:42.759594+0000","last_undegraded":"2024-04-23T10:28:42.759594+0000","last_fullsized":"2024-04-23T10:28:42.759594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'203","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746454+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:28:42.746454+0000","last_peered":"2024-04-23T10:28:42.746454+0000","last_clean":"2024-04-23T10:28:42.746454+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:28:42.746454+0000","last_undegraded":"2024-04-23T10:28:42.746454+0000","last_fullsized":"2024-04-23T10:28:42.746454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'239","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.767869+0000","last_change":"2024-04-23T10:16:26.295515+0000","last_active":"2024-04-23T10:28:42.767869+0000","last_peered":"2024-04-23T10:28:42.767869+0000","last_clean":"2024-04-23T10:28:42.767869+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:28:42.767869+0000","last_undegraded":"2024-04-23T10:28:42.767869+0000","last_fullsized":"2024-04-23T10:28:42.767869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:44:48.448837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.739678+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:28:42.739678+0000","last_peered":"2024-04-23T10:28:42.739678+0000","last_clean":"2024-04-23T10:28:42.739678+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:28:42.739678+0000","last_undegraded":"2024-04-23T10:28:42.739678+0000","last_fullsized":"2024-04-23T10:28:42.739678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'218","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.788708+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:28:42.788708+0000","last_peered":"2024-04-23T10:28:42.788708+0000","last_clean":"2024-04-23T10:28:42.788708+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:28:42.788708+0000","last_undegraded":"2024-04-23T10:28:42.788708+0000","last_fullsized":"2024-04-23T10:28:42.788708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759208+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:28:42.759208+0000","last_peered":"2024-04-23T10:28:42.759208+0000","last_clean":"2024-04-23T10:28:42.759208+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:28:42.759208+0000","last_undegraded":"2024-04-23T10:28:42.759208+0000","last_fullsized":"2024-04-23T10:28:42.759208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'207","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792281+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:28:42.792281+0000","last_peered":"2024-04-23T10:28:42.792281+0000","last_clean":"2024-04-23T10:28:42.792281+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:28:42.792281+0000","last_undegraded":"2024-04-23T10:28:42.792281+0000","last_fullsized":"2024-04-23T10:28:42.792281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'209","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.772044+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:28:42.772044+0000","last_peered":"2024-04-23T10:28:42.772044+0000","last_clean":"2024-04-23T10:28:42.772044+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:28:42.772044+0000","last_undegraded":"2024-04-23T10:28:42.772044+0000","last_fullsized":"2024-04-23T10:28:42.772044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'221","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.774617+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:28:42.774617+0000","last_peered":"2024-04-23T10:28:42.774617+0000","last_clean":"2024-04-23T10:28:42.774617+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:28:42.774617+0000","last_undegraded":"2024-04-23T10:28:42.774617+0000","last_fullsized":"2024-04-23T10:28:42.774617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.776817+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:28:42.776817+0000","last_peered":"2024-04-23T10:28:42.776817+0000","last_clean":"2024-04-23T10:28:42.776817+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:28:42.776817+0000","last_undegraded":"2024-04-23T10:28:42.776817+0000","last_fullsized":"2024-04-23T10:28:42.776817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.769568+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:28:42.769568+0000","last_peered":"2024-04-23T10:28:42.769568+0000","last_clean":"2024-04-23T10:28:42.769568+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:28:42.769568+0000","last_undegraded":"2024-04-23T10:28:42.769568+0000","last_fullsized":"2024-04-23T10:28:42.769568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.790426+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:28:42.790426+0000","last_peered":"2024-04-23T10:28:42.790426+0000","last_clean":"2024-04-23T10:28:42.790426+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:28:42.790426+0000","last_undegraded":"2024-04-23T10:28:42.790426+0000","last_fullsized":"2024-04-23T10:28:42.790426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791320+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:28:42.791320+0000","last_peered":"2024-04-23T10:28:42.791320+0000","last_clean":"2024-04-23T10:28:42.791320+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:28:42.791320+0000","last_undegraded":"2024-04-23T10:28:42.791320+0000","last_fullsized":"2024-04-23T10:28:42.791320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.739588+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:28:42.739588+0000","last_peered":"2024-04-23T10:28:42.739588+0000","last_clean":"2024-04-23T10:28:42.739588+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:28:42.739588+0000","last_undegraded":"2024-04-23T10:28:42.739588+0000","last_fullsized":"2024-04-23T10:28:42.739588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'211","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.752016+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:28:42.752016+0000","last_peered":"2024-04-23T10:28:42.752016+0000","last_clean":"2024-04-23T10:28:42.752016+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:28:42.752016+0000","last_undegraded":"2024-04-23T10:28:42.752016+0000","last_fullsized":"2024-04-23T10:28:42.752016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'198","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765626+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:28:42.765626+0000","last_peered":"2024-04-23T10:28:42.765626+0000","last_clean":"2024-04-23T10:28:42.765626+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:28:42.765626+0000","last_undegraded":"2024-04-23T10:28:42.765626+0000","last_fullsized":"2024-04-23T10:28:42.765626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.771282+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:28:42.771282+0000","last_peered":"2024-04-23T10:28:42.771282+0000","last_clean":"2024-04-23T10:28:42.771282+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:28:42.771282+0000","last_undegraded":"2024-04-23T10:28:42.771282+0000","last_fullsized":"2024-04-23T10:28:42.771282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.789862+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:28:42.789862+0000","last_peered":"2024-04-23T10:28:42.789862+0000","last_clean":"2024-04-23T10:28:42.789862+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:28:42.789862+0000","last_undegraded":"2024-04-23T10:28:42.789862+0000","last_fullsized":"2024-04-23T10:28:42.789862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.790198+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:28:42.790198+0000","last_peered":"2024-04-23T10:28:42.790198+0000","last_clean":"2024-04-23T10:28:42.790198+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:28:42.790198+0000","last_undegraded":"2024-04-23T10:28:42.790198+0000","last_fullsized":"2024-04-23T10:28:42.790198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'212","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792384+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:28:42.792384+0000","last_peered":"2024-04-23T10:28:42.792384+0000","last_clean":"2024-04-23T10:28:42.792384+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:28:42.792384+0000","last_undegraded":"2024-04-23T10:28:42.792384+0000","last_fullsized":"2024-04-23T10:28:42.792384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'194","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.993413+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:28:42.993413+0000","last_peered":"2024-04-23T10:28:42.993413+0000","last_clean":"2024-04-23T10:28:42.993413+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:28:42.993413+0000","last_undegraded":"2024-04-23T10:28:42.993413+0000","last_fullsized":"2024-04-23T10:28:42.993413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.753223+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:28:42.753223+0000","last_peered":"2024-04-23T10:28:42.753223+0000","last_clean":"2024-04-23T10:28:42.753223+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:28:42.753223+0000","last_undegraded":"2024-04-23T10:28:42.753223+0000","last_fullsized":"2024-04-23T10:28:42.753223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791471+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:28:42.791471+0000","last_peered":"2024-04-23T10:28:42.791471+0000","last_clean":"2024-04-23T10:28:42.791471+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:28:42.791471+0000","last_undegraded":"2024-04-23T10:28:42.791471+0000","last_fullsized":"2024-04-23T10:28:42.791471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'211","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765496+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:28:42.765496+0000","last_peered":"2024-04-23T10:28:42.765496+0000","last_clean":"2024-04-23T10:28:42.765496+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:28:42.765496+0000","last_undegraded":"2024-04-23T10:28:42.765496+0000","last_fullsized":"2024-04-23T10:28:42.765496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'201","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791523+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:28:42.791523+0000","last_peered":"2024-04-23T10:28:42.791523+0000","last_clean":"2024-04-23T10:28:42.791523+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:28:42.791523+0000","last_undegraded":"2024-04-23T10:28:42.791523+0000","last_fullsized":"2024-04-23T10:28:42.791523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'192","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.751731+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:28:42.751731+0000","last_peered":"2024-04-23T10:28:42.751731+0000","last_clean":"2024-04-23T10:28:42.751731+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:28:42.751731+0000","last_undegraded":"2024-04-23T10:28:42.751731+0000","last_fullsized":"2024-04-23T10:28:42.751731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.723451+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:28:42.723451+0000","last_peered":"2024-04-23T10:28:42.723451+0000","last_clean":"2024-04-23T10:28:42.723451+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:28:42.723451+0000","last_undegraded":"2024-04-23T10:28:42.723451+0000","last_fullsized":"2024-04-23T10:28:42.723451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'214","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.773391+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:28:42.773391+0000","last_peered":"2024-04-23T10:28:42.773391+0000","last_clean":"2024-04-23T10:28:42.773391+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:28:42.773391+0000","last_undegraded":"2024-04-23T10:28:42.773391+0000","last_fullsized":"2024-04-23T10:28:42.773391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2849,"num_read_kb":1515105,"num_write":24366,"num_write_kb":4267173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24772,"ondisk_log_size":24772,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13142,"ondisk_log_size":13142,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":137167340,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":10074,"num_write_kb":140883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274579456,"data_stored":274334680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11007,"ondisk_log_size":11007,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139456,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94232384,"statfs":{"total":96636764160,"available":96493961216,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111508,"kb_used_data":26252,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94260332,"statfs":{"total":96636764160,"available":96522579968,"internally_reserved":0,"allocated":26882048,"data_stored":26671347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142116,"kb_used_data":34588,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94229724,"statfs":{"total":96636764160,"available":96491237376,"internally_reserved":0,"allocated":35418112,"data_stored":35225169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73128,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298712,"statfs":{"total":96636764160,"available":96561881088,"internally_reserved":0,"allocated":10256384,"data_stored":10059311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137856,"kb_used_data":30328,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94233984,"statfs":{"total":96636764160,"available":96495599616,"internally_reserved":0,"allocated":31055872,"data_stored":30862669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30777344,"data_stored":30748221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9977856,"data_stored":9944863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35139584,"data_stored":35110721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26603520,"data_stored":26556899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:28:50.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:28:50.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd902c19640 1 Processor -- start 2024-04-23T10:28:50.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd902c19640 1 -- start start 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd902c19640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd8fc1518f0 0x7fd8fc15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd902c19640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8fc0c7730 0x7fd8fc0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd902c19640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 0x7fd8fc0c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd902c19640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc0c4280 con 0x7fd8fc1518f0 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd902c19640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc15b350 con 0x7fd8fc0c7730 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd902c19640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd8fc15b630 con 0x7fd8fc0c6860 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd9009b5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd8fc1518f0 0x7fd8fc15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd9009b5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd8fc1518f0 0x7fd8fc15ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39836/0 (socket says 172.21.15.29:39836) 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.413+0000 7fd9009b5640 1 -- 172.21.15.29:0/4148925472 learned_addr learned my addr 172.21.15.29:0/4148925472 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd9011b6640 1 --2- 172.21.15.29:0/4148925472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 0x7fd8fc0c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd9009b5640 1 -- 172.21.15.29:0/4148925472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 msgr2=0x7fd8fc0c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:50.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd9009b5640 1 --2- 172.21.15.29:0/4148925472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 0x7fd8fc0c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd8fbfff640 1 --2- 172.21.15.29:0/4148925472 >> v2:172.21.15.72:3300/0 conn(0x7fd8fc0c7730 0x7fd8fc0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd9009b5640 1 -- 172.21.15.29:0/4148925472 >> v2:172.21.15.72:3300/0 conn(0x7fd8fc0c7730 msgr2=0x7fd8fc0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:50.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd9009b5640 1 --2- 172.21.15.29:0/4148925472 >> v2:172.21.15.72:3300/0 conn(0x7fd8fc0c7730 0x7fd8fc0c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd9009b5640 1 -- 172.21.15.29:0/4148925472 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc15b910 con 0x7fd8fc1518f0 2024-04-23T10:28:50.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd9009b5640 1 --2- 172.21.15.29:0/4148925472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc15ac10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc06fa60 tx=0x7fd8ec01daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49c5a4c576a5821 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:50.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd8fb7fe640 1 -- 172.21.15.29:0/4148925472 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00a2d0 con 0x7fd8fc1518f0 2024-04-23T10:28:50.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd8fb7fe640 1 -- 172.21.15.29:0/4148925472 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0a6820 con 0x7fd8fc1518f0 2024-04-23T10:28:50.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd8fb7fe640 1 -- 172.21.15.29:0/4148925472 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0a6bf0 con 0x7fd8fc1518f0 2024-04-23T10:28:50.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 -- 172.21.15.29:0/4148925472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 msgr2=0x7fd8fc15ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 --2- 172.21.15.29:0/4148925472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc15ac10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc06fa60 tx=0x7fd8ec01daf0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 -- 172.21.15.29:0/4148925472 shutdown_connections 2024-04-23T10:28:50.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 --2- 172.21.15.29:0/4148925472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 0x7fd8fc0c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 --2- 172.21.15.29:0/4148925472 >> v2:172.21.15.72:3300/0 conn(0x7fd8fc0c7730 0x7fd8fc0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 --2- 172.21.15.29:0/4148925472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc15ac10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 -- 172.21.15.29:0/4148925472 >> 172.21.15.29:0/4148925472 conn(0x7fd8fc06cfb0 msgr2=0x7fd8fc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:50.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 -- 172.21.15.29:0/4148925472 shutdown_connections 2024-04-23T10:28:50.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.417+0000 7fd902c19640 1 -- 172.21.15.29:0/4148925472 wait complete. 2024-04-23T10:28:50.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 Processor -- start 2024-04-23T10:28:50.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 -- start start 2024-04-23T10:28:50.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 0x7fd8fc071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc0c7730 0x7fd8fc1484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc1449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc151e50 con 0x7fd8fc1518f0 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc151cd0 con 0x7fd8fc0c7730 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd8fc0c7f60 con 0x7fd8fc0c6860 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc1449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc1449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39842/0 (socket says 172.21.15.29:39842) 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 -- 172.21.15.29:0/2027343006 learned_addr learned my addr 172.21.15.29:0/2027343006 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd8fbfff640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc0c7730 0x7fd8fc1484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9009b5640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 0x7fd8fc071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 -- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 msgr2=0x7fd8fc071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 0x7fd8fc071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 -- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc0c7730 msgr2=0x7fd8fc1484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc0c7730 0x7fd8fc1484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 -- 172.21.15.29:0/2027343006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc148a10 con 0x7fd8fc1518f0 2024-04-23T10:28:50.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd8fbfff640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc0c7730 0x7fd8fc1484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:50.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd9011b6640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc1449f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400c4c0 tx=0x7fd8f400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:50.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd8f97fa640 1 -- 172.21.15.29:0/2027343006 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4015070 con 0x7fd8fc1518f0 2024-04-23T10:28:50.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd8f97fa640 1 -- 172.21.15.29:0/2027343006 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f4004220 con 0x7fd8fc1518f0 2024-04-23T10:28:50.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8fc0716f0 con 0x7fd8fc1518f0 2024-04-23T10:28:50.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd8f97fa640 1 -- 172.21.15.29:0/2027343006 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4003620 con 0x7fd8fc1518f0 2024-04-23T10:28:50.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8fc1f7e50 con 0x7fd8fc1518f0 2024-04-23T10:28:50.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8fc068d70 con 0x7fd8fc1518f0 2024-04-23T10:28:50.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.421+0000 7fd8f97fa640 1 -- 172.21.15.29:0/2027343006 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd8f40037c0 con 0x7fd8fc1518f0 2024-04-23T10:28:50.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.425+0000 7fd8f97fa640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8dc068380 0x7fd8dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:50.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.425+0000 7fd8f97fa640 1 -- 172.21.15.29:0/2027343006 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd8f4086f10 con 0x7fd8fc1518f0 2024-04-23T10:28:50.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.425+0000 7fd9009b5640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8dc068380 0x7fd8dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:50.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.425+0000 7fd9009b5640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8dc068380 0x7fd8dc06a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0af000 tx=0x7fd8ec0a8070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:50.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.429+0000 7fd8f97fa640 1 -- 172.21.15.29:0/2027343006 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd8f4056f80 con 0x7fd8fc1518f0 2024-04-23T10:28:50.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.585+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8fc0c3ac0 con 0x7fd8fc1518f0 2024-04-23T10:28:50.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd8f97fa640 1 -- 172.21.15.29:0/2027343006 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18877 (secure 0 0 0) 0x7fd8f4056880 con 0x7fd8fc1518f0 2024-04-23T10:28:50.588 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:50.589 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:16:26.277550+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8dc068380 msgr2=0x7fd8dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8dc068380 0x7fd8dc06a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0af000 tx=0x7fd8ec0a8070 comp rx=0 tx=0).stop 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 msgr2=0x7fd8fc1449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc1449f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400c4c0 tx=0x7fd8f400c980 comp rx=0 tx=0).stop 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 shutdown_connections 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fd8dc068380 0x7fd8dc06a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8fc1518f0 0x7fd8fc1449f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc0c7730 0x7fd8fc1484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 --2- 172.21.15.29:0/2027343006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc0c6860 0x7fd8fc071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.589+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 >> 172.21.15.29:0/2027343006 conn(0x7fd8fc06cfb0 msgr2=0x7fd8fc159580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.593+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 shutdown_connections 2024-04-23T10:28:50.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:50.593+0000 7fd902c19640 1 -- 172.21.15.29:0/2027343006 wait complete. 2024-04-23T10:28:51.607 INFO:tasks.ceph:Scrubbing osd.0 2024-04-23T10:28:51.607 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:28:51.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666e7f8640 1 Processor -- start 2024-04-23T10:28:51.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666e7f8640 1 -- start start 2024-04-23T10:28:51.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666e7f8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66680c43a0 0x7f666806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666e7f8640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f666806ebc0 0x7f66680c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666e7f8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6668162b80 con 0x7f66681595b0 2024-04-23T10:28:51.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666e7f8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f6668162950 con 0x7f66680c43a0 2024-04-23T10:28:51.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666e7f8640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f66680c48b0 con 0x7f666806ebc0 2024-04-23T10:28:51.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f66677fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66680c43a0 0x7f666806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f66677fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f66680c43a0 0x7f666806e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39844/0 (socket says 172.21.15.29:39844) 2024-04-23T10:28:51.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f66677fe640 1 -- 172.21.15.29:0/121780700 learned_addr learned my addr 172.21.15.29:0/121780700 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:51.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666cd95640 1 --2- 172.21.15.29:0/121780700 >> v2:172.21.15.72:3300/0 conn(0x7f666806ebc0 0x7f66680c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f66677fe640 1 -- 172.21.15.29:0/121780700 >> v2:172.21.15.72:3300/0 conn(0x7f666806ebc0 msgr2=0x7f66680c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:51.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f66677fe640 1 --2- 172.21.15.29:0/121780700 >> v2:172.21.15.72:3300/0 conn(0x7f666806ebc0 0x7f66680c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f66677fe640 1 -- 172.21.15.29:0/121780700 >> v1:172.21.15.72:6789/0 conn(0x7f66681595b0 legacy=0x7f666806f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:51.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f66677fe640 1 -- 172.21.15.29:0/121780700 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6668162e60 con 0x7f66680c43a0 2024-04-23T10:28:51.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.749+0000 7f666cd95640 1 --2- 172.21.15.29:0/121780700 >> v2:172.21.15.72:3300/0 conn(0x7f666806ebc0 0x7f66680c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:51.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f66677fe640 1 --2- 172.21.15.29:0/121780700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66680c43a0 0x7f666806e680 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f666806c870 tx=0x7f665c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd8542cf39f221d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:51.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f6666ffd640 1 -- 172.21.15.29:0/121780700 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c0b5070 con 0x7f66680c43a0 2024-04-23T10:28:51.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f6666ffd640 1 -- 172.21.15.29:0/121780700 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c0a89d0 con 0x7f66680c43a0 2024-04-23T10:28:51.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f6666ffd640 1 -- 172.21.15.29:0/121780700 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c0a8da0 con 0x7f66680c43a0 2024-04-23T10:28:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f666e7f8640 1 -- 172.21.15.29:0/121780700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66680c43a0 msgr2=0x7f666806e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f666e7f8640 1 --2- 172.21.15.29:0/121780700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66680c43a0 0x7f666806e680 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f666806c870 tx=0x7f665c01ecd0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f666e7f8640 1 -- 172.21.15.29:0/121780700 shutdown_connections 2024-04-23T10:28:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f666e7f8640 1 --2- 172.21.15.29:0/121780700 >> v2:172.21.15.72:3300/0 conn(0x7f666806ebc0 0x7f66680c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f666e7f8640 1 --2- 172.21.15.29:0/121780700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66680c43a0 0x7f666806e680 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f666e7f8640 1 -- 172.21.15.29:0/121780700 >> 172.21.15.29:0/121780700 conn(0x7f66680c8f90 msgr2=0x7f66680c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f666e7f8640 1 -- 172.21.15.29:0/121780700 shutdown_connections 2024-04-23T10:28:51.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.753+0000 7f666e7f8640 1 -- 172.21.15.29:0/121780700 wait complete. 2024-04-23T10:28:51.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 Processor -- start 2024-04-23T10:28:51.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 -- start start 2024-04-23T10:28:51.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f666806ebc0 0x7f6668148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66680c43a0 0x7f6668071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66681595b0 0x7f666814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6668163420 con 0x7f666806ebc0 2024-04-23T10:28:51.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f666806fb40 con 0x7f66680c43a0 2024-04-23T10:28:51.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6668163700 con 0x7f66681595b0 2024-04-23T10:28:51.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f666806ebc0 0x7f6668148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f666806ebc0 0x7f6668148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39852/0 (socket says 172.21.15.29:39852) 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 -- 172.21.15.29:0/2540786839 learned_addr learned my addr 172.21.15.29:0/2540786839 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f66677fe640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66680c43a0 0x7f6668071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666cd95640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66681595b0 0x7f666814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 -- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66681595b0 msgr2=0x7f666814d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66681595b0 0x7f666814d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 -- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66680c43a0 msgr2=0x7f6668071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66680c43a0 0x7f6668071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 -- 172.21.15.29:0/2540786839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66681614e0 con 0x7f666806ebc0 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666cd95640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66681595b0 0x7f666814d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6667fff640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f666806ebc0 0x7f6668148e10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f665800c450 tx=0x7f665800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658012830 con 0x7f666806ebc0 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6658017070 con 0x7f666806ebc0 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66681617a0 con 0x7f666806ebc0 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658012c30 con 0x7f666806ebc0 2024-04-23T10:28:51.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66680720f0 con 0x7f666806ebc0 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6668068d70 con 0x7f666806ebc0 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.757+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f665801c460 con 0x7f666806ebc0 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f6664ff9640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6654068380 0x7f665406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6658087580 con 0x7f666806ebc0 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f6664ff9640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f6654071e10 0x7f66540742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 --> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6654074980 con 0x7f6654071e10 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6658087a10 con 0x7f666806ebc0 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f66677fe640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6654068380 0x7f665406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f666cd95640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f6654071e10 0x7f66540742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f666cd95640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f6654071e10 0x7f66540742b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:51.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f66677fe640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6654068380 0x7f665406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f665c0b2000 tx=0x7f665c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:51.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.761+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 <== osd.0 v2:172.21.15.29:6800/486295385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6654074980 con 0x7f6654071e10 2024-04-23T10:28:51.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.773+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 --> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66680c3fc0 con 0x7f6654071e10 2024-04-23T10:28:51.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.773+0000 7f6664ff9640 1 -- 172.21.15.29:0/2540786839 <== osd.0 v2:172.21.15.29:6800/486295385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f66680c3fc0 con 0x7f6654071e10 2024-04-23T10:28:51.774 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:51.774 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:28:51.775 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:51.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f6654071e10 msgr2=0x7f66540742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.29:6800/486295385,v1:172.21.15.29:6801/486295385] conn(0x7f6654071e10 0x7f66540742b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6654068380 msgr2=0x7f665406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6654068380 0x7f665406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f665c0b2000 tx=0x7f665c008040 comp rx=0 tx=0).stop 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f666806ebc0 msgr2=0x7f6668148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 --2- 172.21.15.29:0/2540786839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f666806ebc0 0x7f6668148e10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f665800c450 tx=0x7f665800c910 comp rx=0 tx=0).stop 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666cd95640 1 -- 172.21.15.29:0/2540786839 reap_dead start 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 shutdown_connections 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 >> 172.21.15.29:0/2540786839 conn(0x7f66680c8f90 msgr2=0x7f66680cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 shutdown_connections 2024-04-23T10:28:51.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.777+0000 7f666e7f8640 1 -- 172.21.15.29:0/2540786839 wait complete. 2024-04-23T10:28:51.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-23T10:28:51.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7b085f640 1 Processor -- start 2024-04-23T10:28:51.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7b085f640 1 -- start start 2024-04-23T10:28:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7b085f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac153190 0x7ff7ac159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7b085f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7ac0cd360 0x7ff7ac06f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7b085f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ac0c3fe0 con 0x7ff7ac06f150 2024-04-23T10:28:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7b085f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ac159380 con 0x7ff7ac0cd360 2024-04-23T10:28:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7b085f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac0c42c0 con 0x7ff7ac153190 2024-04-23T10:28:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7a9d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff7ac06f150 0x7ff7ac0ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34934/0 (socket says 172.21.15.29:34934) 2024-04-23T10:28:51.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7a9d9b640 1 -- 172.21.15.29:0/4249420384 learned_addr learned my addr 172.21.15.29:0/4249420384 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7aad9d640 1 --2- 172.21.15.29:0/4249420384 >> v2:172.21.15.72:3300/0 conn(0x7ff7ac0cd360 0x7ff7ac06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7aa59c640 1 --2- 172.21.15.29:0/4249420384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac153190 0x7ff7ac159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7a959a640 1 -- 172.21.15.29:0/4249420384 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609410522 0 0) 0x7ff7ac0c3fe0 con 0x7ff7ac06f150 2024-04-23T10:28:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.909+0000 7ff7a959a640 1 -- 172.21.15.29:0/4249420384 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff794003530 con 0x7ff7ac06f150 2024-04-23T10:28:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7a959a640 1 -- 172.21.15.29:0/4249420384 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 521996033 0 0) 0x7ff794003530 con 0x7ff7ac06f150 2024-04-23T10:28:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7aa59c640 1 -- 172.21.15.29:0/4249420384 >> v2:172.21.15.72:3300/0 conn(0x7ff7ac0cd360 msgr2=0x7ff7ac06f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:51.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7aa59c640 1 --2- 172.21.15.29:0/4249420384 >> v2:172.21.15.72:3300/0 conn(0x7ff7ac0cd360 0x7ff7ac06f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7aa59c640 1 -- 172.21.15.29:0/4249420384 >> v1:172.21.15.29:6789/0 conn(0x7ff7ac06f150 legacy=0x7ff7ac0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7aa59c640 1 -- 172.21.15.29:0/4249420384 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac0c45a0 con 0x7ff7ac153190 2024-04-23T10:28:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7aa59c640 1 --2- 172.21.15.29:0/4249420384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac153190 0x7ff7ac159810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0097c0 tx=0x7ff79c01ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5b17e5b58fa2083 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7a959a640 1 -- 172.21.15.29:0/4249420384 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0b5070 con 0x7ff7ac153190 2024-04-23T10:28:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7a959a640 1 -- 172.21.15.29:0/4249420384 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79c0a85f0 con 0x7ff7ac153190 2024-04-23T10:28:51.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7a959a640 1 -- 172.21.15.29:0/4249420384 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0001680 con 0x7ff7ac153190 2024-04-23T10:28:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7b085f640 1 -- 172.21.15.29:0/4249420384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac153190 msgr2=0x7ff7ac159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7b085f640 1 --2- 172.21.15.29:0/4249420384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac153190 0x7ff7ac159810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0097c0 tx=0x7ff79c01ebb0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7b085f640 1 -- 172.21.15.29:0/4249420384 shutdown_connections 2024-04-23T10:28:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7b085f640 1 --2- 172.21.15.29:0/4249420384 >> v2:172.21.15.72:3300/0 conn(0x7ff7ac0cd360 0x7ff7ac06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7b085f640 1 --2- 172.21.15.29:0/4249420384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac153190 0x7ff7ac159810 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7b085f640 1 -- 172.21.15.29:0/4249420384 >> 172.21.15.29:0/4249420384 conn(0x7ff7ac06cfb0 msgr2=0x7ff7ac06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7b085f640 1 -- 172.21.15.29:0/4249420384 shutdown_connections 2024-04-23T10:28:51.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.913+0000 7ff7b085f640 1 -- 172.21.15.29:0/4249420384 wait complete. 2024-04-23T10:28:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 Processor -- start 2024-04-23T10:28:51.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 -- start start 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac06f150 0x7ff7ac154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ac0cd360 0x7ff7ac071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7ac153190 0x7ff7ac151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac0c4880 con 0x7ff7ac153190 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac153570 con 0x7ff7ac0cd360 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac0c9070 con 0x7ff7ac06f150 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7ac153190 0x7ff7ac151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7ac153190 0x7ff7ac151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39860/0 (socket says 172.21.15.29:39860) 2024-04-23T10:28:51.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 -- 172.21.15.29:0/798950965 learned_addr learned my addr 172.21.15.29:0/798950965 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:51.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aa59c640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac06f150 0x7ff7ac154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 -- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac06f150 msgr2=0x7ff7ac154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7a9d9b640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ac0cd360 0x7ff7ac071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac06f150 0x7ff7ac154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 -- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ac0cd360 msgr2=0x7ff7ac071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ac0cd360 0x7ff7ac071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 -- 172.21.15.29:0/798950965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac1555b0 con 0x7ff7ac153190 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7a9d9b640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ac0cd360 0x7ff7ac071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7aad9d640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7ac153190 0x7ff7ac151880 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009e30 tx=0x7ff7a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff79affd640 1 -- 172.21.15.29:0/798950965 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4018020 con 0x7ff7ac153190 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff79affd640 1 -- 172.21.15.29:0/798950965 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a4014480 con 0x7ff7ac153190 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff79affd640 1 -- 172.21.15.29:0/798950965 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4014870 con 0x7ff7ac153190 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac1551c0 con 0x7ff7ac153190 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac153b70 con 0x7ff7ac153190 2024-04-23T10:28:51.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ac155ce0 con 0x7ff7ac153190 2024-04-23T10:28:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.917+0000 7ff79affd640 1 -- 172.21.15.29:0/798950965 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff7a401b020 con 0x7ff7ac153190 2024-04-23T10:28:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.921+0000 7ff79affd640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff78c0683b0 0x7ff78c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.921+0000 7ff79affd640 1 -- 172.21.15.29:0/798950965 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff7a4087c30 con 0x7ff7ac153190 2024-04-23T10:28:51.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.921+0000 7ff7aa59c640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff78c0683b0 0x7ff78c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:51.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.921+0000 7ff7aa59c640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff78c0683b0 0x7ff78c06a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0b2000 tx=0x7ff79c0aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:51.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:51.925+0000 7ff79affd640 1 -- 172.21.15.29:0/798950965 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff7a408e080 con 0x7ff7ac153190 2024-04-23T10:28:52.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.085+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff7ac156920 con 0x7ff78c0683b0 2024-04-23T10:28:52.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff79affd640 1 -- 172.21.15.29:0/798950965 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff7ac156920 con 0x7ff78c0683b0 2024-04-23T10:28:52.087 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff78c0683b0 msgr2=0x7ff78c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff78c0683b0 0x7ff78c06a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0b2000 tx=0x7ff79c0aa070 comp rx=0 tx=0).stop 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7ac153190 msgr2=0x7ff7ac151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7ac153190 0x7ff7ac151880 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009e30 tx=0x7ff7a400c490 comp rx=0 tx=0).stop 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 shutdown_connections 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7ff78c0683b0 0x7ff78c06a870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7ac153190 0x7ff7ac151880 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ac0cd360 0x7ff7ac071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 --2- 172.21.15.29:0/798950965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7ac06f150 0x7ff7ac154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 >> 172.21.15.29:0/798950965 conn(0x7ff7ac06cfb0 msgr2=0x7ff7ac159710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:52.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 shutdown_connections 2024-04-23T10:28:52.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.089+0000 7ff7b085f640 1 -- 172.21.15.29:0/798950965 wait complete. 2024-04-23T10:28:52.109 INFO:tasks.ceph:Scrubbing osd.1 2024-04-23T10:28:52.109 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:28:52.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f4981b6f640 1 Processor -- start 2024-04-23T10:28:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f4981b6f640 1 -- start start 2024-04-23T10:28:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f4981b6f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f497c0cd5f0 0x7f497c166900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f4981b6f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c0cc540 con 0x7f497c155330 2024-04-23T10:28:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f4981b6f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c0cc820 con 0x7f497c0b6580 2024-04-23T10:28:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f4981b6f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f497c15b3a0 con 0x7f497c0cd5f0 2024-04-23T10:28:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f497bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f497c0cd5f0 0x7f497c166900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f497b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f497c155330 0x7f497c06c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34950/0 (socket says 172.21.15.29:34950) 2024-04-23T10:28:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f497b7fe640 1 -- 172.21.15.29:0/209025204 learned_addr learned my addr 172.21.15.29:0/209025204 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:52.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f497bfff640 1 -- 172.21.15.29:0/209025204 >> v1:172.21.15.72:6789/0 conn(0x7f497c0b6580 legacy=0x7f497c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f497bfff640 1 -- 172.21.15.29:0/209025204 >> v1:172.21.15.29:6789/0 conn(0x7f497c155330 legacy=0x7f497c06c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.241+0000 7f497bfff640 1 -- 172.21.15.29:0/209025204 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c15b680 con 0x7f497c0cd5f0 2024-04-23T10:28:52.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f497bfff640 1 --2- 172.21.15.29:0/209025204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 0x7f497c166900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f49740097c0 tx=0x7f497401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c90da6ba1cdad2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f497a7fc640 1 -- 172.21.15.29:0/209025204 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49740b5070 con 0x7f497c0cd5f0 2024-04-23T10:28:52.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f497a7fc640 1 -- 172.21.15.29:0/209025204 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49740a8990 con 0x7f497c0cd5f0 2024-04-23T10:28:52.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f497a7fc640 1 -- 172.21.15.29:0/209025204 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49740a8d60 con 0x7f497c0cd5f0 2024-04-23T10:28:52.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f4981b6f640 1 -- 172.21.15.29:0/209025204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 msgr2=0x7f497c166900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f4981b6f640 1 --2- 172.21.15.29:0/209025204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 0x7f497c166900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f49740097c0 tx=0x7f497401ec90 comp rx=0 tx=0).stop 2024-04-23T10:28:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f4981b6f640 1 -- 172.21.15.29:0/209025204 shutdown_connections 2024-04-23T10:28:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f4981b6f640 1 --2- 172.21.15.29:0/209025204 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 0x7f497c166900 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f4981b6f640 1 -- 172.21.15.29:0/209025204 >> 172.21.15.29:0/209025204 conn(0x7f497c0758f0 msgr2=0x7f497c0730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f4981b6f640 1 -- 172.21.15.29:0/209025204 shutdown_connections 2024-04-23T10:28:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.245+0000 7f4981b6f640 1 -- 172.21.15.29:0/209025204 wait complete. 2024-04-23T10:28:52.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 Processor -- start 2024-04-23T10:28:52.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 -- start start 2024-04-23T10:28:52.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0b6580 0x7f497c1f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 0x7f497c0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f497c155330 0x7f497c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f497c15b050 con 0x7f497c0cd5f0 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f497c155710 con 0x7f497c0b6580 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f497c15be80 con 0x7f497c155330 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 0x7f497c0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 0x7f497c0c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39868/0 (socket says 172.21.15.29:39868) 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 -- 172.21.15.29:0/2484472656 learned_addr learned my addr 172.21.15.29:0/2484472656 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497bfff640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f497c155330 0x7f497c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497b7fe640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0b6580 0x7f497c1f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 -- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f497c155330 msgr2=0x7f497c159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f497c155330 0x7f497c159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 -- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0b6580 msgr2=0x7f497c1f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f497c0b6580 0x7f497c1f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 -- 172.21.15.29:0/2484472656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c155d00 con 0x7f497c0cd5f0 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f497affd640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 0x7f497c0c68d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f496400c790 tx=0x7f496400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964016020 con 0x7f497c0cd5f0 2024-04-23T10:28:52.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4964006d60 con 0x7f497c0cd5f0 2024-04-23T10:28:52.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964003bc0 con 0x7f497c0cd5f0 2024-04-23T10:28:52.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c155fe0 con 0x7f497c0cd5f0 2024-04-23T10:28:52.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c1565a0 con 0x7f497c0cd5f0 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f497c068d70 con 0x7f497c0cd5f0 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f496400a850 con 0x7f497c0cd5f0 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.249+0000 7f4973fff640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f495c068380 0x7f495c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f49640877f0 con 0x7f497c0cd5f0 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f4973fff640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f495c071e10 0x7f495c0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 --> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4964017e70 con 0x7f495c071e10 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4964087c80 con 0x7f497c0cd5f0 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f497b7fe640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f495c068380 0x7f495c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f497bfff640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f495c071e10 0x7f495c0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f497bfff640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f495c071e10 0x7f495c0742b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f497b7fe640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f495c068380 0x7f495c06a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f496c005890 tx=0x7f496c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.253+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 <== osd.1 v2:172.21.15.29:6824/808351651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4964017e70 con 0x7f495c071e10 2024-04-23T10:28:52.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 --> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f497c159730 con 0x7f495c071e10 2024-04-23T10:28:52.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4973fff640 1 -- 172.21.15.29:0/2484472656 <== osd.1 v2:172.21.15.29:6824/808351651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f497c159730 con 0x7f495c071e10 2024-04-23T10:28:52.266 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:28:52.266 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f495c071e10 msgr2=0x7f495c0742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.29:6824/808351651,v1:172.21.15.29:6825/808351651] conn(0x7f495c071e10 0x7f495c0742b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f495c068380 msgr2=0x7f495c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f495c068380 0x7f495c06a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f496c005890 tx=0x7f496c009040 comp rx=0 tx=0).stop 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 msgr2=0x7f497c0c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 --2- 172.21.15.29:0/2484472656 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c0cd5f0 0x7f497c0c68d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f496400c790 tx=0x7f496400cc50 comp rx=0 tx=0).stop 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f497bfff640 1 -- 172.21.15.29:0/2484472656 reap_dead start 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 shutdown_connections 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 >> 172.21.15.29:0/2484472656 conn(0x7f497c0758f0 msgr2=0x7f497c153600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 shutdown_connections 2024-04-23T10:28:52.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.265+0000 7f4981b6f640 1 -- 172.21.15.29:0/2484472656 wait complete. 2024-04-23T10:28:52.283 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-23T10:28:52.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4603a40640 1 Processor -- start 2024-04-23T10:28:52.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4603a40640 1 -- start start 2024-04-23T10:28:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4603a40640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45fc06f150 0x7f45fc06f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4603a40640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45fc0ccc50 0x7f45fc0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4603a40640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45fc0cd5a0 con 0x7f45fc153190 2024-04-23T10:28:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4603a40640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f45fc159f20 con 0x7f45fc06f150 2024-04-23T10:28:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4603a40640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f45fc159380 con 0x7f45fc0ccc50 2024-04-23T10:28:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4600fdb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45fc06f150 0x7f45fc06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4600fdb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f45fc06f150 0x7f45fc06f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39880/0 (socket says 172.21.15.29:39880) 2024-04-23T10:28:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4600fdb640 1 -- 172.21.15.29:0/3124876661 learned_addr learned my addr 172.21.15.29:0/3124876661 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:52.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4601fdd640 1 --2- 172.21.15.29:0/3124876661 >> v2:172.21.15.72:3300/0 conn(0x7f45fc0ccc50 0x7f45fc0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4600fdb640 1 -- 172.21.15.29:0/3124876661 >> v2:172.21.15.72:3300/0 conn(0x7f45fc0ccc50 msgr2=0x7f45fc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:52.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4600fdb640 1 --2- 172.21.15.29:0/3124876661 >> v2:172.21.15.72:3300/0 conn(0x7f45fc0ccc50 0x7f45fc0cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4600fdb640 1 -- 172.21.15.29:0/3124876661 >> v1:172.21.15.72:6789/0 conn(0x7f45fc153190 legacy=0x7f45fc159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:52.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.405+0000 7f4600fdb640 1 -- 172.21.15.29:0/3124876661 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc0c3fe0 con 0x7f45fc06f150 2024-04-23T10:28:52.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4600fdb640 1 --2- 172.21.15.29:0/3124876661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc06f150 0x7f45fc06f580 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f45fc159500 tx=0x7f45ec01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a185ea9337c1ba5d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f45f3fff640 1 -- 172.21.15.29:0/3124876661 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0b5070 con 0x7f45fc06f150 2024-04-23T10:28:52.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f45f3fff640 1 -- 172.21.15.29:0/3124876661 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec0a89d0 con 0x7f45fc06f150 2024-04-23T10:28:52.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f45f3fff640 1 -- 172.21.15.29:0/3124876661 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0a8da0 con 0x7f45fc06f150 2024-04-23T10:28:52.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- 172.21.15.29:0/3124876661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc06f150 msgr2=0x7f45fc06f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 --2- 172.21.15.29:0/3124876661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc06f150 0x7f45fc06f580 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f45fc159500 tx=0x7f45ec01ecd0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- 172.21.15.29:0/3124876661 shutdown_connections 2024-04-23T10:28:52.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 --2- 172.21.15.29:0/3124876661 >> v2:172.21.15.72:3300/0 conn(0x7f45fc0ccc50 0x7f45fc0cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 --2- 172.21.15.29:0/3124876661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc06f150 0x7f45fc06f580 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- 172.21.15.29:0/3124876661 >> 172.21.15.29:0/3124876661 conn(0x7f45fc06cfb0 msgr2=0x7f45fc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:52.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- 172.21.15.29:0/3124876661 shutdown_connections 2024-04-23T10:28:52.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- 172.21.15.29:0/3124876661 wait complete. 2024-04-23T10:28:52.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 Processor -- start 2024-04-23T10:28:52.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- start start 2024-04-23T10:28:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45fc06f150 0x7f45fc1e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45fc0ccc50 0x7f45fc151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc153190 0x7f45fc1e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc159010 con 0x7f45fc153190 2024-04-23T10:28:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0c45a0 con 0x7f45fc06f150 2024-04-23T10:28:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4603a40640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc153570 con 0x7f45fc0ccc50 2024-04-23T10:28:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4601fdd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc153190 0x7f45fc1e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4601fdd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc153190 0x7f45fc1e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39884/0 (socket says 172.21.15.29:39884) 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4601fdd640 1 -- 172.21.15.29:0/441013639 learned_addr learned my addr 172.21.15.29:0/441013639 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4600fdb640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45fc0ccc50 0x7f45fc151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f46017dc640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45fc06f150 0x7f45fc1e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4601fdd640 1 -- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45fc0ccc50 msgr2=0x7f45fc151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4601fdd640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45fc0ccc50 0x7f45fc151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.409+0000 7f4601fdd640 1 -- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45fc06f150 msgr2=0x7f45fc1e2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f4601fdd640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45fc06f150 0x7f45fc1e2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f4601fdd640 1 -- 172.21.15.29:0/441013639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc1f1d70 con 0x7f45fc153190 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f4601fdd640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc153190 0x7f45fc1e3690 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f45f400cda0 tx=0x7f45f400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f45f1ffb640 1 -- 172.21.15.29:0/441013639 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4003ba0 con 0x7f45fc153190 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f45f1ffb640 1 -- 172.21.15.29:0/441013639 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f4003d40 con 0x7f45fc153190 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc1f0f10 con 0x7f45fc153190 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f45f1ffb640 1 -- 172.21.15.29:0/441013639 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4004240 con 0x7f45fc153190 2024-04-23T10:28:52.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc1f14d0 con 0x7f45fc153190 2024-04-23T10:28:52.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc068d70 con 0x7f45fc153190 2024-04-23T10:28:52.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f45f1ffb640 1 -- 172.21.15.29:0/441013639 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45f40043e0 con 0x7f45fc153190 2024-04-23T10:28:52.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f45f1ffb640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f45e0068380 0x7f45e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f45f1ffb640 1 -- 172.21.15.29:0/441013639 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f45f4087950 con 0x7f45fc153190 2024-04-23T10:28:52.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f46017dc640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f45e0068380 0x7f45e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.413+0000 7f46017dc640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f45e0068380 0x7f45e006a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f45f8003d60 tx=0x7f45f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.417+0000 7f45f1ffb640 1 -- 172.21.15.29:0/441013639 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45f4057a60 con 0x7f45fc153190 2024-04-23T10:28:52.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.581+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f45fc1e33f0 con 0x7f45e0068380 2024-04-23T10:28:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.581+0000 7f45f1ffb640 1 -- 172.21.15.29:0/441013639 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45fc1e33f0 con 0x7f45e0068380 2024-04-23T10:28:52.581 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f45e0068380 msgr2=0x7f45e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f45e0068380 0x7f45e006a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f45f8003d60 tx=0x7f45f8009040 comp rx=0 tx=0).stop 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc153190 msgr2=0x7f45fc1e3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc153190 0x7f45fc1e3690 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f45f400cda0 tx=0x7f45f400a660 comp rx=0 tx=0).stop 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 shutdown_connections 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f45e0068380 0x7f45e006a840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc153190 0x7f45fc1e3690 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45fc0ccc50 0x7f45fc151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 --2- 172.21.15.29:0/441013639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45fc06f150 0x7f45fc1e2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 >> 172.21.15.29:0/441013639 conn(0x7f45fc06cfb0 msgr2=0x7f45fc1584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:52.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 shutdown_connections 2024-04-23T10:28:52.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.585+0000 7f4603a40640 1 -- 172.21.15.29:0/441013639 wait complete. 2024-04-23T10:28:52.601 INFO:tasks.ceph:Scrubbing osd.2 2024-04-23T10:28:52.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:28:52.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.733+0000 7fe5504e2640 1 Processor -- start 2024-04-23T10:28:52.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.733+0000 7fe5504e2640 1 -- start start 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.733+0000 7fe5504e2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5480c68a0 0x7fe5480cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.733+0000 7fe5504e2640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5480c5c10 con 0x7fe548071570 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.733+0000 7fe5504e2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5480741e0 con 0x7fe548071190 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.733+0000 7fe5504e2640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe5480cd4c0 con 0x7fe5480c68a0 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.733+0000 7fe54ea7f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5480c68a0 0x7fe5480cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54da7d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe548071570 0x7fe5480c6190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34956/0 (socket says 172.21.15.29:34956) 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54da7d640 1 -- 172.21.15.29:0/1818641296 learned_addr learned my addr 172.21.15.29:0/1818641296 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54ea7f640 1 -- 172.21.15.29:0/1818641296 >> v1:172.21.15.72:6789/0 conn(0x7fe548071190 legacy=0x7fe548073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54ea7f640 1 -- 172.21.15.29:0/1818641296 >> v1:172.21.15.29:6789/0 conn(0x7fe548071570 legacy=0x7fe5480c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54ea7f640 1 -- 172.21.15.29:0/1818641296 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe548074480 con 0x7fe5480c68a0 2024-04-23T10:28:52.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54ea7f640 1 --2- 172.21.15.29:0/1818641296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5480c68a0 0x7fe5480cf430 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe5480cd640 tx=0x7fe54001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7f5ce7d55f03ad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54d27c640 1 -- 172.21.15.29:0/1818641296 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5400b2070 con 0x7fe5480c68a0 2024-04-23T10:28:52.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54d27c640 1 -- 172.21.15.29:0/1818641296 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5400a5840 con 0x7fe5480c68a0 2024-04-23T10:28:52.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe54d27c640 1 -- 172.21.15.29:0/1818641296 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5400a5c10 con 0x7fe5480c68a0 2024-04-23T10:28:52.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe5504e2640 1 -- 172.21.15.29:0/1818641296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5480c68a0 msgr2=0x7fe5480cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe5504e2640 1 --2- 172.21.15.29:0/1818641296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5480c68a0 0x7fe5480cf430 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe5480cd640 tx=0x7fe54001c7e0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe5504e2640 1 -- 172.21.15.29:0/1818641296 shutdown_connections 2024-04-23T10:28:52.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe5504e2640 1 --2- 172.21.15.29:0/1818641296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5480c68a0 0x7fe5480cf430 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe5504e2640 1 -- 172.21.15.29:0/1818641296 >> 172.21.15.29:0/1818641296 conn(0x7fe54806fc20 msgr2=0x7fe548074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:52.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe5504e2640 1 -- 172.21.15.29:0/1818641296 shutdown_connections 2024-04-23T10:28:52.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.737+0000 7fe5504e2640 1 -- 172.21.15.29:0/1818641296 wait complete. 2024-04-23T10:28:52.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 Processor -- start 2024-04-23T10:28:52.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 -- start start 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe548071190 0x7fe548144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe548071570 0x7fe54814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5480c68a0 0x7fe5480c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe5480cdcd0 con 0x7fe548071190 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe5480cd9f0 con 0x7fe5480c68a0 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe548152d60 con 0x7fe548071570 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe548071190 0x7fe548144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe548071190 0x7fe548144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39900/0 (socket says 172.21.15.29:39900) 2024-04-23T10:28:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 -- 172.21.15.29:0/283544168 learned_addr learned my addr 172.21.15.29:0/283544168 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54da7d640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe548071570 0x7fe54814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54ea7f640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5480c68a0 0x7fe5480c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 -- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe548071570 msgr2=0x7fe54814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe548071570 0x7fe54814dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 -- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5480c68a0 msgr2=0x7fe5480c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5480c68a0 0x7fe5480c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 -- 172.21.15.29:0/283544168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe548145400 con 0x7fe548071190 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54da7d640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe548071570 0x7fe54814dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe54e27e640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe548071190 0x7fe548144ab0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c420 tx=0x7fe54400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5440052d0 con 0x7fe548071190 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe544005470 con 0x7fe548071190 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544007260 con 0x7fe548071190 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5481f2810 con 0x7fe548071190 2024-04-23T10:28:52.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe548144ff0 con 0x7fe548071190 2024-04-23T10:28:52.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5480693c0 con 0x7fe548071190 2024-04-23T10:28:52.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.741+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe544007400 con 0x7fe548071190 2024-04-23T10:28:52.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe53effd640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe52c068380 0x7fe52c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe544086dc0 con 0x7fe548071190 2024-04-23T10:28:52.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe53effd640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7fe52c071e10 0x7fe52c0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 --> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe544015ec0 con 0x7fe52c071e10 2024-04-23T10:28:52.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe544087250 con 0x7fe548071190 2024-04-23T10:28:52.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe54ea7f640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7fe52c071e10 0x7fe52c0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe54da7d640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe52c068380 0x7fe52c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe54ea7f640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7fe52c071e10 0x7fe52c0742b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe54da7d640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe52c068380 0x7fe52c06a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe5480c5110 tx=0x7fe53800adb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.745+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 <== osd.2 v2:172.21.15.29:6808/1459392502 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe544015ec0 con 0x7fe52c071e10 2024-04-23T10:28:52.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.757+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 --> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe548074f70 con 0x7fe52c071e10 2024-04-23T10:28:52.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe53effd640 1 -- 172.21.15.29:0/283544168 <== osd.2 v2:172.21.15.29:6808/1459392502 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe548074f70 con 0x7fe52c071e10 2024-04-23T10:28:52.759 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:28:52.759 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7fe52c071e10 msgr2=0x7fe52c0742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.29:6808/1459392502,v1:172.21.15.29:6809/1459392502] conn(0x7fe52c071e10 0x7fe52c0742b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe52c068380 msgr2=0x7fe52c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fe52c068380 0x7fe52c06a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe5480c5110 tx=0x7fe53800adb0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe548071190 msgr2=0x7fe548144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 --2- 172.21.15.29:0/283544168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe548071190 0x7fe548144ab0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c420 tx=0x7fe54400c8e0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe54ea7f640 1 -- 172.21.15.29:0/283544168 reap_dead start 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 shutdown_connections 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 >> 172.21.15.29:0/283544168 conn(0x7fe54806fc20 msgr2=0x7fe5480ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 shutdown_connections 2024-04-23T10:28:52.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.761+0000 7fe5504e2640 1 -- 172.21.15.29:0/283544168 wait complete. 2024-04-23T10:28:52.776 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-23T10:28:52.878 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:28:52.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:28:52.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5ca6695640 1 Processor -- start 2024-04-23T10:28:52.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5ca6695640 1 -- start start 2024-04-23T10:28:52.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5ca6695640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca00c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5ca6695640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ca00c2780 0x7f5ca00c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5ca6695640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca01578b0 con 0x7f5ca00c83f0 2024-04-23T10:28:52.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5ca6695640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca0158410 con 0x7f5ca00c2780 2024-04-23T10:28:52.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5ca6695640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca0151bc0 con 0x7f5ca01517e0 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca00c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca00c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41668/0 (socket says 172.21.15.29:41668) 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9f7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ca00c2780 0x7f5ca00c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9ffff640 1 -- 172.21.15.29:0/1186474874 learned_addr learned my addr 172.21.15.29:0/1186474874 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5ca4c32640 1 --1- 172.21.15.29:0/1186474874 >> v1:172.21.15.72:6789/0 conn(0x7f5ca00c83f0 0x7f5ca015b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:36324/0 (socket says 172.21.15.29:36324) 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9f7fe640 1 -- 172.21.15.29:0/1186474874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 msgr2=0x7f5ca00c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9f7fe640 1 --2- 172.21.15.29:0/1186474874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca00c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9f7fe640 1 -- 172.21.15.29:0/1186474874 >> v1:172.21.15.72:6789/0 conn(0x7f5ca00c83f0 legacy=0x7f5ca015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9effd640 1 -- 172.21.15.29:0/1186474874 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292915717 0 0) 0x7f5ca01578b0 con 0x7f5ca00c83f0 2024-04-23T10:28:52.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.893+0000 7f5c9f7fe640 1 -- 172.21.15.29:0/1186474874 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca0157b70 con 0x7f5ca00c2780 2024-04-23T10:28:52.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5c9f7fe640 1 --2- 172.21.15.29:0/1186474874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 0x7f5ca00c7eb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5c940097c0 tx=0x7f5c9401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69e6be8430325307 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5c9effd640 1 -- 172.21.15.29:0/1186474874 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c940b1070 con 0x7f5ca00c2780 2024-04-23T10:28:52.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5c9effd640 1 -- 172.21.15.29:0/1186474874 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c940ac640 con 0x7f5ca00c2780 2024-04-23T10:28:52.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5c9effd640 1 -- 172.21.15.29:0/1186474874 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c940aca10 con 0x7f5ca00c2780 2024-04-23T10:28:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 -- 172.21.15.29:0/1186474874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 msgr2=0x7f5ca00c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 --2- 172.21.15.29:0/1186474874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 0x7f5ca00c7eb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5c940097c0 tx=0x7f5c9401c4a0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 -- 172.21.15.29:0/1186474874 shutdown_connections 2024-04-23T10:28:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 --2- 172.21.15.29:0/1186474874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 0x7f5ca00c7eb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 --2- 172.21.15.29:0/1186474874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca00c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 -- 172.21.15.29:0/1186474874 >> 172.21.15.29:0/1186474874 conn(0x7f5ca00c9e20 msgr2=0x7f5ca00ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 -- 172.21.15.29:0/1186474874 shutdown_connections 2024-04-23T10:28:52.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 -- 172.21.15.29:0/1186474874 wait complete. 2024-04-23T10:28:52.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 Processor -- start 2024-04-23T10:28:52.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.897+0000 7f5ca6695640 1 -- start start 2024-04-23T10:28:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 0x7f5ca00cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ca00c83f0 0x7f5ca0148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca01488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0157610 con 0x7f5ca00c83f0 2024-04-23T10:28:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0157490 con 0x7f5ca00c2780 2024-04-23T10:28:52.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca015b780 con 0x7f5ca01517e0 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ca00c83f0 0x7f5ca0148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ca00c83f0 0x7f5ca0148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39908/0 (socket says 172.21.15.29:39908) 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 -- 172.21.15.29:0/2005472302 learned_addr learned my addr 172.21.15.29:0/2005472302 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9ffff640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 0x7f5ca00cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca4c32640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca01488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 -- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 msgr2=0x7f5ca01488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca01488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 -- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 msgr2=0x7f5ca00cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 0x7f5ca00cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 -- 172.21.15.29:0/2005472302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca01449c0 con 0x7f5ca00c83f0 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9f7fe640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ca00c83f0 0x7f5ca0148360 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5c940097c0 tx=0x7f5c9401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9cff9640 1 -- 172.21.15.29:0/2005472302 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c940b1050 con 0x7f5ca00c83f0 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9cff9640 1 -- 172.21.15.29:0/2005472302 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c940b2040 con 0x7f5ca00c83f0 2024-04-23T10:28:52.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca01472e0 con 0x7f5ca00c83f0 2024-04-23T10:28:52.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9cff9640 1 -- 172.21.15.29:0/2005472302 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94006e20 con 0x7f5ca00c83f0 2024-04-23T10:28:52.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca0147b60 con 0x7f5ca00c83f0 2024-04-23T10:28:52.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca0068d70 con 0x7f5ca00c83f0 2024-04-23T10:28:52.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9cff9640 1 -- 172.21.15.29:0/2005472302 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c940bf060 con 0x7f5ca00c83f0 2024-04-23T10:28:52.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9cff9640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c8c068380 0x7f5c8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:52.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9cff9640 1 -- 172.21.15.29:0/2005472302 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5c94120720 con 0x7f5ca00c83f0 2024-04-23T10:28:52.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.901+0000 7f5c9ffff640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c8c068380 0x7f5c8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:52.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.905+0000 7f5c9ffff640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c8c068380 0x7f5c8c06a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000bdf0 tx=0x7f5c9000b450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:52.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:52.905+0000 7f5c9cff9640 1 -- 172.21.15.29:0/2005472302 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c94016090 con 0x7f5ca00c83f0 2024-04-23T10:28:53.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.069+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5ca00c3d20 con 0x7f5c8c068380 2024-04-23T10:28:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5c9cff9640 1 -- 172.21.15.29:0/2005472302 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5ca00c3d20 con 0x7f5c8c068380 2024-04-23T10:28:53.071 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-04-23T10:28:53.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c8c068380 msgr2=0x7f5c8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c8c068380 0x7f5c8c06a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000bdf0 tx=0x7f5c9000b450 comp rx=0 tx=0).stop 2024-04-23T10:28:53.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ca00c83f0 msgr2=0x7f5ca0148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ca00c83f0 0x7f5ca0148360 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5c940097c0 tx=0x7f5c9401ace0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 shutdown_connections 2024-04-23T10:28:53.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5c8c068380 0x7f5c8c06a840 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca01517e0 0x7f5ca01488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ca00c83f0 0x7f5ca0148360 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 --2- 172.21.15.29:0/2005472302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca00c2780 0x7f5ca00cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 >> 172.21.15.29:0/2005472302 conn(0x7f5ca00c9e20 msgr2=0x7f5ca0156360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:53.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 shutdown_connections 2024-04-23T10:28:53.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.073+0000 7f5ca6695640 1 -- 172.21.15.29:0/2005472302 wait complete. 2024-04-23T10:28:53.090 INFO:tasks.ceph:Scrubbing osd.3 2024-04-23T10:28:53.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:28:53.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.221+0000 7fca5c4eb640 1 Processor -- start 2024-04-23T10:28:53.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.221+0000 7fca5c4eb640 1 -- start start 2024-04-23T10:28:53.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.221+0000 7fca5c4eb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca54152fe0 0x7fca540c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca5415c920 0x7fca5415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5415d2d0 con 0x7fca540c6fb0 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fca540c8de0 con 0x7fca54152fe0 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fca54159120 con 0x7fca5415c920 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5a287640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca54152fe0 0x7fca540c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5a287640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca54152fe0 0x7fca540c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39910/0 (socket says 172.21.15.29:39910) 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5a287640 1 -- 172.21.15.29:0/2704590781 learned_addr learned my addr 172.21.15.29:0/2704590781 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca59a86640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fca540c6fb0 0x7fca540c5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34970/0 (socket says 172.21.15.29:34970) 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5aa88640 1 --2- 172.21.15.29:0/2704590781 >> v2:172.21.15.72:3300/0 conn(0x7fca5415c920 0x7fca5415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5a287640 1 -- 172.21.15.29:0/2704590781 >> v2:172.21.15.72:3300/0 conn(0x7fca5415c920 msgr2=0x7fca5415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5a287640 1 --2- 172.21.15.29:0/2704590781 >> v2:172.21.15.72:3300/0 conn(0x7fca5415c920 0x7fca5415cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5a287640 1 -- 172.21.15.29:0/2704590781 >> v1:172.21.15.29:6789/0 conn(0x7fca540c6fb0 legacy=0x7fca540c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5a287640 1 -- 172.21.15.29:0/2704590781 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca54159400 con 0x7fca54152fe0 2024-04-23T10:28:53.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5a287640 1 --2- 172.21.15.29:0/2704590781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54152fe0 0x7fca540c88a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fca54071150 tx=0x7fca5001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7d00a171762b51 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca59285640 1 -- 172.21.15.29:0/2704590781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca500b1070 con 0x7fca54152fe0 2024-04-23T10:28:53.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca59285640 1 -- 172.21.15.29:0/2704590781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca500a8050 con 0x7fca54152fe0 2024-04-23T10:28:53.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca59285640 1 -- 172.21.15.29:0/2704590781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca500ac860 con 0x7fca54152fe0 2024-04-23T10:28:53.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 -- 172.21.15.29:0/2704590781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54152fe0 msgr2=0x7fca540c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 --2- 172.21.15.29:0/2704590781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54152fe0 0x7fca540c88a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fca54071150 tx=0x7fca5001c440 comp rx=0 tx=0).stop 2024-04-23T10:28:53.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 -- 172.21.15.29:0/2704590781 shutdown_connections 2024-04-23T10:28:53.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 --2- 172.21.15.29:0/2704590781 >> v2:172.21.15.72:3300/0 conn(0x7fca5415c920 0x7fca5415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 --2- 172.21.15.29:0/2704590781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca54152fe0 0x7fca540c88a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 -- 172.21.15.29:0/2704590781 >> 172.21.15.29:0/2704590781 conn(0x7fca540c8f90 msgr2=0x7fca540c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:53.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 -- 172.21.15.29:0/2704590781 shutdown_connections 2024-04-23T10:28:53.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.225+0000 7fca5c4eb640 1 -- 172.21.15.29:0/2704590781 wait complete. 2024-04-23T10:28:53.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 Processor -- start 2024-04-23T10:28:53.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 -- start start 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca540c6fb0 0x7fca541ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca54152fe0 0x7fca54157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5415c920 0x7fca5415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fca54159ca0 con 0x7fca540c6fb0 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca541599c0 con 0x7fca5415c920 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fca5415c400 con 0x7fca54152fe0 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca540c6fb0 0x7fca541ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca540c6fb0 0x7fca541ef630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39922/0 (socket says 172.21.15.29:39922) 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 -- 172.21.15.29:0/416578110 learned_addr learned my addr 172.21.15.29:0/416578110 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:53.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5aa88640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5415c920 0x7fca5415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 -- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca54152fe0 msgr2=0x7fca54157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca54152fe0 0x7fca54157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 -- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5415c920 msgr2=0x7fca5415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5415c920 0x7fca5415a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 -- 172.21.15.29:0/416578110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca540cade0 con 0x7fca540c6fb0 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5a287640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca540c6fb0 0x7fca541ef630 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fca500af040 tx=0x7fca500191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca500bc070 con 0x7fca540c6fb0 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca500ab800 con 0x7fca540c6fb0 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca540cb080 con 0x7fca540c6fb0 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca500b1040 con 0x7fca540c6fb0 2024-04-23T10:28:53.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca540cb640 con 0x7fca540c6fb0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca54068d70 con 0x7fca540c6fb0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca500bf070 con 0x7fca540c6fb0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca4affd640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca38068380 0x7fca3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.229+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fca501205c0 con 0x7fca540c6fb0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.233+0000 7fca4affd640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7fca38071e10 0x7fca380742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.233+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 --> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca500bae50 con 0x7fca38071e10 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.233+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fca50127050 con 0x7fca540c6fb0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.233+0000 7fca5aa88640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7fca38071e10 0x7fca380742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.233+0000 7fca59a86640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca38068380 0x7fca3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.233+0000 7fca5aa88640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7fca38071e10 0x7fca380742b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.233+0000 7fca59a86640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca38068380 0x7fca3806a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca540ca9d0 tx=0x7fca44005260 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.233+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 <== osd.3 v2:172.21.15.29:6816/657827017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca500bae50 con 0x7fca38071e10 2024-04-23T10:28:53.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 --> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fca5406fac0 con 0x7fca38071e10 2024-04-23T10:28:53.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca4affd640 1 -- 172.21.15.29:0/416578110 <== osd.3 v2:172.21.15.29:6816/657827017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fca5406fac0 con 0x7fca38071e10 2024-04-23T10:28:53.245 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:53.245 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:28:53.245 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7fca38071e10 msgr2=0x7fca380742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.29:6816/657827017,v1:172.21.15.29:6817/657827017] conn(0x7fca38071e10 0x7fca380742b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca38068380 msgr2=0x7fca3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca38068380 0x7fca3806a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca540ca9d0 tx=0x7fca44005260 comp rx=0 tx=0).stop 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca540c6fb0 msgr2=0x7fca541ef630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 --2- 172.21.15.29:0/416578110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca540c6fb0 0x7fca541ef630 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fca500af040 tx=0x7fca500191e0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5aa88640 1 -- 172.21.15.29:0/416578110 reap_dead start 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 shutdown_connections 2024-04-23T10:28:53.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 >> 172.21.15.29:0/416578110 conn(0x7fca540c8f90 msgr2=0x7fca5414f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 shutdown_connections 2024-04-23T10:28:53.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.245+0000 7fca5c4eb640 1 -- 172.21.15.29:0/416578110 wait complete. 2024-04-23T10:28:53.259 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-23T10:28:53.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca55d8f640 1 Processor -- start 2024-04-23T10:28:53.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca55d8f640 1 -- start start 2024-04-23T10:28:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca55d8f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca50155470 0x7fca5015e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca55d8f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca5015bb40 0x7fca50073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca55d8f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5015ed20 con 0x7fca500735c0 2024-04-23T10:28:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca55d8f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fca5015f000 con 0x7fca5015bb40 2024-04-23T10:28:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca55d8f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fca5015f2e0 con 0x7fca50155470 2024-04-23T10:28:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca4effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca5015bb40 0x7fca50073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca4effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca5015bb40 0x7fca50073080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39938/0 (socket says 172.21.15.29:39938) 2024-04-23T10:28:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca4effd640 1 -- 172.21.15.29:0/2841360842 learned_addr learned my addr 172.21.15.29:0/2841360842 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca4f7fe640 1 --2- 172.21.15.29:0/2841360842 >> v2:172.21.15.72:3300/0 conn(0x7fca50155470 0x7fca5015e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca4effd640 1 -- 172.21.15.29:0/2841360842 >> v2:172.21.15.72:3300/0 conn(0x7fca50155470 msgr2=0x7fca5015e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca4effd640 1 --2- 172.21.15.29:0/2841360842 >> v2:172.21.15.72:3300/0 conn(0x7fca50155470 0x7fca5015e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca4effd640 1 -- 172.21.15.29:0/2841360842 >> v1:172.21.15.72:6789/0 conn(0x7fca500735c0 legacy=0x7fca500c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:53.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.377+0000 7fca4effd640 1 -- 172.21.15.29:0/2841360842 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5015f5c0 con 0x7fca5015bb40 2024-04-23T10:28:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca4effd640 1 --2- 172.21.15.29:0/2841360842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca5015bb40 0x7fca50073080 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fca50073db0 tx=0x7fca3801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a508d37d3a7c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca4e7fc640 1 -- 172.21.15.29:0/2841360842 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca380b0070 con 0x7fca5015bb40 2024-04-23T10:28:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca4e7fc640 1 -- 172.21.15.29:0/2841360842 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca380ab600 con 0x7fca5015bb40 2024-04-23T10:28:53.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca4e7fc640 1 -- 172.21.15.29:0/2841360842 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca380ab9d0 con 0x7fca5015bb40 2024-04-23T10:28:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 -- 172.21.15.29:0/2841360842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca5015bb40 msgr2=0x7fca50073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2841360842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca5015bb40 0x7fca50073080 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fca50073db0 tx=0x7fca3801c450 comp rx=0 tx=0).stop 2024-04-23T10:28:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 -- 172.21.15.29:0/2841360842 shutdown_connections 2024-04-23T10:28:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2841360842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca5015bb40 0x7fca50073080 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2841360842 >> v2:172.21.15.72:3300/0 conn(0x7fca50155470 0x7fca5015e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 -- 172.21.15.29:0/2841360842 >> 172.21.15.29:0/2841360842 conn(0x7fca5006d5e0 msgr2=0x7fca50072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 -- 172.21.15.29:0/2841360842 shutdown_connections 2024-04-23T10:28:53.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 -- 172.21.15.29:0/2841360842 wait complete. 2024-04-23T10:28:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 Processor -- start 2024-04-23T10:28:53.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.381+0000 7fca55d8f640 1 -- start start 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca500735c0 0x7fca5015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca50155470 0x7fca50154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca5015bb40 0x7fca500b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fca500cb700 con 0x7fca500735c0 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca500cb580 con 0x7fca50155470 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fca50168260 con 0x7fca5015bb40 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca500735c0 0x7fca5015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca500735c0 0x7fca5015e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39948/0 (socket says 172.21.15.29:39948) 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 -- 172.21.15.29:0/2534250520 learned_addr learned my addr 172.21.15.29:0/2534250520 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:53.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4effd640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca50155470 0x7fca50154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 -- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca5015bb40 msgr2=0x7fca500b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4ffff640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca5015bb40 0x7fca500b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca5015bb40 0x7fca500b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 -- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca50155470 msgr2=0x7fca50154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca50155470 0x7fca50154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 -- 172.21.15.29:0/2534250520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5015d530 con 0x7fca500735c0 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4f7fe640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca500735c0 0x7fca5015e2b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fca48007f20 tx=0x7fca4800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca47fff640 1 -- 172.21.15.29:0/2534250520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48014620 con 0x7fca500735c0 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca47fff640 1 -- 172.21.15.29:0/2534250520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca48019070 con 0x7fca500735c0 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca501f7fa0 con 0x7fca500735c0 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca47fff640 1 -- 172.21.15.29:0/2534250520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48014a00 con 0x7fca500735c0 2024-04-23T10:28:53.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5015dab0 con 0x7fca500735c0 2024-04-23T10:28:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca50068d70 con 0x7fca500735c0 2024-04-23T10:28:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca47fff640 1 -- 172.21.15.29:0/2534250520 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca48014ba0 con 0x7fca500735c0 2024-04-23T10:28:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca47fff640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca30068380 0x7fca3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca47fff640 1 -- 172.21.15.29:0/2534250520 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fca48087880 con 0x7fca500735c0 2024-04-23T10:28:53.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.385+0000 7fca4effd640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca30068380 0x7fca3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.389+0000 7fca4effd640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca30068380 0x7fca3006a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca380ad000 tx=0x7fca38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.389+0000 7fca47fff640 1 -- 172.21.15.29:0/2534250520 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca480578f0 con 0x7fca500735c0 2024-04-23T10:28:53.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.549+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fca500ce950 con 0x7fca30068380 2024-04-23T10:28:53.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca47fff640 1 -- 172.21.15.29:0/2534250520 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fca500ce950 con 0x7fca30068380 2024-04-23T10:28:53.551 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2024-04-23T10:28:53.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca30068380 msgr2=0x7fca3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca30068380 0x7fca3006a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca380ad000 tx=0x7fca38008040 comp rx=0 tx=0).stop 2024-04-23T10:28:53.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca500735c0 msgr2=0x7fca5015e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca500735c0 0x7fca5015e2b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fca48007f20 tx=0x7fca4800e570 comp rx=0 tx=0).stop 2024-04-23T10:28:53.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 shutdown_connections 2024-04-23T10:28:53.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fca30068380 0x7fca3006a840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca5015bb40 0x7fca500b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca50155470 0x7fca50154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 --2- 172.21.15.29:0/2534250520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca500735c0 0x7fca5015e2b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 >> 172.21.15.29:0/2534250520 conn(0x7fca5006d5e0 msgr2=0x7fca501456b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:53.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 shutdown_connections 2024-04-23T10:28:53.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.553+0000 7fca55d8f640 1 -- 172.21.15.29:0/2534250520 wait complete. 2024-04-23T10:28:53.570 INFO:tasks.ceph:Scrubbing osd.4 2024-04-23T10:28:53.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:28:53.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bd0475640 1 Processor -- start 2024-04-23T10:28:53.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bd0475640 1 -- start start 2024-04-23T10:28:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bd0475640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8157cd0 0x7f1bc81592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bd0475640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bc8159800 0x7f1bc8162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bd0475640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc8159c70 con 0x7f1bc8151e20 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bd0475640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc806f970 con 0x7f1bc8159800 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bd0475640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc806eaa0 con 0x7f1bc8157cd0 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bcea12640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bc8159800 0x7f1bc8162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bcea12640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bc8159800 0x7f1bc8162650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39960/0 (socket says 172.21.15.29:39960) 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bcea12640 1 -- 172.21.15.29:0/2370595680 learned_addr learned my addr 172.21.15.29:0/2370595680 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bcda10640 1 --2- 172.21.15.29:0/2370595680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8157cd0 0x7f1bc81592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bcea12640 1 -- 172.21.15.29:0/2370595680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8157cd0 msgr2=0x7f1bc81592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bcea12640 1 --2- 172.21.15.29:0/2370595680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8157cd0 0x7f1bc81592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bcea12640 1 -- 172.21.15.29:0/2370595680 >> v1:172.21.15.72:6789/0 conn(0x7f1bc8151e20 legacy=0x7f1bc80c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.689+0000 7f1bcea12640 1 -- 172.21.15.29:0/2370595680 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc806ed60 con 0x7f1bc8159800 2024-04-23T10:28:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bcea12640 1 --2- 172.21.15.29:0/2370595680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8159800 0x7f1bc8162650 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009e50 tx=0x7f1bc001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796127594d39f11f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bcd20f640 1 -- 172.21.15.29:0/2370595680 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00b4070 con 0x7f1bc8159800 2024-04-23T10:28:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bcd20f640 1 -- 172.21.15.29:0/2370595680 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc00af400 con 0x7f1bc8159800 2024-04-23T10:28:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bcd20f640 1 -- 172.21.15.29:0/2370595680 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00af7d0 con 0x7f1bc8159800 2024-04-23T10:28:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 -- 172.21.15.29:0/2370595680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8159800 msgr2=0x7f1bc8162650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 --2- 172.21.15.29:0/2370595680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8159800 0x7f1bc8162650 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009e50 tx=0x7f1bc001f210 comp rx=0 tx=0).stop 2024-04-23T10:28:53.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 -- 172.21.15.29:0/2370595680 shutdown_connections 2024-04-23T10:28:53.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 --2- 172.21.15.29:0/2370595680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8159800 0x7f1bc8162650 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 --2- 172.21.15.29:0/2370595680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8157cd0 0x7f1bc81592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 -- 172.21.15.29:0/2370595680 >> 172.21.15.29:0/2370595680 conn(0x7f1bc80c8f90 msgr2=0x7f1bc80c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:53.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 -- 172.21.15.29:0/2370595680 shutdown_connections 2024-04-23T10:28:53.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 -- 172.21.15.29:0/2370595680 wait complete. 2024-04-23T10:28:53.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.693+0000 7f1bd0475640 1 Processor -- start 2024-04-23T10:28:53.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 -- start start 2024-04-23T10:28:53.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8151e20 0x7f1bc814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bc8157cd0 0x7f1bc8143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8159800 0x7f1bc8144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc806f600 con 0x7f1bc8151e20 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc806f320 con 0x7f1bc8157cd0 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc80c3d40 con 0x7f1bc8159800 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8151e20 0x7f1bc814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8151e20 0x7f1bc814c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39976/0 (socket says 172.21.15.29:39976) 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 -- 172.21.15.29:0/4286552193 learned_addr learned my addr 172.21.15.29:0/4286552193 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bcda10640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bc8157cd0 0x7f1bc8143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bcea12640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8159800 0x7f1bc8144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 -- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8159800 msgr2=0x7f1bc8144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bc8159800 0x7f1bc8144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 -- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bc8157cd0 msgr2=0x7f1bc8143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bc8157cd0 0x7f1bc8143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 -- 172.21.15.29:0/4286552193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc81f0b50 con 0x7f1bc8151e20 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bcda10640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bc8157cd0 0x7f1bc8143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bce211640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8151e20 0x7f1bc814c330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c370 tx=0x7f1bc400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40052d0 con 0x7f1bc8151e20 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc4005470 con 0x7f1bc8151e20 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc81f0e20 con 0x7f1bc8151e20 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4007260 con 0x7f1bc8151e20 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc81f13e0 con 0x7f1bc8151e20 2024-04-23T10:28:53.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1bc80c4fb0 con 0x7f1bc8151e20 2024-04-23T10:28:53.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bc4007400 con 0x7f1bc8151e20 2024-04-23T10:28:53.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1bac068380 0x7f1bac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1bc40869d0 con 0x7f1bc8151e20 2024-04-23T10:28:53.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7f1bac071e10 0x7f1bac0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 --> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bac074980 con 0x7f1bac071e10 2024-04-23T10:28:53.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1bc4086e60 con 0x7f1bc8151e20 2024-04-23T10:28:53.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bcda10640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1bac068380 0x7f1bac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.697+0000 7f1bcea12640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7f1bac071e10 0x7f1bac0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.701+0000 7f1bcda10640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1bac068380 0x7f1bac06a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1bc815c180 tx=0x7f1bb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.701+0000 7f1bcea12640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7f1bac071e10 0x7f1bac0742b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.701+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 <== osd.4 v2:172.21.15.72:6816/4213352672 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1bac074980 con 0x7f1bac071e10 2024-04-23T10:28:53.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 --> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1bc81f1aa0 con 0x7f1bac071e10 2024-04-23T10:28:53.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bbeffd640 1 -- 172.21.15.29:0/4286552193 <== osd.4 v2:172.21.15.72:6816/4213352672 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1bc81f1aa0 con 0x7f1bac071e10 2024-04-23T10:28:53.714 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:53.714 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:28:53.714 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:53.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7f1bac071e10 msgr2=0x7f1bac0742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6816/4213352672,v1:172.21.15.72:6817/4213352672] conn(0x7f1bac071e10 0x7f1bac0742b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1bac068380 msgr2=0x7f1bac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1bac068380 0x7f1bac06a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1bc815c180 tx=0x7f1bb8008040 comp rx=0 tx=0).stop 2024-04-23T10:28:53.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8151e20 msgr2=0x7f1bc814c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 --2- 172.21.15.29:0/4286552193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bc8151e20 0x7f1bc814c330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c370 tx=0x7f1bc400c830 comp rx=0 tx=0).stop 2024-04-23T10:28:53.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bcea12640 1 -- 172.21.15.29:0/4286552193 reap_dead start 2024-04-23T10:28:53.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 shutdown_connections 2024-04-23T10:28:53.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 >> 172.21.15.29:0/4286552193 conn(0x7f1bc80c8f90 msgr2=0x7f1bc8155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:53.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.713+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 shutdown_connections 2024-04-23T10:28:53.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.717+0000 7f1bd0475640 1 -- 172.21.15.29:0/4286552193 wait complete. 2024-04-23T10:28:53.729 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-23T10:28:53.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3289a6e640 1 Processor -- start 2024-04-23T10:28:53.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3289a6e640 1 -- start start 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3289a6e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 0x7f328415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3289a6e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f32840c5d20 0x7f32840c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3289a6e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32840c6170 con 0x7f32840c5900 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3289a6e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f328406c910 con 0x7f32840c5d20 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3289a6e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f328406cbf0 con 0x7f3284151bb0 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3283fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f32840c5d20 0x7f32840c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3282ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f32840c5900 0x7f32840cb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:34972/0 (socket says 172.21.15.29:34972) 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f3282ffd640 1 -- 172.21.15.29:0/1405741501 learned_addr learned my addr 172.21.15.29:0/1405741501 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.837+0000 7f32837fe640 1 --2- 172.21.15.29:0/1405741501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 0x7f328415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3283fff640 1 -- 172.21.15.29:0/1405741501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 msgr2=0x7f328415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3283fff640 1 --2- 172.21.15.29:0/1405741501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 0x7f328415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3283fff640 1 -- 172.21.15.29:0/1405741501 >> v1:172.21.15.29:6789/0 conn(0x7f32840c5900 legacy=0x7f32840cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3283fff640 1 -- 172.21.15.29:0/1405741501 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328406ced0 con 0x7f32840c5d20 2024-04-23T10:28:53.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f32827fc640 1 -- 172.21.15.29:0/1405741501 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230072433 0 0) 0x7f3278001120 con 0x7f32840c5900 2024-04-23T10:28:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3283fff640 1 --2- 172.21.15.29:0/1405741501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f32840c6840 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f327c009d90 tx=0x7f327c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a170b20559192d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f32827fc640 1 -- 172.21.15.29:0/1405741501 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c0b4070 con 0x7f32840c5d20 2024-04-23T10:28:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f32827fc640 1 -- 172.21.15.29:0/1405741501 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327c0af600 con 0x7f32840c5d20 2024-04-23T10:28:53.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f32827fc640 1 -- 172.21.15.29:0/1405741501 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c0af9d0 con 0x7f32840c5d20 2024-04-23T10:28:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3289a6e640 1 -- 172.21.15.29:0/1405741501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 msgr2=0x7f32840c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3289a6e640 1 --2- 172.21.15.29:0/1405741501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f32840c6840 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f327c009d90 tx=0x7f327c01f150 comp rx=0 tx=0).stop 2024-04-23T10:28:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3289a6e640 1 -- 172.21.15.29:0/1405741501 shutdown_connections 2024-04-23T10:28:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3289a6e640 1 --2- 172.21.15.29:0/1405741501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f32840c6840 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3289a6e640 1 --2- 172.21.15.29:0/1405741501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 0x7f328415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3289a6e640 1 -- 172.21.15.29:0/1405741501 >> 172.21.15.29:0/1405741501 conn(0x7f32840730f0 msgr2=0x7f3284073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3289a6e640 1 -- 172.21.15.29:0/1405741501 shutdown_connections 2024-04-23T10:28:53.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.841+0000 7f3289a6e640 1 -- 172.21.15.29:0/1405741501 wait complete. 2024-04-23T10:28:53.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 Processor -- start 2024-04-23T10:28:53.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 -- start start 2024-04-23T10:28:53.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32840c5900 0x7f32840c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f328414d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 0x7f328414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3284151f90 con 0x7f32840c5d20 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f328406d490 con 0x7f32840c5900 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f32840cbe80 con 0x7f3284151bb0 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f328414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f328414d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39996/0 (socket says 172.21.15.29:39996) 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 -- 172.21.15.29:0/2737663659 learned_addr learned my addr 172.21.15.29:0/2737663659 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f32837fe640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32840c5900 0x7f32840c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 -- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 msgr2=0x7f328414dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 0x7f328414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 -- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32840c5900 msgr2=0x7f32840c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32840c5900 0x7f32840c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 -- 172.21.15.29:0/2737663659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3284156070 con 0x7f32840c5d20 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f32837fe640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32840c5900 0x7f32840c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:53.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3282ffd640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f328414d710 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f327800c7b0 tx=0x7f327800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f326bfff640 1 -- 172.21.15.29:0/2737663659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278018070 con 0x7f32840c5d20 2024-04-23T10:28:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f326bfff640 1 -- 172.21.15.29:0/2737663659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32780072f0 con 0x7f32840c5d20 2024-04-23T10:28:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328415cfd0 con 0x7f32840c5d20 2024-04-23T10:28:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f326bfff640 1 -- 172.21.15.29:0/2737663659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32780047f0 con 0x7f32840c5d20 2024-04-23T10:28:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328415d590 con 0x7f32840c5d20 2024-04-23T10:28:53.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3284068d70 con 0x7f32840c5d20 2024-04-23T10:28:53.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.845+0000 7f326bfff640 1 -- 172.21.15.29:0/2737663659 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f327801b070 con 0x7f32840c5d20 2024-04-23T10:28:53.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.849+0000 7f326bfff640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3270068380 0x7f327006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:53.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.849+0000 7f326bfff640 1 -- 172.21.15.29:0/2737663659 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f32780862c0 con 0x7f32840c5d20 2024-04-23T10:28:53.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.849+0000 7f32837fe640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3270068380 0x7f327006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:53.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.849+0000 7f32837fe640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3270068380 0x7f327006a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3274009a40 tx=0x7f3274008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:53.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:53.853+0000 7f326bfff640 1 -- 172.21.15.29:0/2737663659 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f32840c6170 con 0x7f32840c5d20 2024-04-23T10:28:54.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.009+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f32840cf4d0 con 0x7f3270068380 2024-04-23T10:28:54.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.009+0000 7f326bfff640 1 -- 172.21.15.29:0/2737663659 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f32840cf4d0 con 0x7f3270068380 2024-04-23T10:28:54.010 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 4 to deep-scrub 2024-04-23T10:28:54.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3270068380 msgr2=0x7f327006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3270068380 0x7f327006a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3274009a40 tx=0x7f3274008040 comp rx=0 tx=0).stop 2024-04-23T10:28:54.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 msgr2=0x7f328414d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f328414d710 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f327800c7b0 tx=0x7f327800cc70 comp rx=0 tx=0).stop 2024-04-23T10:28:54.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 shutdown_connections 2024-04-23T10:28:54.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3270068380 0x7f327006a840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3284151bb0 0x7f328414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32840c5d20 0x7f328414d710 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 --2- 172.21.15.29:0/2737663659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32840c5900 0x7f32840c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 >> 172.21.15.29:0/2737663659 conn(0x7f32840730f0 msgr2=0x7f32840734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 shutdown_connections 2024-04-23T10:28:54.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.013+0000 7f3289a6e640 1 -- 172.21.15.29:0/2737663659 wait complete. 2024-04-23T10:28:54.029 INFO:tasks.ceph:Scrubbing osd.5 2024-04-23T10:28:54.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:28:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d3196b640 1 Processor -- start 2024-04-23T10:28:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d3196b640 1 -- start start 2024-04-23T10:28:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d3196b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d2c155270 0x7f8d2c0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d3196b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c072fd0 0x7f8d2c0733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d3196b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d2c155650 con 0x7f8d2c15af50 2024-04-23T10:28:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d3196b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8d2c15e540 con 0x7f8d2c155270 2024-04-23T10:28:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d3196b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2c073cf0 con 0x7f8d2c072fd0 2024-04-23T10:28:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2b7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c072fd0 0x7f8d2c0733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d2c155270 0x7f8d2c0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2b7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c072fd0 0x7f8d2c0733e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:41724/0 (socket says 172.21.15.29:41724) 2024-04-23T10:28:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2b7fe640 1 -- 172.21.15.29:0/728205980 learned_addr learned my addr 172.21.15.29:0/728205980 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2a7fc640 1 --1- 172.21.15.29:0/728205980 >> v1:172.21.15.72:6789/0 conn(0x7f8d2c15af50 0x7f8d2c15ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.29:36348/0 (socket says 172.21.15.29:36348) 2024-04-23T10:28:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2b7fe640 1 -- 172.21.15.29:0/728205980 >> v2:172.21.15.72:3300/0 conn(0x7f8d2c155270 msgr2=0x7f8d2c0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2b7fe640 1 --2- 172.21.15.29:0/728205980 >> v2:172.21.15.72:3300/0 conn(0x7f8d2c155270 0x7f8d2c0cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2b7fe640 1 -- 172.21.15.29:0/728205980 >> v1:172.21.15.72:6789/0 conn(0x7f8d2c15af50 legacy=0x7f8d2c15ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.165+0000 7f8d2b7fe640 1 -- 172.21.15.29:0/728205980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c0c5a40 con 0x7f8d2c072fd0 2024-04-23T10:28:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d2b7fe640 1 --2- 172.21.15.29:0/728205980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c072fd0 0x7f8d2c0733e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009e50 tx=0x7f8d2401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f138c093c73c07 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d29ffb640 1 -- 172.21.15.29:0/728205980 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d240a57f0 con 0x7f8d2c072fd0 2024-04-23T10:28:54.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d29ffb640 1 -- 172.21.15.29:0/728205980 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d240a5990 con 0x7f8d2c072fd0 2024-04-23T10:28:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d29ffb640 1 -- 172.21.15.29:0/728205980 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d240a5d60 con 0x7f8d2c072fd0 2024-04-23T10:28:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- 172.21.15.29:0/728205980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c072fd0 msgr2=0x7f8d2c0733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 --2- 172.21.15.29:0/728205980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c072fd0 0x7f8d2c0733e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009e50 tx=0x7f8d2401ca30 comp rx=0 tx=0).stop 2024-04-23T10:28:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- 172.21.15.29:0/728205980 shutdown_connections 2024-04-23T10:28:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 --2- 172.21.15.29:0/728205980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c072fd0 0x7f8d2c0733e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 --2- 172.21.15.29:0/728205980 >> v2:172.21.15.72:3300/0 conn(0x7f8d2c155270 0x7f8d2c0cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- 172.21.15.29:0/728205980 >> 172.21.15.29:0/728205980 conn(0x7f8d2c06c800 msgr2=0x7f8d2c074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- 172.21.15.29:0/728205980 shutdown_connections 2024-04-23T10:28:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- 172.21.15.29:0/728205980 wait complete. 2024-04-23T10:28:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 Processor -- start 2024-04-23T10:28:54.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- start start 2024-04-23T10:28:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d2c072fd0 0x7f8d2c14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c155270 0x7f8d2c150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d2c15af50 0x7f8d2c1481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c15e790 con 0x7f8d2c072fd0 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c15bd50 con 0x7f8d2c15af50 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d3196b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2c15f3c0 con 0x7f8d2c155270 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d2affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d2c072fd0 0x7f8d2c14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d2affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d2c072fd0 0x7f8d2c14a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40012/0 (socket says 172.21.15.29:40012) 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d2affd640 1 -- 172.21.15.29:0/685864917 learned_addr learned my addr 172.21.15.29:0/685864917 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d2a7fc640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c155270 0x7f8d2c150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.169+0000 7f8d2b7fe640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d2c15af50 0x7f8d2c1481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2affd640 1 -- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c155270 msgr2=0x7f8d2c150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2affd640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2c155270 0x7f8d2c150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2affd640 1 -- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d2c15af50 msgr2=0x7f8d2c1481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2affd640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d2c15af50 0x7f8d2c1481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2affd640 1 -- 172.21.15.29:0/685864917 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c14ad00 con 0x7f8d2c072fd0 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2affd640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d2c072fd0 0x7f8d2c14a7c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e9b0 tx=0x7f8d1c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c017070 con 0x7f8d2c072fd0 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c00c9a0 con 0x7f8d2c072fd0 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2c0d16d0 con 0x7f8d2c072fd0 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00cd70 con 0x7f8d2c072fd0 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2c0cebb0 con 0x7f8d2c072fd0 2024-04-23T10:28:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d2c068d70 con 0x7f8d2c072fd0 2024-04-23T10:28:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d1c01a070 con 0x7f8d2c072fd0 2024-04-23T10:28:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d180683b0 0x7f8d1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8d1c087250 con 0x7f8d2c072fd0 2024-04-23T10:28:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7f8d18071e40 0x7f8d180742e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 --> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d180749b0 con 0x7f8d18071e40 2024-04-23T10:28:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8d1c087600 con 0x7f8d2c072fd0 2024-04-23T10:28:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2a7fc640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d180683b0 0x7f8d1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2b7fe640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7f8d18071e40 0x7f8d180742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2b7fe640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7f8d18071e40 0x7f8d180742e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.173+0000 7f8d2a7fc640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d180683b0 0x7f8d1806a870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c1658a0 tx=0x7f8d20007cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.177+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 <== osd.5 v2:172.21.15.72:6800/4132179166 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d180749b0 con 0x7f8d18071e40 2024-04-23T10:28:54.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 --> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8d2c158ba0 con 0x7f8d18071e40 2024-04-23T10:28:54.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d13fff640 1 -- 172.21.15.29:0/685864917 <== osd.5 v2:172.21.15.72:6800/4132179166 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8d2c158ba0 con 0x7f8d18071e40 2024-04-23T10:28:54.190 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:54.190 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:28:54.190 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:54.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7f8d18071e40 msgr2=0x7f8d180742e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6800/4132179166,v1:172.21.15.72:6802/4132179166] conn(0x7f8d18071e40 0x7f8d180742e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d180683b0 msgr2=0x7f8d1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f8d180683b0 0x7f8d1806a870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c1658a0 tx=0x7f8d20007cb0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d2c072fd0 msgr2=0x7f8d2c14a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 --2- 172.21.15.29:0/685864917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d2c072fd0 0x7f8d2c14a7c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e9b0 tx=0x7f8d1c00ee70 comp rx=0 tx=0).stop 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d2b7fe640 1 -- 172.21.15.29:0/685864917 reap_dead start 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 shutdown_connections 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 >> 172.21.15.29:0/685864917 conn(0x7f8d2c06c800 msgr2=0x7f8d2c159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 shutdown_connections 2024-04-23T10:28:54.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.189+0000 7f8d3196b640 1 -- 172.21.15.29:0/685864917 wait complete. 2024-04-23T10:28:54.206 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-23T10:28:54.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d7df1640 1 Processor -- start 2024-04-23T10:28:54.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d7df1640 1 -- start start 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d7df1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7d0151850 0x7fc7d0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d7df1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00b2d10 0x7fc7d006d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d7df1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7d00c8d00 0x7fc7d006de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d7df1640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d006e460 con 0x7fc7d0151850 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d7df1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d0151c30 con 0x7fc7d00c8d00 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d7df1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d006ec70 con 0x7fc7d00b2d10 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d5b8d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7d0151850 0x7fc7d0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d5b8d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7d0151850 0x7fc7d0157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40014/0 (socket says 172.21.15.29:40014) 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.321+0000 7fc7d5b8d640 1 -- 172.21.15.29:0/3814993729 learned_addr learned my addr 172.21.15.29:0/3814993729 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:54.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d5b8d640 1 -- 172.21.15.29:0/3814993729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00b2d10 msgr2=0x7fc7d006d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:54.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d5b8d640 1 --2- 172.21.15.29:0/3814993729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00b2d10 0x7fc7d006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d5b8d640 1 -- 172.21.15.29:0/3814993729 >> v2:172.21.15.72:3300/0 conn(0x7fc7d00c8d00 msgr2=0x7fc7d006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:54.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d638e640 1 --2- 172.21.15.29:0/3814993729 >> v2:172.21.15.72:3300/0 conn(0x7fc7d00c8d00 0x7fc7d006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d5b8d640 1 --2- 172.21.15.29:0/3814993729 >> v2:172.21.15.72:3300/0 conn(0x7fc7d00c8d00 0x7fc7d006de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d5b8d640 1 -- 172.21.15.29:0/3814993729 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d00c7ac0 con 0x7fc7d0151850 2024-04-23T10:28:54.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d5b8d640 1 --2- 172.21.15.29:0/3814993729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0157f10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc7d006f430 tx=0x7fc7cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdf0f721d627e47 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d4b8b640 1 -- 172.21.15.29:0/3814993729 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0b0070 con 0x7fc7d0151850 2024-04-23T10:28:54.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d4b8b640 1 -- 172.21.15.29:0/3814993729 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc0ab600 con 0x7fc7d0151850 2024-04-23T10:28:54.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d4b8b640 1 -- 172.21.15.29:0/3814993729 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0ab9d0 con 0x7fc7d0151850 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 -- 172.21.15.29:0/3814993729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 msgr2=0x7fc7d0157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/3814993729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0157f10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc7d006f430 tx=0x7fc7cc01c490 comp rx=0 tx=0).stop 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 -- 172.21.15.29:0/3814993729 shutdown_connections 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/3814993729 >> v2:172.21.15.72:3300/0 conn(0x7fc7d00c8d00 0x7fc7d006de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/3814993729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00b2d10 0x7fc7d006d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/3814993729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0157f10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 -- 172.21.15.29:0/3814993729 >> 172.21.15.29:0/3814993729 conn(0x7fc7d00c9a90 msgr2=0x7fc7d00c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 -- 172.21.15.29:0/3814993729 shutdown_connections 2024-04-23T10:28:54.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.325+0000 7fc7d7df1640 1 -- 172.21.15.29:0/3814993729 wait complete. 2024-04-23T10:28:54.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 Processor -- start 2024-04-23T10:28:54.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 -- start start 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d00b2d10 0x7fc7d01f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00c8d00 0x7fc7d0153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d00c7fa0 con 0x7fc7d0151850 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d006e990 con 0x7fc7d00b2d10 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d00c8120 con 0x7fc7d00c8d00 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40030/0 (socket says 172.21.15.29:40030) 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 -- 172.21.15.29:0/1515720624 learned_addr learned my addr 172.21.15.29:0/1515720624 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d5b8d640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d00b2d10 0x7fc7d01f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 -- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00c8d00 msgr2=0x7fc7d0153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d538c640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00c8d00 0x7fc7d0153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00c8d00 0x7fc7d0153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 -- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d00b2d10 msgr2=0x7fc7d01f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d00b2d10 0x7fc7d01f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 -- 172.21.15.29:0/1515720624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d0155cf0 con 0x7fc7d0151850 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d5b8d640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d00b2d10 0x7fc7d01f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d638e640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0153e40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800cda0 tx=0x7fc7c800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7c67fc640 1 -- 172.21.15.29:0/1515720624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8003ba0 con 0x7fc7d0151850 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7c67fc640 1 -- 172.21.15.29:0/1515720624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c8003d40 con 0x7fc7d0151850 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d00cbdb0 con 0x7fc7d0151850 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7c67fc640 1 -- 172.21.15.29:0/1515720624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8004240 con 0x7fc7d0151850 2024-04-23T10:28:54.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d01f4040 con 0x7fc7d0151850 2024-04-23T10:28:54.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d00693c0 con 0x7fc7d0151850 2024-04-23T10:28:54.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7c67fc640 1 -- 172.21.15.29:0/1515720624 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc7c80043e0 con 0x7fc7d0151850 2024-04-23T10:28:54.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7c67fc640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc7b40683b0 0x7fc7b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7c67fc640 1 -- 172.21.15.29:0/1515720624 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc7c80878c0 con 0x7fc7d0151850 2024-04-23T10:28:54.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.329+0000 7fc7d5b8d640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc7b40683b0 0x7fc7b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.333+0000 7fc7d5b8d640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc7b40683b0 0x7fc7b406a870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0ad000 tx=0x7fc7cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.333+0000 7fc7c67fc640 1 -- 172.21.15.29:0/1515720624 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc7c801d340 con 0x7fc7d0151850 2024-04-23T10:28:54.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.501+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc7d00b2850 con 0x7fc7b40683b0 2024-04-23T10:28:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.501+0000 7fc7c67fc640 1 -- 172.21.15.29:0/1515720624 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc7d00b2850 con 0x7fc7b40683b0 2024-04-23T10:28:54.500 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 5 to deep-scrub 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.501+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc7b40683b0 msgr2=0x7fc7b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.501+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc7b40683b0 0x7fc7b406a870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0ad000 tx=0x7fc7cc008040 comp rx=0 tx=0).stop 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.501+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 msgr2=0x7fc7d0153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.501+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0153e40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800cda0 tx=0x7fc7c800a660 comp rx=0 tx=0).stop 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.505+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 shutdown_connections 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.505+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc7b40683b0 0x7fc7b406a870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.505+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7d0151850 0x7fc7d0153e40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.505+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7d00c8d00 0x7fc7d0153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.505+0000 7fc7d7df1640 1 --2- 172.21.15.29:0/1515720624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d00b2d10 0x7fc7d01f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.505+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 >> 172.21.15.29:0/1515720624 conn(0x7fc7d00c9a90 msgr2=0x7fc7d00c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.505+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 shutdown_connections 2024-04-23T10:28:54.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.505+0000 7fc7d7df1640 1 -- 172.21.15.29:0/1515720624 wait complete. 2024-04-23T10:28:54.521 INFO:tasks.ceph:Scrubbing osd.6 2024-04-23T10:28:54.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:28:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36aab8e640 1 Processor -- start 2024-04-23T10:28:54.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36aab8e640 1 -- start start 2024-04-23T10:28:54.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36aab8e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 0x7f36a4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36aab8e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36a41599d0 0x7f36a40c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36aab8e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a406eaa0 con 0x7f36a40c7fa0 2024-04-23T10:28:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36aab8e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f36a406f970 con 0x7f36a41599d0 2024-04-23T10:28:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36aab8e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f36a406ed60 con 0x7f36a4151e20 2024-04-23T10:28:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a3fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f36a40c7fa0 0x7f36a41592c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33176/0 (socket says 172.21.15.29:33176) 2024-04-23T10:28:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a3fff640 1 -- 172.21.15.29:0/1713944478 learned_addr learned my addr 172.21.15.29:0/1713944478 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a892a640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 0x7f36a4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a912b640 1 --2- 172.21.15.29:0/1713944478 >> v2:172.21.15.72:3300/0 conn(0x7f36a41599d0 0x7f36a40c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43347240 0 0) 0x7f36a406eaa0 con 0x7f36a40c7fa0 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f368c003530 con 0x7f36a40c7fa0 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1262279168 0 0) 0x7f368c003530 con 0x7f36a40c7fa0 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 msgr2=0x7f36a4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 0x7f36a4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 >> v2:172.21.15.72:3300/0 conn(0x7f36a41599d0 msgr2=0x7f36a40c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 --2- 172.21.15.29:0/1713944478 >> v2:172.21.15.72:3300/0 conn(0x7f36a41599d0 0x7f36a40c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a406f040 con 0x7f36a40c7fa0 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f3698001680 con 0x7f36a40c7fa0 2024-04-23T10:28:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 >> v1:172.21.15.29:6789/0 conn(0x7f36a40c7fa0 legacy=0x7f36a41592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0039c0 0x7f368c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 0x7f368c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f368c004d50 0x7f368c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f36a406f970 con 0x7f368c004d50 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.649+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f36a406ed60 con 0x7f368c0039c0 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f368c00ba00 con 0x7f36a4151e20 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a912b640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f368c004d50 0x7f368c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a3fff640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 0x7f368c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a892a640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0039c0 0x7f368c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a912b640 1 -- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 msgr2=0x7f368c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a912b640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 0x7f368c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a912b640 1 -- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0039c0 msgr2=0x7f368c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a912b640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0039c0 0x7f368c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a912b640 1 -- 172.21.15.29:0/1713944478 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c003530 con 0x7f368c004d50 2024-04-23T10:28:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a3fff640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a4151e20 0x7f368c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a912b640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f368c004d50 0x7f368c0051d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f369c009fc0 tx=0x7f369c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c4f3883b90aed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c0b2070 con 0x7f368c004d50 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c0a5cd0 con 0x7f368c004d50 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a37fe640 1 -- 172.21.15.29:0/1713944478 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c009c10 con 0x7f368c004d50 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36aab8e640 1 -- 172.21.15.29:0/1713944478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f368c004d50 msgr2=0x7f368c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36aab8e640 1 --2- 172.21.15.29:0/1713944478 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f368c004d50 0x7f368c0051d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f369c009fc0 tx=0x7f369c01ccc0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36a912b640 1 -- 172.21.15.29:0/1713944478 reap_dead start 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36aab8e640 1 -- 172.21.15.29:0/1713944478 shutdown_connections 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36aab8e640 1 -- 172.21.15.29:0/1713944478 >> 172.21.15.29:0/1713944478 conn(0x7f36a40c8f90 msgr2=0x7f36a40c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36aab8e640 1 -- 172.21.15.29:0/1713944478 shutdown_connections 2024-04-23T10:28:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.653+0000 7f36aab8e640 1 -- 172.21.15.29:0/1713944478 wait complete. 2024-04-23T10:28:54.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 Processor -- start 2024-04-23T10:28:54.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 -- start start 2024-04-23T10:28:54.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36a4073d40 0x7f36a41ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a41ef950 0x7f36a40c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a4074120 0x7f36a41458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f36a40c3d40 con 0x7f36a4073d40 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f36a406f600 con 0x7f36a4074120 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f36a40c3ec0 con 0x7f36a41ef950 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36a4073d40 0x7f36a41ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36a4073d40 0x7f36a41ee4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53818/0 (socket says 172.21.15.29:53818) 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 -- 172.21.15.29:0/4225248855 learned_addr learned my addr 172.21.15.29:0/4225248855 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a912b640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a4074120 0x7f36a41458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a3fff640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a41ef950 0x7f36a40c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 -- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a41ef950 msgr2=0x7f36a40c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a41ef950 0x7f36a40c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 -- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a4074120 msgr2=0x7f36a41458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a4074120 0x7f36a41458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 -- 172.21.15.29:0/4225248855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a41eea20 con 0x7f36a4073d40 2024-04-23T10:28:54.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a892a640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36a4073d40 0x7f36a41ee4e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3694011560 tx=0x7f3694011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694015930 con 0x7f36a4073d40 2024-04-23T10:28:54.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3694015ad0 con 0x7f36a4073d40 2024-04-23T10:28:54.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a40c64d0 con 0x7f36a4073d40 2024-04-23T10:28:54.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369400f460 con 0x7f36a4073d40 2024-04-23T10:28:54.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a41eef70 con 0x7f36a4073d40 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.657+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36a4158ef0 con 0x7f36a4073d40 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f369400f600 con 0x7f36a4073d40 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a17fa640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3690068380 0x7f369006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3694087c00 con 0x7f36a4073d40 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a17fa640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f3690071e10 0x7f36900742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 --> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3694007e90 con 0x7f3690071e10 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3694088090 con 0x7f36a4073d40 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a3fff640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3690068380 0x7f369006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a912b640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f3690071e10 0x7f36900742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a3fff640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3690068380 0x7f369006a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3698000fc0 tx=0x7f3698009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.661+0000 7f36a912b640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f3690071e10 0x7f36900742b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.665+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 <== osd.6 v2:172.21.15.72:6824/3506994715 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3694007e90 con 0x7f3690071e10 2024-04-23T10:28:54.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 --> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f36a4068d70 con 0x7f3690071e10 2024-04-23T10:28:54.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36a17fa640 1 -- 172.21.15.29:0/4225248855 <== osd.6 v2:172.21.15.72:6824/3506994715 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f36a4068d70 con 0x7f3690071e10 2024-04-23T10:28:54.677 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:54.677 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:28:54.677 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f3690071e10 msgr2=0x7f36900742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6824/3506994715,v1:172.21.15.72:6825/3506994715] conn(0x7f3690071e10 0x7f36900742b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3690068380 msgr2=0x7f369006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f3690068380 0x7f369006a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3698000fc0 tx=0x7f3698009040 comp rx=0 tx=0).stop 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36a4073d40 msgr2=0x7f36a41ee4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 --2- 172.21.15.29:0/4225248855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36a4073d40 0x7f36a41ee4e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3694011560 tx=0x7f3694011a20 comp rx=0 tx=0).stop 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36a912b640 1 -- 172.21.15.29:0/4225248855 reap_dead start 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 shutdown_connections 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 >> 172.21.15.29:0/4225248855 conn(0x7f36a40c8f90 msgr2=0x7f36a406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 shutdown_connections 2024-04-23T10:28:54.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.677+0000 7f36aab8e640 1 -- 172.21.15.29:0/4225248855 wait complete. 2024-04-23T10:28:54.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-23T10:28:54.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b38b16640 1 Processor -- start 2024-04-23T10:28:54.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b38b16640 1 -- start start 2024-04-23T10:28:54.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b38b16640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b341518f0 0x7f5b3415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b38b16640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b340c7730 0x7f5b340c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b38b16640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3415b350 con 0x7f5b340c6860 2024-04-23T10:28:54.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b38b16640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5b340c4280 con 0x7f5b340c7730 2024-04-23T10:28:54.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b38b16640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3415b630 con 0x7f5b341518f0 2024-04-23T10:28:54.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b31d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b340c7730 0x7f5b340c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b31d9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5b340c7730 0x7f5b340c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53822/0 (socket says 172.21.15.29:53822) 2024-04-23T10:28:54.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b32d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5b340c6860 0x7f5b340c4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33178/0 (socket says 172.21.15.29:33178) 2024-04-23T10:28:54.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b31d9b640 1 -- 172.21.15.29:0/142505459 learned_addr learned my addr 172.21.15.29:0/142505459 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:54.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b3259c640 1 --2- 172.21.15.29:0/142505459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b341518f0 0x7f5b3415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b31d9b640 1 -- 172.21.15.29:0/142505459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b341518f0 msgr2=0x7f5b3415ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:54.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b31d9b640 1 --2- 172.21.15.29:0/142505459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b341518f0 0x7f5b3415ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b31d9b640 1 -- 172.21.15.29:0/142505459 >> v1:172.21.15.29:6789/0 conn(0x7f5b340c6860 legacy=0x7f5b340c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.817+0000 7f5b31d9b640 1 -- 172.21.15.29:0/142505459 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3415b910 con 0x7f5b340c7730 2024-04-23T10:28:54.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b31d9b640 1 --2- 172.21.15.29:0/142505459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b340c7730 0x7f5b340c6320 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5b28006fd0 tx=0x7f5b2801e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defaae41bba59a4a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b3159a640 1 -- 172.21.15.29:0/142505459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b280ad070 con 0x7f5b340c7730 2024-04-23T10:28:54.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b3159a640 1 -- 172.21.15.29:0/142505459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b28004230 con 0x7f5b340c7730 2024-04-23T10:28:54.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b3159a640 1 -- 172.21.15.29:0/142505459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b280a7750 con 0x7f5b340c7730 2024-04-23T10:28:54.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- 172.21.15.29:0/142505459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b340c7730 msgr2=0x7f5b340c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 --2- 172.21.15.29:0/142505459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b340c7730 0x7f5b340c6320 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5b28006fd0 tx=0x7f5b2801e9f0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- 172.21.15.29:0/142505459 shutdown_connections 2024-04-23T10:28:54.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 --2- 172.21.15.29:0/142505459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b340c7730 0x7f5b340c6320 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 --2- 172.21.15.29:0/142505459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b341518f0 0x7f5b3415ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- 172.21.15.29:0/142505459 >> 172.21.15.29:0/142505459 conn(0x7f5b3406cfb0 msgr2=0x7f5b3406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- 172.21.15.29:0/142505459 shutdown_connections 2024-04-23T10:28:54.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- 172.21.15.29:0/142505459 wait complete. 2024-04-23T10:28:54.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 Processor -- start 2024-04-23T10:28:54.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- start start 2024-04-23T10:28:54.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b340c6860 0x7f5b3414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b340c7730 0x7f5b34071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b341518f0 0x7f5b341f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5b340c80e0 con 0x7f5b341518f0 2024-04-23T10:28:54.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b340c7f60 con 0x7f5b340c7730 2024-04-23T10:28:54.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b38b16640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5b34163fb0 con 0x7f5b340c6860 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b32d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b341518f0 0x7f5b341f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b32d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b341518f0 0x7f5b341f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53834/0 (socket says 172.21.15.29:53834) 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b32d9d640 1 -- 172.21.15.29:0/991704091 learned_addr learned my addr 172.21.15.29:0/991704091 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b31d9b640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b340c7730 0x7f5b34071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.821+0000 7f5b3259c640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b340c6860 0x7f5b3414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b32d9d640 1 -- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b340c6860 msgr2=0x7f5b3414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b32d9d640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b340c6860 0x7f5b3414cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b32d9d640 1 -- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b340c7730 msgr2=0x7f5b34071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b32d9d640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b340c7730 0x7f5b34071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b32d9d640 1 -- 172.21.15.29:0/991704091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3414d960 con 0x7f5b341518f0 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b31d9b640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b340c7730 0x7f5b34071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b32d9d640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b341518f0 0x7f5b341f1e50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c730 tx=0x7f5b2c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b22ffd640 1 -- 172.21.15.29:0/991704091 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c018070 con 0x7f5b341518f0 2024-04-23T10:28:54.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b22ffd640 1 -- 172.21.15.29:0/991704091 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c004d70 con 0x7f5b341518f0 2024-04-23T10:28:54.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3414dc40 con 0x7f5b341518f0 2024-04-23T10:28:54.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b22ffd640 1 -- 172.21.15.29:0/991704091 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00a880 con 0x7f5b341518f0 2024-04-23T10:28:54.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b341f1650 con 0x7f5b341518f0 2024-04-23T10:28:54.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b34068d70 con 0x7f5b341518f0 2024-04-23T10:28:54.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b22ffd640 1 -- 172.21.15.29:0/991704091 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b2c00aa20 con 0x7f5b341518f0 2024-04-23T10:28:54.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b22ffd640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b14068380 0x7f5b1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:54.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b22ffd640 1 -- 172.21.15.29:0/991704091 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5b2c0865e0 con 0x7f5b341518f0 2024-04-23T10:28:54.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b3259c640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b14068380 0x7f5b1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:54.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.825+0000 7f5b3259c640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b14068380 0x7f5b1406a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009790 tx=0x7f5b24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:54.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.829+0000 7f5b22ffd640 1 -- 172.21.15.29:0/991704091 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5b2c0566e0 con 0x7f5b341518f0 2024-04-23T10:28:54.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.993+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f5b340c8dc0 con 0x7f5b14068380 2024-04-23T10:28:54.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.993+0000 7f5b22ffd640 1 -- 172.21.15.29:0/991704091 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5b340c8dc0 con 0x7f5b14068380 2024-04-23T10:28:54.993 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 6 to deep-scrub 2024-04-23T10:28:54.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b14068380 msgr2=0x7f5b1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b14068380 0x7f5b1406a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009790 tx=0x7f5b24008040 comp rx=0 tx=0).stop 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b341518f0 msgr2=0x7f5b341f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b341518f0 0x7f5b341f1e50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c730 tx=0x7f5b2c00cb30 comp rx=0 tx=0).stop 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 shutdown_connections 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f5b14068380 0x7f5b1406a840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b341518f0 0x7f5b341f1e50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b340c7730 0x7f5b34071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 --2- 172.21.15.29:0/991704091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b340c6860 0x7f5b3414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 >> 172.21.15.29:0/991704091 conn(0x7f5b3406cfb0 msgr2=0x7f5b3415aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 shutdown_connections 2024-04-23T10:28:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:54.997+0000 7f5b38b16640 1 -- 172.21.15.29:0/991704091 wait complete. 2024-04-23T10:28:55.013 INFO:tasks.ceph:Scrubbing osd.7 2024-04-23T10:28:55.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:28:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67be7d4640 1 Processor -- start 2024-04-23T10:28:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67be7d4640 1 -- start start 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67be7d4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f67b8152fe0 0x7f67b80c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67be7d4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f67b80c6fb0 0x7f67b80c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67be7d4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b8159120 con 0x7f67b80c60e0 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67be7d4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f67b80c8de0 con 0x7f67b80c6fb0 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67be7d4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f67b8159400 con 0x7f67b8152fe0 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67b77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f67b80c6fb0 0x7f67b80c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67b77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f67b80c6fb0 0x7f67b80c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53842/0 (socket says 172.21.15.29:53842) 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67b77fe640 1 -- 172.21.15.29:0/3072413198 learned_addr learned my addr 172.21.15.29:0/3072413198 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67b7fff640 1 --2- 172.21.15.29:0/3072413198 >> v2:172.21.15.72:3300/0 conn(0x7f67b8152fe0 0x7f67b80c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67b77fe640 1 -- 172.21.15.29:0/3072413198 >> v2:172.21.15.72:3300/0 conn(0x7f67b8152fe0 msgr2=0x7f67b80c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67b77fe640 1 --2- 172.21.15.29:0/3072413198 >> v2:172.21.15.72:3300/0 conn(0x7f67b8152fe0 0x7f67b80c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67b77fe640 1 -- 172.21.15.29:0/3072413198 >> v1:172.21.15.72:6789/0 conn(0x7f67b80c60e0 legacy=0x7f67b815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:55.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.141+0000 7f67b77fe640 1 -- 172.21.15.29:0/3072413198 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b81596e0 con 0x7f67b80c6fb0 2024-04-23T10:28:55.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 --2- 172.21.15.29:0/3072413198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 0x7f67b80c5ba0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f67b806de60 tx=0x7f67ac01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d07a2ec2c96386c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b6ffd640 1 -- 172.21.15.29:0/3072413198 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0b5070 con 0x7f67b80c6fb0 2024-04-23T10:28:55.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b6ffd640 1 -- 172.21.15.29:0/3072413198 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac0a89d0 con 0x7f67b80c6fb0 2024-04-23T10:28:55.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b6ffd640 1 -- 172.21.15.29:0/3072413198 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0a8da0 con 0x7f67b80c6fb0 2024-04-23T10:28:55.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- 172.21.15.29:0/3072413198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 msgr2=0x7f67b80c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 --2- 172.21.15.29:0/3072413198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 0x7f67b80c5ba0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f67b806de60 tx=0x7f67ac01ecd0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- 172.21.15.29:0/3072413198 shutdown_connections 2024-04-23T10:28:55.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 --2- 172.21.15.29:0/3072413198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 0x7f67b80c5ba0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 --2- 172.21.15.29:0/3072413198 >> v2:172.21.15.72:3300/0 conn(0x7f67b8152fe0 0x7f67b80c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- 172.21.15.29:0/3072413198 >> 172.21.15.29:0/3072413198 conn(0x7f67b80c8f90 msgr2=0x7f67b80c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:55.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- 172.21.15.29:0/3072413198 shutdown_connections 2024-04-23T10:28:55.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- 172.21.15.29:0/3072413198 wait complete. 2024-04-23T10:28:55.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 Processor -- start 2024-04-23T10:28:55.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- start start 2024-04-23T10:28:55.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67b80c60e0 0x7f67b81f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 0x7f67b806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67b8152fe0 0x7f67b8145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f67b815c400 con 0x7f67b80c6fb0 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f67b8159ca0 con 0x7f67b80c60e0 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67be7d4640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f67b81533c0 con 0x7f67b8152fe0 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 0x7f67b806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 0x7f67b806c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53846/0 (socket says 172.21.15.29:53846) 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 -- 172.21.15.29:0/1841317953 learned_addr learned my addr 172.21.15.29:0/1841317953 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b7fff640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67b80c60e0 0x7f67b81f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67bcd71640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67b8152fe0 0x7f67b8145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 -- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67b8152fe0 msgr2=0x7f67b8145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67b8152fe0 0x7f67b8145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 -- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67b80c60e0 msgr2=0x7f67b81f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67b80c60e0 0x7f67b81f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 -- 172.21.15.29:0/1841317953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b815b960 con 0x7f67b80c6fb0 2024-04-23T10:28:55.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.145+0000 7f67b77fe640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 0x7f67b806c9b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f67ac01c900 tx=0x7f67ac01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0b5070 con 0x7f67b80c6fb0 2024-04-23T10:28:55.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac0b0a70 con 0x7f67b80c6fb0 2024-04-23T10:28:55.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b815bc40 con 0x7f67b80c6fb0 2024-04-23T10:28:55.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0b0e60 con 0x7f67b80c6fb0 2024-04-23T10:28:55.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b814d290 con 0x7f67b80c6fb0 2024-04-23T10:28:55.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67b8068d70 con 0x7f67b80c6fb0 2024-04-23T10:28:55.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67ac0c2060 con 0x7f67b80c6fb0 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f67a40683b0 0x7f67a406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f67ac124530 con 0x7f67b80c6fb0 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 0x7f67a40742e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 --> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67ac0c5e50 con 0x7f67a4071e40 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f67ac1249c0 con 0x7f67b80c6fb0 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b7fff640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f67a40683b0 0x7f67a406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67bcd71640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 0x7f67a40742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67bcd71640 1 -- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 msgr2=0x7f67a40742e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67bcd71640 1 -- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 msgr2=0x7f67a40742e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67bcd71640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 0x7f67a40742e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67bcd71640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 0x7f67a40742e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:28:55.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.149+0000 7f67b7fff640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f67a40683b0 0x7f67a406a870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f67a800b9d0 tx=0x7f67a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.353+0000 7f67bcd71640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 0x7f67a40742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.353+0000 7f67bcd71640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 0x7f67a40742e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.353+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 <== osd.7 v2:172.21.15.72:6801/1745734040 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67ac0c5e50 con 0x7f67a4071e40 2024-04-23T10:28:55.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.369+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 --> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f67b806fac0 con 0x7f67a4071e40 2024-04-23T10:28:55.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.369+0000 7f67b4ff9640 1 -- 172.21.15.29:0/1841317953 <== osd.7 v2:172.21.15.72:6801/1745734040 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f67b806fac0 con 0x7f67a4071e40 2024-04-23T10:28:55.370 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-23T10:28:55.370 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:28:55.371 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-23T10:28:55.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 msgr2=0x7f67a40742e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6801/1745734040,v1:172.21.15.72:6803/1745734040] conn(0x7f67a4071e40 0x7f67a40742e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f67a40683b0 msgr2=0x7f67a406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f67a40683b0 0x7f67a406a870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f67a800b9d0 tx=0x7f67a8008040 comp rx=0 tx=0).stop 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 msgr2=0x7f67b806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 --2- 172.21.15.29:0/1841317953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67b80c6fb0 0x7f67b806c9b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f67ac01c900 tx=0x7f67ac01ba70 comp rx=0 tx=0).stop 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67bcd71640 1 -- 172.21.15.29:0/1841317953 reap_dead start 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 shutdown_connections 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 >> 172.21.15.29:0/1841317953 conn(0x7f67b80c8f90 msgr2=0x7f67b80711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 shutdown_connections 2024-04-23T10:28:55.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.373+0000 7f67be7d4640 1 -- 172.21.15.29:0/1841317953 wait complete. 2024-04-23T10:28:55.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-23T10:28:55.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82dde73640 1 Processor -- start 2024-04-23T10:28:55.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82dde73640 1 -- start start 2024-04-23T10:28:55.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82dde73640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 0x7f82d815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82dde73640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82d80c5d20 0x7f82d80c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82dde73640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d80c6170 con 0x7f82d80c5900 2024-04-23T10:28:55.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82dde73640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f82d806c910 con 0x7f82d80c5d20 2024-04-23T10:28:55.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82dde73640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f82d806cbf0 con 0x7f82d8151bb0 2024-04-23T10:28:55.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d6ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f82d80c5900 0x7f82d80cb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33190/0 (socket says 172.21.15.29:33190) 2024-04-23T10:28:55.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d6ffd640 1 -- 172.21.15.29:0/58882285 learned_addr learned my addr 172.21.15.29:0/58882285 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:55.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d77fe640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 0x7f82d815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d7fff640 1 --2- 172.21.15.29:0/58882285 >> v2:172.21.15.72:3300/0 conn(0x7f82d80c5d20 0x7f82d80c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538286702 0 0) 0x7f82cc001120 con 0x7f82d80c5900 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c0003530 con 0x7f82d80c5900 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3803345689 0 0) 0x7f82c0003530 con 0x7f82d80c5900 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 msgr2=0x7f82d815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 0x7f82d815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 >> v2:172.21.15.72:3300/0 conn(0x7f82d80c5d20 msgr2=0x7f82d80c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 --2- 172.21.15.29:0/58882285 >> v2:172.21.15.72:3300/0 conn(0x7f82d80c5d20 0x7f82d80c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d806ced0 con 0x7f82d80c5900 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7f82cc001850 con 0x7f82d80c5900 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 >> v1:172.21.15.29:6789/0 conn(0x7f82d80c5900 legacy=0x7f82d80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 0x7f82c00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0003f40 0x7f82c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82c0004d50 0x7f82c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f82d806c910 con 0x7f82c0004d50 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f82d806cbf0 con 0x7f82c0003f40 2024-04-23T10:28:55.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f82c000ba00 con 0x7f82d8151bb0 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d7fff640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82c0004d50 0x7f82c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d6ffd640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0003f40 0x7f82c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d77fe640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 0x7f82c00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.533+0000 7f82d7fff640 1 -- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 msgr2=0x7f82c00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d7fff640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 0x7f82c00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d7fff640 1 -- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0003f40 msgr2=0x7f82c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d7fff640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0003f40 0x7f82c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d7fff640 1 -- 172.21.15.29:0/58882285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c0003530 con 0x7f82c0004d50 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d77fe640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8151bb0 0x7f82c00039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:55.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d6ffd640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0003f40 0x7f82c0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:55.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d7fff640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82c0004d50 0x7f82c00051d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009fc0 tx=0x7f82d001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a308b3ce960ee2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d00b2070 con 0x7f82c0004d50 2024-04-23T10:28:55.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d00a5cd0 con 0x7f82c0004d50 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d67fc640 1 -- 172.21.15.29:0/58882285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0009c10 con 0x7f82c0004d50 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82dde73640 1 -- 172.21.15.29:0/58882285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82c0004d50 msgr2=0x7f82c00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82dde73640 1 --2- 172.21.15.29:0/58882285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82c0004d50 0x7f82c00051d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009fc0 tx=0x7f82d001ccc0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82d7fff640 1 -- 172.21.15.29:0/58882285 reap_dead start 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82dde73640 1 -- 172.21.15.29:0/58882285 shutdown_connections 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82dde73640 1 -- 172.21.15.29:0/58882285 >> 172.21.15.29:0/58882285 conn(0x7f82d80730f0 msgr2=0x7f82d8073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82dde73640 1 -- 172.21.15.29:0/58882285 shutdown_connections 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.537+0000 7f82dde73640 1 -- 172.21.15.29:0/58882285 wait complete. 2024-04-23T10:28:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 Processor -- start 2024-04-23T10:28:55.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 -- start start 2024-04-23T10:28:55.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d8147e20 0x7f82d80ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8156af0 0x7f82d81f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82d814e340 0x7f82d80c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8151f90 con 0x7f82d814e340 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f82d806d490 con 0x7f82d8147e20 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f82d80cbe80 con 0x7f82d8156af0 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82d814e340 0x7f82d80c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82d814e340 0x7f82d80c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53856/0 (socket says 172.21.15.29:53856) 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 -- 172.21.15.29:0/1391848207 learned_addr learned my addr 172.21.15.29:0/1391848207 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d77fe640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d8147e20 0x7f82d80ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d6ffd640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8156af0 0x7f82d81f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 -- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8156af0 msgr2=0x7f82d81f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8156af0 0x7f82d81f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 -- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d8147e20 msgr2=0x7f82d80ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d8147e20 0x7f82d80ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 -- 172.21.15.29:0/1391848207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d81f1d90 con 0x7f82d814e340 2024-04-23T10:28:55.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82d7fff640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82d814e340 0x7f82d80c7d60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f82d0002240 tx=0x7f82d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82bffff640 1 -- 172.21.15.29:0/1391848207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d00bd070 con 0x7f82d814e340 2024-04-23T10:28:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82bffff640 1 -- 172.21.15.29:0/1391848207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d00a5ad0 con 0x7f82d814e340 2024-04-23T10:28:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d80cf2a0 con 0x7f82d814e340 2024-04-23T10:28:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82bffff640 1 -- 172.21.15.29:0/1391848207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d00b2040 con 0x7f82d814e340 2024-04-23T10:28:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d80cf860 con 0x7f82d814e340 2024-04-23T10:28:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.541+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d80cfaa0 con 0x7f82d814e340 2024-04-23T10:28:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.545+0000 7f82bffff640 1 -- 172.21.15.29:0/1391848207 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82d00c0070 con 0x7f82d814e340 2024-04-23T10:28:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.545+0000 7f82bffff640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f82c40683b0 0x7f82c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.545+0000 7f82bffff640 1 -- 172.21.15.29:0/1391848207 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f82d0120c80 con 0x7f82d814e340 2024-04-23T10:28:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.545+0000 7f82d77fe640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f82c40683b0 0x7f82c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.545+0000 7f82d77fe640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f82c40683b0 0x7f82c406a870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009ab0 tx=0x7f82c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.549+0000 7f82bffff640 1 -- 172.21.15.29:0/1391848207 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82d00169d0 con 0x7f82d814e340 2024-04-23T10:28:55.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.713+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f82d8068d70 con 0x7f82c40683b0 2024-04-23T10:28:55.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.713+0000 7f82bffff640 1 -- 172.21.15.29:0/1391848207 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f82d8068d70 con 0x7f82c40683b0 2024-04-23T10:28:55.713 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 7 to deep-scrub 2024-04-23T10:28:55.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f82c40683b0 msgr2=0x7f82c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f82c40683b0 0x7f82c406a870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009ab0 tx=0x7f82c8008040 comp rx=0 tx=0).stop 2024-04-23T10:28:55.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82d814e340 msgr2=0x7f82d80c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82d814e340 0x7f82d80c7d60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f82d0002240 tx=0x7f82d0009750 comp rx=0 tx=0).stop 2024-04-23T10:28:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 shutdown_connections 2024-04-23T10:28:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f82c40683b0 0x7f82c406a870 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82d814e340 0x7f82d80c7d60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82d8156af0 0x7f82d81f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 --2- 172.21.15.29:0/1391848207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d8147e20 0x7f82d80ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 >> 172.21.15.29:0/1391848207 conn(0x7f82d80730f0 msgr2=0x7f82d814cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 shutdown_connections 2024-04-23T10:28:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.717+0000 7f82dde73640 1 -- 172.21.15.29:0/1391848207 wait complete. 2024-04-23T10:28:55.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:28:55.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c8542640 1 Processor -- start 2024-04-23T10:28:55.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c8542640 1 -- start start 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c8542640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f10c0070930 0x7f10c0073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c8542640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c00c8380 con 0x7f10c0152ff0 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c8542640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c01533d0 con 0x7f10c0070410 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c8542640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f10c00733c0 con 0x7f10c0070930 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c62de640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f10c0152ff0 0x7f10c00c6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33206/0 (socket says 172.21.15.29:33206) 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c5add640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f10c0070930 0x7f10c0073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c62de640 1 -- 172.21.15.29:0/4041645169 learned_addr learned my addr 172.21.15.29:0/4041645169 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c5add640 1 -- 172.21.15.29:0/4041645169 >> v1:172.21.15.72:6789/0 conn(0x7f10c0070410 legacy=0x7f10c01638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c5add640 1 -- 172.21.15.29:0/4041645169 >> v1:172.21.15.29:6789/0 conn(0x7f10c0152ff0 legacy=0x7f10c00c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.853+0000 7f10c5add640 1 -- 172.21.15.29:0/4041645169 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c006c210 con 0x7f10c0070930 2024-04-23T10:28:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c5add640 1 --2- 172.21.15.29:0/4041645169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070930 0x7f10c0073e10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009d90 tx=0x7f10b401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3edf37746625364 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c52dc640 1 -- 172.21.15.29:0/4041645169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b40b2070 con 0x7f10c0070930 2024-04-23T10:28:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c52dc640 1 -- 172.21.15.29:0/4041645169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b40a5920 con 0x7f10c0070930 2024-04-23T10:28:55.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c52dc640 1 -- 172.21.15.29:0/4041645169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b40a5cf0 con 0x7f10c0070930 2024-04-23T10:28:55.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- 172.21.15.29:0/4041645169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070930 msgr2=0x7f10c0073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 --2- 172.21.15.29:0/4041645169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070930 0x7f10c0073e10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009d90 tx=0x7f10b401c970 comp rx=0 tx=0).stop 2024-04-23T10:28:55.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- 172.21.15.29:0/4041645169 shutdown_connections 2024-04-23T10:28:55.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 --2- 172.21.15.29:0/4041645169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070930 0x7f10c0073e10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- 172.21.15.29:0/4041645169 >> 172.21.15.29:0/4041645169 conn(0x7f10c00cd750 msgr2=0x7f10c00cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:55.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- 172.21.15.29:0/4041645169 shutdown_connections 2024-04-23T10:28:55.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- 172.21.15.29:0/4041645169 wait complete. 2024-04-23T10:28:55.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 Processor -- start 2024-04-23T10:28:55.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- start start 2024-04-23T10:28:55.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070410 0x7f10c015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0070930 0x7f10c014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c0152ff0 0x7f10c014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f10c0159360 con 0x7f10c0070410 2024-04-23T10:28:55.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f10c00738f0 con 0x7f10c0070930 2024-04-23T10:28:55.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c8542640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f10c00c74f0 con 0x7f10c0152ff0 2024-04-23T10:28:55.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c62de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070410 0x7f10c015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c62de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070410 0x7f10c015be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53882/0 (socket says 172.21.15.29:53882) 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c62de640 1 -- 172.21.15.29:0/2213109387 learned_addr learned my addr 172.21.15.29:0/2213109387 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c5add640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0070930 0x7f10c014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c6adf640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c0152ff0 0x7f10c014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c62de640 1 -- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c0152ff0 msgr2=0x7f10c014f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.857+0000 7f10c62de640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c0152ff0 0x7f10c014f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c62de640 1 -- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0070930 msgr2=0x7f10c014ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c62de640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0070930 0x7f10c014ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c62de640 1 -- 172.21.15.29:0/2213109387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c015a220 con 0x7f10c0070410 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c5add640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0070930 0x7f10c014ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c62de640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070410 0x7f10c015be80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f10b800c430 tx=0x7f10b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10beffd640 1 -- 172.21.15.29:0/2213109387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8017070 con 0x7f10c0070410 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10beffd640 1 -- 172.21.15.29:0/2213109387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b8005cf0 con 0x7f10c0070410 2024-04-23T10:28:55.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10beffd640 1 -- 172.21.15.29:0/2213109387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b80072d0 con 0x7f10c0070410 2024-04-23T10:28:55.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c015a4c0 con 0x7f10c0070410 2024-04-23T10:28:55.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c015a780 con 0x7f10c0070410 2024-04-23T10:28:55.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c00693c0 con 0x7f10c0070410 2024-04-23T10:28:55.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10beffd640 1 -- 172.21.15.29:0/2213109387 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10b801a070 con 0x7f10c0070410 2024-04-23T10:28:55.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10beffd640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10ac068380 0x7f10ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:55.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10beffd640 1 -- 172.21.15.29:0/2213109387 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f10b80861a0 con 0x7f10c0070410 2024-04-23T10:28:55.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.861+0000 7f10c5add640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10ac068380 0x7f10ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:55.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.865+0000 7f10c5add640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10ac068380 0x7f10ac06a840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f10b40af000 tx=0x7f10b40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:55.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:55.865+0000 7f10beffd640 1 -- 172.21.15.29:0/2213109387 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10c00c8380 con 0x7f10c0070410 2024-04-23T10:28:56.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.029+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10c00cdeb0 con 0x7f10ac068380 2024-04-23T10:28:56.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.053+0000 7f10beffd640 1 -- 172.21.15.29:0/2213109387 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334424 (secure 0 0 0) 0x7f10c00cdeb0 con 0x7f10ac068380 2024-04-23T10:28:56.055 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:28:56.056 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:28:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10ac068380 msgr2=0x7f10ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10ac068380 0x7f10ac06a840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f10b40af000 tx=0x7f10b40a7070 comp rx=0 tx=0).stop 2024-04-23T10:28:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070410 msgr2=0x7f10c015be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070410 0x7f10c015be80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f10b800c430 tx=0x7f10b800c8f0 comp rx=0 tx=0).stop 2024-04-23T10:28:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 shutdown_connections 2024-04-23T10:28:56.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f10ac068380 0x7f10ac06a840 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10c0152ff0 0x7f10c014f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0070930 0x7f10c014ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 --2- 172.21.15.29:0/2213109387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10c0070410 0x7f10c015be80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 >> 172.21.15.29:0/2213109387 conn(0x7f10c00cd750 msgr2=0x7f10c00c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 shutdown_connections 2024-04-23T10:28:56.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:28:56.057+0000 7f10c8542640 1 -- 172.21.15.29:0/2213109387 wait complete. 2024-04-23T10:28:56.074 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":421,"stamp":"2024-04-23T10:28:55.507266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137757708,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":3613,"num_read_kb":1517165,"num_write":34599,"num_write_kb":4410472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49038,"ondisk_log_size":49038,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":939960,"kb_used_data":271480,"kb_used_omap":12,"kb_used_meta":668403,"kb_avail":754034760,"statfs":{"total":773094113280,"available":772131594240,"internally_reserved":0,"allocated":277995520,"data_stored":276431000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":684445232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4146,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004616"},"pg_stats":[{"pgid":"2.1f","version":"26'99","reported_seq":131,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:33.266625+0000","last_change":"2024-04-23T10:15:37.032150+0000","last_active":"2024-04-23T10:28:33.266625+0000","last_peered":"2024-04-23T10:28:33.266625+0000","last_clean":"2024-04-23T10:28:33.266625+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:28:33.266625+0000","last_undegraded":"2024-04-23T10:28:33.266625+0000","last_fullsized":"2024-04-23T10:28:33.266625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:15.567294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.761244+0000","last_change":"2024-04-23T10:15:38.037997+0000","last_active":"2024-04-23T10:28:42.761244+0000","last_peered":"2024-04-23T10:28:42.761244+0000","last_clean":"2024-04-23T10:28:42.761244+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:28:42.761244+0000","last_undegraded":"2024-04-23T10:28:42.761244+0000","last_fullsized":"2024-04-23T10:28:42.761244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:07.886261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'789","reported_seq":878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.235748+0000","last_change":"2024-04-23T10:15:42.177527+0000","last_active":"2024-04-23T10:28:39.235748+0000","last_peered":"2024-04-23T10:28:39.235748+0000","last_clean":"2024-04-23T10:28:39.235748+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:28:39.235748+0000","last_undegraded":"2024-04-23T10:28:39.235748+0000","last_fullsized":"2024-04-23T10:28:39.235748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:13:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31845,"num_write":775,"num_write_kb":142945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'95","reported_seq":127,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.125361+0000","last_change":"2024-04-23T10:15:37.007842+0000","last_active":"2024-04-23T10:28:30.125361+0000","last_peered":"2024-04-23T10:28:30.125361+0000","last_clean":"2024-04-23T10:28:30.125361+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:28:30.125361+0000","last_undegraded":"2024-04-23T10:28:30.125361+0000","last_fullsized":"2024-04-23T10:28:30.125361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:33.769262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.786472+0000","last_change":"2024-04-23T10:15:38.014261+0000","last_active":"2024-04-23T10:28:42.786472+0000","last_peered":"2024-04-23T10:28:42.786472+0000","last_clean":"2024-04-23T10:28:42.786472+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:28:42.786472+0000","last_undegraded":"2024-04-23T10:28:42.786472+0000","last_fullsized":"2024-04-23T10:28:42.786472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:38:55.091757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'755","reported_seq":872,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.217040+0000","last_change":"2024-04-23T10:15:42.097103+0000","last_active":"2024-04-23T10:28:39.217040+0000","last_peered":"2024-04-23T10:28:39.217040+0000","last_clean":"2024-04-23T10:28:39.217040+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:28:39.217040+0000","last_undegraded":"2024-04-23T10:28:39.217040+0000","last_fullsized":"2024-04-23T10:28:39.217040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:38:13.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":56312,"num_write":739,"num_write_kb":106537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'962","reported_seq":993,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.157999+0000","last_change":"2024-04-23T10:15:37.034854+0000","last_active":"2024-04-23T10:28:38.157999+0000","last_peered":"2024-04-23T10:28:38.157999+0000","last_clean":"2024-04-23T10:28:38.157999+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:28:38.157999+0000","last_undegraded":"2024-04-23T10:28:38.157999+0000","last_fullsized":"2024-04-23T10:28:38.157999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:03:16.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":12538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'189","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791598+0000","last_change":"2024-04-23T10:15:38.014688+0000","last_active":"2024-04-23T10:28:42.791598+0000","last_peered":"2024-04-23T10:28:42.791598+0000","last_clean":"2024-04-23T10:28:42.791598+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:28:42.791598+0000","last_undegraded":"2024-04-23T10:28:42.791598+0000","last_fullsized":"2024-04-23T10:28:42.791598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:42.817311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'777","reported_seq":887,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.206811+0000","last_change":"2024-04-23T10:15:42.095977+0000","last_active":"2024-04-23T10:28:39.206811+0000","last_peered":"2024-04-23T10:28:39.206811+0000","last_clean":"2024-04-23T10:28:39.206811+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:28:39.206811+0000","last_undegraded":"2024-04-23T10:28:39.206811+0000","last_fullsized":"2024-04-23T10:28:39.206811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:07:07.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47927,"num_write":766,"num_write_kb":159845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'381","reported_seq":412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:34.176429+0000","last_change":"2024-04-23T10:15:37.032538+0000","last_active":"2024-04-23T10:28:34.176429+0000","last_peered":"2024-04-23T10:28:34.176429+0000","last_clean":"2024-04-23T10:28:34.176429+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:28:34.176429+0000","last_undegraded":"2024-04-23T10:28:34.176429+0000","last_fullsized":"2024-04-23T10:28:34.176429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:10.051254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791818+0000","last_change":"2024-04-23T10:15:37.997084+0000","last_active":"2024-04-23T10:28:42.791818+0000","last_peered":"2024-04-23T10:28:42.791818+0000","last_clean":"2024-04-23T10:28:42.791818+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:28:42.791818+0000","last_undegraded":"2024-04-23T10:28:42.791818+0000","last_fullsized":"2024-04-23T10:28:42.791818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:11.323448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'750","reported_seq":840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.175260+0000","last_change":"2024-04-23T10:15:42.088926+0000","last_active":"2024-04-23T10:28:39.175260+0000","last_peered":"2024-04-23T10:28:39.175260+0000","last_clean":"2024-04-23T10:28:39.175260+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:28:39.175260+0000","last_undegraded":"2024-04-23T10:28:39.175260+0000","last_fullsized":"2024-04-23T10:28:39.175260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:30.592738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32547,"num_write":740,"num_write_kb":109806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'207","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.774782+0000","last_change":"2024-04-23T10:15:38.035877+0000","last_active":"2024-04-23T10:28:42.774782+0000","last_peered":"2024-04-23T10:28:42.774782+0000","last_clean":"2024-04-23T10:28:42.774782+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:28:42.774782+0000","last_undegraded":"2024-04-23T10:28:42.774782+0000","last_fullsized":"2024-04-23T10:28:42.774782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:22:08.211594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'271","reported_seq":302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.085034+0000","last_change":"2024-04-23T10:15:37.032149+0000","last_active":"2024-04-23T10:28:32.085034+0000","last_peered":"2024-04-23T10:28:32.085034+0000","last_clean":"2024-04-23T10:28:32.085034+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:28:32.085034+0000","last_undegraded":"2024-04-23T10:28:32.085034+0000","last_fullsized":"2024-04-23T10:28:32.085034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:45.726640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":8310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'776","reported_seq":911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.169088+0000","last_change":"2024-04-23T10:15:42.086900+0000","last_active":"2024-04-23T10:28:38.169088+0000","last_peered":"2024-04-23T10:28:38.169088+0000","last_clean":"2024-04-23T10:28:38.169088+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:28:38.169088+0000","last_undegraded":"2024-04-23T10:28:38.169088+0000","last_fullsized":"2024-04-23T10:28:38.169088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:30.833952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57747,"num_write":758,"num_write_kb":151052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735623+0000","last_change":"2024-04-23T10:15:38.016900+0000","last_active":"2024-04-23T10:28:42.735623+0000","last_peered":"2024-04-23T10:28:42.735623+0000","last_clean":"2024-04-23T10:28:42.735623+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:28:42.735623+0000","last_undegraded":"2024-04-23T10:28:42.735623+0000","last_fullsized":"2024-04-23T10:28:42.735623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:21.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'236","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.395266+0000","last_change":"2024-04-23T10:15:37.005464+0000","last_active":"2024-04-23T10:28:38.395266+0000","last_peered":"2024-04-23T10:28:38.395266+0000","last_clean":"2024-04-23T10:28:38.395266+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:28:38.395266+0000","last_undegraded":"2024-04-23T10:28:38.395266+0000","last_fullsized":"2024-04-23T10:28:38.395266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:16.323054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.147546+0000","last_change":"2024-04-23T10:15:42.090002+0000","last_active":"2024-04-23T10:28:39.147546+0000","last_peered":"2024-04-23T10:28:39.147546+0000","last_clean":"2024-04-23T10:28:39.147546+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:28:39.147546+0000","last_undegraded":"2024-04-23T10:28:39.147546+0000","last_fullsized":"2024-04-23T10:28:39.147546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:35.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":42307,"num_write":786,"num_write_kb":84940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'208","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746296+0000","last_change":"2024-04-23T10:15:38.016384+0000","last_active":"2024-04-23T10:28:42.746296+0000","last_peered":"2024-04-23T10:28:42.746296+0000","last_clean":"2024-04-23T10:28:42.746296+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:28:42.746296+0000","last_undegraded":"2024-04-23T10:28:42.746296+0000","last_fullsized":"2024-04-23T10:28:42.746296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:51:49.320963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'75","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.187469+0000","last_change":"2024-04-23T10:15:37.019682+0000","last_active":"2024-04-23T10:28:32.187469+0000","last_peered":"2024-04-23T10:28:32.187469+0000","last_clean":"2024-04-23T10:28:32.187469+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:28:32.187469+0000","last_undegraded":"2024-04-23T10:28:32.187469+0000","last_fullsized":"2024-04-23T10:28:32.187469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.645738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'766","reported_seq":886,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.194471+0000","last_change":"2024-04-23T10:15:42.170220+0000","last_active":"2024-04-23T10:28:39.194471+0000","last_peered":"2024-04-23T10:28:39.194471+0000","last_clean":"2024-04-23T10:28:39.194471+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:28:39.194471+0000","last_undegraded":"2024-04-23T10:28:39.194471+0000","last_fullsized":"2024-04-23T10:28:39.194471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:10.825310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":54473,"num_write":759,"num_write_kb":130945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.690464+0000","last_change":"2024-04-23T10:15:38.016618+0000","last_active":"2024-04-23T10:28:42.690464+0000","last_peered":"2024-04-23T10:28:42.690464+0000","last_clean":"2024-04-23T10:28:42.690464+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:28:42.690464+0000","last_undegraded":"2024-04-23T10:28:42.690464+0000","last_fullsized":"2024-04-23T10:28:42.690464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:25.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'963","reported_seq":995,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:34.174254+0000","last_change":"2024-04-23T10:15:37.032623+0000","last_active":"2024-04-23T10:28:34.174254+0000","last_peered":"2024-04-23T10:28:34.174254+0000","last_clean":"2024-04-23T10:28:34.174254+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:28:34.174254+0000","last_undegraded":"2024-04-23T10:28:34.174254+0000","last_fullsized":"2024-04-23T10:28:34.174254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:00:17.413122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":4487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'727","reported_seq":836,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.246601+0000","last_change":"2024-04-23T10:15:42.098342+0000","last_active":"2024-04-23T10:28:39.246601+0000","last_peered":"2024-04-23T10:28:39.246601+0000","last_clean":"2024-04-23T10:28:39.246601+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:28:39.246601+0000","last_undegraded":"2024-04-23T10:28:39.246601+0000","last_fullsized":"2024-04-23T10:28:39.246601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:06:12.290573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46853,"num_write":712,"num_write_kb":125891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'218","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746113+0000","last_change":"2024-04-23T10:15:38.015317+0000","last_active":"2024-04-23T10:28:42.746113+0000","last_peered":"2024-04-23T10:28:42.746113+0000","last_clean":"2024-04-23T10:28:42.746113+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:28:42.746113+0000","last_undegraded":"2024-04-23T10:28:42.746113+0000","last_fullsized":"2024-04-23T10:28:42.746113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:50.032349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'73","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:36.425633+0000","last_change":"2024-04-23T10:15:37.034252+0000","last_active":"2024-04-23T10:28:36.425633+0000","last_peered":"2024-04-23T10:28:36.425633+0000","last_clean":"2024-04-23T10:28:36.425633+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:28:36.425633+0000","last_undegraded":"2024-04-23T10:28:36.425633+0000","last_fullsized":"2024-04-23T10:28:36.425633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:53.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'725","reported_seq":813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.177812+0000","last_change":"2024-04-23T10:15:42.173228+0000","last_active":"2024-04-23T10:28:39.177812+0000","last_peered":"2024-04-23T10:28:39.177812+0000","last_clean":"2024-04-23T10:28:39.177812+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:28:39.177812+0000","last_undegraded":"2024-04-23T10:28:39.177812+0000","last_fullsized":"2024-04-23T10:28:39.177812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:12.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33152,"num_write":717,"num_write_kb":76622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.771760+0000","last_change":"2024-04-23T10:15:38.033416+0000","last_active":"2024-04-23T10:28:42.771760+0000","last_peered":"2024-04-23T10:28:42.771760+0000","last_clean":"2024-04-23T10:28:42.771760+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:28:42.771760+0000","last_undegraded":"2024-04-23T10:28:42.771760+0000","last_fullsized":"2024-04-23T10:28:42.771760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:42:56.369168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'520","reported_seq":552,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.924119+0000","last_change":"2024-04-23T10:15:37.012602+0000","last_active":"2024-04-23T10:28:38.924119+0000","last_peered":"2024-04-23T10:28:38.924119+0000","last_clean":"2024-04-23T10:28:38.924119+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:28:38.924119+0000","last_undegraded":"2024-04-23T10:28:38.924119+0000","last_fullsized":"2024-04-23T10:28:38.924119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:16.214827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":1827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'785","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.161865+0000","last_change":"2024-04-23T10:16:27.066954+0000","last_active":"2024-04-23T10:28:38.161865+0000","last_peered":"2024-04-23T10:28:38.161865+0000","last_clean":"2024-04-23T10:28:38.161865+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:28:38.161865+0000","last_undegraded":"2024-04-23T10:28:38.161865+0000","last_fullsized":"2024-04-23T10:28:38.161865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:04:19.036666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28458,"num_write":774,"num_write_kb":115794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.737757+0000","last_change":"2024-04-23T10:15:38.019768+0000","last_active":"2024-04-23T10:28:42.737757+0000","last_peered":"2024-04-23T10:28:42.737757+0000","last_clean":"2024-04-23T10:28:42.737757+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:28:42.737757+0000","last_undegraded":"2024-04-23T10:28:42.737757+0000","last_fullsized":"2024-04-23T10:28:42.737757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:50:10.200750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'255","reported_seq":287,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.151694+0000","last_change":"2024-04-23T10:15:37.034022+0000","last_active":"2024-04-23T10:28:32.151694+0000","last_peered":"2024-04-23T10:28:32.151694+0000","last_clean":"2024-04-23T10:28:32.151694+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:28:32.151694+0000","last_undegraded":"2024-04-23T10:28:32.151694+0000","last_fullsized":"2024-04-23T10:28:32.151694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:52.730960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'721","reported_seq":782,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.138151+0000","last_change":"2024-04-23T10:15:42.171177+0000","last_active":"2024-04-23T10:28:39.138151+0000","last_peered":"2024-04-23T10:28:39.138151+0000","last_clean":"2024-04-23T10:28:39.138151+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:28:39.138151+0000","last_undegraded":"2024-04-23T10:28:39.138151+0000","last_fullsized":"2024-04-23T10:28:39.138151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:47:39.607385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21238,"num_write":700,"num_write_kb":76444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'211","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791453+0000","last_change":"2024-04-23T10:16:26.682509+0000","last_active":"2024-04-23T10:28:42.791453+0000","last_peered":"2024-04-23T10:28:42.791453+0000","last_clean":"2024-04-23T10:28:42.791453+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:28:42.791453+0000","last_undegraded":"2024-04-23T10:28:42.791453+0000","last_fullsized":"2024-04-23T10:28:42.791453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:03.876389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.092820+0000","last_change":"2024-04-23T10:15:37.011938+0000","last_active":"2024-04-23T10:28:32.092820+0000","last_peered":"2024-04-23T10:28:32.092820+0000","last_clean":"2024-04-23T10:28:32.092820+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:28:32.092820+0000","last_undegraded":"2024-04-23T10:28:32.092820+0000","last_fullsized":"2024-04-23T10:28:32.092820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:18:17.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'775","reported_seq":838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.163395+0000","last_change":"2024-04-23T10:15:42.086139+0000","last_active":"2024-04-23T10:28:39.163395+0000","last_peered":"2024-04-23T10:28:39.163395+0000","last_clean":"2024-04-23T10:28:39.163395+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:28:39.163395+0000","last_undegraded":"2024-04-23T10:28:39.163395+0000","last_fullsized":"2024-04-23T10:28:39.163395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:43.674481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25895,"num_write":752,"num_write_kb":125637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.726054+0000","last_change":"2024-04-23T10:15:38.013174+0000","last_active":"2024-04-23T10:28:42.726054+0000","last_peered":"2024-04-23T10:28:42.726054+0000","last_clean":"2024-04-23T10:28:42.726054+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:28:42.726054+0000","last_undegraded":"2024-04-23T10:28:42.726054+0000","last_fullsized":"2024-04-23T10:28:42.726054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'706","reported_seq":738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:22.080601+0000","last_change":"2024-04-23T10:15:37.021028+0000","last_active":"2024-04-23T10:28:22.080601+0000","last_peered":"2024-04-23T10:28:22.080601+0000","last_clean":"2024-04-23T10:28:22.080601+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:28:22.080601+0000","last_undegraded":"2024-04-23T10:28:22.080601+0000","last_fullsized":"2024-04-23T10:28:22.080601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:05:17.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":8518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'759","reported_seq":968,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.261178+0000","last_change":"2024-04-23T10:15:42.083617+0000","last_active":"2024-04-23T10:28:39.261178+0000","last_peered":"2024-04-23T10:28:39.261178+0000","last_clean":"2024-04-23T10:28:39.261178+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:28:39.261178+0000","last_undegraded":"2024-04-23T10:28:39.261178+0000","last_fullsized":"2024-04-23T10:28:39.261178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:48:23.341518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":98862,"num_write":741,"num_write_kb":163671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'207","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.731572+0000","last_change":"2024-04-23T10:15:38.018912+0000","last_active":"2024-04-23T10:28:42.731572+0000","last_peered":"2024-04-23T10:28:42.731572+0000","last_clean":"2024-04-23T10:28:42.731572+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:28:42.731572+0000","last_undegraded":"2024-04-23T10:28:42.731572+0000","last_fullsized":"2024-04-23T10:28:42.731572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:23.686721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'729","reported_seq":1409,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:40.123720+0000","last_change":"2024-04-23T10:15:37.003402+0000","last_active":"2024-04-23T10:28:40.123720+0000","last_peered":"2024-04-23T10:28:40.123720+0000","last_clean":"2024-04-23T10:28:40.123720+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:28:40.123720+0000","last_undegraded":"2024-04-23T10:28:40.123720+0000","last_fullsized":"2024-04-23T10:28:40.123720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:56.771150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554323,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":662,"num_write_kb":1972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'710","reported_seq":799,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.217512+0000","last_change":"2024-04-23T10:15:42.086228+0000","last_active":"2024-04-23T10:28:39.217512+0000","last_peered":"2024-04-23T10:28:39.217512+0000","last_clean":"2024-04-23T10:28:39.217512+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:28:39.217512+0000","last_undegraded":"2024-04-23T10:28:39.217512+0000","last_fullsized":"2024-04-23T10:28:39.217512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:17:50.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33554,"num_write":702,"num_write_kb":88722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759922+0000","last_change":"2024-04-23T10:15:38.007500+0000","last_active":"2024-04-23T10:28:42.759922+0000","last_peered":"2024-04-23T10:28:42.759922+0000","last_clean":"2024-04-23T10:28:42.759922+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:28:42.759922+0000","last_undegraded":"2024-04-23T10:28:42.759922+0000","last_fullsized":"2024-04-23T10:28:42.759922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:13:52.205399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'335","reported_seq":367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.185295+0000","last_change":"2024-04-23T10:15:37.022105+0000","last_active":"2024-04-23T10:28:32.185295+0000","last_peered":"2024-04-23T10:28:32.185295+0000","last_clean":"2024-04-23T10:28:32.185295+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:28:32.185295+0000","last_undegraded":"2024-04-23T10:28:32.185295+0000","last_fullsized":"2024-04-23T10:28:32.185295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:56.524092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'893","reported_seq":1085,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.223914+0000","last_change":"2024-04-23T10:15:42.170271+0000","last_active":"2024-04-23T10:28:39.223914+0000","last_peered":"2024-04-23T10:28:39.223914+0000","last_clean":"2024-04-23T10:28:39.223914+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:28:39.223914+0000","last_undegraded":"2024-04-23T10:28:39.223914+0000","last_fullsized":"2024-04-23T10:28:39.223914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:57.014244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":90539,"num_write":885,"num_write_kb":222131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735139+0000","last_change":"2024-04-23T10:16:26.682268+0000","last_active":"2024-04-23T10:28:42.735139+0000","last_peered":"2024-04-23T10:28:42.735139+0000","last_clean":"2024-04-23T10:28:42.735139+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:28:42.735139+0000","last_undegraded":"2024-04-23T10:28:42.735139+0000","last_fullsized":"2024-04-23T10:28:42.735139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:30:42.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'76","reported_seq":108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.160988+0000","last_change":"2024-04-23T10:15:37.005624+0000","last_active":"2024-04-23T10:28:38.160988+0000","last_peered":"2024-04-23T10:28:38.160988+0000","last_clean":"2024-04-23T10:28:38.160988+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:28:38.160988+0000","last_undegraded":"2024-04-23T10:28:38.160988+0000","last_fullsized":"2024-04-23T10:28:38.160988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:55.482592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:36.395058+0000","last_change":"2024-04-23T10:15:32.927528+0000","last_active":"2024-04-23T10:25:36.395058+0000","last_peered":"2024-04-23T10:25:36.395058+0000","last_clean":"2024-04-23T10:25:36.395058+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:25:36.395058+0000","last_undegraded":"2024-04-23T10:25:36.395058+0000","last_fullsized":"2024-04-23T10:25:36.395058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:31.902990+0000","last_clean_scrub_stamp":"2024-04-23T10:15:31.902990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:43.561809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'772","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.252010+0000","last_change":"2024-04-23T10:15:42.173602+0000","last_active":"2024-04-23T10:28:39.252010+0000","last_peered":"2024-04-23T10:28:39.252010+0000","last_clean":"2024-04-23T10:28:39.252010+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:28:39.252010+0000","last_undegraded":"2024-04-23T10:28:39.252010+0000","last_fullsized":"2024-04-23T10:28:39.252010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:43:10.618702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47063,"num_write":757,"num_write_kb":125918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792417+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:28:42.792417+0000","last_peered":"2024-04-23T10:28:42.792417+0000","last_clean":"2024-04-23T10:28:42.792417+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:28:42.792417+0000","last_undegraded":"2024-04-23T10:28:42.792417+0000","last_fullsized":"2024-04-23T10:28:42.792417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:30.737169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'64","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.170196+0000","last_change":"2024-04-23T10:15:37.003269+0000","last_active":"2024-04-23T10:28:39.170196+0000","last_peered":"2024-04-23T10:28:39.170196+0000","last_clean":"2024-04-23T10:28:39.170196+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:28:39.170196+0000","last_undegraded":"2024-04-23T10:28:39.170196+0000","last_fullsized":"2024-04-23T10:28:39.170196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:16.006999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'800","reported_seq":922,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.273293+0000","last_change":"2024-04-23T10:15:42.170366+0000","last_active":"2024-04-23T10:28:39.273293+0000","last_peered":"2024-04-23T10:28:39.273293+0000","last_clean":"2024-04-23T10:28:39.273293+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:28:39.273293+0000","last_undegraded":"2024-04-23T10:28:39.273293+0000","last_fullsized":"2024-04-23T10:28:39.273293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:21:20.362360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":46277,"num_write":791,"num_write_kb":155967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.788550+0000","last_change":"2024-04-23T10:15:38.013922+0000","last_active":"2024-04-23T10:28:42.788550+0000","last_peered":"2024-04-23T10:28:42.788550+0000","last_clean":"2024-04-23T10:28:42.788550+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:28:42.788550+0000","last_undegraded":"2024-04-23T10:28:42.788550+0000","last_fullsized":"2024-04-23T10:28:42.788550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:47.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'673","reported_seq":704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.209024+0000","last_change":"2024-04-23T10:15:37.009396+0000","last_active":"2024-04-23T10:28:31.209024+0000","last_peered":"2024-04-23T10:28:31.209024+0000","last_clean":"2024-04-23T10:28:31.209024+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:28:31.209024+0000","last_undegraded":"2024-04-23T10:28:31.209024+0000","last_fullsized":"2024-04-23T10:28:31.209024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:20:43.888308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'770","reported_seq":890,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.295167+0000","last_change":"2024-04-23T10:15:42.089180+0000","last_active":"2024-04-23T10:28:37.295167+0000","last_peered":"2024-04-23T10:28:37.295167+0000","last_clean":"2024-04-23T10:28:37.295167+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:28:37.295167+0000","last_undegraded":"2024-04-23T10:28:37.295167+0000","last_fullsized":"2024-04-23T10:28:37.295167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:08.004175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":57774,"num_write":776,"num_write_kb":117908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.778691+0000","last_change":"2024-04-23T10:15:38.039818+0000","last_active":"2024-04-23T10:28:42.778691+0000","last_peered":"2024-04-23T10:28:42.778691+0000","last_clean":"2024-04-23T10:28:42.778691+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:28:42.778691+0000","last_undegraded":"2024-04-23T10:28:42.778691+0000","last_fullsized":"2024-04-23T10:28:42.778691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:55:06.210650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'437","reported_seq":468,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:27.091495+0000","last_change":"2024-04-23T10:15:37.002661+0000","last_active":"2024-04-23T10:28:27.091495+0000","last_peered":"2024-04-23T10:28:27.091495+0000","last_clean":"2024-04-23T10:28:27.091495+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:28:27.091495+0000","last_undegraded":"2024-04-23T10:28:27.091495+0000","last_fullsized":"2024-04-23T10:28:27.091495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:27.304624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'820","reported_seq":989,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.242668+0000","last_change":"2024-04-23T10:15:42.170779+0000","last_active":"2024-04-23T10:28:39.242668+0000","last_peered":"2024-04-23T10:28:39.242668+0000","last_clean":"2024-04-23T10:28:39.242668+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:28:39.242668+0000","last_undegraded":"2024-04-23T10:28:39.242668+0000","last_fullsized":"2024-04-23T10:28:39.242668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":78747,"num_write":811,"num_write_kb":155987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'186","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777993+0000","last_change":"2024-04-23T10:15:38.037424+0000","last_active":"2024-04-23T10:28:42.777993+0000","last_peered":"2024-04-23T10:28:42.777993+0000","last_clean":"2024-04-23T10:28:42.777993+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:28:42.777993+0000","last_undegraded":"2024-04-23T10:28:42.777993+0000","last_fullsized":"2024-04-23T10:28:42.777993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:29.356209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'187","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.275846+0000","last_change":"2024-04-23T10:15:37.014134+0000","last_active":"2024-04-23T10:28:37.275846+0000","last_peered":"2024-04-23T10:28:37.275846+0000","last_clean":"2024-04-23T10:28:37.275846+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:28:37.275846+0000","last_undegraded":"2024-04-23T10:28:37.275846+0000","last_fullsized":"2024-04-23T10:28:37.275846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:14.115007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'819","reported_seq":905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.269480+0000","last_change":"2024-04-23T10:15:42.092963+0000","last_active":"2024-04-23T10:28:39.269480+0000","last_peered":"2024-04-23T10:28:39.269480+0000","last_clean":"2024-04-23T10:28:39.269480+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:28:39.269480+0000","last_undegraded":"2024-04-23T10:28:39.269480+0000","last_fullsized":"2024-04-23T10:28:39.269480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:17:28.272966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":36072,"num_write":807,"num_write_kb":130604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765068+0000","last_change":"2024-04-23T10:15:38.039817+0000","last_active":"2024-04-23T10:28:42.765068+0000","last_peered":"2024-04-23T10:28:42.765068+0000","last_clean":"2024-04-23T10:28:42.765068+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:28:42.765068+0000","last_undegraded":"2024-04-23T10:28:42.765068+0000","last_fullsized":"2024-04-23T10:28:42.765068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:54:11.141895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'275","reported_seq":306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.141294+0000","last_change":"2024-04-23T10:15:36.998475+0000","last_active":"2024-04-23T10:28:39.141294+0000","last_peered":"2024-04-23T10:28:39.141294+0000","last_clean":"2024-04-23T10:28:39.141294+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:28:39.141294+0000","last_undegraded":"2024-04-23T10:28:39.141294+0000","last_fullsized":"2024-04-23T10:28:39.141294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:47.046185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'783","reported_seq":890,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.205009+0000","last_change":"2024-04-23T10:15:42.076252+0000","last_active":"2024-04-23T10:28:39.205009+0000","last_peered":"2024-04-23T10:28:39.205009+0000","last_clean":"2024-04-23T10:28:39.205009+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:28:39.205009+0000","last_undegraded":"2024-04-23T10:28:39.205009+0000","last_fullsized":"2024-04-23T10:28:39.205009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:45:53.029559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":28210,"num_write":769,"num_write_kb":122559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.725278+0000","last_change":"2024-04-23T10:15:38.032361+0000","last_active":"2024-04-23T10:28:42.725278+0000","last_peered":"2024-04-23T10:28:42.725278+0000","last_clean":"2024-04-23T10:28:42.725278+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:28:42.725278+0000","last_undegraded":"2024-04-23T10:28:42.725278+0000","last_fullsized":"2024-04-23T10:28:42.725278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:00:33.933188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'67","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:28.067048+0000","last_change":"2024-04-23T10:15:37.013138+0000","last_active":"2024-04-23T10:28:28.067048+0000","last_peered":"2024-04-23T10:28:28.067048+0000","last_clean":"2024-04-23T10:28:28.067048+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:28:28.067048+0000","last_undegraded":"2024-04-23T10:28:28.067048+0000","last_fullsized":"2024-04-23T10:28:28.067048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:46.503428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'801","reported_seq":932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.307545+0000","last_change":"2024-04-23T10:15:42.170655+0000","last_active":"2024-04-23T10:28:37.307545+0000","last_peered":"2024-04-23T10:28:37.307545+0000","last_clean":"2024-04-23T10:28:37.307545+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:28:37.307545+0000","last_undegraded":"2024-04-23T10:28:37.307545+0000","last_fullsized":"2024-04-23T10:28:37.307545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:51:40.238891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":64319,"num_write":793,"num_write_kb":152801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.778485+0000","last_change":"2024-04-23T10:15:38.040722+0000","last_active":"2024-04-23T10:28:42.778485+0000","last_peered":"2024-04-23T10:28:42.778485+0000","last_clean":"2024-04-23T10:28:42.778485+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:28:42.778485+0000","last_undegraded":"2024-04-23T10:28:42.778485+0000","last_fullsized":"2024-04-23T10:28:42.778485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:14:34.699496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'71","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.127628+0000","last_change":"2024-04-23T10:15:37.022675+0000","last_active":"2024-04-23T10:28:39.127628+0000","last_peered":"2024-04-23T10:28:39.127628+0000","last_clean":"2024-04-23T10:28:39.127628+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:28:39.127628+0000","last_undegraded":"2024-04-23T10:28:39.127628+0000","last_fullsized":"2024-04-23T10:28:39.127628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:45.668844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'716","reported_seq":841,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.181269+0000","last_change":"2024-04-23T10:16:26.368606+0000","last_active":"2024-04-23T10:28:39.181269+0000","last_peered":"2024-04-23T10:28:39.181269+0000","last_clean":"2024-04-23T10:28:39.181269+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:28:39.181269+0000","last_undegraded":"2024-04-23T10:28:39.181269+0000","last_fullsized":"2024-04-23T10:28:39.181269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:02.237968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50110,"num_write":710,"num_write_kb":147181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.768300+0000","last_change":"2024-04-23T10:15:38.030355+0000","last_active":"2024-04-23T10:28:42.768300+0000","last_peered":"2024-04-23T10:28:42.768300+0000","last_clean":"2024-04-23T10:28:42.768300+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:28:42.768300+0000","last_undegraded":"2024-04-23T10:28:42.768300+0000","last_fullsized":"2024-04-23T10:28:42.768300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:32:19.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'594","reported_seq":625,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:25.069702+0000","last_change":"2024-04-23T10:15:37.026230+0000","last_active":"2024-04-23T10:28:25.069702+0000","last_peered":"2024-04-23T10:28:25.069702+0000","last_clean":"2024-04-23T10:28:25.069702+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:28:25.069702+0000","last_undegraded":"2024-04-23T10:28:25.069702+0000","last_fullsized":"2024-04-23T10:28:25.069702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:32.209250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.258805+0000","last_change":"2024-04-23T10:15:42.165833+0000","last_active":"2024-04-23T10:28:39.258805+0000","last_peered":"2024-04-23T10:28:39.258805+0000","last_clean":"2024-04-23T10:28:39.258805+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:28:39.258805+0000","last_undegraded":"2024-04-23T10:28:39.258805+0000","last_fullsized":"2024-04-23T10:28:39.258805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:59:52.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41492,"num_write":740,"num_write_kb":126321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777861+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:28:42.777861+0000","last_peered":"2024-04-23T10:28:42.777861+0000","last_clean":"2024-04-23T10:28:42.777861+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:28:42.777861+0000","last_undegraded":"2024-04-23T10:28:42.777861+0000","last_fullsized":"2024-04-23T10:28:42.777861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:02.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'447","reported_seq":478,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.230434+0000","last_change":"2024-04-23T10:15:37.010434+0000","last_active":"2024-04-23T10:28:30.230434+0000","last_peered":"2024-04-23T10:28:30.230434+0000","last_clean":"2024-04-23T10:28:30.230434+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:28:30.230434+0000","last_undegraded":"2024-04-23T10:28:30.230434+0000","last_fullsized":"2024-04-23T10:28:30.230434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:52.343715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'781","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.162612+0000","last_change":"2024-04-23T10:15:42.083192+0000","last_active":"2024-04-23T10:28:39.162612+0000","last_peered":"2024-04-23T10:28:39.162612+0000","last_clean":"2024-04-23T10:28:39.162612+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:28:39.162612+0000","last_undegraded":"2024-04-23T10:28:39.162612+0000","last_fullsized":"2024-04-23T10:28:39.162612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:01:27.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":27921,"num_write":758,"num_write_kb":97957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'198","reported_seq":213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.769078+0000","last_change":"2024-04-23T10:16:26.366127+0000","last_active":"2024-04-23T10:28:42.769078+0000","last_peered":"2024-04-23T10:28:42.769078+0000","last_clean":"2024-04-23T10:28:42.769078+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:28:42.769078+0000","last_undegraded":"2024-04-23T10:28:42.769078+0000","last_fullsized":"2024-04-23T10:28:42.769078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:26.783997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"26'360","reported_seq":391,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:44.554991+0000","last_change":"2024-04-23T10:15:37.024194+0000","last_active":"2024-04-23T10:28:44.554991+0000","last_peered":"2024-04-23T10:28:44.554991+0000","last_clean":"2024-04-23T10:28:44.554991+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:28:44.554991+0000","last_undegraded":"2024-04-23T10:28:44.554991+0000","last_fullsized":"2024-04-23T10:28:44.554991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:11.280842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1387233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'726","reported_seq":837,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.207970+0000","last_change":"2024-04-23T10:15:42.093356+0000","last_active":"2024-04-23T10:28:39.207970+0000","last_peered":"2024-04-23T10:28:39.207970+0000","last_clean":"2024-04-23T10:28:39.207970+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:28:39.207970+0000","last_undegraded":"2024-04-23T10:28:39.207970+0000","last_fullsized":"2024-04-23T10:28:39.207970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:23.865968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44100,"num_write":714,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.744791+0000","last_change":"2024-04-23T10:15:38.015501+0000","last_active":"2024-04-23T10:28:42.744791+0000","last_peered":"2024-04-23T10:28:42.744791+0000","last_clean":"2024-04-23T10:28:42.744791+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:28:42.744791+0000","last_undegraded":"2024-04-23T10:28:42.744791+0000","last_fullsized":"2024-04-23T10:28:42.744791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:36.251701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'237","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:36.118118+0000","last_change":"2024-04-23T10:15:37.028798+0000","last_active":"2024-04-23T10:28:36.118118+0000","last_peered":"2024-04-23T10:28:36.118118+0000","last_clean":"2024-04-23T10:28:36.118118+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:28:36.118118+0000","last_undegraded":"2024-04-23T10:28:36.118118+0000","last_fullsized":"2024-04-23T10:28:36.118118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:16.642452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'829","reported_seq":953,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.250609+0000","last_change":"2024-04-23T10:15:42.096576+0000","last_active":"2024-04-23T10:28:39.250609+0000","last_peered":"2024-04-23T10:28:39.250609+0000","last_clean":"2024-04-23T10:28:39.250609+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:28:39.250609+0000","last_undegraded":"2024-04-23T10:28:39.250609+0000","last_fullsized":"2024-04-23T10:28:39.250609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:44.741112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":58607,"num_write":815,"num_write_kb":134637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'221","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792069+0000","last_change":"2024-04-23T10:15:38.028327+0000","last_active":"2024-04-23T10:28:42.792069+0000","last_peered":"2024-04-23T10:28:42.792069+0000","last_clean":"2024-04-23T10:28:42.792069+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:28:42.792069+0000","last_undegraded":"2024-04-23T10:28:42.792069+0000","last_fullsized":"2024-04-23T10:28:42.792069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:48:18.745496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'71","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.682822+0000","last_change":"2024-04-23T10:15:37.024719+0000","last_active":"2024-04-23T10:28:42.682822+0000","last_peered":"2024-04-23T10:28:42.682822+0000","last_clean":"2024-04-23T10:28:42.682822+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:28:42.682822+0000","last_undegraded":"2024-04-23T10:28:42.682822+0000","last_fullsized":"2024-04-23T10:28:42.682822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:54.028739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'829","reported_seq":947,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.248571+0000","last_change":"2024-04-23T10:15:42.174320+0000","last_active":"2024-04-23T10:28:39.248571+0000","last_peered":"2024-04-23T10:28:39.248571+0000","last_clean":"2024-04-23T10:28:39.248571+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:28:39.248571+0000","last_undegraded":"2024-04-23T10:28:39.248571+0000","last_fullsized":"2024-04-23T10:28:39.248571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:58.153378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":52124,"num_write":807,"num_write_kb":167221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'853","reported_seq":1000,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.219943+0000","last_change":"2024-04-23T10:15:42.170586+0000","last_active":"2024-04-23T10:28:39.219943+0000","last_peered":"2024-04-23T10:28:39.219943+0000","last_clean":"2024-04-23T10:28:39.219943+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:28:39.219943+0000","last_undegraded":"2024-04-23T10:28:39.219943+0000","last_fullsized":"2024-04-23T10:28:39.219943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:44.860678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":70228,"num_write":840,"num_write_kb":218801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.758002+0000","last_change":"2024-04-23T10:15:38.012699+0000","last_active":"2024-04-23T10:28:42.758002+0000","last_peered":"2024-04-23T10:28:42.758002+0000","last_clean":"2024-04-23T10:28:42.758002+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:28:42.758002+0000","last_undegraded":"2024-04-23T10:28:42.758002+0000","last_fullsized":"2024-04-23T10:28:42.758002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:24:27.361285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1123","reported_seq":1154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.131685+0000","last_change":"2024-04-23T10:15:37.020739+0000","last_active":"2024-04-23T10:28:31.131685+0000","last_peered":"2024-04-23T10:28:31.131685+0000","last_clean":"2024-04-23T10:28:31.131685+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:28:31.131685+0000","last_undegraded":"2024-04-23T10:28:31.131685+0000","last_fullsized":"2024-04-23T10:28:31.131685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:53.548297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'763","reported_seq":848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:37.139173+0000","last_change":"2024-04-23T10:15:42.085138+0000","last_active":"2024-04-23T10:28:37.139173+0000","last_peered":"2024-04-23T10:28:37.139173+0000","last_clean":"2024-04-23T10:28:37.139173+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:28:37.139173+0000","last_undegraded":"2024-04-23T10:28:37.139173+0000","last_fullsized":"2024-04-23T10:28:37.139173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:45.956720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":755,"num_write_kb":160183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746444+0000","last_change":"2024-04-23T10:15:38.003651+0000","last_active":"2024-04-23T10:28:42.746444+0000","last_peered":"2024-04-23T10:28:42.746444+0000","last_clean":"2024-04-23T10:28:42.746444+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:42.746444+0000","last_undegraded":"2024-04-23T10:28:42.746444+0000","last_fullsized":"2024-04-23T10:28:42.746444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:39.619494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'101","reported_seq":132,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:31.163083+0000","last_change":"2024-04-23T10:15:37.021797+0000","last_active":"2024-04-23T10:28:31.163083+0000","last_peered":"2024-04-23T10:28:31.163083+0000","last_clean":"2024-04-23T10:28:31.163083+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:28:31.163083+0000","last_undegraded":"2024-04-23T10:28:31.163083+0000","last_fullsized":"2024-04-23T10:28:31.163083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:55.954529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'346","reported_seq":377,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:30.151218+0000","last_change":"2024-04-23T10:15:37.011366+0000","last_active":"2024-04-23T10:28:30.151218+0000","last_peered":"2024-04-23T10:28:30.151218+0000","last_clean":"2024-04-23T10:28:30.151218+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:28:30.151218+0000","last_undegraded":"2024-04-23T10:28:30.151218+0000","last_fullsized":"2024-04-23T10:28:30.151218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:42:59.877498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":12468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'181","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.758412+0000","last_change":"2024-04-23T10:15:38.004598+0000","last_active":"2024-04-23T10:28:42.758412+0000","last_peered":"2024-04-23T10:28:42.758412+0000","last_clean":"2024-04-23T10:28:42.758412+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:42.758412+0000","last_undegraded":"2024-04-23T10:28:42.758412+0000","last_fullsized":"2024-04-23T10:28:42.758412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:57:33.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'746","reported_seq":883,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.187774+0000","last_change":"2024-04-23T10:15:42.087100+0000","last_active":"2024-04-23T10:28:39.187774+0000","last_peered":"2024-04-23T10:28:39.187774+0000","last_clean":"2024-04-23T10:28:39.187774+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:28:39.187774+0000","last_undegraded":"2024-04-23T10:28:39.187774+0000","last_fullsized":"2024-04-23T10:28:39.187774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:04:01.447063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":53240,"num_write":729,"num_write_kb":139197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'111","reported_seq":142,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:32.092373+0000","last_change":"2024-04-23T10:15:37.038658+0000","last_active":"2024-04-23T10:28:32.092373+0000","last_peered":"2024-04-23T10:28:32.092373+0000","last_clean":"2024-04-23T10:28:32.092373+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:28:32.092373+0000","last_undegraded":"2024-04-23T10:28:32.092373+0000","last_fullsized":"2024-04-23T10:28:32.092373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:35.956631+0000","last_clean_scrub_stamp":"2024-04-23T10:15:35.956631+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:29.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.761091+0000","last_change":"2024-04-23T10:15:38.019188+0000","last_active":"2024-04-23T10:28:42.761091+0000","last_peered":"2024-04-23T10:28:42.761091+0000","last_clean":"2024-04-23T10:28:42.761091+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:28:42.761091+0000","last_undegraded":"2024-04-23T10:28:42.761091+0000","last_fullsized":"2024-04-23T10:28:42.761091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:08:51.536193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'701","reported_seq":783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:38.135009+0000","last_change":"2024-04-23T10:16:26.958520+0000","last_active":"2024-04-23T10:28:38.135009+0000","last_peered":"2024-04-23T10:28:38.135009+0000","last_clean":"2024-04-23T10:28:38.135009+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:28:38.135009+0000","last_undegraded":"2024-04-23T10:28:38.135009+0000","last_fullsized":"2024-04-23T10:28:38.135009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:06.464656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24902,"num_write":688,"num_write_kb":109624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'212","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.764520+0000","last_change":"2024-04-23T10:15:38.029857+0000","last_active":"2024-04-23T10:28:42.764520+0000","last_peered":"2024-04-23T10:28:42.764520+0000","last_clean":"2024-04-23T10:28:42.764520+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:28:42.764520+0000","last_undegraded":"2024-04-23T10:28:42.764520+0000","last_fullsized":"2024-04-23T10:28:42.764520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:19.322367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'216","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.787955+0000","last_change":"2024-04-23T10:15:38.021813+0000","last_active":"2024-04-23T10:28:42.787955+0000","last_peered":"2024-04-23T10:28:42.787955+0000","last_clean":"2024-04-23T10:28:42.787955+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:28:42.787955+0000","last_undegraded":"2024-04-23T10:28:42.787955+0000","last_fullsized":"2024-04-23T10:28:42.787955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:46:16.318945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'240","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.724207+0000","last_change":"2024-04-23T10:16:26.295163+0000","last_active":"2024-04-23T10:28:42.724207+0000","last_peered":"2024-04-23T10:28:42.724207+0000","last_clean":"2024-04-23T10:28:42.724207+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:28:42.724207+0000","last_undegraded":"2024-04-23T10:28:42.724207+0000","last_fullsized":"2024-04-23T10:28:42.724207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:23.533100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.747300+0000","last_change":"2024-04-23T10:15:38.005218+0000","last_active":"2024-04-23T10:28:42.747300+0000","last_peered":"2024-04-23T10:28:42.747300+0000","last_clean":"2024-04-23T10:28:42.747300+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:28:42.747300+0000","last_undegraded":"2024-04-23T10:28:42.747300+0000","last_fullsized":"2024-04-23T10:28:42.747300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:26.463721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'187","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759594+0000","last_change":"2024-04-23T10:15:38.024698+0000","last_active":"2024-04-23T10:28:42.759594+0000","last_peered":"2024-04-23T10:28:42.759594+0000","last_clean":"2024-04-23T10:28:42.759594+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:28:42.759594+0000","last_undegraded":"2024-04-23T10:28:42.759594+0000","last_fullsized":"2024-04-23T10:28:42.759594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:10.949793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'203","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.746454+0000","last_change":"2024-04-23T10:15:38.016433+0000","last_active":"2024-04-23T10:28:42.746454+0000","last_peered":"2024-04-23T10:28:42.746454+0000","last_clean":"2024-04-23T10:28:42.746454+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:28:42.746454+0000","last_undegraded":"2024-04-23T10:28:42.746454+0000","last_fullsized":"2024-04-23T10:28:42.746454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:18.387168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'239","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.767869+0000","last_change":"2024-04-23T10:16:26.295515+0000","last_active":"2024-04-23T10:28:42.767869+0000","last_peered":"2024-04-23T10:28:42.767869+0000","last_clean":"2024-04-23T10:28:42.767869+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:28:42.767869+0000","last_undegraded":"2024-04-23T10:28:42.767869+0000","last_fullsized":"2024-04-23T10:28:42.767869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:44:48.448837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.739678+0000","last_change":"2024-04-23T10:15:38.024815+0000","last_active":"2024-04-23T10:28:42.739678+0000","last_peered":"2024-04-23T10:28:42.739678+0000","last_clean":"2024-04-23T10:28:42.739678+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:28:42.739678+0000","last_undegraded":"2024-04-23T10:28:42.739678+0000","last_fullsized":"2024-04-23T10:28:42.739678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:59.010194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'218","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.788708+0000","last_change":"2024-04-23T10:15:38.001075+0000","last_active":"2024-04-23T10:28:42.788708+0000","last_peered":"2024-04-23T10:28:42.788708+0000","last_clean":"2024-04-23T10:28:42.788708+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:28:42.788708+0000","last_undegraded":"2024-04-23T10:28:42.788708+0000","last_fullsized":"2024-04-23T10:28:42.788708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:52.981269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.759208+0000","last_change":"2024-04-23T10:15:38.000396+0000","last_active":"2024-04-23T10:28:42.759208+0000","last_peered":"2024-04-23T10:28:42.759208+0000","last_clean":"2024-04-23T10:28:42.759208+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:28:42.759208+0000","last_undegraded":"2024-04-23T10:28:42.759208+0000","last_fullsized":"2024-04-23T10:28:42.759208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:10.791187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'207","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792281+0000","last_change":"2024-04-23T10:15:38.038870+0000","last_active":"2024-04-23T10:28:42.792281+0000","last_peered":"2024-04-23T10:28:42.792281+0000","last_clean":"2024-04-23T10:28:42.792281+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:28:42.792281+0000","last_undegraded":"2024-04-23T10:28:42.792281+0000","last_fullsized":"2024-04-23T10:28:42.792281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:26:03.251339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'209","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.772044+0000","last_change":"2024-04-23T10:15:38.028291+0000","last_active":"2024-04-23T10:28:42.772044+0000","last_peered":"2024-04-23T10:28:42.772044+0000","last_clean":"2024-04-23T10:28:42.772044+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:28:42.772044+0000","last_undegraded":"2024-04-23T10:28:42.772044+0000","last_fullsized":"2024-04-23T10:28:42.772044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:50.717227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'221","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.774617+0000","last_change":"2024-04-23T10:15:38.008705+0000","last_active":"2024-04-23T10:28:42.774617+0000","last_peered":"2024-04-23T10:28:42.774617+0000","last_clean":"2024-04-23T10:28:42.774617+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:28:42.774617+0000","last_undegraded":"2024-04-23T10:28:42.774617+0000","last_fullsized":"2024-04-23T10:28:42.774617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:51.213429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.776817+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:28:42.776817+0000","last_peered":"2024-04-23T10:28:42.776817+0000","last_clean":"2024-04-23T10:28:42.776817+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:28:42.776817+0000","last_undegraded":"2024-04-23T10:28:42.776817+0000","last_fullsized":"2024-04-23T10:28:42.776817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:06:35.881549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.769568+0000","last_change":"2024-04-23T10:15:38.036844+0000","last_active":"2024-04-23T10:28:42.769568+0000","last_peered":"2024-04-23T10:28:42.769568+0000","last_clean":"2024-04-23T10:28:42.769568+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:28:42.769568+0000","last_undegraded":"2024-04-23T10:28:42.769568+0000","last_fullsized":"2024-04-23T10:28:42.769568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:30.739960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.790426+0000","last_change":"2024-04-23T10:15:38.038534+0000","last_active":"2024-04-23T10:28:42.790426+0000","last_peered":"2024-04-23T10:28:42.790426+0000","last_clean":"2024-04-23T10:28:42.790426+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:28:42.790426+0000","last_undegraded":"2024-04-23T10:28:42.790426+0000","last_fullsized":"2024-04-23T10:28:42.790426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:25.398498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791320+0000","last_change":"2024-04-23T10:15:38.016137+0000","last_active":"2024-04-23T10:28:42.791320+0000","last_peered":"2024-04-23T10:28:42.791320+0000","last_clean":"2024-04-23T10:28:42.791320+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:28:42.791320+0000","last_undegraded":"2024-04-23T10:28:42.791320+0000","last_fullsized":"2024-04-23T10:28:42.791320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:05.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.739588+0000","last_change":"2024-04-23T10:15:38.016281+0000","last_active":"2024-04-23T10:28:42.739588+0000","last_peered":"2024-04-23T10:28:42.739588+0000","last_clean":"2024-04-23T10:28:42.739588+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:28:42.739588+0000","last_undegraded":"2024-04-23T10:28:42.739588+0000","last_fullsized":"2024-04-23T10:28:42.739588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:16.487628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'211","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.752016+0000","last_change":"2024-04-23T10:15:38.021357+0000","last_active":"2024-04-23T10:28:42.752016+0000","last_peered":"2024-04-23T10:28:42.752016+0000","last_clean":"2024-04-23T10:28:42.752016+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:28:42.752016+0000","last_undegraded":"2024-04-23T10:28:42.752016+0000","last_fullsized":"2024-04-23T10:28:42.752016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:28:30.539883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'198","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765626+0000","last_change":"2024-04-23T10:15:38.036972+0000","last_active":"2024-04-23T10:28:42.765626+0000","last_peered":"2024-04-23T10:28:42.765626+0000","last_clean":"2024-04-23T10:28:42.765626+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:28:42.765626+0000","last_undegraded":"2024-04-23T10:28:42.765626+0000","last_fullsized":"2024-04-23T10:28:42.765626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:30.183704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.771282+0000","last_change":"2024-04-23T10:15:38.008867+0000","last_active":"2024-04-23T10:28:42.771282+0000","last_peered":"2024-04-23T10:28:42.771282+0000","last_clean":"2024-04-23T10:28:42.771282+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:28:42.771282+0000","last_undegraded":"2024-04-23T10:28:42.771282+0000","last_fullsized":"2024-04-23T10:28:42.771282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:25:44.975945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.789862+0000","last_change":"2024-04-23T10:15:38.031807+0000","last_active":"2024-04-23T10:28:42.789862+0000","last_peered":"2024-04-23T10:28:42.789862+0000","last_clean":"2024-04-23T10:28:42.789862+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:28:42.789862+0000","last_undegraded":"2024-04-23T10:28:42.789862+0000","last_fullsized":"2024-04-23T10:28:42.789862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:14.564270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.790198+0000","last_change":"2024-04-23T10:15:38.031510+0000","last_active":"2024-04-23T10:28:42.790198+0000","last_peered":"2024-04-23T10:28:42.790198+0000","last_clean":"2024-04-23T10:28:42.790198+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:28:42.790198+0000","last_undegraded":"2024-04-23T10:28:42.790198+0000","last_fullsized":"2024-04-23T10:28:42.790198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:13.943197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'212","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.792384+0000","last_change":"2024-04-23T10:15:38.040123+0000","last_active":"2024-04-23T10:28:42.792384+0000","last_peered":"2024-04-23T10:28:42.792384+0000","last_clean":"2024-04-23T10:28:42.792384+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:28:42.792384+0000","last_undegraded":"2024-04-23T10:28:42.792384+0000","last_fullsized":"2024-04-23T10:28:42.792384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:52:09.059927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'194","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.993413+0000","last_change":"2024-04-23T10:15:38.019629+0000","last_active":"2024-04-23T10:28:42.993413+0000","last_peered":"2024-04-23T10:28:42.993413+0000","last_clean":"2024-04-23T10:28:42.993413+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:28:42.993413+0000","last_undegraded":"2024-04-23T10:28:42.993413+0000","last_fullsized":"2024-04-23T10:28:42.993413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:32.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.753223+0000","last_change":"2024-04-23T10:15:38.039652+0000","last_active":"2024-04-23T10:28:42.753223+0000","last_peered":"2024-04-23T10:28:42.753223+0000","last_clean":"2024-04-23T10:28:42.753223+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:28:42.753223+0000","last_undegraded":"2024-04-23T10:28:42.753223+0000","last_fullsized":"2024-04-23T10:28:42.753223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:02:49.373752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791471+0000","last_change":"2024-04-23T10:15:38.015349+0000","last_active":"2024-04-23T10:28:42.791471+0000","last_peered":"2024-04-23T10:28:42.791471+0000","last_clean":"2024-04-23T10:28:42.791471+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:28:42.791471+0000","last_undegraded":"2024-04-23T10:28:42.791471+0000","last_fullsized":"2024-04-23T10:28:42.791471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:34:08.290241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'211","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.765496+0000","last_change":"2024-04-23T10:15:38.038157+0000","last_active":"2024-04-23T10:28:42.765496+0000","last_peered":"2024-04-23T10:28:42.765496+0000","last_clean":"2024-04-23T10:28:42.765496+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:28:42.765496+0000","last_undegraded":"2024-04-23T10:28:42.765496+0000","last_fullsized":"2024-04-23T10:28:42.765496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.861014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'201","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791523+0000","last_change":"2024-04-23T10:15:38.014510+0000","last_active":"2024-04-23T10:28:42.791523+0000","last_peered":"2024-04-23T10:28:42.791523+0000","last_clean":"2024-04-23T10:28:42.791523+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:28:42.791523+0000","last_undegraded":"2024-04-23T10:28:42.791523+0000","last_fullsized":"2024-04-23T10:28:42.791523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:49.004305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'192","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.751731+0000","last_change":"2024-04-23T10:15:38.017065+0000","last_active":"2024-04-23T10:28:42.751731+0000","last_peered":"2024-04-23T10:28:42.751731+0000","last_clean":"2024-04-23T10:28:42.751731+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:28:42.751731+0000","last_undegraded":"2024-04-23T10:28:42.751731+0000","last_fullsized":"2024-04-23T10:28:42.751731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:41:20.960205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.723451+0000","last_change":"2024-04-23T10:15:38.027481+0000","last_active":"2024-04-23T10:28:42.723451+0000","last_peered":"2024-04-23T10:28:42.723451+0000","last_clean":"2024-04-23T10:28:42.723451+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:28:42.723451+0000","last_undegraded":"2024-04-23T10:28:42.723451+0000","last_fullsized":"2024-04-23T10:28:42.723451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:50:13.444605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'214","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.773391+0000","last_change":"2024-04-23T10:15:38.039927+0000","last_active":"2024-04-23T10:28:42.773391+0000","last_peered":"2024-04-23T10:28:42.773391+0000","last_clean":"2024-04-23T10:28:42.773391+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:28:42.773391+0000","last_undegraded":"2024-04-23T10:28:42.773391+0000","last_fullsized":"2024-04-23T10:28:42.773391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:01.308247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2849,"num_read_kb":1515105,"num_write":24366,"num_write_kb":4267173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24772,"ondisk_log_size":24772,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13142,"ondisk_log_size":13142,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":137167340,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":10074,"num_write_kb":140883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274579456,"data_stored":274334680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11007,"ondisk_log_size":11007,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139456,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94232384,"statfs":{"total":96636764160,"available":96493961216,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575013,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111508,"kb_used_data":26252,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94260332,"statfs":{"total":96636764160,"available":96522579968,"internally_reserved":0,"allocated":26882048,"data_stored":26671347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142116,"kb_used_data":34588,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94229724,"statfs":{"total":96636764160,"available":96491237376,"internally_reserved":0,"allocated":35418112,"data_stored":35225169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73128,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298712,"statfs":{"total":96636764160,"available":96561881088,"internally_reserved":0,"allocated":10256384,"data_stored":10059311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137856,"kb_used_data":30328,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94233984,"statfs":{"total":96636764160,"available":96495599616,"internally_reserved":0,"allocated":31055872,"data_stored":30862669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575011,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30777344,"data_stored":30748221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9977856,"data_stored":9944863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35139584,"data_stored":35110721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26603520,"data_stored":26556899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:28:56.082 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.082 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.082 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.082 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.082 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.082 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.082 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.083 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.084 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.085 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.086 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T10:15:31.902990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.087 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.088 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.089 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.090 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.091 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-23T10:15:35.956631+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=35, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.092 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.093 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.094 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.095 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.095 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.095 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.095 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.095 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.095 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.095 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:28:56.095 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T10:29:16.096 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:29:16.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad741da640 1 Processor -- start 2024-04-23T10:29:16.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad741da640 1 -- start start 2024-04-23T10:29:16.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad741da640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad6c06f150 0x7fad6c06f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad741da640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6c0c3fe0 con 0x7fad6c0ccc50 2024-04-23T10:29:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad741da640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6c0c42c0 con 0x7fad6c153190 2024-04-23T10:29:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad741da640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fad6c159f20 con 0x7fad6c06f150 2024-04-23T10:29:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad72777640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fad6c0ccc50 0x7fad6c0cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33188/0 (socket says 172.21.15.29:33188) 2024-04-23T10:29:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad72777640 1 -- 172.21.15.29:0/71240514 learned_addr learned my addr 172.21.15.29:0/71240514 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:29:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad71775640 1 --2- 172.21.15.29:0/71240514 >> v2:172.21.15.72:3300/0 conn(0x7fad6c06f150 0x7fad6c06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615589888 0 0) 0x7fad6c0c3fe0 con 0x7fad6c0ccc50 2024-04-23T10:29:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad58003530 con 0x7fad6c0ccc50 2024-04-23T10:29:16.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4291015211 0 0) 0x7fad58003530 con 0x7fad6c0ccc50 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 >> v2:172.21.15.72:3300/0 conn(0x7fad6c06f150 msgr2=0x7fad6c06f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 --2- 172.21.15.29:0/71240514 >> v2:172.21.15.72:3300/0 conn(0x7fad6c06f150 0x7fad6c06f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 >> v1:172.21.15.72:6789/0 conn(0x7fad6c153190 legacy=0x7fad6c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c0c45a0 con 0x7fad6c0ccc50 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fad64001680 con 0x7fad6c0ccc50 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 >> v1:172.21.15.29:6789/0 conn(0x7fad6c0ccc50 legacy=0x7fad6c0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580039c0 0x7fad58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad58004810 0x7fad58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad580051d0 0x7fad5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c159f20 con 0x7fad580051d0 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fad5800c080 con 0x7fad58004810 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fad5800c280 con 0x7fad580039c0 2024-04-23T10:29:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad72777640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad580051d0 0x7fad5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad71f76640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580039c0 0x7fad58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad72777640 1 -- 172.21.15.29:0/71240514 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580039c0 msgr2=0x7fad58003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad72777640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580039c0 0x7fad58003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad72777640 1 -- 172.21.15.29:0/71240514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad58004810 msgr2=0x7fad58004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad72777640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad58004810 0x7fad58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.232+0000 7fad72777640 1 -- 172.21.15.29:0/71240514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad58003530 con 0x7fad580051d0 2024-04-23T10:29:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad72777640 1 -- 172.21.15.29:0/71240514 reap_dead start 2024-04-23T10:29:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad72777640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad580051d0 0x7fad5800b9d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c1c0 tx=0x7fad6401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ab3a2f2c457923 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64007d00 con 0x7fad580051d0 2024-04-23T10:29:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad640a9070 con 0x7fad580051d0 2024-04-23T10:29:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad70f74640 1 -- 172.21.15.29:0/71240514 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad640a5dc0 con 0x7fad580051d0 2024-04-23T10:29:16.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- 172.21.15.29:0/71240514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad580051d0 msgr2=0x7fad5800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad580051d0 0x7fad5800b9d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c1c0 tx=0x7fad6401cc60 comp rx=0 tx=0).stop 2024-04-23T10:29:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- 172.21.15.29:0/71240514 shutdown_connections 2024-04-23T10:29:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 --2- 172.21.15.29:0/71240514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad580051d0 0x7fad5800b9d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- 172.21.15.29:0/71240514 >> 172.21.15.29:0/71240514 conn(0x7fad6c06cfb0 msgr2=0x7fad6c06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- 172.21.15.29:0/71240514 shutdown_connections 2024-04-23T10:29:16.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- 172.21.15.29:0/71240514 wait complete. 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 Processor -- start 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- start start 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580051d0 0x7fad6c1ef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6c1e2470 0x7fad6c155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c155690 0x7fad6c1e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c153570 con 0x7fad6c155690 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c159380 con 0x7fad6c1e2470 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad741da640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fad6c0c4880 con 0x7fad580051d0 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad72777640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c155690 0x7fad6c1e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:16.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad72777640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c155690 0x7fad6c1e53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43694/0 (socket says 172.21.15.29:43694) 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.236+0000 7fad72777640 1 -- 172.21.15.29:0/650334775 learned_addr learned my addr 172.21.15.29:0/650334775 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad71775640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6c1e2470 0x7fad6c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad71f76640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580051d0 0x7fad6c1ef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad72777640 1 -- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580051d0 msgr2=0x7fad6c1ef180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad72777640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580051d0 0x7fad6c1ef180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad72777640 1 -- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6c1e2470 msgr2=0x7fad6c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad72777640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6c1e2470 0x7fad6c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad72777640 1 -- 172.21.15.29:0/650334775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c15d2b0 con 0x7fad6c155690 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad72777640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c155690 0x7fad6c1e53d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fad64007040 tx=0x7fad58005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad627fc640 1 -- 172.21.15.29:0/650334775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad640b4070 con 0x7fad6c155690 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad627fc640 1 -- 172.21.15.29:0/650334775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad64004a00 con 0x7fad6c155690 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6c155b10 con 0x7fad6c155690 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad627fc640 1 -- 172.21.15.29:0/650334775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64007d00 con 0x7fad6c155690 2024-04-23T10:29:16.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6c155d80 con 0x7fad6c155690 2024-04-23T10:29:16.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6c1560c0 con 0x7fad6c155690 2024-04-23T10:29:16.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad627fc640 1 -- 172.21.15.29:0/650334775 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad640b7070 con 0x7fad6c155690 2024-04-23T10:29:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad627fc640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fad50068380 0x7fad5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad627fc640 1 -- 172.21.15.29:0/650334775 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fad6411f5f0 con 0x7fad6c155690 2024-04-23T10:29:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.240+0000 7fad71f76640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fad50068380 0x7fad5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:16.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.244+0000 7fad71f76640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fad50068380 0x7fad5006a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad68007fd0 tx=0x7fad68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:16.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.244+0000 7fad627fc640 1 -- 172.21.15.29:0/650334775 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad6c1560c0 con 0x7fad6c155690 2024-04-23T10:29:16.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.404+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad6c068d70 con 0x7fad50068380 2024-04-23T10:29:16.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.428+0000 7fad627fc640 1 -- 172.21.15.29:0/650334775 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334963 (secure 0 0 0) 0x7fad6c068d70 con 0x7fad50068380 2024-04-23T10:29:16.433 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:29:16.435 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:29:16.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fad50068380 msgr2=0x7fad5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fad50068380 0x7fad5006a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad68007fd0 tx=0x7fad68009040 comp rx=0 tx=0).stop 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c155690 msgr2=0x7fad6c1e53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c155690 0x7fad6c1e53d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fad64007040 tx=0x7fad58005840 comp rx=0 tx=0).stop 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 shutdown_connections 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fad50068380 0x7fad5006a840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c155690 0x7fad6c1e53d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad6c1e2470 0x7fad6c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 --2- 172.21.15.29:0/650334775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad580051d0 0x7fad6c1ef180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 >> 172.21.15.29:0/650334775 conn(0x7fad6c06cfb0 msgr2=0x7fad6c157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 shutdown_connections 2024-04-23T10:29:16.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:16.436+0000 7fad741da640 1 -- 172.21.15.29:0/650334775 wait complete. 2024-04-23T10:29:16.453 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":431,"stamp":"2024-04-23T10:29:15.515240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137757708,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":3613,"num_read_kb":1517165,"num_write":34599,"num_write_kb":4410472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49158,"ondisk_log_size":49158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":944120,"kb_used_data":271480,"kb_used_omap":12,"kb_used_meta":672563,"kb_avail":754030600,"statfs":{"total":773094113280,"available":772127334400,"internally_reserved":0,"allocated":277995520,"data_stored":276431000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":688705072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004638"},"pg_stats":[{"pgid":"2.1f","version":"26'106","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.038505+0000","last_change":"2024-04-23T10:28:55.038566+0000","last_active":"2024-04-23T10:28:55.038505+0000","last_peered":"2024-04-23T10:28:55.038505+0000","last_clean":"2024-04-23T10:28:55.038505+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:28:55.038505+0000","last_undegraded":"2024-04-23T10:28:55.038505+0000","last_fullsized":"2024-04-23T10:28:55.038505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'106","last_scrub_stamp":"2024-04-23T10:28:55.038426+0000","last_deep_scrub":"26'106","last_deep_scrub_stamp":"2024-04-23T10:28:55.038426+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.038426+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:32:26.303000+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.677943+0000","last_change":"2024-04-23T10:28:56.678007+0000","last_active":"2024-04-23T10:28:56.677943+0000","last_peered":"2024-04-23T10:28:56.677943+0000","last_clean":"2024-04-23T10:28:56.677943+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:28:56.677943+0000","last_undegraded":"2024-04-23T10:28:56.677943+0000","last_fullsized":"2024-04-23T10:28:56.677943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-23T10:28:56.677764+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-23T10:28:56.677764+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.677764+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:24.650083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'789","reported_seq":887,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.669113+0000","last_change":"2024-04-23T10:29:09.669177+0000","last_active":"2024-04-23T10:29:09.669113+0000","last_peered":"2024-04-23T10:29:09.669113+0000","last_clean":"2024-04-23T10:29:09.669113+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:29:09.669113+0000","last_undegraded":"2024-04-23T10:29:09.669113+0000","last_fullsized":"2024-04-23T10:29:09.669113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'789","last_scrub_stamp":"2024-04-23T10:29:09.668922+0000","last_deep_scrub":"26'789","last_deep_scrub_stamp":"2024-04-23T10:29:09.668922+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.668922+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:57:55.186791+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31845,"num_write":775,"num_write_kb":142945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'96","reported_seq":137,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.707154+0000","last_change":"2024-04-23T10:28:58.707225+0000","last_active":"2024-04-23T10:28:58.707154+0000","last_peered":"2024-04-23T10:28:58.707154+0000","last_clean":"2024-04-23T10:28:58.707154+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:28:58.707154+0000","last_undegraded":"2024-04-23T10:28:58.707154+0000","last_fullsized":"2024-04-23T10:28:58.707154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'96","last_scrub_stamp":"2024-04-23T10:28:58.706977+0000","last_deep_scrub":"26'96","last_deep_scrub_stamp":"2024-04-23T10:28:58.706977+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.706977+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:47.023712+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.094283+0000","last_change":"2024-04-23T10:28:59.094353+0000","last_active":"2024-04-23T10:28:59.094283+0000","last_peered":"2024-04-23T10:28:59.094283+0000","last_clean":"2024-04-23T10:28:59.094283+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:28:59.094283+0000","last_undegraded":"2024-04-23T10:28:59.094283+0000","last_fullsized":"2024-04-23T10:28:59.094283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'182","last_scrub_stamp":"2024-04-23T10:28:59.094102+0000","last_deep_scrub":"26'182","last_deep_scrub_stamp":"2024-04-23T10:28:59.094102+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.094102+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:48.759946+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'755","reported_seq":881,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.371948+0000","last_change":"2024-04-23T10:29:05.372010+0000","last_active":"2024-04-23T10:29:05.371948+0000","last_peered":"2024-04-23T10:29:05.371948+0000","last_clean":"2024-04-23T10:29:05.371948+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:29:05.371948+0000","last_undegraded":"2024-04-23T10:29:05.371948+0000","last_fullsized":"2024-04-23T10:29:05.371948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'755","last_scrub_stamp":"2024-04-23T10:29:05.371769+0000","last_deep_scrub":"26'755","last_deep_scrub_stamp":"2024-04-23T10:29:05.371769+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.371769+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:43.590589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":56312,"num_write":739,"num_write_kb":106537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'972","reported_seq":1012,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.784562+0000","last_change":"2024-04-23T10:29:04.784615+0000","last_active":"2024-04-23T10:29:04.784562+0000","last_peered":"2024-04-23T10:29:04.784562+0000","last_clean":"2024-04-23T10:29:04.784562+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:29:04.784562+0000","last_undegraded":"2024-04-23T10:29:04.784562+0000","last_fullsized":"2024-04-23T10:29:04.784562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'972","last_scrub_stamp":"2024-04-23T10:29:04.784480+0000","last_deep_scrub":"26'972","last_deep_scrub_stamp":"2024-04-23T10:29:04.784480+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.784480+0000","objects_scrubbed":10,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:27:55.447792+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":12538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'189","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.535842+0000","last_change":"2024-04-23T10:28:54.535901+0000","last_active":"2024-04-23T10:28:54.535842+0000","last_peered":"2024-04-23T10:28:54.535842+0000","last_clean":"2024-04-23T10:28:54.535842+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:28:54.535842+0000","last_undegraded":"2024-04-23T10:28:54.535842+0000","last_fullsized":"2024-04-23T10:28:54.535842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'189","last_scrub_stamp":"2024-04-23T10:28:54.535675+0000","last_deep_scrub":"26'189","last_deep_scrub_stamp":"2024-04-23T10:28:54.535675+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.535675+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:36:29.346675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'777","reported_seq":896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.364899+0000","last_change":"2024-04-23T10:29:04.364968+0000","last_active":"2024-04-23T10:29:04.364899+0000","last_peered":"2024-04-23T10:29:04.364899+0000","last_clean":"2024-04-23T10:29:04.364899+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:29:04.364899+0000","last_undegraded":"2024-04-23T10:29:04.364899+0000","last_fullsized":"2024-04-23T10:29:04.364899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'777","last_scrub_stamp":"2024-04-23T10:29:04.364701+0000","last_deep_scrub":"26'777","last_deep_scrub_stamp":"2024-04-23T10:29:04.364701+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.364701+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:04:59.514736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47927,"num_write":766,"num_write_kb":159845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'385","reported_seq":425,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.632119+0000","last_change":"2024-04-23T10:29:01.632206+0000","last_active":"2024-04-23T10:29:01.632119+0000","last_peered":"2024-04-23T10:29:01.632119+0000","last_clean":"2024-04-23T10:29:01.632119+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:29:01.632119+0000","last_undegraded":"2024-04-23T10:29:01.632119+0000","last_fullsized":"2024-04-23T10:29:01.632119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'385","last_scrub_stamp":"2024-04-23T10:29:01.631952+0000","last_deep_scrub":"26'385","last_deep_scrub_stamp":"2024-04-23T10:29:01.631952+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.631952+0000","objects_scrubbed":4,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:30:44.459457+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.500297+0000","last_change":"2024-04-23T10:29:01.500358+0000","last_active":"2024-04-23T10:29:01.500297+0000","last_peered":"2024-04-23T10:29:01.500297+0000","last_clean":"2024-04-23T10:29:01.500297+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:29:01.500297+0000","last_undegraded":"2024-04-23T10:29:01.500297+0000","last_fullsized":"2024-04-23T10:29:01.500297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'192","last_scrub_stamp":"2024-04-23T10:29:01.500119+0000","last_deep_scrub":"26'192","last_deep_scrub_stamp":"2024-04-23T10:29:01.500119+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.500119+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:11:49.718645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'750","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.378298+0000","last_change":"2024-04-23T10:29:00.378362+0000","last_active":"2024-04-23T10:29:00.378298+0000","last_peered":"2024-04-23T10:29:00.378298+0000","last_clean":"2024-04-23T10:29:00.378298+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:29:00.378298+0000","last_undegraded":"2024-04-23T10:29:00.378298+0000","last_fullsized":"2024-04-23T10:29:00.378298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'750","last_scrub_stamp":"2024-04-23T10:29:00.378063+0000","last_deep_scrub":"26'750","last_deep_scrub_stamp":"2024-04-23T10:29:00.378063+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.378063+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:39.652652+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32547,"num_write":740,"num_write_kb":109806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'207","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.691418+0000","last_change":"2024-04-23T10:29:05.691484+0000","last_active":"2024-04-23T10:29:05.691418+0000","last_peered":"2024-04-23T10:29:05.691418+0000","last_clean":"2024-04-23T10:29:05.691418+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:29:05.691418+0000","last_undegraded":"2024-04-23T10:29:05.691418+0000","last_fullsized":"2024-04-23T10:29:05.691418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-23T10:29:05.691218+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-23T10:29:05.691218+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.691218+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:57:34.743632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'275","reported_seq":316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.640029+0000","last_change":"2024-04-23T10:29:00.640029+0000","last_active":"2024-04-23T10:29:00.640029+0000","last_peered":"2024-04-23T10:29:00.640029+0000","last_clean":"2024-04-23T10:29:00.640029+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:29:00.640029+0000","last_undegraded":"2024-04-23T10:29:00.640029+0000","last_fullsized":"2024-04-23T10:29:00.640029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'275","last_scrub_stamp":"2024-04-23T10:29:00.639742+0000","last_deep_scrub":"26'275","last_deep_scrub_stamp":"2024-04-23T10:29:00.639742+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.639742+0000","objects_scrubbed":4,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:58.625852+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":8310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'776","reported_seq":921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.418847+0000","last_change":"2024-04-23T10:28:59.418847+0000","last_active":"2024-04-23T10:28:59.418847+0000","last_peered":"2024-04-23T10:28:59.418847+0000","last_clean":"2024-04-23T10:28:59.418847+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:28:59.418847+0000","last_undegraded":"2024-04-23T10:28:59.418847+0000","last_fullsized":"2024-04-23T10:28:59.418847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'776","last_scrub_stamp":"2024-04-23T10:28:59.418378+0000","last_deep_scrub":"26'776","last_deep_scrub_stamp":"2024-04-23T10:28:59.418378+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.418378+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:06:43.206285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57747,"num_write":758,"num_write_kb":151052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'204","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.699675+0000","last_change":"2024-04-23T10:29:04.699675+0000","last_active":"2024-04-23T10:29:04.699675+0000","last_peered":"2024-04-23T10:29:04.699675+0000","last_clean":"2024-04-23T10:29:04.699675+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:29:04.699675+0000","last_undegraded":"2024-04-23T10:29:04.699675+0000","last_fullsized":"2024-04-23T10:29:04.699675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:29:04.699338+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:29:04.699338+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.699338+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:27.631024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'238","reported_seq":279,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.112847+0000","last_change":"2024-04-23T10:28:54.112882+0000","last_active":"2024-04-23T10:28:54.112847+0000","last_peered":"2024-04-23T10:28:54.112847+0000","last_clean":"2024-04-23T10:28:54.112847+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:28:54.112847+0000","last_undegraded":"2024-04-23T10:28:54.112847+0000","last_fullsized":"2024-04-23T10:28:54.112847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'238","last_scrub_stamp":"2024-04-23T10:28:54.112762+0000","last_deep_scrub":"26'238","last_deep_scrub_stamp":"2024-04-23T10:28:54.112762+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.112762+0000","objects_scrubbed":3,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:49.877403+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.334344+0000","last_change":"2024-04-23T10:29:01.334344+0000","last_active":"2024-04-23T10:29:01.334344+0000","last_peered":"2024-04-23T10:29:01.334344+0000","last_clean":"2024-04-23T10:29:01.334344+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:29:01.334344+0000","last_undegraded":"2024-04-23T10:29:01.334344+0000","last_fullsized":"2024-04-23T10:29:01.334344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'802","last_scrub_stamp":"2024-04-23T10:29:01.334075+0000","last_deep_scrub":"26'802","last_deep_scrub_stamp":"2024-04-23T10:29:01.334075+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.334075+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:48.948148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":42307,"num_write":786,"num_write_kb":84940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'208","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.705859+0000","last_change":"2024-04-23T10:29:03.705918+0000","last_active":"2024-04-23T10:29:03.705859+0000","last_peered":"2024-04-23T10:29:03.705859+0000","last_clean":"2024-04-23T10:29:03.705859+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:29:03.705859+0000","last_undegraded":"2024-04-23T10:29:03.705859+0000","last_fullsized":"2024-04-23T10:29:03.705859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:29:03.705675+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:29:03.705675+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.705675+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:26.389033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'79","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.123503+0000","last_change":"2024-04-23T10:28:58.123583+0000","last_active":"2024-04-23T10:28:58.123503+0000","last_peered":"2024-04-23T10:28:58.123503+0000","last_clean":"2024-04-23T10:28:58.123503+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:28:58.123503+0000","last_undegraded":"2024-04-23T10:28:58.123503+0000","last_fullsized":"2024-04-23T10:28:58.123503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2024-04-23T10:28:58.123333+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2024-04-23T10:28:58.123333+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.123333+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:35:40.339944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'766","reported_seq":896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.117885+0000","last_change":"2024-04-23T10:29:09.117885+0000","last_active":"2024-04-23T10:29:09.117885+0000","last_peered":"2024-04-23T10:29:09.117885+0000","last_clean":"2024-04-23T10:29:09.117885+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:29:09.117885+0000","last_undegraded":"2024-04-23T10:29:09.117885+0000","last_fullsized":"2024-04-23T10:29:09.117885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'766","last_scrub_stamp":"2024-04-23T10:29:09.117540+0000","last_deep_scrub":"26'766","last_deep_scrub_stamp":"2024-04-23T10:29:09.117540+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.117540+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:10:17.710601+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":54473,"num_write":759,"num_write_kb":130945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'215","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.420691+0000","last_change":"2024-04-23T10:28:57.420812+0000","last_active":"2024-04-23T10:28:57.420691+0000","last_peered":"2024-04-23T10:28:57.420691+0000","last_clean":"2024-04-23T10:28:57.420691+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:28:57.420691+0000","last_undegraded":"2024-04-23T10:28:57.420691+0000","last_fullsized":"2024-04-23T10:28:57.420691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'215","last_scrub_stamp":"2024-04-23T10:28:57.420471+0000","last_deep_scrub":"26'215","last_deep_scrub_stamp":"2024-04-23T10:28:57.420471+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.420471+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:38:01.361586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'965","reported_seq":1006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.655083+0000","last_change":"2024-04-23T10:29:02.655205+0000","last_active":"2024-04-23T10:29:02.655083+0000","last_peered":"2024-04-23T10:29:02.655083+0000","last_clean":"2024-04-23T10:29:02.655083+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:29:02.655083+0000","last_undegraded":"2024-04-23T10:29:02.655083+0000","last_fullsized":"2024-04-23T10:29:02.655083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'965","last_scrub_stamp":"2024-04-23T10:29:02.654882+0000","last_deep_scrub":"26'965","last_deep_scrub_stamp":"2024-04-23T10:29:02.654882+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.654882+0000","objects_scrubbed":2,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:35:33.563672+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":4487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'727","reported_seq":846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.323742+0000","last_change":"2024-04-23T10:29:06.323742+0000","last_active":"2024-04-23T10:29:06.323742+0000","last_peered":"2024-04-23T10:29:06.323742+0000","last_clean":"2024-04-23T10:29:06.323742+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:29:06.323742+0000","last_undegraded":"2024-04-23T10:29:06.323742+0000","last_fullsized":"2024-04-23T10:29:06.323742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'727","last_scrub_stamp":"2024-04-23T10:29:06.323483+0000","last_deep_scrub":"26'727","last_deep_scrub_stamp":"2024-04-23T10:29:06.323483+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.323483+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:56:09.368593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46853,"num_write":712,"num_write_kb":125891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'218","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.046312+0000","last_change":"2024-04-23T10:29:00.046375+0000","last_active":"2024-04-23T10:29:00.046312+0000","last_peered":"2024-04-23T10:29:00.046312+0000","last_clean":"2024-04-23T10:29:00.046312+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:29:00.046312+0000","last_undegraded":"2024-04-23T10:29:00.046312+0000","last_fullsized":"2024-04-23T10:29:00.046312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-23T10:29:00.046134+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-23T10:29:00.046134+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.046134+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:13.626513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'77","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.752742+0000","last_change":"2024-04-23T10:28:59.752818+0000","last_active":"2024-04-23T10:28:59.752742+0000","last_peered":"2024-04-23T10:28:59.752742+0000","last_clean":"2024-04-23T10:28:59.752742+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:28:59.752742+0000","last_undegraded":"2024-04-23T10:28:59.752742+0000","last_fullsized":"2024-04-23T10:28:59.752742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2024-04-23T10:28:59.752551+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2024-04-23T10:28:59.752551+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.752551+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:04.478703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'725","reported_seq":822,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.313175+0000","last_change":"2024-04-23T10:29:07.313238+0000","last_active":"2024-04-23T10:29:07.313175+0000","last_peered":"2024-04-23T10:29:07.313175+0000","last_clean":"2024-04-23T10:29:07.313175+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:29:07.313175+0000","last_undegraded":"2024-04-23T10:29:07.313175+0000","last_fullsized":"2024-04-23T10:29:07.313175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'725","last_scrub_stamp":"2024-04-23T10:29:07.312985+0000","last_deep_scrub":"26'725","last_deep_scrub_stamp":"2024-04-23T10:29:07.312985+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.312985+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:16:57.860174+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33152,"num_write":717,"num_write_kb":76622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":216,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:53.684929+0000","last_change":"2024-04-23T10:28:53.684952+0000","last_active":"2024-04-23T10:28:53.684929+0000","last_peered":"2024-04-23T10:28:53.684929+0000","last_clean":"2024-04-23T10:28:53.684929+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:28:53.684929+0000","last_undegraded":"2024-04-23T10:28:53.684929+0000","last_fullsized":"2024-04-23T10:28:53.684929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'177","last_scrub_stamp":"2024-04-23T10:28:53.684856+0000","last_deep_scrub":"26'177","last_deep_scrub_stamp":"2024-04-23T10:28:53.684856+0000","last_clean_scrub_stamp":"2024-04-23T10:28:53.684856+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:40:43.962560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'523","reported_seq":564,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.171938+0000","last_change":"2024-04-23T10:28:57.172013+0000","last_active":"2024-04-23T10:28:57.171938+0000","last_peered":"2024-04-23T10:28:57.171938+0000","last_clean":"2024-04-23T10:28:57.171938+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:28:57.171938+0000","last_undegraded":"2024-04-23T10:28:57.171938+0000","last_fullsized":"2024-04-23T10:28:57.171938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'523","last_scrub_stamp":"2024-04-23T10:28:57.171772+0000","last_deep_scrub":"26'523","last_deep_scrub_stamp":"2024-04-23T10:28:57.171772+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.171772+0000","objects_scrubbed":4,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:02.126985+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":1827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'785","reported_seq":865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.246369+0000","last_change":"2024-04-23T10:16:27.066954+0000","last_active":"2024-04-23T10:28:39.246369+0000","last_peered":"2024-04-23T10:28:39.246369+0000","last_clean":"2024-04-23T10:28:39.246369+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:28:39.246369+0000","last_undegraded":"2024-04-23T10:28:39.246369+0000","last_fullsized":"2024-04-23T10:28:39.246369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28458,"num_write":774,"num_write_kb":115794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.046219+0000","last_change":"2024-04-23T10:29:03.046279+0000","last_active":"2024-04-23T10:29:03.046219+0000","last_peered":"2024-04-23T10:29:03.046219+0000","last_clean":"2024-04-23T10:29:03.046219+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:29:03.046219+0000","last_undegraded":"2024-04-23T10:29:03.046219+0000","last_fullsized":"2024-04-23T10:29:03.046219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:29:03.046048+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:29:03.046048+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.046048+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:08:40.675716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'259","reported_seq":300,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.693915+0000","last_change":"2024-04-23T10:29:03.693993+0000","last_active":"2024-04-23T10:29:03.693915+0000","last_peered":"2024-04-23T10:29:03.693915+0000","last_clean":"2024-04-23T10:29:03.693915+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:29:03.693915+0000","last_undegraded":"2024-04-23T10:29:03.693915+0000","last_fullsized":"2024-04-23T10:29:03.693915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'259","last_scrub_stamp":"2024-04-23T10:29:03.693742+0000","last_deep_scrub":"26'259","last_deep_scrub_stamp":"2024-04-23T10:29:03.693742+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.693742+0000","objects_scrubbed":4,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:47:03.820245+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'721","reported_seq":791,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.986141+0000","last_change":"2024-04-23T10:29:08.986204+0000","last_active":"2024-04-23T10:29:08.986141+0000","last_peered":"2024-04-23T10:29:08.986141+0000","last_clean":"2024-04-23T10:29:08.986141+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:29:08.986141+0000","last_undegraded":"2024-04-23T10:29:08.986141+0000","last_fullsized":"2024-04-23T10:29:08.986141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'721","last_scrub_stamp":"2024-04-23T10:29:08.985960+0000","last_deep_scrub":"26'721","last_deep_scrub_stamp":"2024-04-23T10:29:08.985960+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.985960+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:34.537033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21238,"num_write":700,"num_write_kb":76444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'211","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.791750+0000","last_change":"2024-04-23T10:16:26.682509+0000","last_active":"2024-04-23T10:28:42.791750+0000","last_peered":"2024-04-23T10:28:42.791750+0000","last_clean":"2024-04-23T10:28:42.791750+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:28:42.791750+0000","last_undegraded":"2024-04-23T10:28:42.791750+0000","last_fullsized":"2024-04-23T10:28:42.791750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.140696+0000","last_change":"2024-04-23T10:28:56.140761+0000","last_active":"2024-04-23T10:28:56.140696+0000","last_peered":"2024-04-23T10:28:56.140696+0000","last_clean":"2024-04-23T10:28:56.140696+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:28:56.140696+0000","last_undegraded":"2024-04-23T10:28:56.140696+0000","last_fullsized":"2024-04-23T10:28:56.140696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'67","last_scrub_stamp":"2024-04-23T10:28:56.140492+0000","last_deep_scrub":"26'67","last_deep_scrub_stamp":"2024-04-23T10:28:56.140492+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.140492+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:51:19.851529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'775","reported_seq":847,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.046572+0000","last_change":"2024-04-23T10:29:07.046637+0000","last_active":"2024-04-23T10:29:07.046572+0000","last_peered":"2024-04-23T10:29:07.046572+0000","last_clean":"2024-04-23T10:29:07.046572+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:29:07.046572+0000","last_undegraded":"2024-04-23T10:29:07.046572+0000","last_fullsized":"2024-04-23T10:29:07.046572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'775","last_scrub_stamp":"2024-04-23T10:29:07.046392+0000","last_deep_scrub":"26'775","last_deep_scrub_stamp":"2024-04-23T10:29:07.046392+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.046392+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:48.716394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25895,"num_write":752,"num_write_kb":125637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.411614+0000","last_change":"2024-04-23T10:28:56.411673+0000","last_active":"2024-04-23T10:28:56.411614+0000","last_peered":"2024-04-23T10:28:56.411614+0000","last_clean":"2024-04-23T10:28:56.411614+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:28:56.411614+0000","last_undegraded":"2024-04-23T10:28:56.411614+0000","last_fullsized":"2024-04-23T10:28:56.411614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:28:56.411438+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:28:56.411438+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.411438+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:29:35.656749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'710","reported_seq":751,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.525464+0000","last_change":"2024-04-23T10:28:58.525535+0000","last_active":"2024-04-23T10:28:58.525464+0000","last_peered":"2024-04-23T10:28:58.525464+0000","last_clean":"2024-04-23T10:28:58.525464+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:28:58.525464+0000","last_undegraded":"2024-04-23T10:28:58.525464+0000","last_fullsized":"2024-04-23T10:28:58.525464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'710","last_scrub_stamp":"2024-04-23T10:28:58.525300+0000","last_deep_scrub":"26'710","last_deep_scrub_stamp":"2024-04-23T10:28:58.525300+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.525300+0000","objects_scrubbed":4,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:15:55.914238+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":8518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'759","reported_seq":977,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.086222+0000","last_change":"2024-04-23T10:29:06.086285+0000","last_active":"2024-04-23T10:29:06.086222+0000","last_peered":"2024-04-23T10:29:06.086222+0000","last_clean":"2024-04-23T10:29:06.086222+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:29:06.086222+0000","last_undegraded":"2024-04-23T10:29:06.086222+0000","last_fullsized":"2024-04-23T10:29:06.086222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'759","last_scrub_stamp":"2024-04-23T10:29:06.086025+0000","last_deep_scrub":"26'759","last_deep_scrub_stamp":"2024-04-23T10:29:06.086025+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.086025+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:19.383668+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":98862,"num_write":741,"num_write_kb":163671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'207","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.075303+0000","last_change":"2024-04-23T10:29:02.075365+0000","last_active":"2024-04-23T10:29:02.075303+0000","last_peered":"2024-04-23T10:29:02.075303+0000","last_clean":"2024-04-23T10:29:02.075303+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:29:02.075303+0000","last_undegraded":"2024-04-23T10:29:02.075303+0000","last_fullsized":"2024-04-23T10:29:02.075303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-23T10:29:02.075106+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-23T10:29:02.075106+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.075106+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:17.288158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'731","reported_seq":1420,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.087850+0000","last_change":"2024-04-23T10:28:56.087889+0000","last_active":"2024-04-23T10:28:56.087850+0000","last_peered":"2024-04-23T10:28:56.087850+0000","last_clean":"2024-04-23T10:28:56.087850+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:28:56.087850+0000","last_undegraded":"2024-04-23T10:28:56.087850+0000","last_fullsized":"2024-04-23T10:28:56.087850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'731","last_scrub_stamp":"2024-04-23T10:28:56.087779+0000","last_deep_scrub":"26'731","last_deep_scrub_stamp":"2024-04-23T10:28:56.087779+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.087779+0000","objects_scrubbed":4,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:00.434784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554323,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":662,"num_write_kb":1972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'710","reported_seq":808,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.091422+0000","last_change":"2024-04-23T10:29:08.091487+0000","last_active":"2024-04-23T10:29:08.091422+0000","last_peered":"2024-04-23T10:29:08.091422+0000","last_clean":"2024-04-23T10:29:08.091422+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:29:08.091422+0000","last_undegraded":"2024-04-23T10:29:08.091422+0000","last_fullsized":"2024-04-23T10:29:08.091422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'710","last_scrub_stamp":"2024-04-23T10:29:08.091242+0000","last_deep_scrub":"26'710","last_deep_scrub_stamp":"2024-04-23T10:29:08.091242+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.091242+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:12.076033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33554,"num_write":702,"num_write_kb":88722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.107764+0000","last_change":"2024-04-23T10:28:58.107881+0000","last_active":"2024-04-23T10:28:58.107764+0000","last_peered":"2024-04-23T10:28:58.107764+0000","last_clean":"2024-04-23T10:28:58.107764+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:28:58.107764+0000","last_undegraded":"2024-04-23T10:28:58.107764+0000","last_fullsized":"2024-04-23T10:28:58.107764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'194","last_scrub_stamp":"2024-04-23T10:28:58.107481+0000","last_deep_scrub":"26'194","last_deep_scrub_stamp":"2024-04-23T10:28:58.107481+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.107481+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:31.852994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'338","reported_seq":379,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.592281+0000","last_change":"2024-04-23T10:28:59.592412+0000","last_active":"2024-04-23T10:28:59.592281+0000","last_peered":"2024-04-23T10:28:59.592281+0000","last_clean":"2024-04-23T10:28:59.592281+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:28:59.592281+0000","last_undegraded":"2024-04-23T10:28:59.592281+0000","last_fullsized":"2024-04-23T10:28:59.592281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'338","last_scrub_stamp":"2024-04-23T10:28:59.592077+0000","last_deep_scrub":"26'338","last_deep_scrub_stamp":"2024-04-23T10:28:59.592077+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.592077+0000","objects_scrubbed":3,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:16.440806+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'893","reported_seq":1094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.983141+0000","last_change":"2024-04-23T10:29:06.983312+0000","last_active":"2024-04-23T10:29:06.983141+0000","last_peered":"2024-04-23T10:29:06.983141+0000","last_clean":"2024-04-23T10:29:06.983141+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:29:06.983141+0000","last_undegraded":"2024-04-23T10:29:06.983141+0000","last_fullsized":"2024-04-23T10:29:06.983141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'893","last_scrub_stamp":"2024-04-23T10:29:06.982916+0000","last_deep_scrub":"26'893","last_deep_scrub_stamp":"2024-04-23T10:29:06.982916+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.982916+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:49.768722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":90539,"num_write":885,"num_write_kb":222131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.735374+0000","last_change":"2024-04-23T10:16:26.682268+0000","last_active":"2024-04-23T10:28:42.735374+0000","last_peered":"2024-04-23T10:28:42.735374+0000","last_clean":"2024-04-23T10:28:42.735374+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:28:42.735374+0000","last_undegraded":"2024-04-23T10:28:42.735374+0000","last_fullsized":"2024-04-23T10:28:42.735374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'81","reported_seq":122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.523527+0000","last_change":"2024-04-23T10:28:56.523601+0000","last_active":"2024-04-23T10:28:56.523527+0000","last_peered":"2024-04-23T10:28:56.523527+0000","last_clean":"2024-04-23T10:28:56.523527+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:28:56.523527+0000","last_undegraded":"2024-04-23T10:28:56.523527+0000","last_fullsized":"2024-04-23T10:28:56.523527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'81","last_scrub_stamp":"2024-04-23T10:28:56.523356+0000","last_deep_scrub":"26'81","last_deep_scrub_stamp":"2024-04-23T10:28:56.523356+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.523356+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:41.765874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.551328+0000","last_change":"2024-04-23T10:28:58.551400+0000","last_active":"2024-04-23T10:28:58.551328+0000","last_peered":"2024-04-23T10:28:58.551328+0000","last_clean":"2024-04-23T10:28:58.551328+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:28:58.551328+0000","last_undegraded":"2024-04-23T10:28:58.551328+0000","last_fullsized":"2024-04-23T10:28:58.551328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-23T10:28:58.551162+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-23T10:28:58.551162+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.551162+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:49:47.778050+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'772","reported_seq":889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.680879+0000","last_change":"2024-04-23T10:29:08.681009+0000","last_active":"2024-04-23T10:29:08.680879+0000","last_peered":"2024-04-23T10:29:08.680879+0000","last_clean":"2024-04-23T10:29:08.680879+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:29:08.680879+0000","last_undegraded":"2024-04-23T10:29:08.680879+0000","last_fullsized":"2024-04-23T10:29:08.680879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'772","last_scrub_stamp":"2024-04-23T10:29:08.680640+0000","last_deep_scrub":"26'772","last_deep_scrub_stamp":"2024-04-23T10:29:08.680640+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.680640+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:54.429502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47063,"num_write":757,"num_write_kb":125918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'204","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.721146+0000","last_change":"2024-04-23T10:15:38.042339+0000","last_active":"2024-04-23T10:28:55.721146+0000","last_peered":"2024-04-23T10:28:55.721146+0000","last_clean":"2024-04-23T10:28:55.721146+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:28:55.721146+0000","last_undegraded":"2024-04-23T10:28:55.721146+0000","last_fullsized":"2024-04-23T10:28:55.721146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'66","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.053473+0000","last_change":"2024-04-23T10:28:55.053473+0000","last_active":"2024-04-23T10:28:55.053473+0000","last_peered":"2024-04-23T10:28:55.053473+0000","last_clean":"2024-04-23T10:28:55.053473+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:28:55.053473+0000","last_undegraded":"2024-04-23T10:28:55.053473+0000","last_fullsized":"2024-04-23T10:28:55.053473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'66","last_scrub_stamp":"2024-04-23T10:28:55.053307+0000","last_deep_scrub":"26'66","last_deep_scrub_stamp":"2024-04-23T10:28:55.053307+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.053307+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:45:04.175802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'800","reported_seq":931,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.701099+0000","last_change":"2024-04-23T10:29:07.701166+0000","last_active":"2024-04-23T10:29:07.701099+0000","last_peered":"2024-04-23T10:29:07.701099+0000","last_clean":"2024-04-23T10:29:07.701099+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:29:07.701099+0000","last_undegraded":"2024-04-23T10:29:07.701099+0000","last_fullsized":"2024-04-23T10:29:07.701099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'800","last_scrub_stamp":"2024-04-23T10:29:07.700919+0000","last_deep_scrub":"26'800","last_deep_scrub_stamp":"2024-04-23T10:29:07.700919+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.700919+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:20:23.429978+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":46277,"num_write":791,"num_write_kb":155967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.410988+0000","last_change":"2024-04-23T10:29:03.410988+0000","last_active":"2024-04-23T10:29:03.410988+0000","last_peered":"2024-04-23T10:29:03.410988+0000","last_clean":"2024-04-23T10:29:03.410988+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:29:03.410988+0000","last_undegraded":"2024-04-23T10:29:03.410988+0000","last_fullsized":"2024-04-23T10:29:03.410988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-23T10:29:03.410753+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-23T10:29:03.410753+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.410753+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:25.236193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'675","reported_seq":716,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.147847+0000","last_change":"2024-04-23T10:28:55.147847+0000","last_active":"2024-04-23T10:28:55.147847+0000","last_peered":"2024-04-23T10:28:55.147847+0000","last_clean":"2024-04-23T10:28:55.147847+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:28:55.147847+0000","last_undegraded":"2024-04-23T10:28:55.147847+0000","last_fullsized":"2024-04-23T10:28:55.147847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'675","last_scrub_stamp":"2024-04-23T10:28:55.147739+0000","last_deep_scrub":"26'675","last_deep_scrub_stamp":"2024-04-23T10:28:55.147739+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.147739+0000","objects_scrubbed":2,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:15:35.423709+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'770","reported_seq":900,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.026635+0000","last_change":"2024-04-23T10:29:06.026635+0000","last_active":"2024-04-23T10:29:06.026635+0000","last_peered":"2024-04-23T10:29:06.026635+0000","last_clean":"2024-04-23T10:29:06.026635+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:29:06.026635+0000","last_undegraded":"2024-04-23T10:29:06.026635+0000","last_fullsized":"2024-04-23T10:29:06.026635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'770","last_scrub_stamp":"2024-04-23T10:29:06.026374+0000","last_deep_scrub":"26'770","last_deep_scrub_stamp":"2024-04-23T10:29:06.026374+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.026374+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:03.872920+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":57774,"num_write":776,"num_write_kb":117908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'202","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.674451+0000","last_change":"2024-04-23T10:29:06.674451+0000","last_active":"2024-04-23T10:29:06.674451+0000","last_peered":"2024-04-23T10:29:06.674451+0000","last_clean":"2024-04-23T10:29:06.674451+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:29:06.674451+0000","last_undegraded":"2024-04-23T10:29:06.674451+0000","last_fullsized":"2024-04-23T10:29:06.674451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-23T10:29:06.674217+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-23T10:29:06.674217+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.674217+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:17.140224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'440","reported_seq":481,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.097294+0000","last_change":"2024-04-23T10:28:54.097294+0000","last_active":"2024-04-23T10:28:54.097294+0000","last_peered":"2024-04-23T10:28:54.097294+0000","last_clean":"2024-04-23T10:28:54.097294+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:28:54.097294+0000","last_undegraded":"2024-04-23T10:28:54.097294+0000","last_fullsized":"2024-04-23T10:28:54.097294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'440","last_scrub_stamp":"2024-04-23T10:28:54.097133+0000","last_deep_scrub":"26'440","last_deep_scrub_stamp":"2024-04-23T10:28:54.097133+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.097133+0000","objects_scrubbed":3,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:43.795864+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'820","reported_seq":998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:10.539842+0000","last_change":"2024-04-23T10:29:10.539906+0000","last_active":"2024-04-23T10:29:10.539842+0000","last_peered":"2024-04-23T10:29:10.539842+0000","last_clean":"2024-04-23T10:29:10.539842+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:29:10.539842+0000","last_undegraded":"2024-04-23T10:29:10.539842+0000","last_fullsized":"2024-04-23T10:29:10.539842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'820","last_scrub_stamp":"2024-04-23T10:29:10.539649+0000","last_deep_scrub":"26'820","last_deep_scrub_stamp":"2024-04-23T10:29:10.539649+0000","last_clean_scrub_stamp":"2024-04-23T10:29:10.539649+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:23:00.534854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":78747,"num_write":811,"num_write_kb":155987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'186","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.699902+0000","last_change":"2024-04-23T10:29:05.699902+0000","last_active":"2024-04-23T10:29:05.699902+0000","last_peered":"2024-04-23T10:29:05.699902+0000","last_clean":"2024-04-23T10:29:05.699902+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:29:05.699902+0000","last_undegraded":"2024-04-23T10:29:05.699902+0000","last_fullsized":"2024-04-23T10:29:05.699902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'186","last_scrub_stamp":"2024-04-23T10:29:05.699573+0000","last_deep_scrub":"26'186","last_deep_scrub_stamp":"2024-04-23T10:29:05.699573+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.699573+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:04:25.350216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'190","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.412772+0000","last_change":"2024-04-23T10:28:54.412772+0000","last_active":"2024-04-23T10:28:54.412772+0000","last_peered":"2024-04-23T10:28:54.412772+0000","last_clean":"2024-04-23T10:28:54.412772+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:28:54.412772+0000","last_undegraded":"2024-04-23T10:28:54.412772+0000","last_fullsized":"2024-04-23T10:28:54.412772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'190","last_scrub_stamp":"2024-04-23T10:28:54.412515+0000","last_deep_scrub":"26'190","last_deep_scrub_stamp":"2024-04-23T10:28:54.412515+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.412515+0000","objects_scrubbed":3,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:56.215284+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'819","reported_seq":914,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.375704+0000","last_change":"2024-04-23T10:29:02.375769+0000","last_active":"2024-04-23T10:29:02.375704+0000","last_peered":"2024-04-23T10:29:02.375704+0000","last_clean":"2024-04-23T10:29:02.375704+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:29:02.375704+0000","last_undegraded":"2024-04-23T10:29:02.375704+0000","last_fullsized":"2024-04-23T10:29:02.375704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'819","last_scrub_stamp":"2024-04-23T10:29:02.375504+0000","last_deep_scrub":"26'819","last_deep_scrub_stamp":"2024-04-23T10:29:02.375504+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.375504+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:58.020629+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":36072,"num_write":807,"num_write_kb":130604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.709028+0000","last_change":"2024-04-23T10:29:07.709092+0000","last_active":"2024-04-23T10:29:07.709028+0000","last_peered":"2024-04-23T10:29:07.709028+0000","last_clean":"2024-04-23T10:29:07.709028+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:29:07.709028+0000","last_undegraded":"2024-04-23T10:29:07.709028+0000","last_fullsized":"2024-04-23T10:29:07.709028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'235","last_scrub_stamp":"2024-04-23T10:29:07.708856+0000","last_deep_scrub":"26'235","last_deep_scrub_stamp":"2024-04-23T10:29:07.708856+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.708856+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:25.935475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'283","reported_seq":323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:53.140765+0000","last_change":"2024-04-23T10:28:53.140824+0000","last_active":"2024-04-23T10:28:53.140765+0000","last_peered":"2024-04-23T10:28:53.140765+0000","last_clean":"2024-04-23T10:28:53.140765+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:28:53.140765+0000","last_undegraded":"2024-04-23T10:28:53.140765+0000","last_fullsized":"2024-04-23T10:28:53.140765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'283","last_scrub_stamp":"2024-04-23T10:28:53.140676+0000","last_deep_scrub":"26'283","last_deep_scrub_stamp":"2024-04-23T10:28:53.140676+0000","last_clean_scrub_stamp":"2024-04-23T10:28:53.140676+0000","objects_scrubbed":9,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:15.458449+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'783","reported_seq":899,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.033512+0000","last_change":"2024-04-23T10:29:05.033638+0000","last_active":"2024-04-23T10:29:05.033512+0000","last_peered":"2024-04-23T10:29:05.033512+0000","last_clean":"2024-04-23T10:29:05.033512+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:29:05.033512+0000","last_undegraded":"2024-04-23T10:29:05.033512+0000","last_fullsized":"2024-04-23T10:29:05.033512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'783","last_scrub_stamp":"2024-04-23T10:29:05.033187+0000","last_deep_scrub":"26'783","last_deep_scrub_stamp":"2024-04-23T10:29:05.033187+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.033187+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:06:51.550414+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":28210,"num_write":769,"num_write_kb":122559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":258,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.727013+0000","last_change":"2024-04-23T10:29:04.727074+0000","last_active":"2024-04-23T10:29:04.727013+0000","last_peered":"2024-04-23T10:29:04.727013+0000","last_clean":"2024-04-23T10:29:04.727013+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:29:04.727013+0000","last_undegraded":"2024-04-23T10:29:04.727013+0000","last_fullsized":"2024-04-23T10:29:04.727013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'220","last_scrub_stamp":"2024-04-23T10:29:04.726838+0000","last_deep_scrub":"26'220","last_deep_scrub_stamp":"2024-04-23T10:29:04.726838+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.726838+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:52:56.493620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'69","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.823226+0000","last_change":"2024-04-23T10:28:57.823300+0000","last_active":"2024-04-23T10:28:57.823226+0000","last_peered":"2024-04-23T10:28:57.823226+0000","last_clean":"2024-04-23T10:28:57.823226+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:28:57.823226+0000","last_undegraded":"2024-04-23T10:28:57.823226+0000","last_fullsized":"2024-04-23T10:28:57.823226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'69","last_scrub_stamp":"2024-04-23T10:28:57.823057+0000","last_deep_scrub":"26'69","last_deep_scrub_stamp":"2024-04-23T10:28:57.823057+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.823057+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:13.345688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'801","reported_seq":941,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.681990+0000","last_change":"2024-04-23T10:29:07.682120+0000","last_active":"2024-04-23T10:29:07.681990+0000","last_peered":"2024-04-23T10:29:07.681990+0000","last_clean":"2024-04-23T10:29:07.681990+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:29:07.681990+0000","last_undegraded":"2024-04-23T10:29:07.681990+0000","last_fullsized":"2024-04-23T10:29:07.681990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'801","last_scrub_stamp":"2024-04-23T10:29:07.681760+0000","last_deep_scrub":"26'801","last_deep_scrub_stamp":"2024-04-23T10:29:07.681760+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.681760+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:39.212996+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":64319,"num_write":793,"num_write_kb":152801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'200","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:10.744778+0000","last_change":"2024-04-23T10:29:10.744867+0000","last_active":"2024-04-23T10:29:10.744778+0000","last_peered":"2024-04-23T10:29:10.744778+0000","last_clean":"2024-04-23T10:29:10.744778+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:29:10.744778+0000","last_undegraded":"2024-04-23T10:29:10.744778+0000","last_fullsized":"2024-04-23T10:29:10.744778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:29:10.744612+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:29:10.744612+0000","last_clean_scrub_stamp":"2024-04-23T10:29:10.744612+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:41.916697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'74","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.453314+0000","last_change":"2024-04-23T10:28:59.453383+0000","last_active":"2024-04-23T10:28:59.453314+0000","last_peered":"2024-04-23T10:28:59.453314+0000","last_clean":"2024-04-23T10:28:59.453314+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:28:59.453314+0000","last_undegraded":"2024-04-23T10:28:59.453314+0000","last_fullsized":"2024-04-23T10:28:59.453314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'74","last_scrub_stamp":"2024-04-23T10:28:59.453139+0000","last_deep_scrub":"26'74","last_deep_scrub_stamp":"2024-04-23T10:28:59.453139+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.453139+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:46.438687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'716","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:10.622140+0000","last_change":"2024-04-23T10:29:10.622212+0000","last_active":"2024-04-23T10:29:10.622140+0000","last_peered":"2024-04-23T10:29:10.622140+0000","last_clean":"2024-04-23T10:29:10.622140+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:29:10.622140+0000","last_undegraded":"2024-04-23T10:29:10.622140+0000","last_fullsized":"2024-04-23T10:29:10.622140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'716","last_scrub_stamp":"2024-04-23T10:29:10.621941+0000","last_deep_scrub":"26'716","last_deep_scrub_stamp":"2024-04-23T10:29:10.621941+0000","last_clean_scrub_stamp":"2024-04-23T10:29:10.621941+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:01.788765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50110,"num_write":710,"num_write_kb":147181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'208","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.048040+0000","last_change":"2024-04-23T10:29:04.048097+0000","last_active":"2024-04-23T10:29:04.048040+0000","last_peered":"2024-04-23T10:29:04.048040+0000","last_clean":"2024-04-23T10:29:04.048040+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:29:04.048040+0000","last_undegraded":"2024-04-23T10:29:04.048040+0000","last_fullsized":"2024-04-23T10:29:04.048040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:29:04.047871+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:29:04.047871+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.047871+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:44:36.899916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'602","reported_seq":642,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.050952+0000","last_change":"2024-04-23T10:28:54.051036+0000","last_active":"2024-04-23T10:28:54.050952+0000","last_peered":"2024-04-23T10:28:54.050952+0000","last_clean":"2024-04-23T10:28:54.050952+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:28:54.050952+0000","last_undegraded":"2024-04-23T10:28:54.050952+0000","last_fullsized":"2024-04-23T10:28:54.050952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'602","last_scrub_stamp":"2024-04-23T10:28:54.050808+0000","last_deep_scrub":"26'602","last_deep_scrub_stamp":"2024-04-23T10:28:54.050808+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.050808+0000","objects_scrubbed":8,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:54.710413+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.525835+0000","last_change":"2024-04-23T10:29:09.525910+0000","last_active":"2024-04-23T10:29:09.525835+0000","last_peered":"2024-04-23T10:29:09.525835+0000","last_clean":"2024-04-23T10:29:09.525835+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:29:09.525835+0000","last_undegraded":"2024-04-23T10:29:09.525835+0000","last_fullsized":"2024-04-23T10:29:09.525835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'753","last_scrub_stamp":"2024-04-23T10:29:09.525616+0000","last_deep_scrub":"26'753","last_deep_scrub_stamp":"2024-04-23T10:29:09.525616+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.525616+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:25:14.099613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41492,"num_write":740,"num_write_kb":126321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:42.777940+0000","last_change":"2024-04-23T10:15:38.041999+0000","last_active":"2024-04-23T10:28:42.777940+0000","last_peered":"2024-04-23T10:28:42.777940+0000","last_clean":"2024-04-23T10:28:42.777940+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:28:42.777940+0000","last_undegraded":"2024-04-23T10:28:42.777940+0000","last_fullsized":"2024-04-23T10:28:42.777940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'454","reported_seq":494,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.922916+0000","last_change":"2024-04-23T10:28:55.922992+0000","last_active":"2024-04-23T10:28:55.922916+0000","last_peered":"2024-04-23T10:28:55.922916+0000","last_clean":"2024-04-23T10:28:55.922916+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:28:55.922916+0000","last_undegraded":"2024-04-23T10:28:55.922916+0000","last_fullsized":"2024-04-23T10:28:55.922916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'454","last_scrub_stamp":"2024-04-23T10:28:55.922753+0000","last_deep_scrub":"26'454","last_deep_scrub_stamp":"2024-04-23T10:28:55.922753+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.922753+0000","objects_scrubbed":8,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:37.132927+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'781","reported_seq":865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.040041+0000","last_change":"2024-04-23T10:29:05.040129+0000","last_active":"2024-04-23T10:29:05.040041+0000","last_peered":"2024-04-23T10:29:05.040041+0000","last_clean":"2024-04-23T10:29:05.040041+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:29:05.040041+0000","last_undegraded":"2024-04-23T10:29:05.040041+0000","last_fullsized":"2024-04-23T10:29:05.040041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'781","last_scrub_stamp":"2024-04-23T10:29:05.039823+0000","last_deep_scrub":"26'781","last_deep_scrub_stamp":"2024-04-23T10:29:05.039823+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.039823+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:48:12.282438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":27921,"num_write":758,"num_write_kb":97957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'198","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.073457+0000","last_change":"2024-04-23T10:29:01.073517+0000","last_active":"2024-04-23T10:29:01.073457+0000","last_peered":"2024-04-23T10:29:01.073457+0000","last_clean":"2024-04-23T10:29:01.073457+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:29:01.073457+0000","last_undegraded":"2024-04-23T10:29:01.073457+0000","last_fullsized":"2024-04-23T10:29:01.073457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'198","last_scrub_stamp":"2024-04-23T10:29:01.073289+0000","last_deep_scrub":"26'198","last_deep_scrub_stamp":"2024-04-23T10:29:01.073289+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.073289+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:45.176247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"26'363","reported_seq":403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.158077+0000","last_change":"2024-04-23T10:28:59.158152+0000","last_active":"2024-04-23T10:28:59.158077+0000","last_peered":"2024-04-23T10:28:59.158077+0000","last_clean":"2024-04-23T10:28:59.158077+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:28:59.158077+0000","last_undegraded":"2024-04-23T10:28:59.158077+0000","last_fullsized":"2024-04-23T10:28:59.158077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'363","last_scrub_stamp":"2024-04-23T10:28:59.157909+0000","last_deep_scrub":"26'363","last_deep_scrub_stamp":"2024-04-23T10:28:59.157909+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.157909+0000","objects_scrubbed":5,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:55.747926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1387233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'726","reported_seq":846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.341489+0000","last_change":"2024-04-23T10:29:03.341641+0000","last_active":"2024-04-23T10:29:03.341489+0000","last_peered":"2024-04-23T10:29:03.341489+0000","last_clean":"2024-04-23T10:29:03.341489+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:29:03.341489+0000","last_undegraded":"2024-04-23T10:29:03.341489+0000","last_fullsized":"2024-04-23T10:29:03.341489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'726","last_scrub_stamp":"2024-04-23T10:29:03.341265+0000","last_deep_scrub":"26'726","last_deep_scrub_stamp":"2024-04-23T10:29:03.341265+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.341265+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:59.451383+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44100,"num_write":714,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.063873+0000","last_change":"2024-04-23T10:29:01.063935+0000","last_active":"2024-04-23T10:29:01.063873+0000","last_peered":"2024-04-23T10:29:01.063873+0000","last_clean":"2024-04-23T10:29:01.063873+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:29:01.063873+0000","last_undegraded":"2024-04-23T10:29:01.063873+0000","last_fullsized":"2024-04-23T10:29:01.063873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'199","last_scrub_stamp":"2024-04-23T10:29:01.063695+0000","last_deep_scrub":"26'199","last_deep_scrub_stamp":"2024-04-23T10:29:01.063695+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.063695+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:34:17.921069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'240","reported_seq":280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.518911+0000","last_change":"2024-04-23T10:29:00.518985+0000","last_active":"2024-04-23T10:29:00.518911+0000","last_peered":"2024-04-23T10:29:00.518911+0000","last_clean":"2024-04-23T10:29:00.518911+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:29:00.518911+0000","last_undegraded":"2024-04-23T10:29:00.518911+0000","last_fullsized":"2024-04-23T10:29:00.518911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'240","last_scrub_stamp":"2024-04-23T10:29:00.518718+0000","last_deep_scrub":"26'240","last_deep_scrub_stamp":"2024-04-23T10:29:00.518718+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.518718+0000","objects_scrubbed":3,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:30.135187+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'829","reported_seq":962,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.689389+0000","last_change":"2024-04-23T10:29:06.689452+0000","last_active":"2024-04-23T10:29:06.689389+0000","last_peered":"2024-04-23T10:29:06.689389+0000","last_clean":"2024-04-23T10:29:06.689389+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:29:06.689389+0000","last_undegraded":"2024-04-23T10:29:06.689389+0000","last_fullsized":"2024-04-23T10:29:06.689389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'829","last_scrub_stamp":"2024-04-23T10:29:06.689202+0000","last_deep_scrub":"26'829","last_deep_scrub_stamp":"2024-04-23T10:29:06.689202+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.689202+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:50:46.066802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":58607,"num_write":815,"num_write_kb":134637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'221","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.426120+0000","last_change":"2024-04-23T10:29:06.426183+0000","last_active":"2024-04-23T10:29:06.426120+0000","last_peered":"2024-04-23T10:29:06.426120+0000","last_clean":"2024-04-23T10:29:06.426120+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:29:06.426120+0000","last_undegraded":"2024-04-23T10:29:06.426120+0000","last_fullsized":"2024-04-23T10:29:06.426120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'221","last_scrub_stamp":"2024-04-23T10:29:06.425929+0000","last_deep_scrub":"26'221","last_deep_scrub_stamp":"2024-04-23T10:29:06.425929+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.425929+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:49:51.477844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'72","reported_seq":112,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.790140+0000","last_change":"2024-04-23T10:28:58.790289+0000","last_active":"2024-04-23T10:28:58.790140+0000","last_peered":"2024-04-23T10:28:58.790140+0000","last_clean":"2024-04-23T10:28:58.790140+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:28:58.790140+0000","last_undegraded":"2024-04-23T10:28:58.790140+0000","last_fullsized":"2024-04-23T10:28:58.790140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'72","last_scrub_stamp":"2024-04-23T10:28:58.789937+0000","last_deep_scrub":"26'72","last_deep_scrub_stamp":"2024-04-23T10:28:58.789937+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.789937+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:08:41.338880+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'829","reported_seq":956,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.706032+0000","last_change":"2024-04-23T10:29:08.706097+0000","last_active":"2024-04-23T10:29:08.706032+0000","last_peered":"2024-04-23T10:29:08.706032+0000","last_clean":"2024-04-23T10:29:08.706032+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:29:08.706032+0000","last_undegraded":"2024-04-23T10:29:08.706032+0000","last_fullsized":"2024-04-23T10:29:08.706032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'829","last_scrub_stamp":"2024-04-23T10:29:08.705859+0000","last_deep_scrub":"26'829","last_deep_scrub_stamp":"2024-04-23T10:29:08.705859+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.705859+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:40:24.745471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":52124,"num_write":807,"num_write_kb":167221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'853","reported_seq":1009,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.005835+0000","last_change":"2024-04-23T10:29:08.005897+0000","last_active":"2024-04-23T10:29:08.005835+0000","last_peered":"2024-04-23T10:29:08.005835+0000","last_clean":"2024-04-23T10:29:08.005835+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:29:08.005835+0000","last_undegraded":"2024-04-23T10:29:08.005835+0000","last_fullsized":"2024-04-23T10:29:08.005835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'853","last_scrub_stamp":"2024-04-23T10:29:08.005654+0000","last_deep_scrub":"26'853","last_deep_scrub_stamp":"2024-04-23T10:29:08.005654+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.005654+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:50.883554+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":70228,"num_write":840,"num_write_kb":218801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.153241+0000","last_change":"2024-04-23T10:29:00.153382+0000","last_active":"2024-04-23T10:29:00.153241+0000","last_peered":"2024-04-23T10:29:00.153241+0000","last_clean":"2024-04-23T10:29:00.153241+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:29:00.153241+0000","last_undegraded":"2024-04-23T10:29:00.153241+0000","last_fullsized":"2024-04-23T10:29:00.153241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-23T10:29:00.152982+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-23T10:29:00.152982+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.152982+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:30.620696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1126","reported_seq":1166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.558589+0000","last_change":"2024-04-23T10:28:57.558668+0000","last_active":"2024-04-23T10:28:57.558589+0000","last_peered":"2024-04-23T10:28:57.558589+0000","last_clean":"2024-04-23T10:28:57.558589+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:28:57.558589+0000","last_undegraded":"2024-04-23T10:28:57.558589+0000","last_fullsized":"2024-04-23T10:28:57.558589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1126","last_scrub_stamp":"2024-04-23T10:28:57.558416+0000","last_deep_scrub":"26'1126","last_deep_scrub_stamp":"2024-04-23T10:28:57.558416+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.558416+0000","objects_scrubbed":3,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:00.596690+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'763","reported_seq":857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.723012+0000","last_change":"2024-04-23T10:29:06.723074+0000","last_active":"2024-04-23T10:29:06.723012+0000","last_peered":"2024-04-23T10:29:06.723012+0000","last_clean":"2024-04-23T10:29:06.723012+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:29:06.723012+0000","last_undegraded":"2024-04-23T10:29:06.723012+0000","last_fullsized":"2024-04-23T10:29:06.723012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'763","last_scrub_stamp":"2024-04-23T10:29:06.722829+0000","last_deep_scrub":"26'763","last_deep_scrub_stamp":"2024-04-23T10:29:06.722829+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.722829+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:25:47.675932+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":755,"num_write_kb":160183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'223","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.714879+0000","last_change":"2024-04-23T10:29:02.715021+0000","last_active":"2024-04-23T10:29:02.714879+0000","last_peered":"2024-04-23T10:29:02.714879+0000","last_clean":"2024-04-23T10:29:02.714879+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:29:02.714879+0000","last_undegraded":"2024-04-23T10:29:02.714879+0000","last_fullsized":"2024-04-23T10:29:02.714879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'223","last_scrub_stamp":"2024-04-23T10:29:02.714597+0000","last_deep_scrub":"26'223","last_deep_scrub_stamp":"2024-04-23T10:29:02.714597+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.714597+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:00:26.725013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'104","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.722382+0000","last_change":"2024-04-23T10:28:59.722471+0000","last_active":"2024-04-23T10:28:59.722382+0000","last_peered":"2024-04-23T10:28:59.722382+0000","last_clean":"2024-04-23T10:28:59.722382+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:28:59.722382+0000","last_undegraded":"2024-04-23T10:28:59.722382+0000","last_fullsized":"2024-04-23T10:28:59.722382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'104","last_scrub_stamp":"2024-04-23T10:28:59.722146+0000","last_deep_scrub":"26'104","last_deep_scrub_stamp":"2024-04-23T10:28:59.722146+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.722146+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:41.981739+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'352","reported_seq":392,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.884027+0000","last_change":"2024-04-23T10:28:56.884168+0000","last_active":"2024-04-23T10:28:56.884027+0000","last_peered":"2024-04-23T10:28:56.884027+0000","last_clean":"2024-04-23T10:28:56.884027+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:28:56.884027+0000","last_undegraded":"2024-04-23T10:28:56.884027+0000","last_fullsized":"2024-04-23T10:28:56.884027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'352","last_scrub_stamp":"2024-04-23T10:28:56.883809+0000","last_deep_scrub":"26'352","last_deep_scrub_stamp":"2024-04-23T10:28:56.883809+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.883809+0000","objects_scrubbed":6,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:31.280038+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":12468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'181","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.037212+0000","last_change":"2024-04-23T10:28:56.037272+0000","last_active":"2024-04-23T10:28:56.037212+0000","last_peered":"2024-04-23T10:28:56.037212+0000","last_clean":"2024-04-23T10:28:56.037212+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:56.037212+0000","last_undegraded":"2024-04-23T10:28:56.037212+0000","last_fullsized":"2024-04-23T10:28:56.037212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'181","last_scrub_stamp":"2024-04-23T10:28:56.037023+0000","last_deep_scrub":"26'181","last_deep_scrub_stamp":"2024-04-23T10:28:56.037023+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.037023+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:51:40.331673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'746","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.092430+0000","last_change":"2024-04-23T10:28:59.092520+0000","last_active":"2024-04-23T10:28:59.092430+0000","last_peered":"2024-04-23T10:28:59.092430+0000","last_clean":"2024-04-23T10:28:59.092430+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:28:59.092430+0000","last_undegraded":"2024-04-23T10:28:59.092430+0000","last_fullsized":"2024-04-23T10:28:59.092430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'746","last_scrub_stamp":"2024-04-23T10:28:59.092228+0000","last_deep_scrub":"26'746","last_deep_scrub_stamp":"2024-04-23T10:28:59.092228+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.092228+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:36.748144+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":53240,"num_write":729,"num_write_kb":139197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'113","reported_seq":153,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.757504+0000","last_change":"2024-04-23T10:29:00.757575+0000","last_active":"2024-04-23T10:29:00.757504+0000","last_peered":"2024-04-23T10:29:00.757504+0000","last_clean":"2024-04-23T10:29:00.757504+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:29:00.757504+0000","last_undegraded":"2024-04-23T10:29:00.757504+0000","last_fullsized":"2024-04-23T10:29:00.757504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'113","last_scrub_stamp":"2024-04-23T10:29:00.757321+0000","last_deep_scrub":"26'113","last_deep_scrub_stamp":"2024-04-23T10:29:00.757321+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.757321+0000","objects_scrubbed":3,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:24.908268+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'206","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.419844+0000","last_change":"2024-04-23T10:28:58.419961+0000","last_active":"2024-04-23T10:28:58.419844+0000","last_peered":"2024-04-23T10:28:58.419844+0000","last_clean":"2024-04-23T10:28:58.419844+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:28:58.419844+0000","last_undegraded":"2024-04-23T10:28:58.419844+0000","last_fullsized":"2024-04-23T10:28:58.419844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:28:58.419626+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:28:58.419626+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.419626+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:27:12.971853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'701","reported_seq":784,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:39.224076+0000","last_change":"2024-04-23T10:16:26.958520+0000","last_active":"2024-04-23T10:28:39.224076+0000","last_peered":"2024-04-23T10:28:39.224076+0000","last_clean":"2024-04-23T10:28:39.224076+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:28:39.224076+0000","last_undegraded":"2024-04-23T10:28:39.224076+0000","last_fullsized":"2024-04-23T10:28:39.224076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:41.035204+0000","last_clean_scrub_stamp":"2024-04-23T10:15:41.035204+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24902,"num_write":688,"num_write_kb":109624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'212","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.787937+0000","last_change":"2024-04-23T10:29:01.787995+0000","last_active":"2024-04-23T10:29:01.787937+0000","last_peered":"2024-04-23T10:29:01.787937+0000","last_clean":"2024-04-23T10:29:01.787937+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:29:01.787937+0000","last_undegraded":"2024-04-23T10:29:01.787937+0000","last_fullsized":"2024-04-23T10:29:01.787937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-23T10:29:01.787754+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-23T10:29:01.787754+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.787754+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:22:18.521542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'216","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.079260+0000","last_change":"2024-04-23T10:28:57.079321+0000","last_active":"2024-04-23T10:28:57.079260+0000","last_peered":"2024-04-23T10:28:57.079260+0000","last_clean":"2024-04-23T10:28:57.079260+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:28:57.079260+0000","last_undegraded":"2024-04-23T10:28:57.079260+0000","last_fullsized":"2024-04-23T10:28:57.079260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-23T10:28:57.079091+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-23T10:28:57.079091+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.079091+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:56:53.700052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'240","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.113555+0000","last_change":"2024-04-23T10:29:00.113614+0000","last_active":"2024-04-23T10:29:00.113555+0000","last_peered":"2024-04-23T10:29:00.113555+0000","last_clean":"2024-04-23T10:29:00.113555+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:29:00.113555+0000","last_undegraded":"2024-04-23T10:29:00.113555+0000","last_fullsized":"2024-04-23T10:29:00.113555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'240","last_scrub_stamp":"2024-04-23T10:29:00.113380+0000","last_deep_scrub":"26'240","last_deep_scrub_stamp":"2024-04-23T10:29:00.113380+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.113380+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:53.434504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.087546+0000","last_change":"2024-04-23T10:28:57.087605+0000","last_active":"2024-04-23T10:28:57.087546+0000","last_peered":"2024-04-23T10:28:57.087546+0000","last_clean":"2024-04-23T10:28:57.087546+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:28:57.087546+0000","last_undegraded":"2024-04-23T10:28:57.087546+0000","last_fullsized":"2024-04-23T10:28:57.087546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:28:57.087368+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:28:57.087368+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.087368+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:23.149238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'187","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.646651+0000","last_change":"2024-04-23T10:28:57.646711+0000","last_active":"2024-04-23T10:28:57.646651+0000","last_peered":"2024-04-23T10:28:57.646651+0000","last_clean":"2024-04-23T10:28:57.646651+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:28:57.646651+0000","last_undegraded":"2024-04-23T10:28:57.646651+0000","last_fullsized":"2024-04-23T10:28:57.646651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:28:57.646467+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:28:57.646467+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.646467+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:15:19.815560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'203","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:53.057266+0000","last_change":"2024-04-23T10:28:53.057322+0000","last_active":"2024-04-23T10:28:53.057266+0000","last_peered":"2024-04-23T10:28:53.057266+0000","last_clean":"2024-04-23T10:28:53.057266+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:28:53.057266+0000","last_undegraded":"2024-04-23T10:28:53.057266+0000","last_fullsized":"2024-04-23T10:28:53.057266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-23T10:28:53.057101+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-23T10:28:53.057101+0000","last_clean_scrub_stamp":"2024-04-23T10:28:53.057101+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:03:42.691173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'239","reported_seq":283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.715567+0000","last_change":"2024-04-23T10:29:09.715633+0000","last_active":"2024-04-23T10:29:09.715567+0000","last_peered":"2024-04-23T10:29:09.715567+0000","last_clean":"2024-04-23T10:29:09.715567+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:29:09.715567+0000","last_undegraded":"2024-04-23T10:29:09.715567+0000","last_fullsized":"2024-04-23T10:29:09.715567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'239","last_scrub_stamp":"2024-04-23T10:29:09.715395+0000","last_deep_scrub":"26'239","last_deep_scrub_stamp":"2024-04-23T10:29:09.715395+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.715395+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:31:38.473429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.705622+0000","last_change":"2024-04-23T10:28:55.705667+0000","last_active":"2024-04-23T10:28:55.705622+0000","last_peered":"2024-04-23T10:28:55.705622+0000","last_clean":"2024-04-23T10:28:55.705622+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:28:55.705622+0000","last_undegraded":"2024-04-23T10:28:55.705622+0000","last_fullsized":"2024-04-23T10:28:55.705622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-23T10:28:55.705507+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-23T10:28:55.705507+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.705507+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:59.108345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'218","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.452203+0000","last_change":"2024-04-23T10:29:02.452322+0000","last_active":"2024-04-23T10:29:02.452203+0000","last_peered":"2024-04-23T10:29:02.452203+0000","last_clean":"2024-04-23T10:29:02.452203+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:29:02.452203+0000","last_undegraded":"2024-04-23T10:29:02.452203+0000","last_fullsized":"2024-04-23T10:29:02.452203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-23T10:29:02.451927+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-23T10:29:02.451927+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.451927+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:09.561742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'204","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.709600+0000","last_change":"2024-04-23T10:29:01.709600+0000","last_active":"2024-04-23T10:29:01.709600+0000","last_peered":"2024-04-23T10:29:01.709600+0000","last_clean":"2024-04-23T10:29:01.709600+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:29:01.709600+0000","last_undegraded":"2024-04-23T10:29:01.709600+0000","last_fullsized":"2024-04-23T10:29:01.709600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:29:01.709261+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:29:01.709261+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.709261+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:13.109776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'207","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.469908+0000","last_change":"2024-04-23T10:29:08.469908+0000","last_active":"2024-04-23T10:29:08.469908+0000","last_peered":"2024-04-23T10:29:08.469908+0000","last_clean":"2024-04-23T10:29:08.469908+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:29:08.469908+0000","last_undegraded":"2024-04-23T10:29:08.469908+0000","last_fullsized":"2024-04-23T10:29:08.469908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-23T10:29:08.469660+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-23T10:29:08.469660+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.469660+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:32.184740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'209","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.097601+0000","last_change":"2024-04-23T10:29:03.097601+0000","last_active":"2024-04-23T10:29:03.097601+0000","last_peered":"2024-04-23T10:29:03.097601+0000","last_clean":"2024-04-23T10:29:03.097601+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:29:03.097601+0000","last_undegraded":"2024-04-23T10:29:03.097601+0000","last_fullsized":"2024-04-23T10:29:03.097601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'209","last_scrub_stamp":"2024-04-23T10:29:03.097376+0000","last_deep_scrub":"26'209","last_deep_scrub_stamp":"2024-04-23T10:29:03.097376+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.097376+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:13.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'221","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.778158+0000","last_change":"2024-04-23T10:29:00.778158+0000","last_active":"2024-04-23T10:29:00.778158+0000","last_peered":"2024-04-23T10:29:00.778158+0000","last_clean":"2024-04-23T10:29:00.778158+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:29:00.778158+0000","last_undegraded":"2024-04-23T10:29:00.778158+0000","last_fullsized":"2024-04-23T10:29:00.778158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'221","last_scrub_stamp":"2024-04-23T10:29:00.777915+0000","last_deep_scrub":"26'221","last_deep_scrub_stamp":"2024-04-23T10:29:00.777915+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.777915+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:02:45.077111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'208","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.721316+0000","last_change":"2024-04-23T10:15:38.042389+0000","last_active":"2024-04-23T10:28:55.721316+0000","last_peered":"2024-04-23T10:28:55.721316+0000","last_clean":"2024-04-23T10:28:55.721316+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:28:55.721316+0000","last_undegraded":"2024-04-23T10:28:55.721316+0000","last_fullsized":"2024-04-23T10:28:55.721316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:15:36.966375+0000","last_clean_scrub_stamp":"2024-04-23T10:15:36.966375+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'208","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.106247+0000","last_change":"2024-04-23T10:28:58.106376+0000","last_active":"2024-04-23T10:28:58.106247+0000","last_peered":"2024-04-23T10:28:58.106247+0000","last_clean":"2024-04-23T10:28:58.106247+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:28:58.106247+0000","last_undegraded":"2024-04-23T10:28:58.106247+0000","last_fullsized":"2024-04-23T10:28:58.106247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:28:58.106066+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:28:58.106066+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.106066+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:05.068327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'202","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.439565+0000","last_change":"2024-04-23T10:29:07.439694+0000","last_active":"2024-04-23T10:29:07.439565+0000","last_peered":"2024-04-23T10:29:07.439565+0000","last_clean":"2024-04-23T10:29:07.439565+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:29:07.439565+0000","last_undegraded":"2024-04-23T10:29:07.439565+0000","last_fullsized":"2024-04-23T10:29:07.439565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-23T10:29:07.439316+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-23T10:29:07.439316+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.439316+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:30:47.000661+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.387878+0000","last_change":"2024-04-23T10:29:05.387948+0000","last_active":"2024-04-23T10:29:05.387878+0000","last_peered":"2024-04-23T10:29:05.387878+0000","last_clean":"2024-04-23T10:29:05.387878+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:29:05.387878+0000","last_undegraded":"2024-04-23T10:29:05.387878+0000","last_fullsized":"2024-04-23T10:29:05.387878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'219","last_scrub_stamp":"2024-04-23T10:29:05.387694+0000","last_deep_scrub":"26'219","last_deep_scrub_stamp":"2024-04-23T10:29:05.387694+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.387694+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:15.908474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.128362+0000","last_change":"2024-04-23T10:29:01.128421+0000","last_active":"2024-04-23T10:29:01.128362+0000","last_peered":"2024-04-23T10:29:01.128362+0000","last_clean":"2024-04-23T10:29:01.128362+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:29:01.128362+0000","last_undegraded":"2024-04-23T10:29:01.128362+0000","last_fullsized":"2024-04-23T10:29:01.128362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-23T10:29:01.128184+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-23T10:29:01.128184+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.128184+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:20:34.788689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'211","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.076182+0000","last_change":"2024-04-23T10:29:02.076248+0000","last_active":"2024-04-23T10:29:02.076182+0000","last_peered":"2024-04-23T10:29:02.076182+0000","last_clean":"2024-04-23T10:29:02.076182+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:29:02.076182+0000","last_undegraded":"2024-04-23T10:29:02.076182+0000","last_fullsized":"2024-04-23T10:29:02.076182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'211","last_scrub_stamp":"2024-04-23T10:29:02.075999+0000","last_deep_scrub":"26'211","last_deep_scrub_stamp":"2024-04-23T10:29:02.075999+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.075999+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:32:28.368897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'198","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.679441+0000","last_change":"2024-04-23T10:28:54.679463+0000","last_active":"2024-04-23T10:28:54.679441+0000","last_peered":"2024-04-23T10:28:54.679441+0000","last_clean":"2024-04-23T10:28:54.679441+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:28:54.679441+0000","last_undegraded":"2024-04-23T10:28:54.679441+0000","last_fullsized":"2024-04-23T10:28:54.679441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'198","last_scrub_stamp":"2024-04-23T10:28:54.679364+0000","last_deep_scrub":"26'198","last_deep_scrub_stamp":"2024-04-23T10:28:54.679364+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.679364+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:27:07.120591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'183","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.437357+0000","last_change":"2024-04-23T10:28:55.437487+0000","last_active":"2024-04-23T10:28:55.437357+0000","last_peered":"2024-04-23T10:28:55.437357+0000","last_clean":"2024-04-23T10:28:55.437357+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:28:55.437357+0000","last_undegraded":"2024-04-23T10:28:55.437357+0000","last_fullsized":"2024-04-23T10:28:55.437357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'183","last_scrub_stamp":"2024-04-23T10:28:55.437152+0000","last_deep_scrub":"26'183","last_deep_scrub_stamp":"2024-04-23T10:28:55.437152+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.437152+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:41.948480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.754634+0000","last_change":"2024-04-23T10:29:03.754789+0000","last_active":"2024-04-23T10:29:03.754634+0000","last_peered":"2024-04-23T10:29:03.754634+0000","last_clean":"2024-04-23T10:29:03.754634+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:29:03.754634+0000","last_undegraded":"2024-04-23T10:29:03.754634+0000","last_fullsized":"2024-04-23T10:29:03.754634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'188","last_scrub_stamp":"2024-04-23T10:29:03.754424+0000","last_deep_scrub":"26'188","last_deep_scrub_stamp":"2024-04-23T10:29:03.754424+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.754424+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:15.215698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'200","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.779026+0000","last_change":"2024-04-23T10:29:02.779087+0000","last_active":"2024-04-23T10:29:02.779026+0000","last_peered":"2024-04-23T10:29:02.779026+0000","last_clean":"2024-04-23T10:29:02.779026+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:29:02.779026+0000","last_undegraded":"2024-04-23T10:29:02.779026+0000","last_fullsized":"2024-04-23T10:29:02.779026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:29:02.778858+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:29:02.778858+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.778858+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:57:47.309447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'212","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.750302+0000","last_change":"2024-04-23T10:29:09.750413+0000","last_active":"2024-04-23T10:29:09.750302+0000","last_peered":"2024-04-23T10:29:09.750302+0000","last_clean":"2024-04-23T10:29:09.750302+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:29:09.750302+0000","last_undegraded":"2024-04-23T10:29:09.750302+0000","last_fullsized":"2024-04-23T10:29:09.750302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-23T10:29:09.750098+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-23T10:29:09.750098+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.750098+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:36:01.767261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'194","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.726349+0000","last_change":"2024-04-23T10:29:05.726410+0000","last_active":"2024-04-23T10:29:05.726349+0000","last_peered":"2024-04-23T10:29:05.726349+0000","last_clean":"2024-04-23T10:29:05.726349+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:29:05.726349+0000","last_undegraded":"2024-04-23T10:29:05.726349+0000","last_fullsized":"2024-04-23T10:29:05.726349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'194","last_scrub_stamp":"2024-04-23T10:29:05.726178+0000","last_deep_scrub":"26'194","last_deep_scrub_stamp":"2024-04-23T10:29:05.726178+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.726178+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:20.450171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.544354+0000","last_change":"2024-04-23T10:28:56.544419+0000","last_active":"2024-04-23T10:28:56.544354+0000","last_peered":"2024-04-23T10:28:56.544354+0000","last_clean":"2024-04-23T10:28:56.544354+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:28:56.544354+0000","last_undegraded":"2024-04-23T10:28:56.544354+0000","last_fullsized":"2024-04-23T10:28:56.544354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:28:56.544183+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:28:56.544183+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.544183+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:04:58.889944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'188","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.431425+0000","last_change":"2024-04-23T10:29:04.431539+0000","last_active":"2024-04-23T10:29:04.431425+0000","last_peered":"2024-04-23T10:29:04.431425+0000","last_clean":"2024-04-23T10:29:04.431425+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:29:04.431425+0000","last_undegraded":"2024-04-23T10:29:04.431425+0000","last_fullsized":"2024-04-23T10:29:04.431425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'188","last_scrub_stamp":"2024-04-23T10:29:04.431150+0000","last_deep_scrub":"26'188","last_deep_scrub_stamp":"2024-04-23T10:29:04.431150+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.431150+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:13.550769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'211","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.551130+0000","last_change":"2024-04-23T10:28:57.551241+0000","last_active":"2024-04-23T10:28:57.551130+0000","last_peered":"2024-04-23T10:28:57.551130+0000","last_clean":"2024-04-23T10:28:57.551130+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:28:57.551130+0000","last_undegraded":"2024-04-23T10:28:57.551130+0000","last_fullsized":"2024-04-23T10:28:57.551130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'211","last_scrub_stamp":"2024-04-23T10:28:57.550850+0000","last_deep_scrub":"26'211","last_deep_scrub_stamp":"2024-04-23T10:28:57.550850+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.550850+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:05.958283+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'201","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.544974+0000","last_change":"2024-04-23T10:28:55.545035+0000","last_active":"2024-04-23T10:28:55.544974+0000","last_peered":"2024-04-23T10:28:55.544974+0000","last_clean":"2024-04-23T10:28:55.544974+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:28:55.544974+0000","last_undegraded":"2024-04-23T10:28:55.544974+0000","last_fullsized":"2024-04-23T10:28:55.544974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-23T10:28:55.544761+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-23T10:28:55.544761+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.544761+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:35:37.106291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'192","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:53.000027+0000","last_change":"2024-04-23T10:28:53.000086+0000","last_active":"2024-04-23T10:28:53.000027+0000","last_peered":"2024-04-23T10:28:53.000027+0000","last_clean":"2024-04-23T10:28:53.000027+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:28:53.000027+0000","last_undegraded":"2024-04-23T10:28:53.000027+0000","last_fullsized":"2024-04-23T10:28:53.000027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'192","last_scrub_stamp":"2024-04-23T10:28:52.999858+0000","last_deep_scrub":"26'192","last_deep_scrub_stamp":"2024-04-23T10:28:52.999858+0000","last_clean_scrub_stamp":"2024-04-23T10:28:52.999858+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:36:50.128405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'215","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.074423+0000","last_change":"2024-04-23T10:29:04.074483+0000","last_active":"2024-04-23T10:29:04.074423+0000","last_peered":"2024-04-23T10:29:04.074423+0000","last_clean":"2024-04-23T10:29:04.074423+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:29:04.074423+0000","last_undegraded":"2024-04-23T10:29:04.074423+0000","last_fullsized":"2024-04-23T10:29:04.074423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'215","last_scrub_stamp":"2024-04-23T10:29:04.074251+0000","last_deep_scrub":"26'215","last_deep_scrub_stamp":"2024-04-23T10:29:04.074251+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.074251+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:50.560344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'214","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.727989+0000","last_change":"2024-04-23T10:29:08.728048+0000","last_active":"2024-04-23T10:29:08.727989+0000","last_peered":"2024-04-23T10:29:08.727989+0000","last_clean":"2024-04-23T10:29:08.727989+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:29:08.727989+0000","last_undegraded":"2024-04-23T10:29:08.727989+0000","last_fullsized":"2024-04-23T10:29:08.727989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-23T10:29:08.727803+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-23T10:29:08.727803+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.727803+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:11:56.298611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2849,"num_read_kb":1515105,"num_write":24366,"num_write_kb":4267173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24772,"ondisk_log_size":24772,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13142,"ondisk_log_size":13142,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":137167340,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":10074,"num_write_kb":140883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274579456,"data_stored":274334680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11125,"ondisk_log_size":11125,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575014,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139456,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94232384,"statfs":{"total":96636764160,"available":96493961216,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575014,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575017,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111508,"kb_used_data":26252,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94260332,"statfs":{"total":96636764160,"available":96522579968,"internally_reserved":0,"allocated":26882048,"data_stored":26671347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575015,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142116,"kb_used_data":34588,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94229724,"statfs":{"total":96636764160,"available":96491237376,"internally_reserved":0,"allocated":35418112,"data_stored":35225169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575016,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73128,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298712,"statfs":{"total":96636764160,"available":96561881088,"internally_reserved":0,"allocated":10256384,"data_stored":10059311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575015,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142016,"kb_used_data":30328,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94229824,"statfs":{"total":96636764160,"available":96491339776,"internally_reserved":0,"allocated":31055872,"data_stored":30862669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575015,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30777344,"data_stored":30748221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9977856,"data_stored":9944863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35139584,"data_stored":35110721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26603520,"data_stored":26556899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:29:16.458 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:29:16.459 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:29:16.459 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:29:16.459 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:29:16.459 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:29:16.460 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-23T10:15:41.035204+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:29:16.460 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-23T10:15:36.966375+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=15, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=28, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:29:16.460 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T10:29:22.946 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:29:22.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:29:36.461 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:29:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e94cc640 1 Processor -- start 2024-04-23T10:29:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e94cc640 1 -- start start 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e94cc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e4153190 0x7f70e4159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e94cc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f70e406f150 0x7f70e406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e94cc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f70e40ccc50 0x7f70e40cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e94cc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f70e4159380 con 0x7f70e406f150 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e94cc640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f70e40cd5c0 con 0x7f70e40ccc50 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e94cc640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f70e40c3fe0 con 0x7f70e4153190 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e27fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f70e406f150 0x7f70e406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e27fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f70e406f150 0x7f70e406f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60308/0 (socket says 172.21.15.29:60308) 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e27fc640 1 -- 172.21.15.29:0/2815678199 learned_addr learned my addr 172.21.15.29:0/2815678199 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:36.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e2ffd640 1 --2- 172.21.15.29:0/2815678199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e4153190 0x7f70e4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e37fe640 1 --2- 172.21.15.29:0/2815678199 >> v2:172.21.15.72:3300/0 conn(0x7f70e40ccc50 0x7f70e40cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e27fc640 1 -- 172.21.15.29:0/2815678199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e4153190 msgr2=0x7f70e4159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:36.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e27fc640 1 --2- 172.21.15.29:0/2815678199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e4153190 0x7f70e4159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e27fc640 1 -- 172.21.15.29:0/2815678199 >> v2:172.21.15.72:3300/0 conn(0x7f70e40ccc50 msgr2=0x7f70e40cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:36.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e27fc640 1 --2- 172.21.15.29:0/2815678199 >> v2:172.21.15.72:3300/0 conn(0x7f70e40ccc50 0x7f70e40cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e27fc640 1 -- 172.21.15.29:0/2815678199 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e40c42c0 con 0x7f70e406f150 2024-04-23T10:29:36.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.600+0000 7f70e2ffd640 1 --2- 172.21.15.29:0/2815678199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e4153190 0x7f70e4159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:36.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e27fc640 1 --2- 172.21.15.29:0/2815678199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e406f150 0x7f70e406f550 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f70e406e440 tx=0x7f70dc01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6f5cc832aef18c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e1ffb640 1 -- 172.21.15.29:0/2815678199 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0b4070 con 0x7f70e406f150 2024-04-23T10:29:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e1ffb640 1 -- 172.21.15.29:0/2815678199 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70dc0af400 con 0x7f70e406f150 2024-04-23T10:29:36.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e1ffb640 1 -- 172.21.15.29:0/2815678199 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0af7d0 con 0x7f70e406f150 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- 172.21.15.29:0/2815678199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e406f150 msgr2=0x7f70e406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 --2- 172.21.15.29:0/2815678199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e406f150 0x7f70e406f550 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f70e406e440 tx=0x7f70dc01f1e0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- 172.21.15.29:0/2815678199 shutdown_connections 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 --2- 172.21.15.29:0/2815678199 >> v2:172.21.15.72:3300/0 conn(0x7f70e40ccc50 0x7f70e40cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 --2- 172.21.15.29:0/2815678199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e406f150 0x7f70e406f550 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 --2- 172.21.15.29:0/2815678199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e4153190 0x7f70e4159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- 172.21.15.29:0/2815678199 >> 172.21.15.29:0/2815678199 conn(0x7f70e406cfb0 msgr2=0x7f70e406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- 172.21.15.29:0/2815678199 shutdown_connections 2024-04-23T10:29:36.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- 172.21.15.29:0/2815678199 wait complete. 2024-04-23T10:29:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 Processor -- start 2024-04-23T10:29:36.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- start start 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406f150 0x7f70e4157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e40ccc50 0x7f70e414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e4153190 0x7f70e414e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f70e4153570 con 0x7f70e40ccc50 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f70e4159010 con 0x7f70e4153190 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e94cc640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f70e40c4880 con 0x7f70e406f150 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e40ccc50 0x7f70e414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e40ccc50 0x7f70e414e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60324/0 (socket says 172.21.15.29:60324) 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.604+0000 7f70e27fc640 1 -- 172.21.15.29:0/1141158836 learned_addr learned my addr 172.21.15.29:0/1141158836 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e2ffd640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406f150 0x7f70e4157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e37fe640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e4153190 0x7f70e414e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e27fc640 1 -- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406f150 msgr2=0x7f70e4157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:36.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e27fc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406f150 0x7f70e4157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e27fc640 1 -- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e4153190 msgr2=0x7f70e414e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e27fc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e4153190 0x7f70e414e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e27fc640 1 -- 172.21.15.29:0/1141158836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e414b790 con 0x7f70e40ccc50 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e2ffd640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406f150 0x7f70e4157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e27fc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e40ccc50 0x7f70e414e250 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f70dc01d890 tx=0x7f70dc01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70db7fe640 1 -- 172.21.15.29:0/1141158836 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0c0070 con 0x7f70e40ccc50 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70db7fe640 1 -- 172.21.15.29:0/1141158836 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70dc0afe30 con 0x7f70e40ccc50 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e4158cd0 con 0x7f70e40ccc50 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70db7fe640 1 -- 172.21.15.29:0/1141158836 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0b4040 con 0x7f70e40ccc50 2024-04-23T10:29:36.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e40c8730 con 0x7f70e40ccc50 2024-04-23T10:29:36.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e4068d70 con 0x7f70e40ccc50 2024-04-23T10:29:36.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70db7fe640 1 -- 172.21.15.29:0/1141158836 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70dc0c3070 con 0x7f70e40ccc50 2024-04-23T10:29:36.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70db7fe640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f70c8068380 0x7f70c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70db7fe640 1 -- 172.21.15.29:0/1141158836 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f70dc1244e0 con 0x7f70e40ccc50 2024-04-23T10:29:36.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.608+0000 7f70e2ffd640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f70c8068380 0x7f70c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.612+0000 7f70e2ffd640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f70c8068380 0x7f70c806a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70d4008890 tx=0x7f70d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:36.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.612+0000 7f70db7fe640 1 -- 172.21.15.29:0/1141158836 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70dc018d40 con 0x7f70e40ccc50 2024-04-23T10:29:36.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.780+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 --> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70e4156920 con 0x7f70c8068380 2024-04-23T10:29:36.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.804+0000 7f70db7fe640 1 -- 172.21.15.29:0/1141158836 <== mgr.4102 v2:172.21.15.72:6832/2614464755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335260 (secure 0 0 0) 0x7f70e4156920 con 0x7f70c8068380 2024-04-23T10:29:36.803 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:29:36.805 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-23T10:29:36.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f70c8068380 msgr2=0x7f70c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:36.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f70c8068380 0x7f70c806a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70d4008890 tx=0x7f70d4008040 comp rx=0 tx=0).stop 2024-04-23T10:29:36.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e40ccc50 msgr2=0x7f70e414e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:36.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e40ccc50 0x7f70e414e250 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f70dc01d890 tx=0x7f70dc01bf80 comp rx=0 tx=0).stop 2024-04-23T10:29:36.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 shutdown_connections 2024-04-23T10:29:36.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f70c8068380 0x7f70c806a840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e4153190 0x7f70e414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e40ccc50 0x7f70e414e250 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 --2- 172.21.15.29:0/1141158836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406f150 0x7f70e4157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 >> 172.21.15.29:0/1141158836 conn(0x7f70e406cfb0 msgr2=0x7f70e414d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:36.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 shutdown_connections 2024-04-23T10:29:36.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:36.808+0000 7f70e94cc640 1 -- 172.21.15.29:0/1141158836 wait complete. 2024-04-23T10:29:36.824 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":441,"stamp":"2024-04-23T10:29:35.522934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137757708,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":3613,"num_read_kb":1517165,"num_write":34599,"num_write_kb":4410472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49158,"ondisk_log_size":49158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":944120,"kb_used_data":271480,"kb_used_omap":12,"kb_used_meta":672563,"kb_avail":754030600,"statfs":{"total":773094113280,"available":772127334400,"internally_reserved":0,"allocated":277995520,"data_stored":276431000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":688705072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004439"},"pg_stats":[{"pgid":"2.1f","version":"26'106","reported_seq":147,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.038505+0000","last_change":"2024-04-23T10:28:55.038566+0000","last_active":"2024-04-23T10:28:55.038505+0000","last_peered":"2024-04-23T10:28:55.038505+0000","last_clean":"2024-04-23T10:28:55.038505+0000","last_became_active":"2024-04-23T10:15:37.031780+0000","last_became_peered":"2024-04-23T10:15:37.031780+0000","last_unstale":"2024-04-23T10:28:55.038505+0000","last_undegraded":"2024-04-23T10:28:55.038505+0000","last_fullsized":"2024-04-23T10:28:55.038505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'106","last_scrub_stamp":"2024-04-23T10:28:55.038426+0000","last_deep_scrub":"26'106","last_deep_scrub_stamp":"2024-04-23T10:28:55.038426+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.038426+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:32:26.303000+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'201","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.677943+0000","last_change":"2024-04-23T10:28:56.678007+0000","last_active":"2024-04-23T10:28:56.677943+0000","last_peered":"2024-04-23T10:28:56.677943+0000","last_clean":"2024-04-23T10:28:56.677943+0000","last_became_active":"2024-04-23T10:15:38.037632+0000","last_became_peered":"2024-04-23T10:15:38.037632+0000","last_unstale":"2024-04-23T10:28:56.677943+0000","last_undegraded":"2024-04-23T10:28:56.677943+0000","last_fullsized":"2024-04-23T10:28:56.677943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-23T10:28:56.677764+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-23T10:28:56.677764+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.677764+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:24.650083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'789","reported_seq":887,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.669113+0000","last_change":"2024-04-23T10:29:09.669177+0000","last_active":"2024-04-23T10:29:09.669113+0000","last_peered":"2024-04-23T10:29:09.669113+0000","last_clean":"2024-04-23T10:29:09.669113+0000","last_became_active":"2024-04-23T10:15:42.177143+0000","last_became_peered":"2024-04-23T10:15:42.177143+0000","last_unstale":"2024-04-23T10:29:09.669113+0000","last_undegraded":"2024-04-23T10:29:09.669113+0000","last_fullsized":"2024-04-23T10:29:09.669113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'789","last_scrub_stamp":"2024-04-23T10:29:09.668922+0000","last_deep_scrub":"26'789","last_deep_scrub_stamp":"2024-04-23T10:29:09.668922+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.668922+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:57:55.186791+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31845,"num_write":775,"num_write_kb":142945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'96","reported_seq":137,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.707154+0000","last_change":"2024-04-23T10:28:58.707225+0000","last_active":"2024-04-23T10:28:58.707154+0000","last_peered":"2024-04-23T10:28:58.707154+0000","last_clean":"2024-04-23T10:28:58.707154+0000","last_became_active":"2024-04-23T10:15:37.007303+0000","last_became_peered":"2024-04-23T10:15:37.007303+0000","last_unstale":"2024-04-23T10:28:58.707154+0000","last_undegraded":"2024-04-23T10:28:58.707154+0000","last_fullsized":"2024-04-23T10:28:58.707154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'96","last_scrub_stamp":"2024-04-23T10:28:58.706977+0000","last_deep_scrub":"26'96","last_deep_scrub_stamp":"2024-04-23T10:28:58.706977+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.706977+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:47.023712+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'182","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.094283+0000","last_change":"2024-04-23T10:28:59.094353+0000","last_active":"2024-04-23T10:28:59.094283+0000","last_peered":"2024-04-23T10:28:59.094283+0000","last_clean":"2024-04-23T10:28:59.094283+0000","last_became_active":"2024-04-23T10:15:38.013513+0000","last_became_peered":"2024-04-23T10:15:38.013513+0000","last_unstale":"2024-04-23T10:28:59.094283+0000","last_undegraded":"2024-04-23T10:28:59.094283+0000","last_fullsized":"2024-04-23T10:28:59.094283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'182","last_scrub_stamp":"2024-04-23T10:28:59.094102+0000","last_deep_scrub":"26'182","last_deep_scrub_stamp":"2024-04-23T10:28:59.094102+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.094102+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:48.759946+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'755","reported_seq":881,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.371948+0000","last_change":"2024-04-23T10:29:05.372010+0000","last_active":"2024-04-23T10:29:05.371948+0000","last_peered":"2024-04-23T10:29:05.371948+0000","last_clean":"2024-04-23T10:29:05.371948+0000","last_became_active":"2024-04-23T10:15:42.096072+0000","last_became_peered":"2024-04-23T10:15:42.096072+0000","last_unstale":"2024-04-23T10:29:05.371948+0000","last_undegraded":"2024-04-23T10:29:05.371948+0000","last_fullsized":"2024-04-23T10:29:05.371948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'755","last_scrub_stamp":"2024-04-23T10:29:05.371769+0000","last_deep_scrub":"26'755","last_deep_scrub_stamp":"2024-04-23T10:29:05.371769+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.371769+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:43.590589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":56312,"num_write":739,"num_write_kb":106537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'972","reported_seq":1012,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.784562+0000","last_change":"2024-04-23T10:29:04.784615+0000","last_active":"2024-04-23T10:29:04.784562+0000","last_peered":"2024-04-23T10:29:04.784562+0000","last_clean":"2024-04-23T10:29:04.784562+0000","last_became_active":"2024-04-23T10:15:37.034246+0000","last_became_peered":"2024-04-23T10:15:37.034246+0000","last_unstale":"2024-04-23T10:29:04.784562+0000","last_undegraded":"2024-04-23T10:29:04.784562+0000","last_fullsized":"2024-04-23T10:29:04.784562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'972","last_scrub_stamp":"2024-04-23T10:29:04.784480+0000","last_deep_scrub":"26'972","last_deep_scrub_stamp":"2024-04-23T10:29:04.784480+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.784480+0000","objects_scrubbed":10,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:27:55.447792+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":12538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'189","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.535842+0000","last_change":"2024-04-23T10:28:54.535901+0000","last_active":"2024-04-23T10:28:54.535842+0000","last_peered":"2024-04-23T10:28:54.535842+0000","last_clean":"2024-04-23T10:28:54.535842+0000","last_became_active":"2024-04-23T10:15:38.013982+0000","last_became_peered":"2024-04-23T10:15:38.013982+0000","last_unstale":"2024-04-23T10:28:54.535842+0000","last_undegraded":"2024-04-23T10:28:54.535842+0000","last_fullsized":"2024-04-23T10:28:54.535842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'189","last_scrub_stamp":"2024-04-23T10:28:54.535675+0000","last_deep_scrub":"26'189","last_deep_scrub_stamp":"2024-04-23T10:28:54.535675+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.535675+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:36:29.346675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'777","reported_seq":896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.364899+0000","last_change":"2024-04-23T10:29:04.364968+0000","last_active":"2024-04-23T10:29:04.364899+0000","last_peered":"2024-04-23T10:29:04.364899+0000","last_clean":"2024-04-23T10:29:04.364899+0000","last_became_active":"2024-04-23T10:15:42.095338+0000","last_became_peered":"2024-04-23T10:15:42.095338+0000","last_unstale":"2024-04-23T10:29:04.364899+0000","last_undegraded":"2024-04-23T10:29:04.364899+0000","last_fullsized":"2024-04-23T10:29:04.364899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'777","last_scrub_stamp":"2024-04-23T10:29:04.364701+0000","last_deep_scrub":"26'777","last_deep_scrub_stamp":"2024-04-23T10:29:04.364701+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.364701+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:04:59.514736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47927,"num_write":766,"num_write_kb":159845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'385","reported_seq":425,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.632119+0000","last_change":"2024-04-23T10:29:01.632206+0000","last_active":"2024-04-23T10:29:01.632119+0000","last_peered":"2024-04-23T10:29:01.632119+0000","last_clean":"2024-04-23T10:29:01.632119+0000","last_became_active":"2024-04-23T10:15:37.031855+0000","last_became_peered":"2024-04-23T10:15:37.031855+0000","last_unstale":"2024-04-23T10:29:01.632119+0000","last_undegraded":"2024-04-23T10:29:01.632119+0000","last_fullsized":"2024-04-23T10:29:01.632119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'385","last_scrub_stamp":"2024-04-23T10:29:01.631952+0000","last_deep_scrub":"26'385","last_deep_scrub_stamp":"2024-04-23T10:29:01.631952+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.631952+0000","objects_scrubbed":4,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:30:44.459457+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'192","reported_seq":230,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.500297+0000","last_change":"2024-04-23T10:29:01.500358+0000","last_active":"2024-04-23T10:29:01.500297+0000","last_peered":"2024-04-23T10:29:01.500297+0000","last_clean":"2024-04-23T10:29:01.500297+0000","last_became_active":"2024-04-23T10:15:37.996334+0000","last_became_peered":"2024-04-23T10:15:37.996334+0000","last_unstale":"2024-04-23T10:29:01.500297+0000","last_undegraded":"2024-04-23T10:29:01.500297+0000","last_fullsized":"2024-04-23T10:29:01.500297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'192","last_scrub_stamp":"2024-04-23T10:29:01.500119+0000","last_deep_scrub":"26'192","last_deep_scrub_stamp":"2024-04-23T10:29:01.500119+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.500119+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:11:49.718645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'750","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.378298+0000","last_change":"2024-04-23T10:29:00.378362+0000","last_active":"2024-04-23T10:29:00.378298+0000","last_peered":"2024-04-23T10:29:00.378298+0000","last_clean":"2024-04-23T10:29:00.378298+0000","last_became_active":"2024-04-23T10:15:42.088320+0000","last_became_peered":"2024-04-23T10:15:42.088320+0000","last_unstale":"2024-04-23T10:29:00.378298+0000","last_undegraded":"2024-04-23T10:29:00.378298+0000","last_fullsized":"2024-04-23T10:29:00.378298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'750","last_scrub_stamp":"2024-04-23T10:29:00.378063+0000","last_deep_scrub":"26'750","last_deep_scrub_stamp":"2024-04-23T10:29:00.378063+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.378063+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:39.652652+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32547,"num_write":740,"num_write_kb":109806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'207","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.691418+0000","last_change":"2024-04-23T10:29:05.691484+0000","last_active":"2024-04-23T10:29:05.691418+0000","last_peered":"2024-04-23T10:29:05.691418+0000","last_clean":"2024-04-23T10:29:05.691418+0000","last_became_active":"2024-04-23T10:15:38.035558+0000","last_became_peered":"2024-04-23T10:15:38.035558+0000","last_unstale":"2024-04-23T10:29:05.691418+0000","last_undegraded":"2024-04-23T10:29:05.691418+0000","last_fullsized":"2024-04-23T10:29:05.691418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-23T10:29:05.691218+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-23T10:29:05.691218+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.691218+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:57:34.743632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'275","reported_seq":316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.640029+0000","last_change":"2024-04-23T10:29:00.640029+0000","last_active":"2024-04-23T10:29:00.640029+0000","last_peered":"2024-04-23T10:29:00.640029+0000","last_clean":"2024-04-23T10:29:00.640029+0000","last_became_active":"2024-04-23T10:15:37.031578+0000","last_became_peered":"2024-04-23T10:15:37.031578+0000","last_unstale":"2024-04-23T10:29:00.640029+0000","last_undegraded":"2024-04-23T10:29:00.640029+0000","last_fullsized":"2024-04-23T10:29:00.640029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'275","last_scrub_stamp":"2024-04-23T10:29:00.639742+0000","last_deep_scrub":"26'275","last_deep_scrub_stamp":"2024-04-23T10:29:00.639742+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.639742+0000","objects_scrubbed":4,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:58.625852+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":8310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'776","reported_seq":921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.418847+0000","last_change":"2024-04-23T10:28:59.418847+0000","last_active":"2024-04-23T10:28:59.418847+0000","last_peered":"2024-04-23T10:28:59.418847+0000","last_clean":"2024-04-23T10:28:59.418847+0000","last_became_active":"2024-04-23T10:15:42.085887+0000","last_became_peered":"2024-04-23T10:15:42.085887+0000","last_unstale":"2024-04-23T10:28:59.418847+0000","last_undegraded":"2024-04-23T10:28:59.418847+0000","last_fullsized":"2024-04-23T10:28:59.418847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'776","last_scrub_stamp":"2024-04-23T10:28:59.418378+0000","last_deep_scrub":"26'776","last_deep_scrub_stamp":"2024-04-23T10:28:59.418378+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.418378+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:06:43.206285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57747,"num_write":758,"num_write_kb":151052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'204","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.699675+0000","last_change":"2024-04-23T10:29:04.699675+0000","last_active":"2024-04-23T10:29:04.699675+0000","last_peered":"2024-04-23T10:29:04.699675+0000","last_clean":"2024-04-23T10:29:04.699675+0000","last_became_active":"2024-04-23T10:15:38.010218+0000","last_became_peered":"2024-04-23T10:15:38.010218+0000","last_unstale":"2024-04-23T10:29:04.699675+0000","last_undegraded":"2024-04-23T10:29:04.699675+0000","last_fullsized":"2024-04-23T10:29:04.699675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:29:04.699338+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:29:04.699338+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.699338+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:27.631024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'238","reported_seq":279,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.112847+0000","last_change":"2024-04-23T10:28:54.112882+0000","last_active":"2024-04-23T10:28:54.112847+0000","last_peered":"2024-04-23T10:28:54.112847+0000","last_clean":"2024-04-23T10:28:54.112847+0000","last_became_active":"2024-04-23T10:15:37.004683+0000","last_became_peered":"2024-04-23T10:15:37.004683+0000","last_unstale":"2024-04-23T10:28:54.112847+0000","last_undegraded":"2024-04-23T10:28:54.112847+0000","last_fullsized":"2024-04-23T10:28:54.112847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'238","last_scrub_stamp":"2024-04-23T10:28:54.112762+0000","last_deep_scrub":"26'238","last_deep_scrub_stamp":"2024-04-23T10:28:54.112762+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.112762+0000","objects_scrubbed":3,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:49.877403+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.334344+0000","last_change":"2024-04-23T10:29:01.334344+0000","last_active":"2024-04-23T10:29:01.334344+0000","last_peered":"2024-04-23T10:29:01.334344+0000","last_clean":"2024-04-23T10:29:01.334344+0000","last_became_active":"2024-04-23T10:15:42.088963+0000","last_became_peered":"2024-04-23T10:15:42.088963+0000","last_unstale":"2024-04-23T10:29:01.334344+0000","last_undegraded":"2024-04-23T10:29:01.334344+0000","last_fullsized":"2024-04-23T10:29:01.334344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'802","last_scrub_stamp":"2024-04-23T10:29:01.334075+0000","last_deep_scrub":"26'802","last_deep_scrub_stamp":"2024-04-23T10:29:01.334075+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.334075+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:48.948148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":42307,"num_write":786,"num_write_kb":84940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'208","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.705859+0000","last_change":"2024-04-23T10:29:03.705918+0000","last_active":"2024-04-23T10:29:03.705859+0000","last_peered":"2024-04-23T10:29:03.705859+0000","last_clean":"2024-04-23T10:29:03.705859+0000","last_became_active":"2024-04-23T10:15:38.011565+0000","last_became_peered":"2024-04-23T10:15:38.011565+0000","last_unstale":"2024-04-23T10:29:03.705859+0000","last_undegraded":"2024-04-23T10:29:03.705859+0000","last_fullsized":"2024-04-23T10:29:03.705859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:29:03.705675+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:29:03.705675+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.705675+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:26:26.389033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'79","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.123503+0000","last_change":"2024-04-23T10:28:58.123583+0000","last_active":"2024-04-23T10:28:58.123503+0000","last_peered":"2024-04-23T10:28:58.123503+0000","last_clean":"2024-04-23T10:28:58.123503+0000","last_became_active":"2024-04-23T10:15:37.019328+0000","last_became_peered":"2024-04-23T10:15:37.019328+0000","last_unstale":"2024-04-23T10:28:58.123503+0000","last_undegraded":"2024-04-23T10:28:58.123503+0000","last_fullsized":"2024-04-23T10:28:58.123503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2024-04-23T10:28:58.123333+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2024-04-23T10:28:58.123333+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.123333+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:35:40.339944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'766","reported_seq":896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.117885+0000","last_change":"2024-04-23T10:29:09.117885+0000","last_active":"2024-04-23T10:29:09.117885+0000","last_peered":"2024-04-23T10:29:09.117885+0000","last_clean":"2024-04-23T10:29:09.117885+0000","last_became_active":"2024-04-23T10:15:42.169023+0000","last_became_peered":"2024-04-23T10:15:42.169023+0000","last_unstale":"2024-04-23T10:29:09.117885+0000","last_undegraded":"2024-04-23T10:29:09.117885+0000","last_fullsized":"2024-04-23T10:29:09.117885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'766","last_scrub_stamp":"2024-04-23T10:29:09.117540+0000","last_deep_scrub":"26'766","last_deep_scrub_stamp":"2024-04-23T10:29:09.117540+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.117540+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:10:17.710601+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":54473,"num_write":759,"num_write_kb":130945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'215","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.420691+0000","last_change":"2024-04-23T10:28:57.420812+0000","last_active":"2024-04-23T10:28:57.420691+0000","last_peered":"2024-04-23T10:28:57.420691+0000","last_clean":"2024-04-23T10:28:57.420691+0000","last_became_active":"2024-04-23T10:15:38.015863+0000","last_became_peered":"2024-04-23T10:15:38.015863+0000","last_unstale":"2024-04-23T10:28:57.420691+0000","last_undegraded":"2024-04-23T10:28:57.420691+0000","last_fullsized":"2024-04-23T10:28:57.420691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'215","last_scrub_stamp":"2024-04-23T10:28:57.420471+0000","last_deep_scrub":"26'215","last_deep_scrub_stamp":"2024-04-23T10:28:57.420471+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.420471+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:38:01.361586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'965","reported_seq":1006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.655083+0000","last_change":"2024-04-23T10:29:02.655205+0000","last_active":"2024-04-23T10:29:02.655083+0000","last_peered":"2024-04-23T10:29:02.655083+0000","last_clean":"2024-04-23T10:29:02.655083+0000","last_became_active":"2024-04-23T10:15:37.032121+0000","last_became_peered":"2024-04-23T10:15:37.032121+0000","last_unstale":"2024-04-23T10:29:02.655083+0000","last_undegraded":"2024-04-23T10:29:02.655083+0000","last_fullsized":"2024-04-23T10:29:02.655083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'965","last_scrub_stamp":"2024-04-23T10:29:02.654882+0000","last_deep_scrub":"26'965","last_deep_scrub_stamp":"2024-04-23T10:29:02.654882+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.654882+0000","objects_scrubbed":2,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:35:33.563672+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":4487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'727","reported_seq":846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.323742+0000","last_change":"2024-04-23T10:29:06.323742+0000","last_active":"2024-04-23T10:29:06.323742+0000","last_peered":"2024-04-23T10:29:06.323742+0000","last_clean":"2024-04-23T10:29:06.323742+0000","last_became_active":"2024-04-23T10:15:42.097322+0000","last_became_peered":"2024-04-23T10:15:42.097322+0000","last_unstale":"2024-04-23T10:29:06.323742+0000","last_undegraded":"2024-04-23T10:29:06.323742+0000","last_fullsized":"2024-04-23T10:29:06.323742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'727","last_scrub_stamp":"2024-04-23T10:29:06.323483+0000","last_deep_scrub":"26'727","last_deep_scrub_stamp":"2024-04-23T10:29:06.323483+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.323483+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:56:09.368593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46853,"num_write":712,"num_write_kb":125891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'218","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.046312+0000","last_change":"2024-04-23T10:29:00.046375+0000","last_active":"2024-04-23T10:29:00.046312+0000","last_peered":"2024-04-23T10:29:00.046312+0000","last_clean":"2024-04-23T10:29:00.046312+0000","last_became_active":"2024-04-23T10:15:38.014517+0000","last_became_peered":"2024-04-23T10:15:38.014517+0000","last_unstale":"2024-04-23T10:29:00.046312+0000","last_undegraded":"2024-04-23T10:29:00.046312+0000","last_fullsized":"2024-04-23T10:29:00.046312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-23T10:29:00.046134+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-23T10:29:00.046134+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.046134+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:13.626513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'77","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.752742+0000","last_change":"2024-04-23T10:28:59.752818+0000","last_active":"2024-04-23T10:28:59.752742+0000","last_peered":"2024-04-23T10:28:59.752742+0000","last_clean":"2024-04-23T10:28:59.752742+0000","last_became_active":"2024-04-23T10:15:37.033606+0000","last_became_peered":"2024-04-23T10:15:37.033606+0000","last_unstale":"2024-04-23T10:28:59.752742+0000","last_undegraded":"2024-04-23T10:28:59.752742+0000","last_fullsized":"2024-04-23T10:28:59.752742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2024-04-23T10:28:59.752551+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2024-04-23T10:28:59.752551+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.752551+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:04.478703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'725","reported_seq":822,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.313175+0000","last_change":"2024-04-23T10:29:07.313238+0000","last_active":"2024-04-23T10:29:07.313175+0000","last_peered":"2024-04-23T10:29:07.313175+0000","last_clean":"2024-04-23T10:29:07.313175+0000","last_became_active":"2024-04-23T10:15:42.170187+0000","last_became_peered":"2024-04-23T10:15:42.170187+0000","last_unstale":"2024-04-23T10:29:07.313175+0000","last_undegraded":"2024-04-23T10:29:07.313175+0000","last_fullsized":"2024-04-23T10:29:07.313175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'725","last_scrub_stamp":"2024-04-23T10:29:07.312985+0000","last_deep_scrub":"26'725","last_deep_scrub_stamp":"2024-04-23T10:29:07.312985+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.312985+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:16:57.860174+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33152,"num_write":717,"num_write_kb":76622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'177","reported_seq":216,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:53.684929+0000","last_change":"2024-04-23T10:28:53.684952+0000","last_active":"2024-04-23T10:28:53.684929+0000","last_peered":"2024-04-23T10:28:53.684929+0000","last_clean":"2024-04-23T10:28:53.684929+0000","last_became_active":"2024-04-23T10:15:38.032932+0000","last_became_peered":"2024-04-23T10:15:38.032932+0000","last_unstale":"2024-04-23T10:28:53.684929+0000","last_undegraded":"2024-04-23T10:28:53.684929+0000","last_fullsized":"2024-04-23T10:28:53.684929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'177","last_scrub_stamp":"2024-04-23T10:28:53.684856+0000","last_deep_scrub":"26'177","last_deep_scrub_stamp":"2024-04-23T10:28:53.684856+0000","last_clean_scrub_stamp":"2024-04-23T10:28:53.684856+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:40:43.962560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'523","reported_seq":564,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.171938+0000","last_change":"2024-04-23T10:28:57.172013+0000","last_active":"2024-04-23T10:28:57.171938+0000","last_peered":"2024-04-23T10:28:57.171938+0000","last_clean":"2024-04-23T10:28:57.171938+0000","last_became_active":"2024-04-23T10:15:37.012069+0000","last_became_peered":"2024-04-23T10:15:37.012069+0000","last_unstale":"2024-04-23T10:28:57.171938+0000","last_undegraded":"2024-04-23T10:28:57.171938+0000","last_fullsized":"2024-04-23T10:28:57.171938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'523","last_scrub_stamp":"2024-04-23T10:28:57.171772+0000","last_deep_scrub":"26'523","last_deep_scrub_stamp":"2024-04-23T10:28:57.171772+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.171772+0000","objects_scrubbed":4,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:02.126985+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":1827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'785","reported_seq":873,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:13.621288+0000","last_change":"2024-04-23T10:29:13.621355+0000","last_active":"2024-04-23T10:29:13.621288+0000","last_peered":"2024-04-23T10:29:13.621288+0000","last_clean":"2024-04-23T10:29:13.621288+0000","last_became_active":"2024-04-23T10:16:27.066471+0000","last_became_peered":"2024-04-23T10:16:27.066471+0000","last_unstale":"2024-04-23T10:29:13.621288+0000","last_undegraded":"2024-04-23T10:29:13.621288+0000","last_fullsized":"2024-04-23T10:29:13.621288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'785","last_scrub_stamp":"2024-04-23T10:29:13.621093+0000","last_deep_scrub":"26'785","last_deep_scrub_stamp":"2024-04-23T10:29:13.621093+0000","last_clean_scrub_stamp":"2024-04-23T10:29:13.621093+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:09:44.453821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28458,"num_write":774,"num_write_kb":115794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.046219+0000","last_change":"2024-04-23T10:29:03.046279+0000","last_active":"2024-04-23T10:29:03.046219+0000","last_peered":"2024-04-23T10:29:03.046219+0000","last_clean":"2024-04-23T10:29:03.046219+0000","last_became_active":"2024-04-23T10:15:38.018976+0000","last_became_peered":"2024-04-23T10:15:38.018976+0000","last_unstale":"2024-04-23T10:29:03.046219+0000","last_undegraded":"2024-04-23T10:29:03.046219+0000","last_fullsized":"2024-04-23T10:29:03.046219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:29:03.046048+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:29:03.046048+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.046048+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:08:40.675716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'259","reported_seq":300,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.693915+0000","last_change":"2024-04-23T10:29:03.693993+0000","last_active":"2024-04-23T10:29:03.693915+0000","last_peered":"2024-04-23T10:29:03.693915+0000","last_clean":"2024-04-23T10:29:03.693915+0000","last_became_active":"2024-04-23T10:15:37.033383+0000","last_became_peered":"2024-04-23T10:15:37.033383+0000","last_unstale":"2024-04-23T10:29:03.693915+0000","last_undegraded":"2024-04-23T10:29:03.693915+0000","last_fullsized":"2024-04-23T10:29:03.693915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'259","last_scrub_stamp":"2024-04-23T10:29:03.693742+0000","last_deep_scrub":"26'259","last_deep_scrub_stamp":"2024-04-23T10:29:03.693742+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.693742+0000","objects_scrubbed":4,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:47:03.820245+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'721","reported_seq":791,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.986141+0000","last_change":"2024-04-23T10:29:08.986204+0000","last_active":"2024-04-23T10:29:08.986141+0000","last_peered":"2024-04-23T10:29:08.986141+0000","last_clean":"2024-04-23T10:29:08.986141+0000","last_became_active":"2024-04-23T10:15:42.170058+0000","last_became_peered":"2024-04-23T10:15:42.170058+0000","last_unstale":"2024-04-23T10:29:08.986141+0000","last_undegraded":"2024-04-23T10:29:08.986141+0000","last_fullsized":"2024-04-23T10:29:08.986141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'721","last_scrub_stamp":"2024-04-23T10:29:08.985960+0000","last_deep_scrub":"26'721","last_deep_scrub_stamp":"2024-04-23T10:29:08.985960+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.985960+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:34.537033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21238,"num_write":700,"num_write_kb":76444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'211","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:11.563095+0000","last_change":"2024-04-23T10:29:11.563156+0000","last_active":"2024-04-23T10:29:11.563095+0000","last_peered":"2024-04-23T10:29:11.563095+0000","last_clean":"2024-04-23T10:29:11.563095+0000","last_became_active":"2024-04-23T10:16:26.681911+0000","last_became_peered":"2024-04-23T10:16:26.681911+0000","last_unstale":"2024-04-23T10:29:11.563095+0000","last_undegraded":"2024-04-23T10:29:11.563095+0000","last_fullsized":"2024-04-23T10:29:11.563095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'211","last_scrub_stamp":"2024-04-23T10:29:11.562905+0000","last_deep_scrub":"26'211","last_deep_scrub_stamp":"2024-04-23T10:29:11.562905+0000","last_clean_scrub_stamp":"2024-04-23T10:29:11.562905+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:34:43.612821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'67","reported_seq":108,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.140696+0000","last_change":"2024-04-23T10:28:56.140761+0000","last_active":"2024-04-23T10:28:56.140696+0000","last_peered":"2024-04-23T10:28:56.140696+0000","last_clean":"2024-04-23T10:28:56.140696+0000","last_became_active":"2024-04-23T10:15:37.011640+0000","last_became_peered":"2024-04-23T10:15:37.011640+0000","last_unstale":"2024-04-23T10:28:56.140696+0000","last_undegraded":"2024-04-23T10:28:56.140696+0000","last_fullsized":"2024-04-23T10:28:56.140696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'67","last_scrub_stamp":"2024-04-23T10:28:56.140492+0000","last_deep_scrub":"26'67","last_deep_scrub_stamp":"2024-04-23T10:28:56.140492+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.140492+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:51:19.851529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'775","reported_seq":847,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.046572+0000","last_change":"2024-04-23T10:29:07.046637+0000","last_active":"2024-04-23T10:29:07.046572+0000","last_peered":"2024-04-23T10:29:07.046572+0000","last_clean":"2024-04-23T10:29:07.046572+0000","last_became_active":"2024-04-23T10:15:42.085571+0000","last_became_peered":"2024-04-23T10:15:42.085571+0000","last_unstale":"2024-04-23T10:29:07.046572+0000","last_undegraded":"2024-04-23T10:29:07.046572+0000","last_fullsized":"2024-04-23T10:29:07.046572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'775","last_scrub_stamp":"2024-04-23T10:29:07.046392+0000","last_deep_scrub":"26'775","last_deep_scrub_stamp":"2024-04-23T10:29:07.046392+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.046392+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:48.716394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25895,"num_write":752,"num_write_kb":125637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.411614+0000","last_change":"2024-04-23T10:28:56.411673+0000","last_active":"2024-04-23T10:28:56.411614+0000","last_peered":"2024-04-23T10:28:56.411614+0000","last_clean":"2024-04-23T10:28:56.411614+0000","last_became_active":"2024-04-23T10:15:38.011021+0000","last_became_peered":"2024-04-23T10:15:38.011021+0000","last_unstale":"2024-04-23T10:28:56.411614+0000","last_undegraded":"2024-04-23T10:28:56.411614+0000","last_fullsized":"2024-04-23T10:28:56.411614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:28:56.411438+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:28:56.411438+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.411438+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:29:35.656749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'710","reported_seq":751,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.525464+0000","last_change":"2024-04-23T10:28:58.525535+0000","last_active":"2024-04-23T10:28:58.525464+0000","last_peered":"2024-04-23T10:28:58.525464+0000","last_clean":"2024-04-23T10:28:58.525464+0000","last_became_active":"2024-04-23T10:15:37.015566+0000","last_became_peered":"2024-04-23T10:15:37.015566+0000","last_unstale":"2024-04-23T10:28:58.525464+0000","last_undegraded":"2024-04-23T10:28:58.525464+0000","last_fullsized":"2024-04-23T10:28:58.525464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'710","last_scrub_stamp":"2024-04-23T10:28:58.525300+0000","last_deep_scrub":"26'710","last_deep_scrub_stamp":"2024-04-23T10:28:58.525300+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.525300+0000","objects_scrubbed":4,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:15:55.914238+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":8518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'759","reported_seq":977,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.086222+0000","last_change":"2024-04-23T10:29:06.086285+0000","last_active":"2024-04-23T10:29:06.086222+0000","last_peered":"2024-04-23T10:29:06.086222+0000","last_clean":"2024-04-23T10:29:06.086222+0000","last_became_active":"2024-04-23T10:15:42.082353+0000","last_became_peered":"2024-04-23T10:15:42.082353+0000","last_unstale":"2024-04-23T10:29:06.086222+0000","last_undegraded":"2024-04-23T10:29:06.086222+0000","last_fullsized":"2024-04-23T10:29:06.086222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'759","last_scrub_stamp":"2024-04-23T10:29:06.086025+0000","last_deep_scrub":"26'759","last_deep_scrub_stamp":"2024-04-23T10:29:06.086025+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.086025+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:19.383668+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":98862,"num_write":741,"num_write_kb":163671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'207","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.075303+0000","last_change":"2024-04-23T10:29:02.075365+0000","last_active":"2024-04-23T10:29:02.075303+0000","last_peered":"2024-04-23T10:29:02.075303+0000","last_clean":"2024-04-23T10:29:02.075303+0000","last_became_active":"2024-04-23T10:15:38.018092+0000","last_became_peered":"2024-04-23T10:15:38.018092+0000","last_unstale":"2024-04-23T10:29:02.075303+0000","last_undegraded":"2024-04-23T10:29:02.075303+0000","last_fullsized":"2024-04-23T10:29:02.075303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-23T10:29:02.075106+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-23T10:29:02.075106+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.075106+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:17.288158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'731","reported_seq":1420,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.087850+0000","last_change":"2024-04-23T10:28:56.087889+0000","last_active":"2024-04-23T10:28:56.087850+0000","last_peered":"2024-04-23T10:28:56.087850+0000","last_clean":"2024-04-23T10:28:56.087850+0000","last_became_active":"2024-04-23T10:15:37.002347+0000","last_became_peered":"2024-04-23T10:15:37.002347+0000","last_unstale":"2024-04-23T10:28:56.087850+0000","last_undegraded":"2024-04-23T10:28:56.087850+0000","last_fullsized":"2024-04-23T10:28:56.087850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'731","last_scrub_stamp":"2024-04-23T10:28:56.087779+0000","last_deep_scrub":"26'731","last_deep_scrub_stamp":"2024-04-23T10:28:56.087779+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.087779+0000","objects_scrubbed":4,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:00.434784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554323,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":662,"num_write_kb":1972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'710","reported_seq":808,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.091422+0000","last_change":"2024-04-23T10:29:08.091487+0000","last_active":"2024-04-23T10:29:08.091422+0000","last_peered":"2024-04-23T10:29:08.091422+0000","last_clean":"2024-04-23T10:29:08.091422+0000","last_became_active":"2024-04-23T10:15:42.085392+0000","last_became_peered":"2024-04-23T10:15:42.085392+0000","last_unstale":"2024-04-23T10:29:08.091422+0000","last_undegraded":"2024-04-23T10:29:08.091422+0000","last_fullsized":"2024-04-23T10:29:08.091422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'710","last_scrub_stamp":"2024-04-23T10:29:08.091242+0000","last_deep_scrub":"26'710","last_deep_scrub_stamp":"2024-04-23T10:29:08.091242+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.091242+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:12.076033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33554,"num_write":702,"num_write_kb":88722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'194","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.107764+0000","last_change":"2024-04-23T10:28:58.107881+0000","last_active":"2024-04-23T10:28:58.107764+0000","last_peered":"2024-04-23T10:28:58.107764+0000","last_clean":"2024-04-23T10:28:58.107764+0000","last_became_active":"2024-04-23T10:15:38.006683+0000","last_became_peered":"2024-04-23T10:15:38.006683+0000","last_unstale":"2024-04-23T10:28:58.107764+0000","last_undegraded":"2024-04-23T10:28:58.107764+0000","last_fullsized":"2024-04-23T10:28:58.107764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'194","last_scrub_stamp":"2024-04-23T10:28:58.107481+0000","last_deep_scrub":"26'194","last_deep_scrub_stamp":"2024-04-23T10:28:58.107481+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.107481+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:31.852994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'338","reported_seq":379,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.592281+0000","last_change":"2024-04-23T10:28:59.592412+0000","last_active":"2024-04-23T10:28:59.592281+0000","last_peered":"2024-04-23T10:28:59.592281+0000","last_clean":"2024-04-23T10:28:59.592281+0000","last_became_active":"2024-04-23T10:15:37.019772+0000","last_became_peered":"2024-04-23T10:15:37.019772+0000","last_unstale":"2024-04-23T10:28:59.592281+0000","last_undegraded":"2024-04-23T10:28:59.592281+0000","last_fullsized":"2024-04-23T10:28:59.592281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'338","last_scrub_stamp":"2024-04-23T10:28:59.592077+0000","last_deep_scrub":"26'338","last_deep_scrub_stamp":"2024-04-23T10:28:59.592077+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.592077+0000","objects_scrubbed":3,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:16.440806+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'893","reported_seq":1094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.983141+0000","last_change":"2024-04-23T10:29:06.983312+0000","last_active":"2024-04-23T10:29:06.983141+0000","last_peered":"2024-04-23T10:29:06.983141+0000","last_clean":"2024-04-23T10:29:06.983141+0000","last_became_active":"2024-04-23T10:15:42.169318+0000","last_became_peered":"2024-04-23T10:15:42.169318+0000","last_unstale":"2024-04-23T10:29:06.983141+0000","last_undegraded":"2024-04-23T10:29:06.983141+0000","last_fullsized":"2024-04-23T10:29:06.983141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'893","last_scrub_stamp":"2024-04-23T10:29:06.982916+0000","last_deep_scrub":"26'893","last_deep_scrub_stamp":"2024-04-23T10:29:06.982916+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.982916+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:49.768722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":90539,"num_write":885,"num_write_kb":222131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:11.664400+0000","last_change":"2024-04-23T10:29:11.664480+0000","last_active":"2024-04-23T10:29:11.664400+0000","last_peered":"2024-04-23T10:29:11.664400+0000","last_clean":"2024-04-23T10:29:11.664400+0000","last_became_active":"2024-04-23T10:16:26.681971+0000","last_became_peered":"2024-04-23T10:16:26.681971+0000","last_unstale":"2024-04-23T10:29:11.664400+0000","last_undegraded":"2024-04-23T10:29:11.664400+0000","last_fullsized":"2024-04-23T10:29:11.664400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:29:11.664220+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:29:11.664220+0000","last_clean_scrub_stamp":"2024-04-23T10:29:11.664220+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:45.506380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'81","reported_seq":122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.523527+0000","last_change":"2024-04-23T10:28:56.523601+0000","last_active":"2024-04-23T10:28:56.523527+0000","last_peered":"2024-04-23T10:28:56.523527+0000","last_clean":"2024-04-23T10:28:56.523527+0000","last_became_active":"2024-04-23T10:15:37.003284+0000","last_became_peered":"2024-04-23T10:15:37.003284+0000","last_unstale":"2024-04-23T10:28:56.523527+0000","last_undegraded":"2024-04-23T10:28:56.523527+0000","last_fullsized":"2024-04-23T10:28:56.523527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'81","last_scrub_stamp":"2024-04-23T10:28:56.523356+0000","last_deep_scrub":"26'81","last_deep_scrub_stamp":"2024-04-23T10:28:56.523356+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.523356+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:21:41.765874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.551328+0000","last_change":"2024-04-23T10:28:58.551400+0000","last_active":"2024-04-23T10:28:58.551328+0000","last_peered":"2024-04-23T10:28:58.551328+0000","last_clean":"2024-04-23T10:28:58.551328+0000","last_became_active":"2024-04-23T10:15:32.925610+0000","last_became_peered":"2024-04-23T10:15:32.925610+0000","last_unstale":"2024-04-23T10:28:58.551328+0000","last_undegraded":"2024-04-23T10:28:58.551328+0000","last_fullsized":"2024-04-23T10:28:58.551328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-23T10:28:58.551162+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-23T10:28:58.551162+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.551162+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:49:47.778050+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'772","reported_seq":889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.680879+0000","last_change":"2024-04-23T10:29:08.681009+0000","last_active":"2024-04-23T10:29:08.680879+0000","last_peered":"2024-04-23T10:29:08.680879+0000","last_clean":"2024-04-23T10:29:08.680879+0000","last_became_active":"2024-04-23T10:15:42.172372+0000","last_became_peered":"2024-04-23T10:15:42.172372+0000","last_unstale":"2024-04-23T10:29:08.680879+0000","last_undegraded":"2024-04-23T10:29:08.680879+0000","last_fullsized":"2024-04-23T10:29:08.680879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'772","last_scrub_stamp":"2024-04-23T10:29:08.680640+0000","last_deep_scrub":"26'772","last_deep_scrub_stamp":"2024-04-23T10:29:08.680640+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.680640+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:54.429502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":47063,"num_write":757,"num_write_kb":125918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'204","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:12.706073+0000","last_change":"2024-04-23T10:29:12.706132+0000","last_active":"2024-04-23T10:29:12.706073+0000","last_peered":"2024-04-23T10:29:12.706073+0000","last_clean":"2024-04-23T10:29:12.706073+0000","last_became_active":"2024-04-23T10:15:38.041560+0000","last_became_peered":"2024-04-23T10:15:38.041560+0000","last_unstale":"2024-04-23T10:29:12.706073+0000","last_undegraded":"2024-04-23T10:29:12.706073+0000","last_fullsized":"2024-04-23T10:29:12.706073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:29:12.705902+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:29:12.705902+0000","last_clean_scrub_stamp":"2024-04-23T10:29:12.705902+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:25:04.873710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'66","reported_seq":107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.053473+0000","last_change":"2024-04-23T10:28:55.053473+0000","last_active":"2024-04-23T10:28:55.053473+0000","last_peered":"2024-04-23T10:28:55.053473+0000","last_clean":"2024-04-23T10:28:55.053473+0000","last_became_active":"2024-04-23T10:15:37.002700+0000","last_became_peered":"2024-04-23T10:15:37.002700+0000","last_unstale":"2024-04-23T10:28:55.053473+0000","last_undegraded":"2024-04-23T10:28:55.053473+0000","last_fullsized":"2024-04-23T10:28:55.053473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'66","last_scrub_stamp":"2024-04-23T10:28:55.053307+0000","last_deep_scrub":"26'66","last_deep_scrub_stamp":"2024-04-23T10:28:55.053307+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.053307+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:45:04.175802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'800","reported_seq":931,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.701099+0000","last_change":"2024-04-23T10:29:07.701166+0000","last_active":"2024-04-23T10:29:07.701099+0000","last_peered":"2024-04-23T10:29:07.701099+0000","last_clean":"2024-04-23T10:29:07.701099+0000","last_became_active":"2024-04-23T10:15:42.169325+0000","last_became_peered":"2024-04-23T10:15:42.169325+0000","last_unstale":"2024-04-23T10:29:07.701099+0000","last_undegraded":"2024-04-23T10:29:07.701099+0000","last_fullsized":"2024-04-23T10:29:07.701099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'800","last_scrub_stamp":"2024-04-23T10:29:07.700919+0000","last_deep_scrub":"26'800","last_deep_scrub_stamp":"2024-04-23T10:29:07.700919+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.700919+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:20:23.429978+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":46277,"num_write":791,"num_write_kb":155967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'224","reported_seq":263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.410988+0000","last_change":"2024-04-23T10:29:03.410988+0000","last_active":"2024-04-23T10:29:03.410988+0000","last_peered":"2024-04-23T10:29:03.410988+0000","last_clean":"2024-04-23T10:29:03.410988+0000","last_became_active":"2024-04-23T10:15:38.012388+0000","last_became_peered":"2024-04-23T10:15:38.012388+0000","last_unstale":"2024-04-23T10:29:03.410988+0000","last_undegraded":"2024-04-23T10:29:03.410988+0000","last_fullsized":"2024-04-23T10:29:03.410988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-23T10:29:03.410753+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-23T10:29:03.410753+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.410753+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:25.236193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'675","reported_seq":716,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.147847+0000","last_change":"2024-04-23T10:28:55.147847+0000","last_active":"2024-04-23T10:28:55.147847+0000","last_peered":"2024-04-23T10:28:55.147847+0000","last_clean":"2024-04-23T10:28:55.147847+0000","last_became_active":"2024-04-23T10:15:37.009050+0000","last_became_peered":"2024-04-23T10:15:37.009050+0000","last_unstale":"2024-04-23T10:28:55.147847+0000","last_undegraded":"2024-04-23T10:28:55.147847+0000","last_fullsized":"2024-04-23T10:28:55.147847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'675","last_scrub_stamp":"2024-04-23T10:28:55.147739+0000","last_deep_scrub":"26'675","last_deep_scrub_stamp":"2024-04-23T10:28:55.147739+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.147739+0000","objects_scrubbed":2,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:15:35.423709+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'770","reported_seq":900,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.026635+0000","last_change":"2024-04-23T10:29:06.026635+0000","last_active":"2024-04-23T10:29:06.026635+0000","last_peered":"2024-04-23T10:29:06.026635+0000","last_clean":"2024-04-23T10:29:06.026635+0000","last_became_active":"2024-04-23T10:15:42.088554+0000","last_became_peered":"2024-04-23T10:15:42.088554+0000","last_unstale":"2024-04-23T10:29:06.026635+0000","last_undegraded":"2024-04-23T10:29:06.026635+0000","last_fullsized":"2024-04-23T10:29:06.026635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'770","last_scrub_stamp":"2024-04-23T10:29:06.026374+0000","last_deep_scrub":"26'770","last_deep_scrub_stamp":"2024-04-23T10:29:06.026374+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.026374+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:03.872920+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":57774,"num_write":776,"num_write_kb":117908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'202","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.674451+0000","last_change":"2024-04-23T10:29:06.674451+0000","last_active":"2024-04-23T10:29:06.674451+0000","last_peered":"2024-04-23T10:29:06.674451+0000","last_clean":"2024-04-23T10:29:06.674451+0000","last_became_active":"2024-04-23T10:15:38.039196+0000","last_became_peered":"2024-04-23T10:15:38.039196+0000","last_unstale":"2024-04-23T10:29:06.674451+0000","last_undegraded":"2024-04-23T10:29:06.674451+0000","last_fullsized":"2024-04-23T10:29:06.674451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-23T10:29:06.674217+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-23T10:29:06.674217+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.674217+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:17.140224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'440","reported_seq":481,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.097294+0000","last_change":"2024-04-23T10:28:54.097294+0000","last_active":"2024-04-23T10:28:54.097294+0000","last_peered":"2024-04-23T10:28:54.097294+0000","last_clean":"2024-04-23T10:28:54.097294+0000","last_became_active":"2024-04-23T10:15:37.002246+0000","last_became_peered":"2024-04-23T10:15:37.002246+0000","last_unstale":"2024-04-23T10:28:54.097294+0000","last_undegraded":"2024-04-23T10:28:54.097294+0000","last_fullsized":"2024-04-23T10:28:54.097294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'440","last_scrub_stamp":"2024-04-23T10:28:54.097133+0000","last_deep_scrub":"26'440","last_deep_scrub_stamp":"2024-04-23T10:28:54.097133+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.097133+0000","objects_scrubbed":3,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:43.795864+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'820","reported_seq":998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:10.539842+0000","last_change":"2024-04-23T10:29:10.539906+0000","last_active":"2024-04-23T10:29:10.539842+0000","last_peered":"2024-04-23T10:29:10.539842+0000","last_clean":"2024-04-23T10:29:10.539842+0000","last_became_active":"2024-04-23T10:15:42.169671+0000","last_became_peered":"2024-04-23T10:15:42.169671+0000","last_unstale":"2024-04-23T10:29:10.539842+0000","last_undegraded":"2024-04-23T10:29:10.539842+0000","last_fullsized":"2024-04-23T10:29:10.539842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'820","last_scrub_stamp":"2024-04-23T10:29:10.539649+0000","last_deep_scrub":"26'820","last_deep_scrub_stamp":"2024-04-23T10:29:10.539649+0000","last_clean_scrub_stamp":"2024-04-23T10:29:10.539649+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:23:00.534854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":78747,"num_write":811,"num_write_kb":155987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'186","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.699902+0000","last_change":"2024-04-23T10:29:05.699902+0000","last_active":"2024-04-23T10:29:05.699902+0000","last_peered":"2024-04-23T10:29:05.699902+0000","last_clean":"2024-04-23T10:29:05.699902+0000","last_became_active":"2024-04-23T10:15:38.036922+0000","last_became_peered":"2024-04-23T10:15:38.036922+0000","last_unstale":"2024-04-23T10:29:05.699902+0000","last_undegraded":"2024-04-23T10:29:05.699902+0000","last_fullsized":"2024-04-23T10:29:05.699902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'186","last_scrub_stamp":"2024-04-23T10:29:05.699573+0000","last_deep_scrub":"26'186","last_deep_scrub_stamp":"2024-04-23T10:29:05.699573+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.699573+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:04:25.350216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'190","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.412772+0000","last_change":"2024-04-23T10:28:54.412772+0000","last_active":"2024-04-23T10:28:54.412772+0000","last_peered":"2024-04-23T10:28:54.412772+0000","last_clean":"2024-04-23T10:28:54.412772+0000","last_became_active":"2024-04-23T10:15:37.012744+0000","last_became_peered":"2024-04-23T10:15:37.012744+0000","last_unstale":"2024-04-23T10:28:54.412772+0000","last_undegraded":"2024-04-23T10:28:54.412772+0000","last_fullsized":"2024-04-23T10:28:54.412772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'190","last_scrub_stamp":"2024-04-23T10:28:54.412515+0000","last_deep_scrub":"26'190","last_deep_scrub_stamp":"2024-04-23T10:28:54.412515+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.412515+0000","objects_scrubbed":3,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:56.215284+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'819","reported_seq":914,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.375704+0000","last_change":"2024-04-23T10:29:02.375769+0000","last_active":"2024-04-23T10:29:02.375704+0000","last_peered":"2024-04-23T10:29:02.375704+0000","last_clean":"2024-04-23T10:29:02.375704+0000","last_became_active":"2024-04-23T10:15:42.091709+0000","last_became_peered":"2024-04-23T10:15:42.091709+0000","last_unstale":"2024-04-23T10:29:02.375704+0000","last_undegraded":"2024-04-23T10:29:02.375704+0000","last_fullsized":"2024-04-23T10:29:02.375704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'819","last_scrub_stamp":"2024-04-23T10:29:02.375504+0000","last_deep_scrub":"26'819","last_deep_scrub_stamp":"2024-04-23T10:29:02.375504+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.375504+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:58.020629+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":36072,"num_write":807,"num_write_kb":130604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.709028+0000","last_change":"2024-04-23T10:29:07.709092+0000","last_active":"2024-04-23T10:29:07.709028+0000","last_peered":"2024-04-23T10:29:07.709028+0000","last_clean":"2024-04-23T10:29:07.709028+0000","last_became_active":"2024-04-23T10:15:38.039088+0000","last_became_peered":"2024-04-23T10:15:38.039088+0000","last_unstale":"2024-04-23T10:29:07.709028+0000","last_undegraded":"2024-04-23T10:29:07.709028+0000","last_fullsized":"2024-04-23T10:29:07.709028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'235","last_scrub_stamp":"2024-04-23T10:29:07.708856+0000","last_deep_scrub":"26'235","last_deep_scrub_stamp":"2024-04-23T10:29:07.708856+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.708856+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:25.935475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'283","reported_seq":323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:53.140765+0000","last_change":"2024-04-23T10:28:53.140824+0000","last_active":"2024-04-23T10:28:53.140765+0000","last_peered":"2024-04-23T10:28:53.140765+0000","last_clean":"2024-04-23T10:28:53.140765+0000","last_became_active":"2024-04-23T10:15:36.998190+0000","last_became_peered":"2024-04-23T10:15:36.998190+0000","last_unstale":"2024-04-23T10:28:53.140765+0000","last_undegraded":"2024-04-23T10:28:53.140765+0000","last_fullsized":"2024-04-23T10:28:53.140765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'283","last_scrub_stamp":"2024-04-23T10:28:53.140676+0000","last_deep_scrub":"26'283","last_deep_scrub_stamp":"2024-04-23T10:28:53.140676+0000","last_clean_scrub_stamp":"2024-04-23T10:28:53.140676+0000","objects_scrubbed":9,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:36:15.458449+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'783","reported_seq":899,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.033512+0000","last_change":"2024-04-23T10:29:05.033638+0000","last_active":"2024-04-23T10:29:05.033512+0000","last_peered":"2024-04-23T10:29:05.033512+0000","last_clean":"2024-04-23T10:29:05.033512+0000","last_became_active":"2024-04-23T10:15:42.075656+0000","last_became_peered":"2024-04-23T10:15:42.075656+0000","last_unstale":"2024-04-23T10:29:05.033512+0000","last_undegraded":"2024-04-23T10:29:05.033512+0000","last_fullsized":"2024-04-23T10:29:05.033512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'783","last_scrub_stamp":"2024-04-23T10:29:05.033187+0000","last_deep_scrub":"26'783","last_deep_scrub_stamp":"2024-04-23T10:29:05.033187+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.033187+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:06:51.550414+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":28210,"num_write":769,"num_write_kb":122559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'220","reported_seq":258,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.727013+0000","last_change":"2024-04-23T10:29:04.727074+0000","last_active":"2024-04-23T10:29:04.727013+0000","last_peered":"2024-04-23T10:29:04.727013+0000","last_clean":"2024-04-23T10:29:04.727013+0000","last_became_active":"2024-04-23T10:15:38.031583+0000","last_became_peered":"2024-04-23T10:15:38.031583+0000","last_unstale":"2024-04-23T10:29:04.727013+0000","last_undegraded":"2024-04-23T10:29:04.727013+0000","last_fullsized":"2024-04-23T10:29:04.727013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'220","last_scrub_stamp":"2024-04-23T10:29:04.726838+0000","last_deep_scrub":"26'220","last_deep_scrub_stamp":"2024-04-23T10:29:04.726838+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.726838+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:52:56.493620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'69","reported_seq":109,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.823226+0000","last_change":"2024-04-23T10:28:57.823300+0000","last_active":"2024-04-23T10:28:57.823226+0000","last_peered":"2024-04-23T10:28:57.823226+0000","last_clean":"2024-04-23T10:28:57.823226+0000","last_became_active":"2024-04-23T10:15:37.010677+0000","last_became_peered":"2024-04-23T10:15:37.010677+0000","last_unstale":"2024-04-23T10:28:57.823226+0000","last_undegraded":"2024-04-23T10:28:57.823226+0000","last_fullsized":"2024-04-23T10:28:57.823226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'69","last_scrub_stamp":"2024-04-23T10:28:57.823057+0000","last_deep_scrub":"26'69","last_deep_scrub_stamp":"2024-04-23T10:28:57.823057+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.823057+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:13.345688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'801","reported_seq":941,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.681990+0000","last_change":"2024-04-23T10:29:07.682120+0000","last_active":"2024-04-23T10:29:07.681990+0000","last_peered":"2024-04-23T10:29:07.681990+0000","last_clean":"2024-04-23T10:29:07.681990+0000","last_became_active":"2024-04-23T10:15:42.169629+0000","last_became_peered":"2024-04-23T10:15:42.169629+0000","last_unstale":"2024-04-23T10:29:07.681990+0000","last_undegraded":"2024-04-23T10:29:07.681990+0000","last_fullsized":"2024-04-23T10:29:07.681990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'801","last_scrub_stamp":"2024-04-23T10:29:07.681760+0000","last_deep_scrub":"26'801","last_deep_scrub_stamp":"2024-04-23T10:29:07.681760+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.681760+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:39.212996+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":64319,"num_write":793,"num_write_kb":152801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'200","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:10.744778+0000","last_change":"2024-04-23T10:29:10.744867+0000","last_active":"2024-04-23T10:29:10.744778+0000","last_peered":"2024-04-23T10:29:10.744778+0000","last_clean":"2024-04-23T10:29:10.744778+0000","last_became_active":"2024-04-23T10:15:38.039999+0000","last_became_peered":"2024-04-23T10:15:38.039999+0000","last_unstale":"2024-04-23T10:29:10.744778+0000","last_undegraded":"2024-04-23T10:29:10.744778+0000","last_fullsized":"2024-04-23T10:29:10.744778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:29:10.744612+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:29:10.744612+0000","last_clean_scrub_stamp":"2024-04-23T10:29:10.744612+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:41.916697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'74","reported_seq":114,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.453314+0000","last_change":"2024-04-23T10:28:59.453383+0000","last_active":"2024-04-23T10:28:59.453314+0000","last_peered":"2024-04-23T10:28:59.453314+0000","last_clean":"2024-04-23T10:28:59.453314+0000","last_became_active":"2024-04-23T10:15:37.020947+0000","last_became_peered":"2024-04-23T10:15:37.020947+0000","last_unstale":"2024-04-23T10:28:59.453314+0000","last_undegraded":"2024-04-23T10:28:59.453314+0000","last_fullsized":"2024-04-23T10:28:59.453314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'74","last_scrub_stamp":"2024-04-23T10:28:59.453139+0000","last_deep_scrub":"26'74","last_deep_scrub_stamp":"2024-04-23T10:28:59.453139+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.453139+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:46.438687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'716","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:10.622140+0000","last_change":"2024-04-23T10:29:10.622212+0000","last_active":"2024-04-23T10:29:10.622140+0000","last_peered":"2024-04-23T10:29:10.622140+0000","last_clean":"2024-04-23T10:29:10.622140+0000","last_became_active":"2024-04-23T10:16:26.367734+0000","last_became_peered":"2024-04-23T10:16:26.367734+0000","last_unstale":"2024-04-23T10:29:10.622140+0000","last_undegraded":"2024-04-23T10:29:10.622140+0000","last_fullsized":"2024-04-23T10:29:10.622140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'716","last_scrub_stamp":"2024-04-23T10:29:10.621941+0000","last_deep_scrub":"26'716","last_deep_scrub_stamp":"2024-04-23T10:29:10.621941+0000","last_clean_scrub_stamp":"2024-04-23T10:29:10.621941+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:01.788765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50110,"num_write":710,"num_write_kb":147181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'208","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.048040+0000","last_change":"2024-04-23T10:29:04.048097+0000","last_active":"2024-04-23T10:29:04.048040+0000","last_peered":"2024-04-23T10:29:04.048040+0000","last_clean":"2024-04-23T10:29:04.048040+0000","last_became_active":"2024-04-23T10:15:38.026116+0000","last_became_peered":"2024-04-23T10:15:38.026116+0000","last_unstale":"2024-04-23T10:29:04.048040+0000","last_undegraded":"2024-04-23T10:29:04.048040+0000","last_fullsized":"2024-04-23T10:29:04.048040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:29:04.047871+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:29:04.047871+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.047871+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:44:36.899916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'602","reported_seq":642,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.050952+0000","last_change":"2024-04-23T10:28:54.051036+0000","last_active":"2024-04-23T10:28:54.050952+0000","last_peered":"2024-04-23T10:28:54.050952+0000","last_clean":"2024-04-23T10:28:54.050952+0000","last_became_active":"2024-04-23T10:15:37.026024+0000","last_became_peered":"2024-04-23T10:15:37.026024+0000","last_unstale":"2024-04-23T10:28:54.050952+0000","last_undegraded":"2024-04-23T10:28:54.050952+0000","last_fullsized":"2024-04-23T10:28:54.050952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'602","last_scrub_stamp":"2024-04-23T10:28:54.050808+0000","last_deep_scrub":"26'602","last_deep_scrub_stamp":"2024-04-23T10:28:54.050808+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.050808+0000","objects_scrubbed":8,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:54.710413+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":8486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'753","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.525835+0000","last_change":"2024-04-23T10:29:09.525910+0000","last_active":"2024-04-23T10:29:09.525835+0000","last_peered":"2024-04-23T10:29:09.525835+0000","last_clean":"2024-04-23T10:29:09.525835+0000","last_became_active":"2024-04-23T10:15:42.164767+0000","last_became_peered":"2024-04-23T10:15:42.164767+0000","last_unstale":"2024-04-23T10:29:09.525835+0000","last_undegraded":"2024-04-23T10:29:09.525835+0000","last_fullsized":"2024-04-23T10:29:09.525835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'753","last_scrub_stamp":"2024-04-23T10:29:09.525616+0000","last_deep_scrub":"26'753","last_deep_scrub_stamp":"2024-04-23T10:29:09.525616+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.525616+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:25:14.099613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":41492,"num_write":740,"num_write_kb":126321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:11.747966+0000","last_change":"2024-04-23T10:29:11.748025+0000","last_active":"2024-04-23T10:29:11.747966+0000","last_peered":"2024-04-23T10:29:11.747966+0000","last_clean":"2024-04-23T10:29:11.747966+0000","last_became_active":"2024-04-23T10:15:38.041211+0000","last_became_peered":"2024-04-23T10:15:38.041211+0000","last_unstale":"2024-04-23T10:29:11.747966+0000","last_undegraded":"2024-04-23T10:29:11.747966+0000","last_fullsized":"2024-04-23T10:29:11.747966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:29:11.747791+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:29:11.747791+0000","last_clean_scrub_stamp":"2024-04-23T10:29:11.747791+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:05.193805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'454","reported_seq":494,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.922916+0000","last_change":"2024-04-23T10:28:55.922992+0000","last_active":"2024-04-23T10:28:55.922916+0000","last_peered":"2024-04-23T10:28:55.922916+0000","last_clean":"2024-04-23T10:28:55.922916+0000","last_became_active":"2024-04-23T10:15:37.009627+0000","last_became_peered":"2024-04-23T10:15:37.009627+0000","last_unstale":"2024-04-23T10:28:55.922916+0000","last_undegraded":"2024-04-23T10:28:55.922916+0000","last_fullsized":"2024-04-23T10:28:55.922916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'454","last_scrub_stamp":"2024-04-23T10:28:55.922753+0000","last_deep_scrub":"26'454","last_deep_scrub_stamp":"2024-04-23T10:28:55.922753+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.922753+0000","objects_scrubbed":8,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:37.132927+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'781","reported_seq":865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.040041+0000","last_change":"2024-04-23T10:29:05.040129+0000","last_active":"2024-04-23T10:29:05.040041+0000","last_peered":"2024-04-23T10:29:05.040041+0000","last_clean":"2024-04-23T10:29:05.040041+0000","last_became_active":"2024-04-23T10:15:42.082644+0000","last_became_peered":"2024-04-23T10:15:42.082644+0000","last_unstale":"2024-04-23T10:29:05.040041+0000","last_undegraded":"2024-04-23T10:29:05.040041+0000","last_fullsized":"2024-04-23T10:29:05.040041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'781","last_scrub_stamp":"2024-04-23T10:29:05.039823+0000","last_deep_scrub":"26'781","last_deep_scrub_stamp":"2024-04-23T10:29:05.039823+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.039823+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:48:12.282438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":27921,"num_write":758,"num_write_kb":97957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'198","reported_seq":222,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.073457+0000","last_change":"2024-04-23T10:29:01.073517+0000","last_active":"2024-04-23T10:29:01.073457+0000","last_peered":"2024-04-23T10:29:01.073457+0000","last_clean":"2024-04-23T10:29:01.073457+0000","last_became_active":"2024-04-23T10:16:26.365612+0000","last_became_peered":"2024-04-23T10:16:26.365612+0000","last_unstale":"2024-04-23T10:29:01.073457+0000","last_undegraded":"2024-04-23T10:29:01.073457+0000","last_fullsized":"2024-04-23T10:29:01.073457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'198","last_scrub_stamp":"2024-04-23T10:29:01.073289+0000","last_deep_scrub":"26'198","last_deep_scrub_stamp":"2024-04-23T10:29:01.073289+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.073289+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:45.176247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"26'363","reported_seq":403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.158077+0000","last_change":"2024-04-23T10:28:59.158152+0000","last_active":"2024-04-23T10:28:59.158077+0000","last_peered":"2024-04-23T10:28:59.158077+0000","last_clean":"2024-04-23T10:28:59.158077+0000","last_became_active":"2024-04-23T10:15:37.023865+0000","last_became_peered":"2024-04-23T10:15:37.023865+0000","last_unstale":"2024-04-23T10:28:59.158077+0000","last_undegraded":"2024-04-23T10:28:59.158077+0000","last_fullsized":"2024-04-23T10:28:59.158077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'363","last_scrub_stamp":"2024-04-23T10:28:59.157909+0000","last_deep_scrub":"26'363","last_deep_scrub_stamp":"2024-04-23T10:28:59.157909+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.157909+0000","objects_scrubbed":5,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:55.747926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1387233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'726","reported_seq":846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.341489+0000","last_change":"2024-04-23T10:29:03.341641+0000","last_active":"2024-04-23T10:29:03.341489+0000","last_peered":"2024-04-23T10:29:03.341489+0000","last_clean":"2024-04-23T10:29:03.341489+0000","last_became_active":"2024-04-23T10:15:42.092225+0000","last_became_peered":"2024-04-23T10:15:42.092225+0000","last_unstale":"2024-04-23T10:29:03.341489+0000","last_undegraded":"2024-04-23T10:29:03.341489+0000","last_fullsized":"2024-04-23T10:29:03.341489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'726","last_scrub_stamp":"2024-04-23T10:29:03.341265+0000","last_deep_scrub":"26'726","last_deep_scrub_stamp":"2024-04-23T10:29:03.341265+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.341265+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:59.451383+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44100,"num_write":714,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.063873+0000","last_change":"2024-04-23T10:29:01.063935+0000","last_active":"2024-04-23T10:29:01.063873+0000","last_peered":"2024-04-23T10:29:01.063873+0000","last_clean":"2024-04-23T10:29:01.063873+0000","last_became_active":"2024-04-23T10:15:38.014042+0000","last_became_peered":"2024-04-23T10:15:38.014042+0000","last_unstale":"2024-04-23T10:29:01.063873+0000","last_undegraded":"2024-04-23T10:29:01.063873+0000","last_fullsized":"2024-04-23T10:29:01.063873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'199","last_scrub_stamp":"2024-04-23T10:29:01.063695+0000","last_deep_scrub":"26'199","last_deep_scrub_stamp":"2024-04-23T10:29:01.063695+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.063695+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:34:17.921069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'240","reported_seq":280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.518911+0000","last_change":"2024-04-23T10:29:00.518985+0000","last_active":"2024-04-23T10:29:00.518911+0000","last_peered":"2024-04-23T10:29:00.518911+0000","last_clean":"2024-04-23T10:29:00.518911+0000","last_became_active":"2024-04-23T10:15:37.023979+0000","last_became_peered":"2024-04-23T10:15:37.023979+0000","last_unstale":"2024-04-23T10:29:00.518911+0000","last_undegraded":"2024-04-23T10:29:00.518911+0000","last_fullsized":"2024-04-23T10:29:00.518911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'240","last_scrub_stamp":"2024-04-23T10:29:00.518718+0000","last_deep_scrub":"26'240","last_deep_scrub_stamp":"2024-04-23T10:29:00.518718+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.518718+0000","objects_scrubbed":3,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:30.135187+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'829","reported_seq":962,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.689389+0000","last_change":"2024-04-23T10:29:06.689452+0000","last_active":"2024-04-23T10:29:06.689389+0000","last_peered":"2024-04-23T10:29:06.689389+0000","last_clean":"2024-04-23T10:29:06.689389+0000","last_became_active":"2024-04-23T10:15:42.096063+0000","last_became_peered":"2024-04-23T10:15:42.096063+0000","last_unstale":"2024-04-23T10:29:06.689389+0000","last_undegraded":"2024-04-23T10:29:06.689389+0000","last_fullsized":"2024-04-23T10:29:06.689389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'829","last_scrub_stamp":"2024-04-23T10:29:06.689202+0000","last_deep_scrub":"26'829","last_deep_scrub_stamp":"2024-04-23T10:29:06.689202+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.689202+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:50:46.066802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":58607,"num_write":815,"num_write_kb":134637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'221","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.426120+0000","last_change":"2024-04-23T10:29:06.426183+0000","last_active":"2024-04-23T10:29:06.426120+0000","last_peered":"2024-04-23T10:29:06.426120+0000","last_clean":"2024-04-23T10:29:06.426120+0000","last_became_active":"2024-04-23T10:15:38.027713+0000","last_became_peered":"2024-04-23T10:15:38.027713+0000","last_unstale":"2024-04-23T10:29:06.426120+0000","last_undegraded":"2024-04-23T10:29:06.426120+0000","last_fullsized":"2024-04-23T10:29:06.426120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'221","last_scrub_stamp":"2024-04-23T10:29:06.425929+0000","last_deep_scrub":"26'221","last_deep_scrub_stamp":"2024-04-23T10:29:06.425929+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.425929+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:49:51.477844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'72","reported_seq":112,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.790140+0000","last_change":"2024-04-23T10:28:58.790289+0000","last_active":"2024-04-23T10:28:58.790140+0000","last_peered":"2024-04-23T10:28:58.790140+0000","last_clean":"2024-04-23T10:28:58.790140+0000","last_became_active":"2024-04-23T10:15:37.024148+0000","last_became_peered":"2024-04-23T10:15:37.024148+0000","last_unstale":"2024-04-23T10:28:58.790140+0000","last_undegraded":"2024-04-23T10:28:58.790140+0000","last_fullsized":"2024-04-23T10:28:58.790140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'72","last_scrub_stamp":"2024-04-23T10:28:58.789937+0000","last_deep_scrub":"26'72","last_deep_scrub_stamp":"2024-04-23T10:28:58.789937+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.789937+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:08:41.338880+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'829","reported_seq":956,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.706032+0000","last_change":"2024-04-23T10:29:08.706097+0000","last_active":"2024-04-23T10:29:08.706032+0000","last_peered":"2024-04-23T10:29:08.706032+0000","last_clean":"2024-04-23T10:29:08.706032+0000","last_became_active":"2024-04-23T10:15:42.173170+0000","last_became_peered":"2024-04-23T10:15:42.173170+0000","last_unstale":"2024-04-23T10:29:08.706032+0000","last_undegraded":"2024-04-23T10:29:08.706032+0000","last_fullsized":"2024-04-23T10:29:08.706032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'829","last_scrub_stamp":"2024-04-23T10:29:08.705859+0000","last_deep_scrub":"26'829","last_deep_scrub_stamp":"2024-04-23T10:29:08.705859+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.705859+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:40:24.745471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":52124,"num_write":807,"num_write_kb":167221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'853","reported_seq":1009,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.005835+0000","last_change":"2024-04-23T10:29:08.005897+0000","last_active":"2024-04-23T10:29:08.005835+0000","last_peered":"2024-04-23T10:29:08.005835+0000","last_clean":"2024-04-23T10:29:08.005835+0000","last_became_active":"2024-04-23T10:15:42.169889+0000","last_became_peered":"2024-04-23T10:15:42.169889+0000","last_unstale":"2024-04-23T10:29:08.005835+0000","last_undegraded":"2024-04-23T10:29:08.005835+0000","last_fullsized":"2024-04-23T10:29:08.005835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'853","last_scrub_stamp":"2024-04-23T10:29:08.005654+0000","last_deep_scrub":"26'853","last_deep_scrub_stamp":"2024-04-23T10:29:08.005654+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.005654+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:16:50.883554+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":70228,"num_write":840,"num_write_kb":218801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'218","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.153241+0000","last_change":"2024-04-23T10:29:00.153382+0000","last_active":"2024-04-23T10:29:00.153241+0000","last_peered":"2024-04-23T10:29:00.153241+0000","last_clean":"2024-04-23T10:29:00.153241+0000","last_became_active":"2024-04-23T10:15:38.011465+0000","last_became_peered":"2024-04-23T10:15:38.011465+0000","last_unstale":"2024-04-23T10:29:00.153241+0000","last_undegraded":"2024-04-23T10:29:00.153241+0000","last_fullsized":"2024-04-23T10:29:00.153241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-23T10:29:00.152982+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-23T10:29:00.152982+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.152982+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:16:30.620696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1126","reported_seq":1166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.558589+0000","last_change":"2024-04-23T10:28:57.558668+0000","last_active":"2024-04-23T10:28:57.558589+0000","last_peered":"2024-04-23T10:28:57.558589+0000","last_clean":"2024-04-23T10:28:57.558589+0000","last_became_active":"2024-04-23T10:15:37.016442+0000","last_became_peered":"2024-04-23T10:15:37.016442+0000","last_unstale":"2024-04-23T10:28:57.558589+0000","last_undegraded":"2024-04-23T10:28:57.558589+0000","last_fullsized":"2024-04-23T10:28:57.558589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1126","last_scrub_stamp":"2024-04-23T10:28:57.558416+0000","last_deep_scrub":"26'1126","last_deep_scrub_stamp":"2024-04-23T10:28:57.558416+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.558416+0000","objects_scrubbed":3,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:00.596690+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":8723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'763","reported_seq":857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:06.723012+0000","last_change":"2024-04-23T10:29:06.723074+0000","last_active":"2024-04-23T10:29:06.723012+0000","last_peered":"2024-04-23T10:29:06.723012+0000","last_clean":"2024-04-23T10:29:06.723012+0000","last_became_active":"2024-04-23T10:15:42.084275+0000","last_became_peered":"2024-04-23T10:15:42.084275+0000","last_unstale":"2024-04-23T10:29:06.723012+0000","last_undegraded":"2024-04-23T10:29:06.723012+0000","last_fullsized":"2024-04-23T10:29:06.723012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'763","last_scrub_stamp":"2024-04-23T10:29:06.722829+0000","last_deep_scrub":"26'763","last_deep_scrub_stamp":"2024-04-23T10:29:06.722829+0000","last_clean_scrub_stamp":"2024-04-23T10:29:06.722829+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:25:47.675932+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32210,"num_write":755,"num_write_kb":160183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'223","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.714879+0000","last_change":"2024-04-23T10:29:02.715021+0000","last_active":"2024-04-23T10:29:02.714879+0000","last_peered":"2024-04-23T10:29:02.714879+0000","last_clean":"2024-04-23T10:29:02.714879+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:29:02.714879+0000","last_undegraded":"2024-04-23T10:29:02.714879+0000","last_fullsized":"2024-04-23T10:29:02.714879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'223","last_scrub_stamp":"2024-04-23T10:29:02.714597+0000","last_deep_scrub":"26'223","last_deep_scrub_stamp":"2024-04-23T10:29:02.714597+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.714597+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:00:26.725013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'104","reported_seq":144,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.722382+0000","last_change":"2024-04-23T10:28:59.722471+0000","last_active":"2024-04-23T10:28:59.722382+0000","last_peered":"2024-04-23T10:28:59.722382+0000","last_clean":"2024-04-23T10:28:59.722382+0000","last_became_active":"2024-04-23T10:15:37.021384+0000","last_became_peered":"2024-04-23T10:15:37.021384+0000","last_unstale":"2024-04-23T10:28:59.722382+0000","last_undegraded":"2024-04-23T10:28:59.722382+0000","last_fullsized":"2024-04-23T10:28:59.722382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'104","last_scrub_stamp":"2024-04-23T10:28:59.722146+0000","last_deep_scrub":"26'104","last_deep_scrub_stamp":"2024-04-23T10:28:59.722146+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.722146+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:41.981739+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'352","reported_seq":392,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.884027+0000","last_change":"2024-04-23T10:28:56.884168+0000","last_active":"2024-04-23T10:28:56.884027+0000","last_peered":"2024-04-23T10:28:56.884027+0000","last_clean":"2024-04-23T10:28:56.884027+0000","last_became_active":"2024-04-23T10:15:37.010547+0000","last_became_peered":"2024-04-23T10:15:37.010547+0000","last_unstale":"2024-04-23T10:28:56.884027+0000","last_undegraded":"2024-04-23T10:28:56.884027+0000","last_fullsized":"2024-04-23T10:28:56.884027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'352","last_scrub_stamp":"2024-04-23T10:28:56.883809+0000","last_deep_scrub":"26'352","last_deep_scrub_stamp":"2024-04-23T10:28:56.883809+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.883809+0000","objects_scrubbed":6,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:31.280038+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":12468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'181","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.037212+0000","last_change":"2024-04-23T10:28:56.037272+0000","last_active":"2024-04-23T10:28:56.037212+0000","last_peered":"2024-04-23T10:28:56.037212+0000","last_clean":"2024-04-23T10:28:56.037212+0000","last_became_active":"2024-04-23T10:15:38.002866+0000","last_became_peered":"2024-04-23T10:15:38.002866+0000","last_unstale":"2024-04-23T10:28:56.037212+0000","last_undegraded":"2024-04-23T10:28:56.037212+0000","last_fullsized":"2024-04-23T10:28:56.037212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'181","last_scrub_stamp":"2024-04-23T10:28:56.037023+0000","last_deep_scrub":"26'181","last_deep_scrub_stamp":"2024-04-23T10:28:56.037023+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.037023+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:51:40.331673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'746","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:59.092430+0000","last_change":"2024-04-23T10:28:59.092520+0000","last_active":"2024-04-23T10:28:59.092430+0000","last_peered":"2024-04-23T10:28:59.092430+0000","last_clean":"2024-04-23T10:28:59.092430+0000","last_became_active":"2024-04-23T10:15:42.086675+0000","last_became_peered":"2024-04-23T10:15:42.086675+0000","last_unstale":"2024-04-23T10:28:59.092430+0000","last_undegraded":"2024-04-23T10:28:59.092430+0000","last_fullsized":"2024-04-23T10:28:59.092430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'746","last_scrub_stamp":"2024-04-23T10:28:59.092228+0000","last_deep_scrub":"26'746","last_deep_scrub_stamp":"2024-04-23T10:28:59.092228+0000","last_clean_scrub_stamp":"2024-04-23T10:28:59.092228+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:36.748144+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":53240,"num_write":729,"num_write_kb":139197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'113","reported_seq":153,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.757504+0000","last_change":"2024-04-23T10:29:00.757575+0000","last_active":"2024-04-23T10:29:00.757504+0000","last_peered":"2024-04-23T10:29:00.757504+0000","last_clean":"2024-04-23T10:29:00.757504+0000","last_became_active":"2024-04-23T10:15:37.038272+0000","last_became_peered":"2024-04-23T10:15:37.038272+0000","last_unstale":"2024-04-23T10:29:00.757504+0000","last_undegraded":"2024-04-23T10:29:00.757504+0000","last_fullsized":"2024-04-23T10:29:00.757504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'113","last_scrub_stamp":"2024-04-23T10:29:00.757321+0000","last_deep_scrub":"26'113","last_deep_scrub_stamp":"2024-04-23T10:29:00.757321+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.757321+0000","objects_scrubbed":3,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:24.908268+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'206","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.419844+0000","last_change":"2024-04-23T10:28:58.419961+0000","last_active":"2024-04-23T10:28:58.419844+0000","last_peered":"2024-04-23T10:28:58.419844+0000","last_clean":"2024-04-23T10:28:58.419844+0000","last_became_active":"2024-04-23T10:15:38.018423+0000","last_became_peered":"2024-04-23T10:15:38.018423+0000","last_unstale":"2024-04-23T10:28:58.419844+0000","last_undegraded":"2024-04-23T10:28:58.419844+0000","last_fullsized":"2024-04-23T10:28:58.419844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:28:58.419626+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:28:58.419626+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.419626+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:27:12.971853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'701","reported_seq":792,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:12.659755+0000","last_change":"2024-04-23T10:29:12.659887+0000","last_active":"2024-04-23T10:29:12.659755+0000","last_peered":"2024-04-23T10:29:12.659755+0000","last_clean":"2024-04-23T10:29:12.659755+0000","last_became_active":"2024-04-23T10:16:26.958046+0000","last_became_peered":"2024-04-23T10:16:26.958046+0000","last_unstale":"2024-04-23T10:29:12.659755+0000","last_undegraded":"2024-04-23T10:29:12.659755+0000","last_fullsized":"2024-04-23T10:29:12.659755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'701","last_scrub_stamp":"2024-04-23T10:29:12.659512+0000","last_deep_scrub":"26'701","last_deep_scrub_stamp":"2024-04-23T10:29:12.659512+0000","last_clean_scrub_stamp":"2024-04-23T10:29:12.659512+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:28.490748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24902,"num_write":688,"num_write_kb":109624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'212","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.787937+0000","last_change":"2024-04-23T10:29:01.787995+0000","last_active":"2024-04-23T10:29:01.787937+0000","last_peered":"2024-04-23T10:29:01.787937+0000","last_clean":"2024-04-23T10:29:01.787937+0000","last_became_active":"2024-04-23T10:15:38.029248+0000","last_became_peered":"2024-04-23T10:15:38.029248+0000","last_unstale":"2024-04-23T10:29:01.787937+0000","last_undegraded":"2024-04-23T10:29:01.787937+0000","last_fullsized":"2024-04-23T10:29:01.787937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-23T10:29:01.787754+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-23T10:29:01.787754+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.787754+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:22:18.521542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'216","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.079260+0000","last_change":"2024-04-23T10:28:57.079321+0000","last_active":"2024-04-23T10:28:57.079260+0000","last_peered":"2024-04-23T10:28:57.079260+0000","last_clean":"2024-04-23T10:28:57.079260+0000","last_became_active":"2024-04-23T10:15:38.021111+0000","last_became_peered":"2024-04-23T10:15:38.021111+0000","last_unstale":"2024-04-23T10:28:57.079260+0000","last_undegraded":"2024-04-23T10:28:57.079260+0000","last_fullsized":"2024-04-23T10:28:57.079260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-23T10:28:57.079091+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-23T10:28:57.079091+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.079091+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:56:53.700052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'240","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.113555+0000","last_change":"2024-04-23T10:29:00.113614+0000","last_active":"2024-04-23T10:29:00.113555+0000","last_peered":"2024-04-23T10:29:00.113555+0000","last_clean":"2024-04-23T10:29:00.113555+0000","last_became_active":"2024-04-23T10:16:26.294506+0000","last_became_peered":"2024-04-23T10:16:26.294506+0000","last_unstale":"2024-04-23T10:29:00.113555+0000","last_undegraded":"2024-04-23T10:29:00.113555+0000","last_fullsized":"2024-04-23T10:29:00.113555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'240","last_scrub_stamp":"2024-04-23T10:29:00.113380+0000","last_deep_scrub":"26'240","last_deep_scrub_stamp":"2024-04-23T10:29:00.113380+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.113380+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:53.434504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"26'204","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.087546+0000","last_change":"2024-04-23T10:28:57.087605+0000","last_active":"2024-04-23T10:28:57.087546+0000","last_peered":"2024-04-23T10:28:57.087546+0000","last_clean":"2024-04-23T10:28:57.087546+0000","last_became_active":"2024-04-23T10:15:38.003643+0000","last_became_peered":"2024-04-23T10:15:38.003643+0000","last_unstale":"2024-04-23T10:28:57.087546+0000","last_undegraded":"2024-04-23T10:28:57.087546+0000","last_fullsized":"2024-04-23T10:28:57.087546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:28:57.087368+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:28:57.087368+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.087368+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:23.149238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'187","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.646651+0000","last_change":"2024-04-23T10:28:57.646711+0000","last_active":"2024-04-23T10:28:57.646651+0000","last_peered":"2024-04-23T10:28:57.646651+0000","last_clean":"2024-04-23T10:28:57.646651+0000","last_became_active":"2024-04-23T10:15:38.022008+0000","last_became_peered":"2024-04-23T10:15:38.022008+0000","last_unstale":"2024-04-23T10:28:57.646651+0000","last_undegraded":"2024-04-23T10:28:57.646651+0000","last_fullsized":"2024-04-23T10:28:57.646651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:28:57.646467+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:28:57.646467+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.646467+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:15:19.815560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'203","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:53.057266+0000","last_change":"2024-04-23T10:28:53.057322+0000","last_active":"2024-04-23T10:28:53.057266+0000","last_peered":"2024-04-23T10:28:53.057266+0000","last_clean":"2024-04-23T10:28:53.057266+0000","last_became_active":"2024-04-23T10:15:38.015682+0000","last_became_peered":"2024-04-23T10:15:38.015682+0000","last_unstale":"2024-04-23T10:28:53.057266+0000","last_undegraded":"2024-04-23T10:28:53.057266+0000","last_fullsized":"2024-04-23T10:28:53.057266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-23T10:28:53.057101+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-23T10:28:53.057101+0000","last_clean_scrub_stamp":"2024-04-23T10:28:53.057101+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:03:42.691173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'239","reported_seq":283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.715567+0000","last_change":"2024-04-23T10:29:09.715633+0000","last_active":"2024-04-23T10:29:09.715567+0000","last_peered":"2024-04-23T10:29:09.715567+0000","last_clean":"2024-04-23T10:29:09.715567+0000","last_became_active":"2024-04-23T10:16:26.294633+0000","last_became_peered":"2024-04-23T10:16:26.294633+0000","last_unstale":"2024-04-23T10:29:09.715567+0000","last_undegraded":"2024-04-23T10:29:09.715567+0000","last_fullsized":"2024-04-23T10:29:09.715567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'239","last_scrub_stamp":"2024-04-23T10:29:09.715395+0000","last_deep_scrub":"26'239","last_deep_scrub_stamp":"2024-04-23T10:29:09.715395+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.715395+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:31:38.473429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.705622+0000","last_change":"2024-04-23T10:28:55.705667+0000","last_active":"2024-04-23T10:28:55.705622+0000","last_peered":"2024-04-23T10:28:55.705622+0000","last_clean":"2024-04-23T10:28:55.705622+0000","last_became_active":"2024-04-23T10:15:38.021999+0000","last_became_peered":"2024-04-23T10:15:38.021999+0000","last_unstale":"2024-04-23T10:28:55.705622+0000","last_undegraded":"2024-04-23T10:28:55.705622+0000","last_fullsized":"2024-04-23T10:28:55.705622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-23T10:28:55.705507+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-23T10:28:55.705507+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.705507+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:29:59.108345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'218","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.452203+0000","last_change":"2024-04-23T10:29:02.452322+0000","last_active":"2024-04-23T10:29:02.452203+0000","last_peered":"2024-04-23T10:29:02.452203+0000","last_clean":"2024-04-23T10:29:02.452203+0000","last_became_active":"2024-04-23T10:15:38.000271+0000","last_became_peered":"2024-04-23T10:15:38.000271+0000","last_unstale":"2024-04-23T10:29:02.452203+0000","last_undegraded":"2024-04-23T10:29:02.452203+0000","last_fullsized":"2024-04-23T10:29:02.452203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-23T10:29:02.451927+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-23T10:29:02.451927+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.451927+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:09.561742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'204","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.709600+0000","last_change":"2024-04-23T10:29:01.709600+0000","last_active":"2024-04-23T10:29:01.709600+0000","last_peered":"2024-04-23T10:29:01.709600+0000","last_clean":"2024-04-23T10:29:01.709600+0000","last_became_active":"2024-04-23T10:15:37.997331+0000","last_became_peered":"2024-04-23T10:15:37.997331+0000","last_unstale":"2024-04-23T10:29:01.709600+0000","last_undegraded":"2024-04-23T10:29:01.709600+0000","last_fullsized":"2024-04-23T10:29:01.709600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:29:01.709261+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:29:01.709261+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.709261+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:13.109776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'207","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.469908+0000","last_change":"2024-04-23T10:29:08.469908+0000","last_active":"2024-04-23T10:29:08.469908+0000","last_peered":"2024-04-23T10:29:08.469908+0000","last_clean":"2024-04-23T10:29:08.469908+0000","last_became_active":"2024-04-23T10:15:38.038414+0000","last_became_peered":"2024-04-23T10:15:38.038414+0000","last_unstale":"2024-04-23T10:29:08.469908+0000","last_undegraded":"2024-04-23T10:29:08.469908+0000","last_fullsized":"2024-04-23T10:29:08.469908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-23T10:29:08.469660+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-23T10:29:08.469660+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.469660+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:32.184740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'209","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.097601+0000","last_change":"2024-04-23T10:29:03.097601+0000","last_active":"2024-04-23T10:29:03.097601+0000","last_peered":"2024-04-23T10:29:03.097601+0000","last_clean":"2024-04-23T10:29:03.097601+0000","last_became_active":"2024-04-23T10:15:38.027552+0000","last_became_peered":"2024-04-23T10:15:38.027552+0000","last_unstale":"2024-04-23T10:29:03.097601+0000","last_undegraded":"2024-04-23T10:29:03.097601+0000","last_fullsized":"2024-04-23T10:29:03.097601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'209","last_scrub_stamp":"2024-04-23T10:29:03.097376+0000","last_deep_scrub":"26'209","last_deep_scrub_stamp":"2024-04-23T10:29:03.097376+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.097376+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:13.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'221","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:00.778158+0000","last_change":"2024-04-23T10:29:00.778158+0000","last_active":"2024-04-23T10:29:00.778158+0000","last_peered":"2024-04-23T10:29:00.778158+0000","last_clean":"2024-04-23T10:29:00.778158+0000","last_became_active":"2024-04-23T10:15:38.007919+0000","last_became_peered":"2024-04-23T10:15:38.007919+0000","last_unstale":"2024-04-23T10:29:00.778158+0000","last_undegraded":"2024-04-23T10:29:00.778158+0000","last_fullsized":"2024-04-23T10:29:00.778158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'221","last_scrub_stamp":"2024-04-23T10:29:00.777915+0000","last_deep_scrub":"26'221","last_deep_scrub_stamp":"2024-04-23T10:29:00.777915+0000","last_clean_scrub_stamp":"2024-04-23T10:29:00.777915+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:02:45.077111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'208","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:13.712010+0000","last_change":"2024-04-23T10:29:13.712070+0000","last_active":"2024-04-23T10:29:13.712010+0000","last_peered":"2024-04-23T10:29:13.712010+0000","last_clean":"2024-04-23T10:29:13.712010+0000","last_became_active":"2024-04-23T10:15:38.041956+0000","last_became_peered":"2024-04-23T10:15:38.041956+0000","last_unstale":"2024-04-23T10:29:13.712010+0000","last_undegraded":"2024-04-23T10:29:13.712010+0000","last_fullsized":"2024-04-23T10:29:13.712010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:29:13.711821+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:29:13.711821+0000","last_clean_scrub_stamp":"2024-04-23T10:29:13.711821+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:55:10.831146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'208","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:58.106247+0000","last_change":"2024-04-23T10:28:58.106376+0000","last_active":"2024-04-23T10:28:58.106247+0000","last_peered":"2024-04-23T10:28:58.106247+0000","last_clean":"2024-04-23T10:28:58.106247+0000","last_became_active":"2024-04-23T10:15:38.036524+0000","last_became_peered":"2024-04-23T10:15:38.036524+0000","last_unstale":"2024-04-23T10:28:58.106247+0000","last_undegraded":"2024-04-23T10:28:58.106247+0000","last_fullsized":"2024-04-23T10:28:58.106247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:28:58.106066+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:28:58.106066+0000","last_clean_scrub_stamp":"2024-04-23T10:28:58.106066+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:05.068327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'202","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:07.439565+0000","last_change":"2024-04-23T10:29:07.439694+0000","last_active":"2024-04-23T10:29:07.439565+0000","last_peered":"2024-04-23T10:29:07.439565+0000","last_clean":"2024-04-23T10:29:07.439565+0000","last_became_active":"2024-04-23T10:15:38.038186+0000","last_became_peered":"2024-04-23T10:15:38.038186+0000","last_unstale":"2024-04-23T10:29:07.439565+0000","last_undegraded":"2024-04-23T10:29:07.439565+0000","last_fullsized":"2024-04-23T10:29:07.439565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-23T10:29:07.439316+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-23T10:29:07.439316+0000","last_clean_scrub_stamp":"2024-04-23T10:29:07.439316+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:30:47.000661+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.387878+0000","last_change":"2024-04-23T10:29:05.387948+0000","last_active":"2024-04-23T10:29:05.387878+0000","last_peered":"2024-04-23T10:29:05.387878+0000","last_clean":"2024-04-23T10:29:05.387878+0000","last_became_active":"2024-04-23T10:15:38.015411+0000","last_became_peered":"2024-04-23T10:15:38.015411+0000","last_unstale":"2024-04-23T10:29:05.387878+0000","last_undegraded":"2024-04-23T10:29:05.387878+0000","last_fullsized":"2024-04-23T10:29:05.387878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'219","last_scrub_stamp":"2024-04-23T10:29:05.387694+0000","last_deep_scrub":"26'219","last_deep_scrub_stamp":"2024-04-23T10:29:05.387694+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.387694+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:15.908474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'216","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:01.128362+0000","last_change":"2024-04-23T10:29:01.128421+0000","last_active":"2024-04-23T10:29:01.128362+0000","last_peered":"2024-04-23T10:29:01.128362+0000","last_clean":"2024-04-23T10:29:01.128362+0000","last_became_active":"2024-04-23T10:15:38.015514+0000","last_became_peered":"2024-04-23T10:15:38.015514+0000","last_unstale":"2024-04-23T10:29:01.128362+0000","last_undegraded":"2024-04-23T10:29:01.128362+0000","last_fullsized":"2024-04-23T10:29:01.128362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-23T10:29:01.128184+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-23T10:29:01.128184+0000","last_clean_scrub_stamp":"2024-04-23T10:29:01.128184+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:20:34.788689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'211","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.076182+0000","last_change":"2024-04-23T10:29:02.076248+0000","last_active":"2024-04-23T10:29:02.076182+0000","last_peered":"2024-04-23T10:29:02.076182+0000","last_clean":"2024-04-23T10:29:02.076182+0000","last_became_active":"2024-04-23T10:15:38.016600+0000","last_became_peered":"2024-04-23T10:15:38.016600+0000","last_unstale":"2024-04-23T10:29:02.076182+0000","last_undegraded":"2024-04-23T10:29:02.076182+0000","last_fullsized":"2024-04-23T10:29:02.076182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'211","last_scrub_stamp":"2024-04-23T10:29:02.075999+0000","last_deep_scrub":"26'211","last_deep_scrub_stamp":"2024-04-23T10:29:02.075999+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.075999+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:32:28.368897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'198","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:54.679441+0000","last_change":"2024-04-23T10:28:54.679463+0000","last_active":"2024-04-23T10:28:54.679441+0000","last_peered":"2024-04-23T10:28:54.679441+0000","last_clean":"2024-04-23T10:28:54.679441+0000","last_became_active":"2024-04-23T10:15:38.036317+0000","last_became_peered":"2024-04-23T10:15:38.036317+0000","last_unstale":"2024-04-23T10:28:54.679441+0000","last_undegraded":"2024-04-23T10:28:54.679441+0000","last_fullsized":"2024-04-23T10:28:54.679441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'198","last_scrub_stamp":"2024-04-23T10:28:54.679364+0000","last_deep_scrub":"26'198","last_deep_scrub_stamp":"2024-04-23T10:28:54.679364+0000","last_clean_scrub_stamp":"2024-04-23T10:28:54.679364+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:27:07.120591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'183","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.437357+0000","last_change":"2024-04-23T10:28:55.437487+0000","last_active":"2024-04-23T10:28:55.437357+0000","last_peered":"2024-04-23T10:28:55.437357+0000","last_clean":"2024-04-23T10:28:55.437357+0000","last_became_active":"2024-04-23T10:15:38.008090+0000","last_became_peered":"2024-04-23T10:15:38.008090+0000","last_unstale":"2024-04-23T10:28:55.437357+0000","last_undegraded":"2024-04-23T10:28:55.437357+0000","last_fullsized":"2024-04-23T10:28:55.437357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'183","last_scrub_stamp":"2024-04-23T10:28:55.437152+0000","last_deep_scrub":"26'183","last_deep_scrub_stamp":"2024-04-23T10:28:55.437152+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.437152+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:41.948480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:03.754634+0000","last_change":"2024-04-23T10:29:03.754789+0000","last_active":"2024-04-23T10:29:03.754634+0000","last_peered":"2024-04-23T10:29:03.754634+0000","last_clean":"2024-04-23T10:29:03.754634+0000","last_became_active":"2024-04-23T10:15:38.031034+0000","last_became_peered":"2024-04-23T10:15:38.031034+0000","last_unstale":"2024-04-23T10:29:03.754634+0000","last_undegraded":"2024-04-23T10:29:03.754634+0000","last_fullsized":"2024-04-23T10:29:03.754634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'188","last_scrub_stamp":"2024-04-23T10:29:03.754424+0000","last_deep_scrub":"26'188","last_deep_scrub_stamp":"2024-04-23T10:29:03.754424+0000","last_clean_scrub_stamp":"2024-04-23T10:29:03.754424+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:15.215698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'200","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:02.779026+0000","last_change":"2024-04-23T10:29:02.779087+0000","last_active":"2024-04-23T10:29:02.779026+0000","last_peered":"2024-04-23T10:29:02.779026+0000","last_clean":"2024-04-23T10:29:02.779026+0000","last_became_active":"2024-04-23T10:15:38.031003+0000","last_became_peered":"2024-04-23T10:15:38.031003+0000","last_unstale":"2024-04-23T10:29:02.779026+0000","last_undegraded":"2024-04-23T10:29:02.779026+0000","last_fullsized":"2024-04-23T10:29:02.779026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:29:02.778858+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:29:02.778858+0000","last_clean_scrub_stamp":"2024-04-23T10:29:02.778858+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:57:47.309447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'212","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:09.750302+0000","last_change":"2024-04-23T10:29:09.750413+0000","last_active":"2024-04-23T10:29:09.750302+0000","last_peered":"2024-04-23T10:29:09.750302+0000","last_clean":"2024-04-23T10:29:09.750302+0000","last_became_active":"2024-04-23T10:15:38.039529+0000","last_became_peered":"2024-04-23T10:15:38.039529+0000","last_unstale":"2024-04-23T10:29:09.750302+0000","last_undegraded":"2024-04-23T10:29:09.750302+0000","last_fullsized":"2024-04-23T10:29:09.750302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-23T10:29:09.750098+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-23T10:29:09.750098+0000","last_clean_scrub_stamp":"2024-04-23T10:29:09.750098+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:36:01.767261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'194","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:05.726349+0000","last_change":"2024-04-23T10:29:05.726410+0000","last_active":"2024-04-23T10:29:05.726349+0000","last_peered":"2024-04-23T10:29:05.726349+0000","last_clean":"2024-04-23T10:29:05.726349+0000","last_became_active":"2024-04-23T10:15:38.018869+0000","last_became_peered":"2024-04-23T10:15:38.018869+0000","last_unstale":"2024-04-23T10:29:05.726349+0000","last_undegraded":"2024-04-23T10:29:05.726349+0000","last_fullsized":"2024-04-23T10:29:05.726349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'194","last_scrub_stamp":"2024-04-23T10:29:05.726178+0000","last_deep_scrub":"26'194","last_deep_scrub_stamp":"2024-04-23T10:29:05.726178+0000","last_clean_scrub_stamp":"2024-04-23T10:29:05.726178+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:20.450171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:56.544354+0000","last_change":"2024-04-23T10:28:56.544419+0000","last_active":"2024-04-23T10:28:56.544354+0000","last_peered":"2024-04-23T10:28:56.544354+0000","last_clean":"2024-04-23T10:28:56.544354+0000","last_became_active":"2024-04-23T10:15:38.039050+0000","last_became_peered":"2024-04-23T10:15:38.039050+0000","last_unstale":"2024-04-23T10:28:56.544354+0000","last_undegraded":"2024-04-23T10:28:56.544354+0000","last_fullsized":"2024-04-23T10:28:56.544354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:28:56.544183+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:28:56.544183+0000","last_clean_scrub_stamp":"2024-04-23T10:28:56.544183+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:04:58.889944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'188","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.431425+0000","last_change":"2024-04-23T10:29:04.431539+0000","last_active":"2024-04-23T10:29:04.431425+0000","last_peered":"2024-04-23T10:29:04.431425+0000","last_clean":"2024-04-23T10:29:04.431425+0000","last_became_active":"2024-04-23T10:15:38.014646+0000","last_became_peered":"2024-04-23T10:15:38.014646+0000","last_unstale":"2024-04-23T10:29:04.431425+0000","last_undegraded":"2024-04-23T10:29:04.431425+0000","last_fullsized":"2024-04-23T10:29:04.431425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'188","last_scrub_stamp":"2024-04-23T10:29:04.431150+0000","last_deep_scrub":"26'188","last_deep_scrub_stamp":"2024-04-23T10:29:04.431150+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.431150+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:13.550769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'211","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:57.551130+0000","last_change":"2024-04-23T10:28:57.551241+0000","last_active":"2024-04-23T10:28:57.551130+0000","last_peered":"2024-04-23T10:28:57.551130+0000","last_clean":"2024-04-23T10:28:57.551130+0000","last_became_active":"2024-04-23T10:15:38.037589+0000","last_became_peered":"2024-04-23T10:15:38.037589+0000","last_unstale":"2024-04-23T10:28:57.551130+0000","last_undegraded":"2024-04-23T10:28:57.551130+0000","last_fullsized":"2024-04-23T10:28:57.551130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'211","last_scrub_stamp":"2024-04-23T10:28:57.550850+0000","last_deep_scrub":"26'211","last_deep_scrub_stamp":"2024-04-23T10:28:57.550850+0000","last_clean_scrub_stamp":"2024-04-23T10:28:57.550850+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:39:05.958283+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'201","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:55.544974+0000","last_change":"2024-04-23T10:28:55.545035+0000","last_active":"2024-04-23T10:28:55.544974+0000","last_peered":"2024-04-23T10:28:55.544974+0000","last_clean":"2024-04-23T10:28:55.544974+0000","last_became_active":"2024-04-23T10:15:38.013219+0000","last_became_peered":"2024-04-23T10:15:38.013219+0000","last_unstale":"2024-04-23T10:28:55.544974+0000","last_undegraded":"2024-04-23T10:28:55.544974+0000","last_fullsized":"2024-04-23T10:28:55.544974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-23T10:28:55.544761+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-23T10:28:55.544761+0000","last_clean_scrub_stamp":"2024-04-23T10:28:55.544761+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:35:37.106291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'192","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:28:53.000027+0000","last_change":"2024-04-23T10:28:53.000086+0000","last_active":"2024-04-23T10:28:53.000027+0000","last_peered":"2024-04-23T10:28:53.000027+0000","last_clean":"2024-04-23T10:28:53.000027+0000","last_became_active":"2024-04-23T10:15:38.016185+0000","last_became_peered":"2024-04-23T10:15:38.016185+0000","last_unstale":"2024-04-23T10:28:53.000027+0000","last_undegraded":"2024-04-23T10:28:53.000027+0000","last_fullsized":"2024-04-23T10:28:53.000027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'192","last_scrub_stamp":"2024-04-23T10:28:52.999858+0000","last_deep_scrub":"26'192","last_deep_scrub_stamp":"2024-04-23T10:28:52.999858+0000","last_clean_scrub_stamp":"2024-04-23T10:28:52.999858+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:36:50.128405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'215","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:04.074423+0000","last_change":"2024-04-23T10:29:04.074483+0000","last_active":"2024-04-23T10:29:04.074423+0000","last_peered":"2024-04-23T10:29:04.074423+0000","last_clean":"2024-04-23T10:29:04.074423+0000","last_became_active":"2024-04-23T10:15:38.026169+0000","last_became_peered":"2024-04-23T10:15:38.026169+0000","last_unstale":"2024-04-23T10:29:04.074423+0000","last_undegraded":"2024-04-23T10:29:04.074423+0000","last_fullsized":"2024-04-23T10:29:04.074423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'215","last_scrub_stamp":"2024-04-23T10:29:04.074251+0000","last_deep_scrub":"26'215","last_deep_scrub_stamp":"2024-04-23T10:29:04.074251+0000","last_clean_scrub_stamp":"2024-04-23T10:29:04.074251+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:14:50.560344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'214","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:29:08.727989+0000","last_change":"2024-04-23T10:29:08.728048+0000","last_active":"2024-04-23T10:29:08.727989+0000","last_peered":"2024-04-23T10:29:08.727989+0000","last_clean":"2024-04-23T10:29:08.727989+0000","last_became_active":"2024-04-23T10:15:38.038592+0000","last_became_peered":"2024-04-23T10:15:38.038592+0000","last_unstale":"2024-04-23T10:29:08.727989+0000","last_undegraded":"2024-04-23T10:29:08.727989+0000","last_fullsized":"2024-04-23T10:29:08.727989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-23T10:29:08.727803+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-23T10:29:08.727803+0000","last_clean_scrub_stamp":"2024-04-23T10:29:08.727803+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:11:56.298611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2849,"num_read_kb":1515105,"num_write":24366,"num_write_kb":4267173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24772,"ondisk_log_size":24772,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13142,"ondisk_log_size":13142,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":137167340,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":648,"num_read_kb":1960,"num_write":10074,"num_write_kb":140883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274579456,"data_stored":274334680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11125,"ondisk_log_size":11125,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575018,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139456,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94232384,"statfs":{"total":96636764160,"available":96493961216,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575018,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575021,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111508,"kb_used_data":26252,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94260332,"statfs":{"total":96636764160,"available":96522579968,"internally_reserved":0,"allocated":26882048,"data_stored":26671347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575019,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575019,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142116,"kb_used_data":34588,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94229724,"statfs":{"total":96636764160,"available":96491237376,"internally_reserved":0,"allocated":35418112,"data_stored":35225169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575020,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73128,"kb_used_data":10016,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298712,"statfs":{"total":96636764160,"available":96561881088,"internally_reserved":0,"allocated":10256384,"data_stored":10059311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575019,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142016,"kb_used_data":30328,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94229824,"statfs":{"total":96636764160,"available":96491339776,"internally_reserved":0,"allocated":31055872,"data_stored":30862669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575019,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30777344,"data_stored":30748221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9977856,"data_stored":9944863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35139584,"data_stored":35110721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26603520,"data_stored":26556899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:29:36.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-23T10:29:36.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc785958640 1 Processor -- start 2024-04-23T10:29:36.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc785958640 1 -- start start 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc785958640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc780151bb0 0x7fc78015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc785958640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7800c5d50 0x7fc7800c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc785958640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7800c6160 con 0x7fc7800c5900 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc785958640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc78006c910 con 0x7fc7800c5d50 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc785958640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc78006cbf0 con 0x7fc780151bb0 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc77f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7800c5d50 0x7fc7800c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc77f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc7800c5d50 0x7fc7800c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60328/0 (socket says 172.21.15.29:60328) 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc77f7fe640 1 -- 172.21.15.29:0/3233967327 learned_addr learned my addr 172.21.15.29:0/3233967327 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:36.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc77effd640 1 --2- 172.21.15.29:0/3233967327 >> v2:172.21.15.72:3300/0 conn(0x7fc780151bb0 0x7fc78015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc77f7fe640 1 -- 172.21.15.29:0/3233967327 >> v2:172.21.15.72:3300/0 conn(0x7fc780151bb0 msgr2=0x7fc78015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc77f7fe640 1 --2- 172.21.15.29:0/3233967327 >> v2:172.21.15.72:3300/0 conn(0x7fc780151bb0 0x7fc78015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc77f7fe640 1 -- 172.21.15.29:0/3233967327 >> v1:172.21.15.72:6789/0 conn(0x7fc7800c5900 legacy=0x7fc7800cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.000+0000 7fc77f7fe640 1 -- 172.21.15.29:0/3233967327 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78006ced0 con 0x7fc7800c5d50 2024-04-23T10:29:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77f7fe640 1 --2- 172.21.15.29:0/3233967327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5d50 0x7fc7800c6840 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc7800ce060 tx=0x7fc77801f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa85c1d3bceca8f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77dffb640 1 -- 172.21.15.29:0/3233967327 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780b4070 con 0x7fc7800c5d50 2024-04-23T10:29:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77dffb640 1 -- 172.21.15.29:0/3233967327 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7780af400 con 0x7fc7800c5d50 2024-04-23T10:29:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77dffb640 1 -- 172.21.15.29:0/3233967327 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780af7d0 con 0x7fc7800c5d50 2024-04-23T10:29:37.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- 172.21.15.29:0/3233967327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5d50 msgr2=0x7fc7800c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 --2- 172.21.15.29:0/3233967327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5d50 0x7fc7800c6840 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc7800ce060 tx=0x7fc77801f1a0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- 172.21.15.29:0/3233967327 shutdown_connections 2024-04-23T10:29:37.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 --2- 172.21.15.29:0/3233967327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5d50 0x7fc7800c6840 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 --2- 172.21.15.29:0/3233967327 >> v2:172.21.15.72:3300/0 conn(0x7fc780151bb0 0x7fc78015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- 172.21.15.29:0/3233967327 >> 172.21.15.29:0/3233967327 conn(0x7fc7800730f0 msgr2=0x7fc780073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:37.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- 172.21.15.29:0/3233967327 shutdown_connections 2024-04-23T10:29:37.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- 172.21.15.29:0/3233967327 wait complete. 2024-04-23T10:29:37.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 Processor -- start 2024-04-23T10:29:37.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- start start 2024-04-23T10:29:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5900 0x7fc7801f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7800c5d50 0x7fc780150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc780151bb0 0x7fc78015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc780151f90 con 0x7fc7800c5900 2024-04-23T10:29:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc78006d490 con 0x7fc7800c5d50 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc785958640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc7800cbe80 con 0x7fc780151bb0 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5900 0x7fc7801f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5900 0x7fc7801f1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60342/0 (socket says 172.21.15.29:60342) 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77effd640 1 -- 172.21.15.29:0/1614833726 learned_addr learned my addr 172.21.15.29:0/1614833726 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77f7fe640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc780151bb0 0x7fc78015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77e7fc640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7800c5d50 0x7fc780150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77effd640 1 -- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc780151bb0 msgr2=0x7fc78015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77effd640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc780151bb0 0x7fc78015a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77effd640 1 -- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7800c5d50 msgr2=0x7fc780150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77effd640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7800c5d50 0x7fc780150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77effd640 1 -- 172.21.15.29:0/1614833726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78014f430 con 0x7fc7800c5900 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.004+0000 7fc77e7fc640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7800c5d50 0x7fc780150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc77effd640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5900 0x7fc7801f1770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc77000d620 tx=0x7fc77000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc767fff640 1 -- 172.21.15.29:0/1614833726 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77000b620 con 0x7fc7800c5900 2024-04-23T10:29:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc767fff640 1 -- 172.21.15.29:0/1614833726 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc770019070 con 0x7fc7800c5900 2024-04-23T10:29:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78014f6d0 con 0x7fc7800c5900 2024-04-23T10:29:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc767fff640 1 -- 172.21.15.29:0/1614833726 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77000ba20 con 0x7fc7800c5900 2024-04-23T10:29:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc78014fc90 con 0x7fc7800c5900 2024-04-23T10:29:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc780068d70 con 0x7fc7800c5900 2024-04-23T10:29:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc767fff640 1 -- 172.21.15.29:0/1614833726 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc77000bbc0 con 0x7fc7800c5900 2024-04-23T10:29:37.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc767fff640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc76c0683b0 0x7fc76c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc767fff640 1 -- 172.21.15.29:0/1614833726 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc7700872b0 con 0x7fc7800c5900 2024-04-23T10:29:37.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc77e7fc640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc76c0683b0 0x7fc76c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.008+0000 7fc77e7fc640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc76c0683b0 0x7fc76c06a870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7801558a0 tx=0x7fc774009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:37.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.012+0000 7fc767fff640 1 -- 172.21.15.29:0/1614833726 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc7700573c0 con 0x7fc7800c5900 2024-04-23T10:29:37.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.180+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc7800cc320 con 0x7fc7800c5900 2024-04-23T10:29:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.188+0000 7fc767fff640 1 -- 172.21.15.29:0/1614833726 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fc770056cc0 con 0x7fc7800c5900 2024-04-23T10:29:37.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.188+0000 7fc767fff640 1 -- 172.21.15.29:0/1614833726 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc77005b070 con 0x7fc7800c5900 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc76c0683b0 msgr2=0x7fc76c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc76c0683b0 0x7fc76c06a870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7801558a0 tx=0x7fc774009040 comp rx=0 tx=0).stop 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5900 msgr2=0x7fc7801f1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5900 0x7fc7801f1770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc77000d620 tx=0x7fc77000dae0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 shutdown_connections 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fc76c0683b0 0x7fc76c06a870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc780151bb0 0x7fc78015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7800c5d50 0x7fc780150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 --2- 172.21.15.29:0/1614833726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7800c5900 0x7fc7801f1770 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 >> 172.21.15.29:0/1614833726 conn(0x7fc7800730f0 msgr2=0x7fc7800ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 shutdown_connections 2024-04-23T10:29:37.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.192+0000 7fc785958640 1 -- 172.21.15.29:0/1614833726 wait complete. 2024-04-23T10:29:37.205 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-23T10:29:37.205 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:29:37.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.328+0000 7f6f4da38640 1 Processor -- start 2024-04-23T10:29:37.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.328+0000 7f6f4da38640 1 -- start start 2024-04-23T10:29:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f4da38640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4806f150 0x7f6f4806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f4da38640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f480ccc50 0x7f6f480cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f4da38640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f480cd5c0 con 0x7f6f48153190 2024-04-23T10:29:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f4da38640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6f48159f20 con 0x7f6f480ccc50 2024-04-23T10:29:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f4da38640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6f48159380 con 0x7f6f4806f150 2024-04-23T10:29:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f467fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4806f150 0x7f6f4806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f477fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f480ccc50 0x7f6f480cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f467fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4806f150 0x7f6f4806f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.29:33036/0 (socket says 172.21.15.29:33036) 2024-04-23T10:29:37.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f467fc640 1 -- 172.21.15.29:0/503634348 learned_addr learned my addr 172.21.15.29:0/503634348 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:37.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f467fc640 1 -- 172.21.15.29:0/503634348 >> v2:172.21.15.72:3300/0 conn(0x7f6f480ccc50 msgr2=0x7f6f480cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:37.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f467fc640 1 --2- 172.21.15.29:0/503634348 >> v2:172.21.15.72:3300/0 conn(0x7f6f480ccc50 0x7f6f480cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f467fc640 1 -- 172.21.15.29:0/503634348 >> v1:172.21.15.72:6789/0 conn(0x7f6f48153190 legacy=0x7f6f48159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f45ffb640 1 -- 172.21.15.29:0/503634348 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1624795103 0 0) 0x7f6f38001120 con 0x7f6f48153190 2024-04-23T10:29:37.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f467fc640 1 -- 172.21.15.29:0/503634348 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480c3fe0 con 0x7f6f4806f150 2024-04-23T10:29:37.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.332+0000 7f6f477fe640 1 --2- 172.21.15.29:0/503634348 >> v2:172.21.15.72:3300/0 conn(0x7f6f480ccc50 0x7f6f480cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f467fc640 1 --2- 172.21.15.29:0/503634348 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4806f150 0x7f6f4806f550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009870 tx=0x7f6f3c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34ca5b5b4f3ef466 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f45ffb640 1 -- 172.21.15.29:0/503634348 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0b5070 con 0x7f6f4806f150 2024-04-23T10:29:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f45ffb640 1 -- 172.21.15.29:0/503634348 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f3c0a8a50 con 0x7f6f4806f150 2024-04-23T10:29:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f45ffb640 1 -- 172.21.15.29:0/503634348 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0a8e40 con 0x7f6f4806f150 2024-04-23T10:29:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 -- 172.21.15.29:0/503634348 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4806f150 msgr2=0x7f6f4806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 --2- 172.21.15.29:0/503634348 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4806f150 0x7f6f4806f550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009870 tx=0x7f6f3c01ed50 comp rx=0 tx=0).stop 2024-04-23T10:29:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 -- 172.21.15.29:0/503634348 shutdown_connections 2024-04-23T10:29:37.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 --2- 172.21.15.29:0/503634348 >> v2:172.21.15.72:3300/0 conn(0x7f6f480ccc50 0x7f6f480cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 --2- 172.21.15.29:0/503634348 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4806f150 0x7f6f4806f550 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 -- 172.21.15.29:0/503634348 >> 172.21.15.29:0/503634348 conn(0x7f6f4806cfb0 msgr2=0x7f6f4806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:37.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 -- 172.21.15.29:0/503634348 shutdown_connections 2024-04-23T10:29:37.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 -- 172.21.15.29:0/503634348 wait complete. 2024-04-23T10:29:37.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 Processor -- start 2024-04-23T10:29:37.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.336+0000 7f6f4da38640 1 -- start start 2024-04-23T10:29:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f4806f150 0x7f6f4814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f480ccc50 0x7f6f48145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f48153190 0x7f6f481457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6f48159010 con 0x7f6f4806f150 2024-04-23T10:29:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480c45a0 con 0x7f6f48153190 2024-04-23T10:29:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6f48153570 con 0x7f6f480ccc50 2024-04-23T10:29:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f4806f150 0x7f6f4814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f4806f150 0x7f6f4814a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60348/0 (socket says 172.21.15.29:60348) 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 -- 172.21.15.29:0/2261806295 learned_addr learned my addr 172.21.15.29:0/2261806295 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f477fe640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f48153190 0x7f6f481457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f467fc640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f480ccc50 0x7f6f48145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 -- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f480ccc50 msgr2=0x7f6f48145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f480ccc50 0x7f6f48145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 -- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f48153190 msgr2=0x7f6f481457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f48153190 0x7f6f481457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 -- 172.21.15.29:0/2261806295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f481e3550 con 0x7f6f4806f150 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f46ffd640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f4806f150 0x7f6f4814a8b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c750 tx=0x7f6f3800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f2ffff640 1 -- 172.21.15.29:0/2261806295 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38017070 con 0x7f6f4806f150 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f2ffff640 1 -- 172.21.15.29:0/2261806295 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f38005290 con 0x7f6f4806f150 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f481ef5f0 con 0x7f6f4806f150 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f2ffff640 1 -- 172.21.15.29:0/2261806295 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800a640 con 0x7f6f4806f150 2024-04-23T10:29:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f481ef890 con 0x7f6f4806f150 2024-04-23T10:29:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f48068d70 con 0x7f6f4806f150 2024-04-23T10:29:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f2ffff640 1 -- 172.21.15.29:0/2261806295 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f3801a070 con 0x7f6f4806f150 2024-04-23T10:29:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f2ffff640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f34068380 0x7f6f3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f2ffff640 1 -- 172.21.15.29:0/2261806295 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6f38086250 con 0x7f6f4806f150 2024-04-23T10:29:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.340+0000 7f6f467fc640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f34068380 0x7f6f3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.344+0000 7f6f467fc640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f34068380 0x7f6f3406a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0b2000 tx=0x7f6f3c0aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:37.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.344+0000 7f6f2ffff640 1 -- 172.21.15.29:0/2261806295 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f481e3550 con 0x7f6f4806f150 2024-04-23T10:29:37.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.540+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f48156920 con 0x7f6f4806f150 2024-04-23T10:29:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.540+0000 7f6f2ffff640 1 -- 172.21.15.29:0/2261806295 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7f6f480cd5c0 con 0x7f6f4806f150 2024-04-23T10:29:37.537 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:29:37.537 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:29:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:29:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f34068380 msgr2=0x7f6f3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f34068380 0x7f6f3406a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0b2000 tx=0x7f6f3c0aa070 comp rx=0 tx=0).stop 2024-04-23T10:29:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f4806f150 msgr2=0x7f6f4814a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f4806f150 0x7f6f4814a8b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c750 tx=0x7f6f3800cc10 comp rx=0 tx=0).stop 2024-04-23T10:29:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 shutdown_connections 2024-04-23T10:29:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f6f34068380 0x7f6f3406a840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f48153190 0x7f6f481457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f480ccc50 0x7f6f48145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 --2- 172.21.15.29:0/2261806295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f4806f150 0x7f6f4814a8b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 >> 172.21.15.29:0/2261806295 conn(0x7f6f4806cfb0 msgr2=0x7f6f480c32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 shutdown_connections 2024-04-23T10:29:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.544+0000 7f6f4da38640 1 -- 172.21.15.29:0/2261806295 wait complete. 2024-04-23T10:29:37.555 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:29:37.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb75595640 1 Processor -- start 2024-04-23T10:29:37.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb75595640 1 -- start start 2024-04-23T10:29:37.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb75595640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb7006f3b0 0x7fbb700c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb75595640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb7006f790 0x7fbb70073470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb75595640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70072590 con 0x7fbb70071160 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb75595640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fbb70072fe0 con 0x7fbb7006f3b0 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb75595640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbb70158df0 con 0x7fbb7006f790 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb7006f3b0 0x7fbb700c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb7006f3b0 0x7fbb700c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60352/0 (socket says 172.21.15.29:60352) 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6effd640 1 -- 172.21.15.29:0/1923377165 learned_addr learned my addr 172.21.15.29:0/1923377165 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6e7fc640 1 --2- 172.21.15.29:0/1923377165 >> v2:172.21.15.72:3300/0 conn(0x7fbb7006f790 0x7fbb70073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6effd640 1 -- 172.21.15.29:0/1923377165 >> v2:172.21.15.72:3300/0 conn(0x7fbb7006f790 msgr2=0x7fbb70073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6effd640 1 --2- 172.21.15.29:0/1923377165 >> v2:172.21.15.72:3300/0 conn(0x7fbb7006f790 0x7fbb70073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6effd640 1 -- 172.21.15.29:0/1923377165 >> v1:172.21.15.72:6789/0 conn(0x7fbb70071160 legacy=0x7fbb70157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6effd640 1 -- 172.21.15.29:0/1923377165 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb70158830 con 0x7fbb7006f3b0 2024-04-23T10:29:37.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6effd640 1 --2- 172.21.15.29:0/1923377165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f3b0 0x7fbb700c4d70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbb700c7d30 tx=0x7fbb6001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273d671d438450ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:37.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.668+0000 7fbb6dffb640 1 -- 172.21.15.29:0/1923377165 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb600aa5f0 con 0x7fbb7006f3b0 2024-04-23T10:29:37.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6dffb640 1 -- 172.21.15.29:0/1923377165 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbb600af070 con 0x7fbb7006f3b0 2024-04-23T10:29:37.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6dffb640 1 -- 172.21.15.29:0/1923377165 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb600aa9d0 con 0x7fbb7006f3b0 2024-04-23T10:29:37.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- 172.21.15.29:0/1923377165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f3b0 msgr2=0x7fbb700c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 --2- 172.21.15.29:0/1923377165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f3b0 0x7fbb700c4d70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbb700c7d30 tx=0x7fbb6001c490 comp rx=0 tx=0).stop 2024-04-23T10:29:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- 172.21.15.29:0/1923377165 shutdown_connections 2024-04-23T10:29:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 --2- 172.21.15.29:0/1923377165 >> v2:172.21.15.72:3300/0 conn(0x7fbb7006f790 0x7fbb70073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 --2- 172.21.15.29:0/1923377165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f3b0 0x7fbb700c4d70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- 172.21.15.29:0/1923377165 >> 172.21.15.29:0/1923377165 conn(0x7fbb7006cfb0 msgr2=0x7fbb7006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- 172.21.15.29:0/1923377165 shutdown_connections 2024-04-23T10:29:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- 172.21.15.29:0/1923377165 wait complete. 2024-04-23T10:29:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 Processor -- start 2024-04-23T10:29:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- start start 2024-04-23T10:29:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb7006f3b0 0x7fbb701f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f790 0x7fbb70143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb70071160 0x7fbb701f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70152330 con 0x7fbb7006f790 2024-04-23T10:29:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70158500 con 0x7fbb7006f3b0 2024-04-23T10:29:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbb701524b0 con 0x7fbb70071160 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f790 0x7fbb70143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f790 0x7fbb70143370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60354/0 (socket says 172.21.15.29:60354) 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 -- 172.21.15.29:0/2081618845 learned_addr learned my addr 172.21.15.29:0/2081618845 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 -- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb70071160 msgr2=0x7fbb701f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6effd640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb7006f3b0 0x7fbb701f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6f7fe640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb70071160 0x7fbb701f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb70071160 0x7fbb701f4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 -- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb7006f3b0 msgr2=0x7fbb701f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb7006f3b0 0x7fbb701f78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 -- 172.21.15.29:0/2081618845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb70069650 con 0x7fbb7006f790 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb6e7fc640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f790 0x7fbb70143370 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbb58007f20 tx=0x7fbb5800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb677fe640 1 -- 172.21.15.29:0/2081618845 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58014620 con 0x7fbb7006f790 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb677fe640 1 -- 172.21.15.29:0/2081618845 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbb58019070 con 0x7fbb7006f790 2024-04-23T10:29:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7014ab40 con 0x7fbb7006f790 2024-04-23T10:29:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb677fe640 1 -- 172.21.15.29:0/2081618845 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58014a20 con 0x7fbb7006f790 2024-04-23T10:29:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.672+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7014b100 con 0x7fbb7006f790 2024-04-23T10:29:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.676+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb70068d70 con 0x7fbb7006f790 2024-04-23T10:29:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.676+0000 7fbb677fe640 1 -- 172.21.15.29:0/2081618845 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb58014bc0 con 0x7fbb7006f790 2024-04-23T10:29:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.676+0000 7fbb677fe640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbb500683b0 0x7fbb5006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:37.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.676+0000 7fbb677fe640 1 -- 172.21.15.29:0/2081618845 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbb58087770 con 0x7fbb7006f790 2024-04-23T10:29:37.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.676+0000 7fbb6effd640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbb500683b0 0x7fbb5006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:37.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.676+0000 7fbb6effd640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbb500683b0 0x7fbb5006a870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbb600ae000 tx=0x7fbb60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.680+0000 7fbb677fe640 1 -- 172.21.15.29:0/2081618845 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb58057880 con 0x7fbb7006f790 2024-04-23T10:29:37.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb7014be10 con 0x7fbb7006f790 2024-04-23T10:29:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb677fe640 1 -- 172.21.15.29:0/2081618845 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6899 (secure 0 0 0) 0x7fbb58057180 con 0x7fbb7006f790 2024-04-23T10:29:37.876 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:29:37.876 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/789203002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":789203002},{"type":"v1","addr":"172.21.15.29:6833","nonce":789203002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:15:37.368844+0000","modified":"2024-04-23T10:16:21.349356+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4288,"mds_1":4250,"mds_2":4230,"mds_3":4212,"mds_4":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":14,"addr":"172.21.15.29:6836/3348855066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3348855066},{"type":"v1","addr":"172.21.15.29:6836","nonce":3348855066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4212":{"gid":4212,"name":"e","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6837/927431142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":927431142},{"type":"v1","addr":"172.21.15.29:6837","nonce":927431142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4230":{"gid":4230,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.72:6835/1664530327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1664530327},{"type":"v1","addr":"172.21.15.72:6835","nonce":1664530327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4250":{"gid":4250,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.72:6839/41085720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6837","nonce":41085720},{"type":"v1","addr":"172.21.15.72:6839","nonce":41085720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4288":{"gid":4288,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.72:6838/4284551087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":4284551087},{"type":"v1","addr":"172.21.15.72:6838","nonce":4284551087}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4209,4212,4230,4250,4288]},"id":1}]} 2024-04-23T10:29:37.877 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbb500683b0 msgr2=0x7fbb5006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbb500683b0 0x7fbb5006a870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbb600ae000 tx=0x7fbb60008040 comp rx=0 tx=0).stop 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f790 msgr2=0x7fbb70143370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f790 0x7fbb70143370 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbb58007f20 tx=0x7fbb5800e570 comp rx=0 tx=0).stop 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 shutdown_connections 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fbb500683b0 0x7fbb5006a870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb70071160 0x7fbb701f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb7006f790 0x7fbb70143370 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 --2- 172.21.15.29:0/2081618845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb7006f3b0 0x7fbb701f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 >> 172.21.15.29:0/2081618845 conn(0x7fbb7006cfb0 msgr2=0x7fbb7014ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 shutdown_connections 2024-04-23T10:29:37.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:37.880+0000 7fbb75595640 1 -- 172.21.15.29:0/2081618845 wait complete. 2024-04-23T10:29:37.895 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:29:38.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f264d8d0640 1 Processor -- start 2024-04-23T10:29:38.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f264d8d0640 1 -- start start 2024-04-23T10:29:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f264d8d0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c72e0 0x7f26480740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f264d8d0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26480c76c0 0x7f264815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f264d8d0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2648159cc0 0x7f2648152db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f264d8d0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2648075ce0 con 0x7f2648159cc0 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f264d8d0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2648075050 con 0x7f26480c76c0 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f264d8d0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2648075860 con 0x7f26480c72e0 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26477fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2648159cc0 0x7f2648152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26477fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2648159cc0 0x7f2648152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60356/0 (socket says 172.21.15.29:60356) 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26477fe640 1 -- 172.21.15.29:0/495496322 learned_addr learned my addr 172.21.15.29:0/495496322 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26467fc640 1 --2- 172.21.15.29:0/495496322 >> v2:172.21.15.72:3300/0 conn(0x7f26480c76c0 0x7f264815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f2646ffd640 1 --2- 172.21.15.29:0/495496322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c72e0 0x7f26480740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26477fe640 1 -- 172.21.15.29:0/495496322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c72e0 msgr2=0x7f26480740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26477fe640 1 --2- 172.21.15.29:0/495496322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c72e0 0x7f26480740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26477fe640 1 -- 172.21.15.29:0/495496322 >> v2:172.21.15.72:3300/0 conn(0x7f26480c76c0 msgr2=0x7f264815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26477fe640 1 --2- 172.21.15.29:0/495496322 >> v2:172.21.15.72:3300/0 conn(0x7f26480c76c0 0x7f264815c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.020+0000 7f26477fe640 1 -- 172.21.15.29:0/495496322 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26480752a0 con 0x7f2648159cc0 2024-04-23T10:29:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f26477fe640 1 --2- 172.21.15.29:0/495496322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f2648152db0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2648071d80 tx=0x7f264001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8732df2e1fe1ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f2645ffb640 1 -- 172.21.15.29:0/495496322 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26400b5070 con 0x7f2648159cc0 2024-04-23T10:29:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f2645ffb640 1 -- 172.21.15.29:0/495496322 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f26400a89d0 con 0x7f2648159cc0 2024-04-23T10:29:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f2645ffb640 1 -- 172.21.15.29:0/495496322 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26400a8dc0 con 0x7f2648159cc0 2024-04-23T10:29:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- 172.21.15.29:0/495496322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 msgr2=0x7f2648152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 --2- 172.21.15.29:0/495496322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f2648152db0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2648071d80 tx=0x7f264001ed10 comp rx=0 tx=0).stop 2024-04-23T10:29:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- 172.21.15.29:0/495496322 shutdown_connections 2024-04-23T10:29:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 --2- 172.21.15.29:0/495496322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f2648152db0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 --2- 172.21.15.29:0/495496322 >> v2:172.21.15.72:3300/0 conn(0x7f26480c76c0 0x7f264815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 --2- 172.21.15.29:0/495496322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c72e0 0x7f26480740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- 172.21.15.29:0/495496322 >> 172.21.15.29:0/495496322 conn(0x7f264806b9e0 msgr2=0x7f264806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- 172.21.15.29:0/495496322 shutdown_connections 2024-04-23T10:29:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- 172.21.15.29:0/495496322 wait complete. 2024-04-23T10:29:38.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 Processor -- start 2024-04-23T10:29:38.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- start start 2024-04-23T10:29:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26480c72e0 0x7f26481ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c76c0 0x7f264814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f264814b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f26481594c0 con 0x7f2648159cc0 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f26481591e0 con 0x7f26480c72e0 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f264d8d0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f26481597a0 con 0x7f26480c76c0 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f26477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f264814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f26477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f264814b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60372/0 (socket says 172.21.15.29:60372) 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.024+0000 7f26477fe640 1 -- 172.21.15.29:0/4200466119 learned_addr learned my addr 172.21.15.29:0/4200466119 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f2646ffd640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26480c72e0 0x7f26481ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f26467fc640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c76c0 0x7f264814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f26477fe640 1 -- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c76c0 msgr2=0x7f264814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f26477fe640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c76c0 0x7f264814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f26477fe640 1 -- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26480c72e0 msgr2=0x7f26481ee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f26477fe640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26480c72e0 0x7f26481ee4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f26477fe640 1 -- 172.21.15.29:0/4200466119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2648069f10 con 0x7f2648159cc0 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f2646ffd640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26480c72e0 0x7f26481ee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f26477fe640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f264814b280 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f26400b3040 tx=0x7f264001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f262ffff640 1 -- 172.21.15.29:0/4200466119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26400c0070 con 0x7f2648159cc0 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f262ffff640 1 -- 172.21.15.29:0/4200466119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f26400b07e0 con 0x7f2648159cc0 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f262ffff640 1 -- 172.21.15.29:0/4200466119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26400b5040 con 0x7f2648159cc0 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26481eeaf0 con 0x7f2648159cc0 2024-04-23T10:29:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26481ef0b0 con 0x7f2648159cc0 2024-04-23T10:29:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2648076260 con 0x7f2648159cc0 2024-04-23T10:29:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f262ffff640 1 -- 172.21.15.29:0/4200466119 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f26400c3070 con 0x7f2648159cc0 2024-04-23T10:29:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f262ffff640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2634068380 0x7f263406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f262ffff640 1 -- 172.21.15.29:0/4200466119 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2640123d10 con 0x7f2648159cc0 2024-04-23T10:29:38.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f2646ffd640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2634068380 0x7f263406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.028+0000 7f2646ffd640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2634068380 0x7f263406a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2638003fd0 tx=0x7f2638003a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.032+0000 7f262ffff640 1 -- 172.21.15.29:0/4200466119 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2640018870 con 0x7f2648159cc0 2024-04-23T10:29:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.196+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f264806c100 con 0x7f2648159cc0 2024-04-23T10:29:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f262ffff640 1 -- 172.21.15.29:0/4200466119 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18877 (secure 0 0 0) 0x7f26400f3e20 con 0x7f2648159cc0 2024-04-23T10:29:38.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-23T10:29:38.197 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":26,"fsid":"04cdcd58-672f-4635-ab0e-456f05ed3368","created":"2024-04-23T10:15:20.224358+0000","modified":"2024-04-23T10:16:26.277550+0000","last_up_change":"2024-04-23T10:15:30.899992+0000","last_in_change":"2024-04-23T10:15:22.564029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:15:31.234422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:15:35.259947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:15:36.319607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:15:40.046712+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6e46ea02-d5dd-4188-8828-1b1b43a81155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6801","nonce":486295385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6803","nonce":486295385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6807","nonce":486295385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":486295385},{"type":"v1","addr":"172.21.15.29:6805","nonce":486295385}]},"public_addr":"172.21.15.29:6801/486295385","cluster_addr":"172.21.15.29:6803/486295385","heartbeat_back_addr":"172.21.15.29:6807/486295385","heartbeat_front_addr":"172.21.15.29:6805/486295385","state":["exists","up"]},{"osd":1,"uuid":"6bdb22bd-1e3c-425a-b281-9e2278da0520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6825","nonce":808351651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6827","nonce":808351651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6831","nonce":808351651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":808351651},{"type":"v1","addr":"172.21.15.29:6829","nonce":808351651}]},"public_addr":"172.21.15.29:6825/808351651","cluster_addr":"172.21.15.29:6827/808351651","heartbeat_back_addr":"172.21.15.29:6831/808351651","heartbeat_front_addr":"172.21.15.29:6829/808351651","state":["exists","up"]},{"osd":2,"uuid":"cd517f53-aa2f-4faf-a252-f9b7ad473667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6809","nonce":1459392502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6811","nonce":1459392502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6815","nonce":1459392502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1459392502},{"type":"v1","addr":"172.21.15.29:6813","nonce":1459392502}]},"public_addr":"172.21.15.29:6809/1459392502","cluster_addr":"172.21.15.29:6811/1459392502","heartbeat_back_addr":"172.21.15.29:6815/1459392502","heartbeat_front_addr":"172.21.15.29:6813/1459392502","state":["exists","up"]},{"osd":3,"uuid":"b8b4dae0-fb83-4b89-b0c9-bd95eb9744ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6817","nonce":657827017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6819","nonce":657827017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6823","nonce":657827017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":657827017},{"type":"v1","addr":"172.21.15.29:6821","nonce":657827017}]},"public_addr":"172.21.15.29:6817/657827017","cluster_addr":"172.21.15.29:6819/657827017","heartbeat_back_addr":"172.21.15.29:6823/657827017","heartbeat_front_addr":"172.21.15.29:6821/657827017","state":["exists","up"]},{"osd":4,"uuid":"acfd70d1-45fe-4746-9f3e-6447853dfaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6817","nonce":4213352672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6819","nonce":4213352672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6823","nonce":4213352672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":4213352672},{"type":"v1","addr":"172.21.15.72:6821","nonce":4213352672}]},"public_addr":"172.21.15.72:6817/4213352672","cluster_addr":"172.21.15.72:6819/4213352672","heartbeat_back_addr":"172.21.15.72:6823/4213352672","heartbeat_front_addr":"172.21.15.72:6821/4213352672","state":["exists","up"]},{"osd":5,"uuid":"d93f7e73-c8d0-402e-bf90-9e81ef1bf283","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6802","nonce":4132179166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6805","nonce":4132179166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6812","nonce":4132179166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":4132179166},{"type":"v1","addr":"172.21.15.72:6809","nonce":4132179166}]},"public_addr":"172.21.15.72:6802/4132179166","cluster_addr":"172.21.15.72:6805/4132179166","heartbeat_back_addr":"172.21.15.72:6812/4132179166","heartbeat_front_addr":"172.21.15.72:6809/4132179166","state":["exists","up"]},{"osd":6,"uuid":"330ae5ec-02c0-490e-8031-8a5f432a1dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6825","nonce":3506994715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6827","nonce":3506994715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6831","nonce":3506994715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3506994715},{"type":"v1","addr":"172.21.15.72:6829","nonce":3506994715}]},"public_addr":"172.21.15.72:6825/3506994715","cluster_addr":"172.21.15.72:6827/3506994715","heartbeat_back_addr":"172.21.15.72:6831/3506994715","heartbeat_front_addr":"172.21.15.72:6829/3506994715","state":["exists","up"]},{"osd":7,"uuid":"789febc7-727c-4454-88c9-9b396669f9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6801","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6803","nonce":1745734040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6808","nonce":1745734040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6815","nonce":1745734040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":1745734040},{"type":"v1","addr":"172.21.15.72:6813","nonce":1745734040}]},"public_addr":"172.21.15.72:6803/1745734040","cluster_addr":"172.21.15.72:6808/1745734040","heartbeat_back_addr":"172.21.15.72:6815/1745734040","heartbeat_front_addr":"172.21.15.72:6813/1745734040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.127794+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.086899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.124768+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.116159+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.125272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:27.977238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.085401+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:15:28.092307+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:29:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2634068380 msgr2=0x7f263406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2634068380 0x7f263406a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2638003fd0 tx=0x7f2638003a00 comp rx=0 tx=0).stop 2024-04-23T10:29:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 msgr2=0x7f264814b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f264814b280 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f26400b3040 tx=0x7f264001bab0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 shutdown_connections 2024-04-23T10:29:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f2634068380 0x7f263406a840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2648159cc0 0x7f264814b280 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26480c76c0 0x7f264814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 --2- 172.21.15.29:0/4200466119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26480c72e0 0x7f26481ee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 >> 172.21.15.29:0/4200466119 conn(0x7f264806b9e0 msgr2=0x7f2648151c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.200+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 shutdown_connections 2024-04-23T10:29:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.204+0000 7f264d8d0640 1 -- 172.21.15.29:0/4200466119 wait complete. 2024-04-23T10:29:38.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-23T10:29:38.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.340+0000 7f6346552640 1 Processor -- start 2024-04-23T10:29:38.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6346552640 1 -- start start 2024-04-23T10:29:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6346552640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6340071160 0x7f63400c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6346552640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6340072590 con 0x7f634006f790 2024-04-23T10:29:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6346552640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6340158830 con 0x7f634006f3b0 2024-04-23T10:29:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6346552640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f6340072fe0 con 0x7f6340071160 2024-04-23T10:29:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6344aef640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6340071160 0x7f63400c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f633f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f634006f790 0x7f6340151b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60228/0 (socket says 172.21.15.29:60228) 2024-04-23T10:29:38.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6344aef640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6340071160 0x7f63400c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60374/0 (socket says 172.21.15.29:60374) 2024-04-23T10:29:38.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f633f7fe640 1 -- 172.21.15.29:0/148024565 learned_addr learned my addr 172.21.15.29:0/148024565 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:29:38.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6344aef640 1 -- 172.21.15.29:0/148024565 >> v1:172.21.15.72:6789/0 conn(0x7f634006f3b0 legacy=0x7f6340157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:38.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6344aef640 1 -- 172.21.15.29:0/148024565 >> v1:172.21.15.29:6789/0 conn(0x7f634006f790 legacy=0x7f6340151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6344aef640 1 -- 172.21.15.29:0/148024565 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6340158b10 con 0x7f6340071160 2024-04-23T10:29:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.344+0000 7f6344aef640 1 --2- 172.21.15.29:0/148024565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6340071160 0x7f63400c4d70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f63380097c0 tx=0x7f633801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6a8c7ee8b4661e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633effd640 1 -- 172.21.15.29:0/148024565 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63380b0070 con 0x7f6340071160 2024-04-23T10:29:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633effd640 1 -- 172.21.15.29:0/148024565 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f63380ab600 con 0x7f6340071160 2024-04-23T10:29:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633effd640 1 -- 172.21.15.29:0/148024565 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63380ab9f0 con 0x7f6340071160 2024-04-23T10:29:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- 172.21.15.29:0/148024565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6340071160 msgr2=0x7f63400c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 --2- 172.21.15.29:0/148024565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6340071160 0x7f63400c4d70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f63380097c0 tx=0x7f633801c460 comp rx=0 tx=0).stop 2024-04-23T10:29:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- 172.21.15.29:0/148024565 shutdown_connections 2024-04-23T10:29:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 --2- 172.21.15.29:0/148024565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6340071160 0x7f63400c4d70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- 172.21.15.29:0/148024565 >> 172.21.15.29:0/148024565 conn(0x7f634006cfb0 msgr2=0x7f634006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- 172.21.15.29:0/148024565 shutdown_connections 2024-04-23T10:29:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- 172.21.15.29:0/148024565 wait complete. 2024-04-23T10:29:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 Processor -- start 2024-04-23T10:29:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- start start 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f634006f3b0 0x7f63400cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f634006f790 0x7f6340144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6340071160 0x7f63400c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6340165fa0 con 0x7f634006f3b0 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6340158500 con 0x7f6340071160 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6340166120 con 0x7f634006f790 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f634006f3b0 0x7f63400cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f634006f3b0 0x7f63400cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60380/0 (socket says 172.21.15.29:60380) 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 -- 172.21.15.29:0/755008066 learned_addr learned my addr 172.21.15.29:0/755008066 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633f7fe640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f634006f790 0x7f6340144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6344aef640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6340071160 0x7f63400c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 -- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f634006f790 msgr2=0x7f6340144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f634006f790 0x7f6340144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 -- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6340071160 msgr2=0x7f63400c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6340071160 0x7f63400c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 -- 172.21.15.29:0/755008066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63400c8ad0 con 0x7f634006f3b0 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633ffff640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f634006f3b0 0x7f63400cb090 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f633000ba50 tx=0x7f633000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633cff9640 1 -- 172.21.15.29:0/755008066 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330019070 con 0x7f634006f3b0 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633cff9640 1 -- 172.21.15.29:0/755008066 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f633000cc20 con 0x7f634006f3b0 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63401445b0 con 0x7f634006f3b0 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f633cff9640 1 -- 172.21.15.29:0/755008066 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63300146a0 con 0x7f634006f3b0 2024-04-23T10:29:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.348+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63400c8d70 con 0x7f634006f3b0 2024-04-23T10:29:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.352+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6340068d70 con 0x7f634006f3b0 2024-04-23T10:29:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.352+0000 7f633cff9640 1 -- 172.21.15.29:0/755008066 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f633001c070 con 0x7f634006f3b0 2024-04-23T10:29:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.352+0000 7f633cff9640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f632c068380 0x7f632c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.352+0000 7f633cff9640 1 -- 172.21.15.29:0/755008066 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6330086bb0 con 0x7f634006f3b0 2024-04-23T10:29:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.352+0000 7f633f7fe640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f632c068380 0x7f632c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.352+0000 7f633f7fe640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f632c068380 0x7f632c06a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f63400c7880 tx=0x7f6334009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.356+0000 7f633cff9640 1 -- 172.21.15.29:0/755008066 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63300565d0 con 0x7f634006f3b0 2024-04-23T10:29:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.556+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f63401581e0 con 0x7f634006f3b0 2024-04-23T10:29:38.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.560+0000 7f633cff9640 1 -- 172.21.15.29:0/755008066 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f633005a8d0 con 0x7f634006f3b0 2024-04-23T10:29:38.558 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-23T10:29:38.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.564+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f632c068380 msgr2=0x7f632c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.564+0000 7f6346552640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f632c068380 0x7f632c06a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f63400c7880 tx=0x7f6334009040 comp rx=0 tx=0).stop 2024-04-23T10:29:38.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.564+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f634006f3b0 msgr2=0x7f63400cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.564+0000 7f6346552640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f634006f3b0 0x7f63400cb090 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f633000ba50 tx=0x7f633000bf10 comp rx=0 tx=0).stop 2024-04-23T10:29:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.568+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 shutdown_connections 2024-04-23T10:29:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.568+0000 7f6346552640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f632c068380 0x7f632c06a840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.568+0000 7f6346552640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6340071160 0x7f63400c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.568+0000 7f6346552640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f634006f790 0x7f6340144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.568+0000 7f6346552640 1 --2- 172.21.15.29:0/755008066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f634006f3b0 0x7f63400cb090 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.568+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 >> 172.21.15.29:0/755008066 conn(0x7f634006cfb0 msgr2=0x7f634014cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:38.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.568+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 shutdown_connections 2024-04-23T10:29:38.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.568+0000 7f6346552640 1 -- 172.21.15.29:0/755008066 wait complete. 2024-04-23T10:29:38.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-23T10:29:38.622 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-04-23T10:29:38.635 INFO:tasks.ceph.mds.e.smithi029.stdout:starting mds.e at 2024-04-23T10:29:38.643 INFO:tasks.ceph.mds.f.smithi072.stdout:starting mds.f at 2024-04-23T10:29:38.649 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2024-04-23T10:29:38.650 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2024-04-23T10:29:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f109e7fc640 1 Processor -- start 2024-04-23T10:29:38.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f109e7fc640 1 -- start start 2024-04-23T10:29:38.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f109e7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f109815bee0 0x7f109815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f109e7fc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109815f1e0 con 0x7f109815e7e0 2024-04-23T10:29:38.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f109e7fc640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109815f4c0 con 0x7f1098155410 2024-04-23T10:29:38.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f109e7fc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f109815cc20 con 0x7f109815bee0 2024-04-23T10:29:38.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f10977fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f109815bee0 0x7f109815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f109cd99640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f109815e7e0 0x7f10980cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60240/0 (socket says 172.21.15.29:60240) 2024-04-23T10:29:38.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f109cd99640 1 -- 172.21.15.29:0/3500132596 learned_addr learned my addr 172.21.15.29:0/3500132596 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:29:38.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f10977fe640 1 -- 172.21.15.29:0/3500132596 >> v1:172.21.15.72:6789/0 conn(0x7f1098155410 legacy=0x7f10980756e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:38.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f10977fe640 1 -- 172.21.15.29:0/3500132596 >> v1:172.21.15.29:6789/0 conn(0x7f109815e7e0 legacy=0x7f10980cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f10977fe640 1 -- 172.21.15.29:0/3500132596 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109815b400 con 0x7f109815bee0 2024-04-23T10:29:38.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f10977fe640 1 --2- 172.21.15.29:0/3500132596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815bee0 0x7f109815c6e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f10880097c0 tx=0x7f108801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4929211335dc14 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.700+0000 7f1096ffd640 1 -- 172.21.15.29:0/3500132596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10880b0070 con 0x7f109815bee0 2024-04-23T10:29:38.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f1096ffd640 1 -- 172.21.15.29:0/3500132596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f10880ab600 con 0x7f109815bee0 2024-04-23T10:29:38.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f1096ffd640 1 -- 172.21.15.29:0/3500132596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10880a4e60 con 0x7f109815bee0 2024-04-23T10:29:38.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- 172.21.15.29:0/3500132596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815bee0 msgr2=0x7f109815c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 --2- 172.21.15.29:0/3500132596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815bee0 0x7f109815c6e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f10880097c0 tx=0x7f108801c3d0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- 172.21.15.29:0/3500132596 shutdown_connections 2024-04-23T10:29:38.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 --2- 172.21.15.29:0/3500132596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815bee0 0x7f109815c6e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- 172.21.15.29:0/3500132596 >> 172.21.15.29:0/3500132596 conn(0x7f1098068180 msgr2=0x7f109806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:38.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- 172.21.15.29:0/3500132596 shutdown_connections 2024-04-23T10:29:38.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- 172.21.15.29:0/3500132596 wait complete. 2024-04-23T10:29:38.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 Processor -- start 2024-04-23T10:29:38.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- start start 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1098155410 0x7f10980c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109815bee0 0x7f10980701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815e7e0 0x7f109813e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f10981697b0 con 0x7f109815e7e0 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f109815ba50 con 0x7f1098155410 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1098169930 con 0x7f109815bee0 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815e7e0 0x7f109813e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815e7e0 0x7f109813e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60446/0 (socket says 172.21.15.29:60446) 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 -- 172.21.15.29:0/1367261642 learned_addr learned my addr 172.21.15.29:0/1367261642 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:38.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f1097fff640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1098155410 0x7f10980c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f10977fe640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109815bee0 0x7f10980701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 -- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109815bee0 msgr2=0x7f10980701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109815bee0 0x7f10980701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 -- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1098155410 msgr2=0x7f10980c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1098155410 0x7f10980c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 -- 172.21.15.29:0/1367261642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10980c5230 con 0x7f109815e7e0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f1097fff640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1098155410 0x7f10980c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109cd99640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815e7e0 0x7f109813e1d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f109000cab0 tx=0x7f109000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f1094ff9640 1 -- 172.21.15.29:0/1367261642 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090017070 con 0x7f109815e7e0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f1094ff9640 1 -- 172.21.15.29:0/1367261642 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f109000ac30 con 0x7f109815e7e0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10981585d0 con 0x7f109815e7e0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f1094ff9640 1 -- 172.21.15.29:0/1367261642 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090012400 con 0x7f109815e7e0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.704+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1098158b90 con 0x7f109815e7e0 2024-04-23T10:29:38.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.708+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1098158dd0 con 0x7f109815e7e0 2024-04-23T10:29:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.708+0000 7f1094ff9640 1 -- 172.21.15.29:0/1367261642 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f109001a070 con 0x7f109815e7e0 2024-04-23T10:29:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.708+0000 7f1094ff9640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1084068380 0x7f108406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.708+0000 7f1094ff9640 1 -- 172.21.15.29:0/1367261642 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 7194+0+0 (secure 0 0 0) 0x7f1090086b90 con 0x7f109815e7e0 2024-04-23T10:29:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.708+0000 7f1097fff640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1084068380 0x7f108406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:38.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.708+0000 7f1097fff640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1084068380 0x7f108406a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f108c003ec0 tx=0x7f108c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:38.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.712+0000 7f1094ff9640 1 -- 172.21.15.29:0/1367261642 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1090056530 con 0x7f109815e7e0 2024-04-23T10:29:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:38.908+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1098142980 con 0x7f109815e7e0 2024-04-23T10:29:39.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.564+0000 7f1094ff9640 1 -- 172.21.15.29:0/1367261642 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f109005a830 con 0x7f109815e7e0 2024-04-23T10:29:39.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1084068380 msgr2=0x7f108406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1084068380 0x7f108406a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f108c003ec0 tx=0x7f108c009040 comp rx=0 tx=0).stop 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815e7e0 msgr2=0x7f109813e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815e7e0 0x7f109813e1d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f109000cab0 tx=0x7f109000cf70 comp rx=0 tx=0).stop 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 shutdown_connections 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f1084068380 0x7f108406a840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f109815e7e0 0x7f109813e1d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109815bee0 0x7f10980701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 --2- 172.21.15.29:0/1367261642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1098155410 0x7f10980c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 >> 172.21.15.29:0/1367261642 conn(0x7f1098068180 msgr2=0x7f10980cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 shutdown_connections 2024-04-23T10:29:39.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.568+0000 7f109e7fc640 1 -- 172.21.15.29:0/1367261642 wait complete. 2024-04-23T10:29:39.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-23T10:29:39.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f91904a3640 1 Processor -- start 2024-04-23T10:29:39.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f91904a3640 1 -- start start 2024-04-23T10:29:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f91904a3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9188151e20 0x7f9188157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f91904a3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91881599d0 0x7f91880c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f91904a3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f918806eaa0 con 0x7f91880c7fa0 2024-04-23T10:29:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f91904a3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f918806f970 con 0x7f9188151e20 2024-04-23T10:29:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f91904a3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f918806ed60 con 0x7f91881599d0 2024-04-23T10:29:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918e23f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9188151e20 0x7f9188157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918da3e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f91880c7fa0 0x7f91881592c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60248/0 (socket says 172.21.15.29:60248) 2024-04-23T10:29:39.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918e23f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9188151e20 0x7f9188157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60452/0 (socket says 172.21.15.29:60452) 2024-04-23T10:29:39.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918da3e640 1 -- 172.21.15.29:0/1020972881 learned_addr learned my addr 172.21.15.29:0/1020972881 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:29:39.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918ea40640 1 --2- 172.21.15.29:0/1020972881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91881599d0 0x7f91880c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918e23f640 1 -- 172.21.15.29:0/1020972881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91881599d0 msgr2=0x7f91880c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918e23f640 1 --2- 172.21.15.29:0/1020972881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91881599d0 0x7f91880c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918e23f640 1 -- 172.21.15.29:0/1020972881 >> v1:172.21.15.29:6789/0 conn(0x7f91880c7fa0 legacy=0x7f91881592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.768+0000 7f918e23f640 1 -- 172.21.15.29:0/1020972881 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918806f040 con 0x7f9188151e20 2024-04-23T10:29:39.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f918e23f640 1 --2- 172.21.15.29:0/1020972881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9188151e20 0x7f9188157cd0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f91840097c0 tx=0x7f918401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79a0dea67a9cece server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f918d23d640 1 -- 172.21.15.29:0/1020972881 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91840b0070 con 0x7f9188151e20 2024-04-23T10:29:39.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f918d23d640 1 -- 172.21.15.29:0/1020972881 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f91840ab600 con 0x7f9188151e20 2024-04-23T10:29:39.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f918d23d640 1 -- 172.21.15.29:0/1020972881 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91840ab9f0 con 0x7f9188151e20 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 -- 172.21.15.29:0/1020972881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9188151e20 msgr2=0x7f9188157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 --2- 172.21.15.29:0/1020972881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9188151e20 0x7f9188157cd0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f91840097c0 tx=0x7f918401c3c0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 -- 172.21.15.29:0/1020972881 shutdown_connections 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 --2- 172.21.15.29:0/1020972881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91881599d0 0x7f91880c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 --2- 172.21.15.29:0/1020972881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9188151e20 0x7f9188157cd0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 -- 172.21.15.29:0/1020972881 >> 172.21.15.29:0/1020972881 conn(0x7f91880c8f90 msgr2=0x7f91880c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 -- 172.21.15.29:0/1020972881 shutdown_connections 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 -- 172.21.15.29:0/1020972881 wait complete. 2024-04-23T10:29:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.772+0000 7f91904a3640 1 Processor -- start 2024-04-23T10:29:39.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 -- start start 2024-04-23T10:29:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91880c7fa0 0x7f91880738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9188151e20 0x7f91880c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91881599d0 0x7f91881f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f91880c3d40 con 0x7f91881599d0 2024-04-23T10:29:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f918806f600 con 0x7f9188151e20 2024-04-23T10:29:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f91880c3ec0 con 0x7f91880c7fa0 2024-04-23T10:29:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91881599d0 0x7f91881f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91881599d0 0x7f91881f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60458/0 (socket says 172.21.15.29:60458) 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 -- 172.21.15.29:0/834808026 learned_addr learned my addr 172.21.15.29:0/834808026 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918e23f640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91880c7fa0 0x7f91880738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918da3e640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9188151e20 0x7f91880c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 -- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91880c7fa0 msgr2=0x7f91880738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91880c7fa0 0x7f91880738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 -- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9188151e20 msgr2=0x7f91880c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9188151e20 0x7f91880c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 -- 172.21.15.29:0/834808026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91880c5b80 con 0x7f91881599d0 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918da3e640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9188151e20 0x7f91880c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918ea40640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91881599d0 0x7f91881f4700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9180007e60 tx=0x7f918000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f917effd640 1 -- 172.21.15.29:0/834808026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180014420 con 0x7f91881599d0 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f917effd640 1 -- 172.21.15.29:0/834808026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9180019070 con 0x7f91881599d0 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91880c5e60 con 0x7f91881599d0 2024-04-23T10:29:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f917effd640 1 -- 172.21.15.29:0/834808026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180014840 con 0x7f91881599d0 2024-04-23T10:29:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9188158160 con 0x7f91881599d0 2024-04-23T10:29:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9188068d70 con 0x7f91881599d0 2024-04-23T10:29:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f917effd640 1 -- 172.21.15.29:0/834808026 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91800149e0 con 0x7f91881599d0 2024-04-23T10:29:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f917effd640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f916c068380 0x7f916c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f917effd640 1 -- 172.21.15.29:0/834808026 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 7194+0+0 (secure 0 0 0) 0x7f9180087910 con 0x7f91881599d0 2024-04-23T10:29:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.776+0000 7f918e23f640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f916c068380 0x7f916c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.780+0000 7f918e23f640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f916c068380 0x7f916c06a840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91840ad000 tx=0x7f9184008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.784+0000 7f917effd640 1 -- 172.21.15.29:0/834808026 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9180057870 con 0x7f91881599d0 2024-04-23T10:29:39.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:39.952+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9188155920 con 0x7f91881599d0 2024-04-23T10:29:40.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.572+0000 7f917effd640 1 -- 172.21.15.29:0/834808026 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f9180057170 con 0x7f91881599d0 2024-04-23T10:29:40.570 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-04-23T10:29:40.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.576+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f916c068380 msgr2=0x7f916c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:40.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.576+0000 7f91904a3640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f916c068380 0x7f916c06a840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91840ad000 tx=0x7f9184008040 comp rx=0 tx=0).stop 2024-04-23T10:29:40.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.576+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91881599d0 msgr2=0x7f91881f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:40.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.576+0000 7f91904a3640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91881599d0 0x7f91881f4700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9180007e60 tx=0x7f918000e4b0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.580+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 shutdown_connections 2024-04-23T10:29:40.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.580+0000 7f91904a3640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7f916c068380 0x7f916c06a840 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.580+0000 7f91904a3640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91881599d0 0x7f91881f4700 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.580+0000 7f91904a3640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9188151e20 0x7f91880c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.580+0000 7f91904a3640 1 --2- 172.21.15.29:0/834808026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91880c7fa0 0x7f91880738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.580+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 >> 172.21.15.29:0/834808026 conn(0x7f91880c8f90 msgr2=0x7f918814ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:40.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.580+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 shutdown_connections 2024-04-23T10:29:40.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.580+0000 7f91904a3640 1 -- 172.21.15.29:0/834808026 wait complete. 2024-04-23T10:29:40.599 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-23T10:29:40.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ef512640 1 Processor -- start 2024-04-23T10:29:40.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ef512640 1 -- start start 2024-04-23T10:29:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ef512640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1e8151e20 0x7fa1e8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ef512640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1e81599d0 0x7fa1e80c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ef512640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e806eaa0 con 0x7fa1e80c7fa0 2024-04-23T10:29:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ef512640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e806f970 con 0x7fa1e81599d0 2024-04-23T10:29:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ef512640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e806ed60 con 0x7fa1e8151e20 2024-04-23T10:29:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1edaaf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1e81599d0 0x7fa1e80c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1edaaf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1e81599d0 0x7fa1e80c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60474/0 (socket says 172.21.15.29:60474) 2024-04-23T10:29:40.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1edaaf640 1 -- 172.21.15.29:0/2755767719 learned_addr learned my addr 172.21.15.29:0/2755767719 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:40.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ed2ae640 1 --2- 172.21.15.29:0/2755767719 >> v2:172.21.15.72:3300/0 conn(0x7fa1e8151e20 0x7fa1e8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:40.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1edaaf640 1 -- 172.21.15.29:0/2755767719 >> v2:172.21.15.72:3300/0 conn(0x7fa1e8151e20 msgr2=0x7fa1e8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:40.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1edaaf640 1 --2- 172.21.15.29:0/2755767719 >> v2:172.21.15.72:3300/0 conn(0x7fa1e8151e20 0x7fa1e8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1edaaf640 1 -- 172.21.15.29:0/2755767719 >> v1:172.21.15.72:6789/0 conn(0x7fa1e80c7fa0 legacy=0x7fa1e81592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:40.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1edaaf640 1 -- 172.21.15.29:0/2755767719 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e806f040 con 0x7fa1e81599d0 2024-04-23T10:29:40.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.732+0000 7fa1ed2ae640 1 --2- 172.21.15.29:0/2755767719 >> v2:172.21.15.72:3300/0 conn(0x7fa1e8151e20 0x7fa1e8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1edaaf640 1 --2- 172.21.15.29:0/2755767719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e81599d0 0x7fa1e80c83f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8070ca0 tx=0x7fa1e00213a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c733deb1201828a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1dffff640 1 -- 172.21.15.29:0/2755767719 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00b6070 con 0x7fa1e81599d0 2024-04-23T10:29:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1dffff640 1 -- 172.21.15.29:0/2755767719 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa1e000b2d0 con 0x7fa1e81599d0 2024-04-23T10:29:40.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1dffff640 1 -- 172.21.15.29:0/2755767719 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e000b480 con 0x7fa1e81599d0 2024-04-23T10:29:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1ef512640 1 -- 172.21.15.29:0/2755767719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e81599d0 msgr2=0x7fa1e80c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2755767719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e81599d0 0x7fa1e80c83f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8070ca0 tx=0x7fa1e00213a0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1ef512640 1 -- 172.21.15.29:0/2755767719 shutdown_connections 2024-04-23T10:29:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2755767719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e81599d0 0x7fa1e80c83f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2755767719 >> v2:172.21.15.72:3300/0 conn(0x7fa1e8151e20 0x7fa1e8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1ef512640 1 -- 172.21.15.29:0/2755767719 >> 172.21.15.29:0/2755767719 conn(0x7fa1e80c8f90 msgr2=0x7fa1e80c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1ef512640 1 -- 172.21.15.29:0/2755767719 shutdown_connections 2024-04-23T10:29:40.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.736+0000 7fa1ef512640 1 -- 172.21.15.29:0/2755767719 wait complete. 2024-04-23T10:29:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 Processor -- start 2024-04-23T10:29:40.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 -- start start 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e80c7fa0 0x7fa1e81463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e8151e20 0x7fa1e80c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e81599d0 0x7fa1e8140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80c3d40 con 0x7fa1e8151e20 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e806f600 con 0x7fa1e81599d0 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e80c3ec0 con 0x7fa1e80c7fa0 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e8151e20 0x7fa1e80c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e8151e20 0x7fa1e80c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60486/0 (socket says 172.21.15.29:60486) 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 -- 172.21.15.29:0/2501440949 learned_addr learned my addr 172.21.15.29:0/2501440949 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1edaaf640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e81599d0 0x7fa1e8140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ed2ae640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e80c7fa0 0x7fa1e81463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:40.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 -- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e80c7fa0 msgr2=0x7fa1e81463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e80c7fa0 0x7fa1e81463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 -- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e81599d0 msgr2=0x7fa1e8140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e81599d0 0x7fa1e8140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 -- 172.21.15.29:0/2501440949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e80c4b40 con 0x7fa1e8151e20 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ecaad640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e8151e20 0x7fa1e80c4090 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800c450 tx=0x7fa1d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ddffb640 1 -- 172.21.15.29:0/2501440949 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8012830 con 0x7fa1e8151e20 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ddffb640 1 -- 172.21.15.29:0/2501440949 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa1d8017070 con 0x7fa1e8151e20 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ddffb640 1 -- 172.21.15.29:0/2501440949 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8012c50 con 0x7fa1e8151e20 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e8159e60 con 0x7fa1e8151e20 2024-04-23T10:29:40.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e815a420 con 0x7fa1e8151e20 2024-04-23T10:29:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e8068d70 con 0x7fa1e8151e20 2024-04-23T10:29:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ddffb640 1 -- 172.21.15.29:0/2501440949 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1d801c460 con 0x7fa1e8151e20 2024-04-23T10:29:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ddffb640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.740+0000 7fa1ddffb640 1 -- 172.21.15.29:0/2501440949 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6756+0+0 (secure 0 0 0) 0x7fa1d8086b90 con 0x7fa1e8151e20 2024-04-23T10:29:40.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.744+0000 7fa1ed2ae640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:40.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.744+0000 7fa1ed2ae640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4006fd0 tx=0x7fa1e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:40.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.748+0000 7fa1ddffb640 1 -- 172.21.15.29:0/2501440949 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1d8056ca0 con 0x7fa1e8151e20 2024-04-23T10:29:40.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:40.916+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa1e806da40 con 0x7fa1e8151e20 2024-04-23T10:29:41.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ddffb640 1 -- 172.21.15.29:0/2501440949 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7fa1d80565a0 con 0x7fa1e8151e20 2024-04-23T10:29:41.572 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 msgr2=0x7fa1cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4006fd0 tx=0x7fa1e4008040 comp rx=0 tx=0).stop 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e8151e20 msgr2=0x7fa1e80c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e8151e20 0x7fa1e80c4090 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800c450 tx=0x7fa1d800c910 comp rx=0 tx=0).stop 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 shutdown_connections 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e81599d0 0x7fa1e8140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e8151e20 0x7fa1e80c4090 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 --2- 172.21.15.29:0/2501440949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e80c7fa0 0x7fa1e81463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.576+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 >> 172.21.15.29:0/2501440949 conn(0x7fa1e80c8f90 msgr2=0x7fa1e80cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:41.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.580+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 shutdown_connections 2024-04-23T10:29:41.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.580+0000 7fa1ef512640 1 -- 172.21.15.29:0/2501440949 wait complete. 2024-04-23T10:29:41.605 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-23T10:29:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1e5019640 1 Processor -- start 2024-04-23T10:29:41.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1e5019640 1 -- start start 2024-04-23T10:29:41.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1e5019640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e01550e0 0x7fa1e015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:41.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1e5019640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e00c83c0 con 0x7fa1e015c460 2024-04-23T10:29:41.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1e5019640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e00c70e0 con 0x7fa1e006f430 2024-04-23T10:29:41.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1e5019640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e00c6e90 con 0x7fa1e01550e0 2024-04-23T10:29:41.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1df59e640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa1e015c460 0x7fa1e015c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60258/0 (socket says 172.21.15.29:60258) 2024-04-23T10:29:41.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1df59e640 1 -- 172.21.15.29:0/3929756562 learned_addr learned my addr 172.21.15.29:0/3929756562 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-23T10:29:41.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ded9d640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e01550e0 0x7fa1e015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:41.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155466404 0 0) 0x7fa1e00c83c0 con 0x7fa1e015c460 2024-04-23T10:29:41.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c8003530 con 0x7fa1e015c460 2024-04-23T10:29:41.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 175561898 0 0) 0x7fa1c8003530 con 0x7fa1e015c460 2024-04-23T10:29:41.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e01550e0 msgr2=0x7fa1e015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ddd9b640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e01550e0 0x7fa1e015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 >> v1:172.21.15.72:6789/0 conn(0x7fa1e006f430 legacy=0x7fa1e006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e00c73c0 con 0x7fa1e015c460 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.736+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 504126831 0 0) 0x7fa1d8001a00 con 0x7fa1e015c460 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 >> v1:172.21.15.29:6789/0 conn(0x7fa1e015c460 legacy=0x7fa1e015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e01550e0 0x7fa1c80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8003f70 0x7fa1c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1c8004d50 0x7fa1c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00c6e90 con 0x7fa1c8004d50 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c800bab0 con 0x7fa1c8003f70 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c800bcb0 con 0x7fa1e01550e0 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1df59e640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1c8004d50 0x7fa1c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ded9d640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e01550e0 0x7fa1c80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1de59c640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8003f70 0x7fa1c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1df59e640 1 -- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e01550e0 msgr2=0x7fa1c80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1df59e640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e01550e0 0x7fa1c80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1df59e640 1 -- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8003f70 msgr2=0x7fa1c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1df59e640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8003f70 0x7fa1c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1df59e640 1 -- 172.21.15.29:0/3929756562 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c8003530 con 0x7fa1c8004d50 2024-04-23T10:29:41.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1df59e640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1c8004d50 0x7fa1c80051d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800a850 tx=0x7fa1d801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79eca277558ef63 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:41.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800a4a0 con 0x7fa1c8004d50 2024-04-23T10:29:41.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa1d80ad650 con 0x7fa1c8004d50 2024-04-23T10:29:41.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1ddd9b640 1 -- 172.21.15.29:0/3929756562 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80adaa0 con 0x7fa1c8004d50 2024-04-23T10:29:41.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1e5019640 1 -- 172.21.15.29:0/3929756562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1c8004d50 msgr2=0x7fa1c80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:41.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1e5019640 1 --2- 172.21.15.29:0/3929756562 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1c8004d50 0x7fa1c80051d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800a850 tx=0x7fa1d801d3a0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1df59e640 1 -- 172.21.15.29:0/3929756562 reap_dead start 2024-04-23T10:29:41.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1e5019640 1 -- 172.21.15.29:0/3929756562 shutdown_connections 2024-04-23T10:29:41.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1e5019640 1 -- 172.21.15.29:0/3929756562 >> 172.21.15.29:0/3929756562 conn(0x7fa1e00c8f90 msgr2=0x7fa1e00c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:41.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1e5019640 1 -- 172.21.15.29:0/3929756562 shutdown_connections 2024-04-23T10:29:41.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.740+0000 7fa1e5019640 1 -- 172.21.15.29:0/3929756562 wait complete. 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 Processor -- start 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 -- start start 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e0073df0 0x7fa1e014f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e00741d0 0x7fa1e01f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e0142730 0x7fa1e01f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00c7c60 con 0x7fa1e0142730 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00c7980 con 0x7fa1e0073df0 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e006f890 con 0x7fa1e00741d0 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e0142730 0x7fa1e01f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e0142730 0x7fa1e01f0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60494/0 (socket says 172.21.15.29:60494) 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 -- 172.21.15.29:0/4008058164 learned_addr learned my addr 172.21.15.29:0/4008058164 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1ded9d640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e0073df0 0x7fa1e014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1de59c640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e00741d0 0x7fa1e01f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 -- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e00741d0 msgr2=0x7fa1e01f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e00741d0 0x7fa1e01f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 -- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e0073df0 msgr2=0x7fa1e014f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e0073df0 0x7fa1e014f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 -- 172.21.15.29:0/4008058164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e0069790 con 0x7fa1e0142730 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1df59e640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e0142730 0x7fa1e01f0d50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa1d801dc40 tx=0x7fa1c8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1c77fe640 1 -- 172.21.15.29:0/4008058164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800a480 con 0x7fa1e0142730 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1c77fe640 1 -- 172.21.15.29:0/4008058164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa1d80bb070 con 0x7fa1e0142730 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e0158e80 con 0x7fa1e0142730 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1c77fe640 1 -- 172.21.15.29:0/4008058164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80ad430 con 0x7fa1e0142730 2024-04-23T10:29:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e01f3f20 con 0x7fa1e0142730 2024-04-23T10:29:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.744+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e0068d70 con 0x7fa1e0142730 2024-04-23T10:29:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.748+0000 7fa1c77fe640 1 -- 172.21.15.29:0/4008058164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1d80b5070 con 0x7fa1e0142730 2024-04-23T10:29:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.748+0000 7fa1c77fe640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.748+0000 7fa1c77fe640 1 -- 172.21.15.29:0/4008058164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6197+0+0 (secure 0 0 0) 0x7fa1d8121030 con 0x7fa1e0142730 2024-04-23T10:29:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.748+0000 7fa1ded9d640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.748+0000 7fa1ded9d640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009a30 tx=0x7fa1d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:41.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.752+0000 7fa1c77fe640 1 -- 172.21.15.29:0/4008058164 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1d80170b0 con 0x7fa1e0142730 2024-04-23T10:29:41.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:41.936+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa1e015b020 con 0x7fa1e0142730 2024-04-23T10:29:42.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.600+0000 7fa1c77fe640 1 -- 172.21.15.29:0/4008058164 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7fa1d80ab380 con 0x7fa1e0142730 2024-04-23T10:29:42.597 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' removed 2024-04-23T10:29:42.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 msgr2=0x7fa1cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:42.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009a30 tx=0x7fa1d4008040 comp rx=0 tx=0).stop 2024-04-23T10:29:42.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e0142730 msgr2=0x7fa1e01f0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:42.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e0142730 0x7fa1e01f0d50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa1d801dc40 tx=0x7fa1c8005840 comp rx=0 tx=0).stop 2024-04-23T10:29:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 shutdown_connections 2024-04-23T10:29:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:6832/2614464755,v1:172.21.15.72:6833/2614464755] conn(0x7fa1cc0683b0 0x7fa1cc06a870 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1e0142730 0x7fa1e01f0d50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1e00741d0 0x7fa1e01f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 --2- 172.21.15.29:0/4008058164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1e0073df0 0x7fa1e014f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:42.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 >> 172.21.15.29:0/4008058164 conn(0x7fa1e00c8f90 msgr2=0x7fa1e015a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 shutdown_connections 2024-04-23T10:29:42.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-23T10:29:42.604+0000 7fa1e5019640 1 -- 172.21.15.29:0/4008058164 wait complete. 2024-04-23T10:29:42.629 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-23T10:29:42.629 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-23T10:29:42.629 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:42.641 INFO:tasks.ceph.mds.a:Stopped 2024-04-23T10:29:42.641 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-23T10:29:42.641 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:42.699 INFO:tasks.ceph.mds.c:Stopped 2024-04-23T10:29:42.699 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-23T10:29:42.699 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:42.753 INFO:tasks.ceph.mds.e:Stopped 2024-04-23T10:29:42.753 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-23T10:29:42.754 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:42.765 INFO:tasks.ceph.mds.b:Stopped 2024-04-23T10:29:42.765 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-23T10:29:42.765 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:42.820 INFO:tasks.ceph.mds.d:Stopped 2024-04-23T10:29:42.820 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-23T10:29:42.820 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:42.875 INFO:tasks.ceph.mds.f:Stopped 2024-04-23T10:29:42.875 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-23T10:29:42.875 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-23T10:29:42.876 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:42.948 INFO:tasks.ceph.osd.0:Stopped 2024-04-23T10:29:42.948 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-23T10:29:42.948 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:45.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-23T10:29:49.050 INFO:tasks.ceph.osd.1:Stopped 2024-04-23T10:29:49.051 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-23T10:29:49.051 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:49.122 INFO:tasks.ceph.osd.2:Stopped 2024-04-23T10:29:49.123 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-23T10:29:49.123 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:51.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-23T10:29:51.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-23T10:29:52.997 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:29:53.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:29:55.224 INFO:tasks.ceph.osd.3:Stopped 2024-04-23T10:29:55.225 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-23T10:29:55.225 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:55.302 INFO:tasks.ceph.osd.4:Stopped 2024-04-23T10:29:55.302 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-23T10:29:55.302 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:55.392 INFO:tasks.ceph.osd.5:Stopped 2024-04-23T10:29:55.392 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-23T10:29:55.392 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:55.476 INFO:tasks.ceph.osd.6:Stopped 2024-04-23T10:29:55.477 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-23T10:29:55.477 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:29:57.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-23T10:29:57.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-23T10:30:01.578 INFO:tasks.ceph.osd.7:Stopped 2024-04-23T10:30:01.579 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-23T10:30:01.579 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-23T10:30:01.579 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:30:01.607 INFO:tasks.ceph.mgr.y:Stopped 2024-04-23T10:30:01.608 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-23T10:30:01.608 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:30:01.637 INFO:tasks.ceph.mgr.x:Stopped 2024-04-23T10:30:01.637 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-23T10:30:01.637 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-23T10:30:01.637 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:30:01.669 INFO:tasks.ceph.mon.a:Stopped 2024-04-23T10:30:01.670 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-23T10:30:01.670 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:30:01.692 INFO:tasks.ceph.mon.b:Stopped 2024-04-23T10:30:01.692 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-23T10:30:01.692 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:30:01.747 INFO:tasks.ceph.mon.c:Stopped 2024-04-23T10:30:01.747 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-23T10:30:01.747 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-23T10:30:01.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:30:01.771 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-23T10:30:02.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-23T10:30:02.140 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:30:02.141 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-23T10:30:02.386 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:30:02.386 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-23T10:30:02.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:30:02.592 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-23T10:30:02.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:30:02.784 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-23T10:30:03.162 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:30:03.162 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-23T10:30:03.405 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:30:03.405 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-23T10:30:03.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:30:03.619 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-23T10:30:03.865 INFO:tasks.ceph:Archiving mon data... 2024-04-23T10:30:03.867 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/data/mon.a.tgz 2024-04-23T10:30:03.867 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-23T10:30:03.873 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.eAtNijQLw7 2024-04-23T10:30:03.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eAtNijQLw7 2024-04-23T10:30:03.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.eAtNijQLw7 2024-04-23T10:30:04.052 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.eAtNijQLw7 is 301KB 2024-04-23T10:30:04.113 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.eAtNijQLw7 2024-04-23T10:30:04.119 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/data/mon.b.tgz 2024-04-23T10:30:04.119 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-23T10:30:04.124 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.olSR7InNug 2024-04-23T10:30:04.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.olSR7InNug 2024-04-23T10:30:04.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.olSR7InNug 2024-04-23T10:30:04.307 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.olSR7InNug is 301KB 2024-04-23T10:30:04.364 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.olSR7InNug 2024-04-23T10:30:04.369 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/data/mon.c.tgz 2024-04-23T10:30:04.369 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-23T10:30:04.414 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.1bMen5I0Ma 2024-04-23T10:30:04.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1bMen5I0Ma 2024-04-23T10:30:04.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.1bMen5I0Ma 2024-04-23T10:30:04.598 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.1bMen5I0Ma is 301KB 2024-04-23T10:30:04.614 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.1bMen5I0Ma 2024-04-23T10:30:04.620 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-23T10:30:04.620 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T10:30:04.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T10:30:04.684 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T10:30:04.722 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T10:30:04.722 INFO:tasks.ceph:Archiving crash dumps... 2024-04-23T10:30:04.724 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/remote/smithi029/crash 2024-04-23T10:30:04.725 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T10:30:04.740 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/remote/smithi072/crash 2024-04-23T10:30:04.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T10:30:04.778 INFO:tasks.ceph:Shutting down logrotate 2024-04-23T10:30:04.778 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:30:04.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:30:04.858 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-23T10:30:04.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-23T10:30:04.912 INFO:tasks.ceph:Compressing logs... 2024-04-23T10:30:04.912 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T10:30:04.928 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T10:30:04.949 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27627.log 2024-04-23T10:30:04.949 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35018.log 2024-04-23T10:30:04.950 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.27627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38645.log 2024-04-23T10:30:04.950 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27627.log.gz 2024-04-23T10:30:04.950 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39111.log 2024-04-23T10:30:04.950 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35018.log: /var/log/ceph/ceph-client.admin.38645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33929.log 2024-04-23T10:30:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.admin.39111.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34780.log 2024-04-23T10:30:04.951 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35018.log.gz 2024-04-23T10:30:04.951 INFO:teuthology.orchestra.run.smithi029.stderr: 90.9%/var/log/ceph/ceph-client.admin.33929.log: -- replaced with /var/log/ceph/ceph-client.admin.38645.log.gz 2024-04-23T10:30:04.951 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39111.log.gz 2024-04-23T10:30:04.952 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38990.log 2024-04-23T10:30:04.953 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33929.log.gz 2024-04-23T10:30:04.953 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33243.log 2024-04-23T10:30:04.953 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38990.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-23T10:30:04.953 INFO:teuthology.orchestra.run.smithi029.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34780.log.gz 2024-04-23T10:30:04.953 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38990.log.gz 2024-04-23T10:30:04.953 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37687.log 2024-04-23T10:30:04.953 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33243.log.gz 2024-04-23T10:30:04.953 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34910.log 2024-04-23T10:30:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35643.log 2024-04-23T10:30:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37123.log 2024-04-23T10:30:04.955 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34910.log.gz 2024-04-23T10:30:04.955 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2024-04-23T10:30:04.955 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35643.log.gz 2024-04-23T10:30:04.955 INFO:teuthology.orchestra.run.smithi029.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37687.log.gz 2024-04-23T10:30:04.956 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37123.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22706.log 2024-04-23T10:30:04.956 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34631.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37123.log.gz 2024-04-23T10:30:04.956 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34832.log 2024-04-23T10:30:04.956 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2024-04-23T10:30:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38088.log 2024-04-23T10:30:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.tmp-client.admin.22706.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22706.log.gz 2024-04-23T10:30:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32729.log 2024-04-23T10:30:04.959 INFO:teuthology.orchestra.run.smithi029.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34832.log.gz 2024-04-23T10:30:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38088.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-23T10:30:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37465.log 2024-04-23T10:30:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32729.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38088.log.gz 2024-04-23T10:30:04.959 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35981.log 2024-04-23T10:30:04.960 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32729.log.gz 2024-04-23T10:30:04.960 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37382.log 2024-04-23T10:30:04.960 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35981.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37465.log.gz 2024-04-23T10:30:04.960 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33981.log 2024-04-23T10:30:04.960 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35981.log.gz 2024-04-23T10:30:04.960 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38964.log 2024-04-23T10:30:04.960 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33347.log 2024-04-23T10:30:04.960 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33981.log.gz 2024-04-23T10:30:04.962 INFO:teuthology.orchestra.run.smithi029.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37382.log.gz 2024-04-23T10:30:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33005.log 2024-04-23T10:30:04.962 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33347.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38964.log.gz 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38833.log 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33347.log.gz 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36483.log 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33005.log: /var/log/ceph/ceph-client.admin.38833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35747.log 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33005.log.gz 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36483.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38833.log.gz 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39633.log 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.admin.35747.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33611.log 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36483.log.gz 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39633.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.35747.log.gz /var/log/ceph/ceph-client.admin.34683.log 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39633.log.gz 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33877.log 2024-04-23T10:30:04.963 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33611.log.gz 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34683.log: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32815.log 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34683.log.gz 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35564.log 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33877.log: /var/log/ceph/ceph-client.admin.32815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38885.log 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33877.log.gz 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32815.log.gz 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.35564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35825.log 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34420.log 2024-04-23T10:30:04.966 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35825.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38885.log.gz 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34423.log 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35825.log.gz 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39241.log 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34420.log: /var/log/ceph/ceph-client.admin.34423.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34420.log.gz 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34423.log.gz 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35148.log 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34215.log 2024-04-23T10:30:04.967 INFO:teuthology.orchestra.run.smithi029.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39241.log.gz/var/log/ceph/ceph-osd.2.log: 2024-04-23T10:30:04.969 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35669.log 2024-04-23T10:30:04.969 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35148.log.gz 2024-04-23T10:30:04.969 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33585.log 2024-04-23T10:30:04.969 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35669.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34215.log.gz 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36565.log 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35669.log.gz 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34111.log 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36565.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33585.log.gz 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33033.log 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27518.log 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.36565.log.gz 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33033.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34111.log.gz 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39529.log 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33033.log.gz 2024-04-23T10:30:04.970 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.27518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2024-04-23T10:30:04.972 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39068.log 2024-04-23T10:30:04.972 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39529.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.27518.log.gz 2024-04-23T10:30:04.972 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33637.log 2024-04-23T10:30:04.972 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39529.log.gz 2024-04-23T10:30:04.972 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7%/var/log/ceph/ceph-client.admin.39068.log: -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2024-04-23T10:30:04.973 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-23T10:30:04.973 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39068.log.gz 2024-04-23T10:30:04.973 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35044.log 2024-04-23T10:30:04.973 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33637.log.gz 2024-04-23T10:30:04.973 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39934.log 2024-04-23T10:30:04.973 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.35044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32925.log 2024-04-23T10:30:04.973 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35044.log.gz 2024-04-23T10:30:04.973 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36940.log 2024-04-23T10:30:04.974 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35174.log 2024-04-23T10:30:04.974 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39934.log.gz 2024-04-23T10:30:04.974 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36400.log 2024-04-23T10:30:04.974 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32925.log.gz 2024-04-23T10:30:04.975 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35174.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39293.log 2024-04-23T10:30:04.975 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36940.log.gz 2024-04-23T10:30:04.975 INFO:teuthology.orchestra.run.smithi029.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.35174.log.gz 2024-04-23T10:30:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27818.log 2024-04-23T10:30:04.979 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39581.log 2024-04-23T10:30:04.979 INFO:teuthology.orchestra.run.smithi029.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36400.log.gz 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36967.log 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39293.log.gz 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34936.log 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35695.log 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39581.log.gz 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36967.log: /var/log/ceph/ceph-client.admin.34936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37764.log 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1%/var/log/ceph/ceph-client.admin.35695.log: -- replaced with /var/log/ceph/ceph-client.admin.34936.log.gz 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36967.log.gz 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39163.log 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35695.log.gz 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37764.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37764.log.gz 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35799.log 2024-04-23T10:30:04.980 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36033.log 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27746.log 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27842.log 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27818.log.gz 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27746.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27746.log.gz 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27842.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.7.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.27842.log.gz 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27770.log 2024-04-23T10:30:04.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27890.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27770.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.27770.log.gz -5/var/log/ceph/ceph-client.admin.27890.log: 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr: --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27890.log.gz 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27722.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27866.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27794.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27722.log.gz 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27866.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27866.log.gz 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27794.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27794.log.gz 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-23T10:30:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.audit.log: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T10:30:04.988 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-23T10:30:04.988 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T10:30:04.988 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-23T10:30:04.995 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4%/var/log/ceph/ceph-client.admin.35799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33191.log 2024-04-23T10:30:04.995 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39163.log.gz 2024-04-23T10:30:04.995 INFO:teuthology.orchestra.run.smithi029.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35799.log.gz 2024-04-23T10:30:04.995 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39766.log 2024-04-23T10:30:04.995 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32977.log 2024-04-23T10:30:04.995 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36033.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33191.log: /var/log/ceph/ceph-client.admin.39766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33191.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7%/var/log/ceph/ceph-client.admin.32977.log: -- replaced with /var/log/ceph/ceph-client.admin.39766.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33690.log 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32977.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35122.log 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32867.log 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33690.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35122.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38702.log 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33690.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35122.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32867.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32867.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34884.log 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36085.log 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38702.log.gz 2024-04-23T10:30:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38462.log 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33297.log 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36085.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34884.log.gz 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36085.log.gz 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38462.log.gz 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37982.log 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33297.log: /var/log/ceph/ceph-client.admin.34744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34217.log 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37982.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35773.log 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34217.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36250.log 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37982.log.gz 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33297.log.gz 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35773.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34217.log.gz 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35851.log 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35773.log.gz 2024-04-23T10:30:04.997 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37096.log 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38327.log 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36250.log.gz 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35851.log.gz 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37096.log.gz 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38327.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33794.log 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.3.log: 91.1% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38327.log.gz -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39503.log 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39661.log 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33794.log: /var/log/ceph/ceph-client.admin.39503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33217.log 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33794.log.gz 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39503.log.gz 2024-04-23T10:30:04.998 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39661.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39661.log.gz 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39137.log 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34163.log 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33217.log.gz 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33955.log 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39137.log.gz 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34163.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34163.log.gz 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39215.log 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38807.log 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6%/var/log/ceph/ceph-client.admin.39215.log: -- replaced with /var/log/ceph/ceph-client.admin.33955.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36642.log 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-23T10:30:04.999 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39215.log.gz 2024-04-23T10:30:05.002 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38807.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38807.log.gz 2024-04-23T10:30:05.002 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39425.log 2024-04-23T10:30:05.002 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39016.log 2024-04-23T10:30:05.002 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36059.log 2024-04-23T10:30:05.002 INFO:teuthology.orchestra.run.smithi029.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36642.log.gz 2024-04-23T10:30:05.002 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39425.log.gz 2024-04-23T10:30:05.002 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39016.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39016.log.gz 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35721.log 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38539.log 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3%/var/log/ceph/ceph-client.admin.35721.log: -- replaced with /var/log/ceph/ceph-client.admin.36059.log.gz 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36763.log 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35721.log.gz 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38539.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38539.log.gz 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39345.log 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36763.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr: 87.7%/var/log/ceph/ceph-client.admin.39345.log: -- replaced with /var/log/ceph/ceph-client.admin.36763.log.gz 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39451.log 2024-04-23T10:30:05.003 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39345.log.gz 2024-04-23T10:30:05.004 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-23T10:30:05.005 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39319.log 2024-04-23T10:30:05.005 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36615.log 2024-04-23T10:30:05.005 INFO:teuthology.orchestra.run.smithi029.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2024-04-23T10:30:05.005 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39319.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39319.log.gz 2024-04-23T10:30:05.005 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38859.log 2024-04-23T10:30:05.005 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39792.log 2024-04-23T10:30:05.006 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36615.log: /var/log/ceph/ceph-client.admin.38859.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36615.log.gz 2024-04-23T10:30:05.006 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33820.log 2024-04-23T10:30:05.006 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38859.log.gz 2024-04-23T10:30:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39792.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39792.log.gz 2024-04-23T10:30:05.007 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36456.log 2024-04-23T10:30:05.008 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37929.log 2024-04-23T10:30:05.008 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1%/var/log/ceph/ceph-client.admin.36456.log: -- replaced with /var/log/ceph/ceph-client.admin.33820.log.gz 2024-04-23T10:30:05.008 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36456.log.gz 2024-04-23T10:30:05.008 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34059.log 2024-04-23T10:30:05.009 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34085.log 2024-04-23T10:30:05.010 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37929.log: /var/log/ceph/ceph-client.admin.34059.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34059.log.gz 2024-04-23T10:30:05.010 INFO:teuthology.orchestra.run.smithi029.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37929.log.gz 2024-04-23T10:30:05.010 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39908.log 2024-04-23T10:30:05.011 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34422.log 2024-04-23T10:30:05.011 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34085.log: /var/log/ceph/ceph-client.admin.39908.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34085.log.gz 2024-04-23T10:30:05.012 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35096.log 2024-04-23T10:30:05.012 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39908.log.gz 2024-04-23T10:30:05.012 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34422.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34422.log.gz 2024-04-23T10:30:05.013 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33903.log 2024-04-23T10:30:05.013 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33113.log 2024-04-23T10:30:05.014 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35096.log: /var/log/ceph/ceph-client.admin.33903.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35096.log.gz 2024-04-23T10:30:05.014 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33903.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39844.log 2024-04-23T10:30:05.014 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-23T10:30:05.015 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39818.log 2024-04-23T10:30:05.015 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39844.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33113.log.gz 2024-04-23T10:30:05.016 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39844.log.gz 2024-04-23T10:30:05.016 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33851.log 2024-04-23T10:30:05.016 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39818.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39818.log.gz 2024-04-23T10:30:05.017 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35439.log 2024-04-23T10:30:05.017 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36350.log 2024-04-23T10:30:05.018 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33851.log: /var/log/ceph/ceph-client.admin.35439.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33851.log.gz 2024-04-23T10:30:05.018 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35439.log.gz 2024-04-23T10:30:05.018 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36300.log 2024-04-23T10:30:05.019 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39690.log 2024-04-23T10:30:05.020 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36350.log: /var/log/ceph/ceph-client.admin.36300.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36350.log.gz 2024-04-23T10:30:05.020 INFO:teuthology.orchestra.run.smithi029.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37902.log 2024-04-23T10:30:05.020 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36300.log.gz 2024-04-23T10:30:05.021 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39690.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39690.log.gz 2024-04-23T10:30:05.021 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T10:30:05.022 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33475.log 2024-04-23T10:30:05.022 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37902.log: /var/log/ceph/ceph.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37902.log.gz 2024-04-23T10:30:05.023 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37607.log 2024-04-23T10:30:05.025 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33475.log: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T10:30:05.025 INFO:teuthology.orchestra.run.smithi029.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.33475.log.gz 2024-04-23T10:30:05.026 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35903.log 2024-04-23T10:30:05.026 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37017.log 2024-04-23T10:30:05.027 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37607.log: /var/log/ceph/ceph-client.admin.35903.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35903.log.gz 2024-04-23T10:30:05.027 INFO:teuthology.orchestra.run.smithi029.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37607.log.gz 2024-04-23T10:30:05.027 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37340.log 2024-04-23T10:30:05.028 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35378.log 2024-04-23T10:30:05.028 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37017.log: /var/log/ceph/ceph-client.admin.37340.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37017.log.gz 2024-04-23T10:30:05.028 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37340.log.gz 2024-04-23T10:30:05.028 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35617.log 2024-04-23T10:30:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34214.log 2024-04-23T10:30:05.030 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35378.log: /var/log/ceph/ceph-client.admin.35617.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35617.log.gz 2024-04-23T10:30:05.030 INFO:teuthology.orchestra.run.smithi029.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35378.log.gz 2024-04-23T10:30:05.030 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38061.log 2024-04-23T10:30:05.031 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34657.log 2024-04-23T10:30:05.031 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34214.log: /var/log/ceph/ceph-client.admin.38061.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34214.log.gz 2024-04-23T10:30:05.032 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38061.log.gz 2024-04-23T10:30:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-04-23T10:30:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36790.log 2024-04-23T10:30:05.033 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34657.log: /var/log/ceph/ceph-client.admin.34424.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34657.log.gz 2024-04-23T10:30:05.033 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-23T10:30:05.033 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2024-04-23T10:30:05.034 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35278.log 2024-04-23T10:30:05.035 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36790.log: /var/log/ceph/ceph-client.admin.37044.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36790.log.gz 2024-04-23T10:30:05.035 INFO:teuthology.orchestra.run.smithi029.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2024-04-23T10:30:05.035 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37737.log 2024-04-23T10:30:05.035 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39373.log 2024-04-23T10:30:05.036 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35278.log: /var/log/ceph/ceph-client.admin.37737.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37737.log.gz 91.4% 2024-04-23T10:30:05.036 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35278.log.gz 2024-04-23T10:30:05.037 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38938.log 2024-04-23T10:30:05.037 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34033.log 2024-04-23T10:30:05.038 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39373.log: /var/log/ceph/ceph-client.admin.38938.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39373.log.gz 2024-04-23T10:30:05.038 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38938.log.gz 2024-04-23T10:30:05.038 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36164.log 2024-04-23T10:30:05.038 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34966.log 2024-04-23T10:30:05.039 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34033.log: /var/log/ceph/ceph-client.admin.36164.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34033.log.gz 2024-04-23T10:30:05.039 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37843.log 2024-04-23T10:30:05.039 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36164.log.gz 2024-04-23T10:30:05.040 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34966.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34966.log.gz 2024-04-23T10:30:05.040 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38250.log 2024-04-23T10:30:05.041 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36860.log 2024-04-23T10:30:05.042 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37843.log: /var/log/ceph/ceph-client.admin.38250.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37843.log.gz 2024-04-23T10:30:05.042 INFO:teuthology.orchestra.run.smithi029.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38250.log.gz 2024-04-23T10:30:05.042 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27737.log 2024-04-23T10:30:05.043 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39267.log 2024-04-23T10:30:05.043 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.27737.log: /var/log/ceph/ceph-client.admin.36860.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27737.log.gz 2024-04-23T10:30:05.043 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36860.log.gz 2024-04-23T10:30:05.044 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37660.log 2024-04-23T10:30:05.044 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35877.log 2024-04-23T10:30:05.045 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39267.log: /var/log/ceph/ceph-client.admin.37660.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39267.log.gz 2024-04-23T10:30:05.045 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34007.log 2024-04-23T10:30:05.045 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37660.log.gz 2024-04-23T10:30:05.046 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35877.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35877.log.gz 2024-04-23T10:30:05.046 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38729.log 2024-04-23T10:30:05.046 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39042.log 2024-04-23T10:30:05.047 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34007.log: /var/log/ceph/ceph-client.admin.38729.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34007.log.gz 2024-04-23T10:30:05.048 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39399.log 2024-04-23T10:30:05.048 INFO:teuthology.orchestra.run.smithi029.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.38729.log.gz 2024-04-23T10:30:05.048 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-23T10:30:05.049 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39042.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39042.log.gz 2024-04-23T10:30:05.049 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34418.log 2024-04-23T10:30:05.049 INFO:teuthology.orchestra.run.smithi072.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-23T10:30:05.050 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-04-23T10:30:05.050 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39399.log: /var/log/ceph/ceph-client.admin.34418.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39399.log.gz 2024-04-23T10:30:05.050 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34418.log.gz 2024-04-23T10:30:05.050 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33742.log 2024-04-23T10:30:05.051 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39960.log 2024-04-23T10:30:05.052 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32899.log: /var/log/ceph/ceph-client.admin.33742.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-04-23T10:30:05.052 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33742.log.gz 2024-04-23T10:30:05.052 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36111.log 2024-04-23T10:30:05.052 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34992.log 2024-04-23T10:30:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39960.log: /var/log/ceph/ceph-client.admin.36111.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39960.log.gz 2024-04-23T10:30:05.053 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36111.log.gz 2024-04-23T10:30:05.053 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35955.log 2024-04-23T10:30:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34210.log 2024-04-23T10:30:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34992.log: /var/log/ceph/ceph-client.admin.35955.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34992.log.gz 2024-04-23T10:30:05.054 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35955.log.gz 2024-04-23T10:30:05.054 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T10:30:05.055 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33139.log 2024-04-23T10:30:05.055 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34210.log: /var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34210.log.gz 2024-04-23T10:30:05.056 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-23T10:30:05.056 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33139.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33139.log.gz 2024-04-23T10:30:05.057 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T10:30:05.057 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33165.log 2024-04-23T10:30:05.061 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.c.log: 94.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-23T10:30:05.061 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33533.log 2024-04-23T10:30:05.061 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-23T10:30:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33165.log: /var/log/ceph/ceph-client.admin.33533.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33165.log.gz 2024-04-23T10:30:05.062 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33533.log.gz 2024-04-23T10:30:05.062 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34137.log 2024-04-23T10:30:05.063 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38382.log 2024-04-23T10:30:05.063 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.34137.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34137.log.gz 2024-04-23T10:30:05.064 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35328.log 2024-04-23T10:30:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38382.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38382.log.gz 2024-04-23T10:30:05.065 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34413.log 2024-04-23T10:30:05.066 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35328.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35328.log.gz 2024-04-23T10:30:05.067 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36007.log 2024-04-23T10:30:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34413.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34413.log.gz 2024-04-23T10:30:05.068 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39714.log 2024-04-23T10:30:05.069 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36007.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36007.log.gz 2024-04-23T10:30:05.069 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33768.log 2024-04-23T10:30:05.070 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39714.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39714.log.gz 2024-04-23T10:30:05.071 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34806.log 2024-04-23T10:30:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33768.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33768.log.gz 2024-04-23T10:30:05.072 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34605.log 2024-04-23T10:30:05.073 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34806.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34806.log.gz 2024-04-23T10:30:05.073 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35070.log 2024-04-23T10:30:05.074 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34605.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34605.log.gz 2024-04-23T10:30:05.075 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38300.log 2024-04-23T10:30:05.076 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35070.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35070.log.gz 2024-04-23T10:30:05.076 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37816.log 2024-04-23T10:30:05.077 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38300.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38300.log.gz 2024-04-23T10:30:05.077 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38911.log 2024-04-23T10:30:05.078 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37816.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37816.log.gz 2024-04-23T10:30:05.079 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38168.log 2024-04-23T10:30:05.080 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38911.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38911.log.gz 2024-04-23T10:30:05.080 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33716.log 2024-04-23T10:30:05.082 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38168.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38168.log.gz 2024-04-23T10:30:05.082 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35929.log 2024-04-23T10:30:05.083 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33716.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33716.log.gz 2024-04-23T10:30:05.083 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34717.log 2024-04-23T10:30:05.084 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35929.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35929.log.gz 2024-04-23T10:30:05.084 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38781.log 2024-04-23T10:30:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34717.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34717.log.gz 2024-04-23T10:30:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-04-23T10:30:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38781.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38781.log.gz 2024-04-23T10:30:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32951.log 2024-04-23T10:30:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.35228.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-04-23T10:30:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32693.log 2024-04-23T10:30:05.090 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32951.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32951.log.gz 2024-04-23T10:30:05.090 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39477.log 2024-04-23T10:30:05.092 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.32693.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32693.log.gz 2024-04-23T10:30:05.092 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34208.log 2024-04-23T10:30:05.093 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39477.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39477.log.gz 2024-04-23T10:30:05.093 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33059.log 2024-04-23T10:30:05.094 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34208.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34208.log.gz 2024-04-23T10:30:05.094 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34405.log 2024-04-23T10:30:05.095 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33059.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33059.log.gz 2024-04-23T10:30:05.095 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34858.log 2024-04-23T10:30:05.096 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34405.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34405.log.gz 2024-04-23T10:30:05.097 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38141.log 2024-04-23T10:30:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34858.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34858.log.gz 2024-04-23T10:30:05.098 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39740.log 2024-04-23T10:30:05.099 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38141.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38141.log.gz 2024-04-23T10:30:05.100 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38618.log 2024-04-23T10:30:05.101 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39740.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39740.log.gz 2024-04-23T10:30:05.101 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38409.log 2024-04-23T10:30:05.102 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38618.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38618.log.gz 2024-04-23T10:30:05.102 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33663.log 2024-04-23T10:30:05.104 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38409.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.38409.log.gz 2024-04-23T10:30:05.104 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39607.log 2024-04-23T10:30:05.105 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33663.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33663.log.gz 2024-04-23T10:30:05.105 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37438.log 2024-04-23T10:30:05.106 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39607.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39607.log.gz 2024-04-23T10:30:05.107 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2024-04-23T10:30:05.108 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37438.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37438.log.gz 2024-04-23T10:30:05.108 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38223.log 2024-04-23T10:30:05.109 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38009.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2024-04-23T10:30:05.110 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38566.log 2024-04-23T10:30:05.111 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38223.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38223.log.gz 2024-04-23T10:30:05.111 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36200.log 2024-04-23T10:30:05.113 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38566.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.38566.log.gz 2024-04-23T10:30:05.113 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-04-23T10:30:05.115 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36200.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36200.log.gz 2024-04-23T10:30:05.115 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38489.log 2024-04-23T10:30:05.116 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36887.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-04-23T10:30:05.116 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34209.log 2024-04-23T10:30:05.118 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38489.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.38489.log.gz 2024-04-23T10:30:05.118 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-23T10:30:05.119 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34209.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34209.log.gz 2024-04-23T10:30:05.119 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36137.log 2024-04-23T10:30:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.e.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-23T10:30:05.123 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33559.log 2024-04-23T10:30:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36137.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36137.log.gz 2024-04-23T10:30:05.125 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39555.log 2024-04-23T10:30:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33559.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33559.log.gz 2024-04-23T10:30:05.126 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33085.log 2024-04-23T10:30:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39555.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39555.log.gz 2024-04-23T10:30:05.127 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39189.log 2024-04-23T10:30:05.128 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33085.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33085.log.gz 2024-04-23T10:30:05.129 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36538.log 2024-04-23T10:30:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.39189.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39189.log.gz 2024-04-23T10:30:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34216.log 2024-04-23T10:30:05.131 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-23T10:30:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.36538.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36538.log.gz 2024-04-23T10:30:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33269.log 2024-04-23T10:30:05.132 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.34216.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34216.log.gz 2024-04-23T10:30:05.134 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33269.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33269.log.gz 2024-04-23T10:30:05.195 INFO:teuthology.orchestra.run.smithi029.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-23T10:30:05.241 INFO:teuthology.orchestra.run.smithi072.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-23T10:30:05.317 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-23T10:30:05.734 INFO:teuthology.orchestra.run.smithi029.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-23T10:30:10.979 INFO:teuthology.orchestra.run.smithi029.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-23T10:30:12.702 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-23T10:30:13.072 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-23T10:30:14.409 INFO:teuthology.orchestra.run.smithi029.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-23T10:30:16.297 INFO:teuthology.orchestra.run.smithi072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-23T10:30:16.469 INFO:teuthology.orchestra.run.smithi029.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-23T10:30:18.523 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-23T10:30:19.017 INFO:teuthology.orchestra.run.smithi029.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-23T10:30:22.615 INFO:teuthology.orchestra.run.smithi029.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.35564.log.gz 2024-04-23T10:30:22.616 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-23T10:30:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m17.686s 2024-04-23T10:30:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:user 0m58.117s 2024-04-23T10:30:22.616 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m1.660s 2024-04-23T10:31:09.274 INFO:teuthology.orchestra.run.smithi072.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-23T10:31:09.274 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-23T10:31:09.275 INFO:teuthology.orchestra.run.smithi072.stderr:real 1m4.318s 2024-04-23T10:31:09.275 INFO:teuthology.orchestra.run.smithi072.stderr:user 1m42.269s 2024-04-23T10:31:09.275 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m3.273s 2024-04-23T10:31:09.276 INFO:tasks.ceph:Archiving logs... 2024-04-23T10:31:09.276 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/remote/smithi029/log 2024-04-23T10:31:09.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T10:31:16.570 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/remote/smithi072/log 2024-04-23T10:31:16.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T10:31:28.695 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T10:31:28.704 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T10:31:28.705 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T10:31:28.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T10:31:28.786 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T10:31:28.797 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T10:31:28.797 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:31:28.799 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:31:28.809 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T10:31:28.809 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2024-04-23T10:31:28.809 INFO:teuthology.orchestra.run.smithi029.stdout:*hv01.front.sepi 44.4.53.2 2 u 13 64 377 0.091 -4.778 0.391 2024-04-23T10:31:28.809 INFO:teuthology.orchestra.run.smithi029.stdout:+hv02.front.sepi 63.231.80.2 3 u 10 64 377 0.087 -2.935 0.385 2024-04-23T10:31:28.809 INFO:teuthology.orchestra.run.smithi029.stdout:+hv03.front.sepi 74.6.168.72 3 u 14 64 377 0.083 -3.035 0.439 2024-04-23T10:31:28.809 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-23T10:31:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T10:31:28.812 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-04-23T10:31:28.812 INFO:teuthology.orchestra.run.smithi072.stdout:*hv01.front.sepi 44.4.53.2 2 u 10 64 377 0.081 -6.602 0.789 2024-04-23T10:31:28.812 INFO:teuthology.orchestra.run.smithi072.stdout:+hv02.front.sepi 63.231.80.2 3 u 8 64 377 0.083 -5.065 0.743 2024-04-23T10:31:28.812 INFO:teuthology.orchestra.run.smithi072.stdout:+hv03.front.sepi 74.6.168.72 3 u 8 64 377 0.096 -4.146 0.560 2024-04-23T10:31:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-23T10:31:28.813 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T10:31:28.830 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T10:31:28.830 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T10:31:28.843 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T10:31:28.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T10:31:28.913 INFO:teuthology.task.internal:Duration was 1644.379137 seconds 2024-04-23T10:31:28.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T10:31:28.964 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T10:31:28.964 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T10:31:28.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T10:31:29.004 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T10:31:29.005 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-04-23T10:31:29.005 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T10:31:29.056 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-04-23T10:31:29.057 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T10:31:29.066 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T10:31:29.066 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T10:31:29.100 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T10:31:29.135 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T10:31:29.135 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T10:31:29.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T10:31:29.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T10:31:29.245 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T10:31:29.246 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T10:31:29.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T10:31:29.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T10:31:29.278 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:31:29.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:31:29.309 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-04-23T10:31:29.322 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-04-23T10:31:29.341 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:31:29.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:31:29.367 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:31:29.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:31:29.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T10:31:29.396 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T10:31:29.397 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/remote/smithi029 2024-04-23T10:31:29.397 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T10:31:29.432 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669532/remote/smithi072 2024-04-23T10:31:29.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T10:31:29.454 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T10:31:29.454 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T10:31:29.476 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T10:31:29.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T10:31:29.509 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T10:31:29.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T10:31:29.558 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T10:31:29.558 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T10:31:29.560 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T10:31:29.564 INFO:teuthology.orchestra.run.smithi029.stdout: 658646 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 10:31 /home/ubuntu/cephtest 2024-04-23T10:31:29.566 INFO:teuthology.orchestra.run.smithi072.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 10:31 /home/ubuntu/cephtest 2024-04-23T10:31:29.568 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T10:31:29.600 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T10:31:29.623 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} duration: 1644.3791372776031 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-04-23T10:31:29.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T10:31:29.693 INFO:teuthology.run:pass